Information processing device and information processing method

Abstract

To improve operability regarding layout change of a display.SOLUTION: An information processing device connected to a display and a touch panel, includes: a touch operation detection unit; a display control unit which displays a plurality of display contents at prescribed positions, and controls a display signal to be output to the display so as to display a layout image in which an arrangement state of the plurality of display contents is reduction displayed which, when a predetermined operation is detected, the arrangement of the plurality of display contents are allowed to be changed; and operation position determination means which determines whether the user has made operation from either one of right and left directions. The display control unit allows the layout image to be displayed on a left side on the display when it is determined that the predetermined operation is operated from the left side of the display, and allows the layout image to be displayed on a right side on the display when it is determined that the predetermined operation is operated from the right side of the display.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing method for controlling display on a display. [Background technology]

[0002] Patent Document 1 describes a technique for changing the display layout on a display. It states that "When resizing and moving a window, it is necessary to move it significantly while dragging the mouse," and that "the device is provided with a layout window display means for reducing the entire screen on which an original window 1 is displayed and displaying it as a layout window 3, a relative position calculation means for calculating the relative positioning of the original window with respect to the entire screen, and an image window display means for displaying the original window relatively positioned in the layout window by the relative position calculation means as an image window 4, and the original window is resized and moved by dragging the image window with a mouse pointer 2." [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 10-293674 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the above-mentioned conventional technology, the operability is improved by reducing the amount of mouse movement. However, the above-mentioned conventional technology does not take into consideration various use cases of displays. For example, in a use case where a wide touch panel display is adopted and the user's position is limited, the range that the user can touch and operate may be limited. One specific example is a case where a touch panel display is installed across the left and right sides of the dashboard at the front of the vehicle and operated by the driver's seat occupant or the passenger seat occupant. The display installed on the dashboard can display various contents such as instruments such as a speedometer, maps, and videos. In addition, the display is required to be able to change the layout of the displayed contents. In particular, when a vehicle occupant operates an in-vehicle display, ensuring high operability is also important in terms of safety during vehicle driving.

[0005] An object of the present invention is to improve the operability relating to changing the layout of a display. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, one representative information processing device of the present invention is an information processing device connected to a display and a touch panel stacked on the display, and includes a touch operation detection unit that detects an operation by a user on the touch panel, an application execution unit that executes a plurality of applications, a display control unit that controls a display signal to be output to the display so as to display a layout screen in which the arrangement of the plurality of display contents is reduced, and when a predetermined operation on the touch panel is detected by the touch operation detection unit, the arrangement of the plurality of display contents can be changed in accordance with the operation by the user, and an operation position determination means that determines whether the user is operating from the left or right, and when it is determined by the operation position determination means that the display control unit displays the layout screen in a first layout area located on the left side of the display, and when it is determined by the operation position determination means that the predetermined operation is performed from the right side of the display, the display control unit displays the layout screen in a second layout area located on the right side of the display. Effect of the Invention

[0007] According to the present invention, the operability relating to changing the layout of the display is improved. Problems, configurations and effects other than those described above will become apparent from the following description of the embodiment. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram of a layout screen displayed by the information processing apparatus according to the first embodiment; [Diagram 2] Overall system configuration diagram of the first embodiment [Diagram 3] Illustrative diagram of detection area and layout area [Figure 4]Flowchart of layout screen display [Diagram 5] Layout change process diagram [Figure 6] Flowchart of layout change process DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment will be described with reference to the drawings. EXAMPLES

[0010] 1 is an explanatory diagram of a layout screen displayed by an information processing device according to embodiment 1. An information processing device 30, which will be described later, controls the display on a display 21 installed in a vehicle. The displays 21 are installed on both sides of the dashboard at the front of the vehicle. In this specification, left and right are described based on the state facing in the traveling direction of the vehicle. A touch panel 22, which will be described later, is placed on the display 21. The information processing device 30 executes a plurality of applications. The information processing device 30 controls a display signal to the display 21 so as to display a plurality of display contents generated by the execution of the plurality of applications on the display 21. In FIG. 1(1), the display 21 displays the display contents F1 to F3 in a horizontal row in the order "F1", "F2", and "F3" from the left.

[0011] When the information processing device 30 detects a predetermined operation on the touch panel 22, it displays the layout screen 21a (2). The predetermined operation is, for example, a long press on a predetermined area. Hereinafter, the predetermined operation is referred to as a specific operation. The layout screen 21a is a screen that allows the arrangement of the display contents F1 to F3 to be changed according to an operation by the user. The layout screen 21a is a display area that displays a reduced arrangement of the display contents F1 to F3. In other words, the layout screen 21a is a display that is a reduced version of the screen shown in (1) of FIG. 1.

[0012] The information processing device 30 can determine whether the user is performing the operation from the left or right direction based on the position where the specific operation is performed or a separately installed camera or sensor. When the information processing device 30 determines that the specific operation has been performed from the left side of the display 21, it displays the layout screen 21a on the left side of the display 21. For example, a first layout area is set in advance on the left side of the display 21, and the layout screen 21a is displayed in the first layout area. Alternatively, the layout screen 21a may be displayed in the vicinity of the position where the specific operation has been received. When the information processing device 30 determines that the specific operation has been performed from the right side of the display 21, it displays the layout screen 21a on the right side of the display 21. For example, a second layout area is set in advance on the right side of the display 21, and the layout screen 21a is displayed in the second layout area. Alternatively, the layout screen 21a may be displayed in the vicinity of the position where the specific operation has been received. In FIG. 1(2), the information processing device 30 determines that the specific operation has been performed from the left side of the display 21, and displays a layout screen 21a on the left side of the display 21.

[0013] The information processing device 30 accepts an operation to change the arrangement of the display contents F1 to F3 on the layout screen 21a. When an operation to drag the display content F1 to the right to the display position of the display content F2 is accepted, the information processing device 30 exchanges the positions of the display content F1 and the display content F2 (3).

[0014] When a predetermined end operation is received after the operation to change the layout (3), the information processing device 30 ends the display of the layout screen 21a, reflects the layout change, and cancels the display of the layout screen (4). The predetermined end operation is, for example, an operation of long pressing outside the layout screen 21a. When the display of the layout screen is canceled, the display contents F1 to F3 are displayed over the entire display 21. Here, since the layout change has been reflected, in FIG. 1 (4), the display 21 displays the display contents F1 to F3 horizontally in the order of "F2", "F1", and "F3" from the left.

[0015] FIG. 2 is a diagram showing the overall configuration of the system according to the first embodiment. The in-vehicle system 10 includes an in-vehicle display device 20 and an information processing device 30. The in-vehicle display device 20 has a display 21 and a touch panel 22 laminated on the display 21. The information processing device 30 is connected to a display 21 and a touch panel 22 . The information processing device 30 includes a touch operation detection unit 31, an operation position determination unit 32, an application execution unit 33, and a display control unit .

[0016] The touch operation detection unit 31 detects an operation on the touch panel 22 by the user from a detection signal from the touch panel 22 . The operation position determination unit 32 determines whether the user is operating from the left or right direction. As an example, the operation position determination unit 32 determines from which direction the user is operating based on whether the specific operation is performed in a predetermined first detection area on the left side of the display 21 or whether the specific operation is performed in a predetermined second detection area on the right side of the display. As another example, the operation position determination unit 32 detects whether the user is operating from the left side or the right side by recognizing the human body using a camera or a sensor.

[0017] The application execution unit 33 executes a plurality of applications, such as an application for displaying gauges such as a speedometer, an application for displaying a map and providing route guidance, an application for playing video and music, an application for receiving and outputting television and radio programs, and the like.

[0018] The display control unit 34 displays the multiple display contents generated by the application execution unit 33 at predetermined positions, and controls a display signal output to the display 21 so as to display the layout screen 21a when a specific operation on the touch panel 22 is detected by the touch operation detection unit 31. The layout screen 21a is a screen that displays a reduced arrangement of the multiple display contents, and allows the arrangement of the multiple display contents to be changed according to an operation by the user.

[0019] When the operation position determination unit 32 determines that the specific operation has been performed from the left side of the display 21, the display control unit 34 displays the layout screen in a first layout area located on the left side of the display 21. When the operation position determination unit 32 determines that the specific operation has been performed from the right side of the display 21, the display control unit 34 displays the layout screen in the second layout area located on the right side of the display 21.

[0020] The display control unit 34 controls the display signal to be output to the display 21 so that when a user performs a drag operation on the layout screen to move a first display content, which is one of multiple display contents, closer to an adjacent second display content, the size of the second display content is reduced, and when the movement distance of the drag operation exceeds a predetermined distance, the positions of the first display content and the second display content are swapped. Furthermore, the display control unit 34 changes the reduction ratio of the second display content depending on the movement distance of the drag operation. These will be described in more detail below.

[0021] Fig. 3 is an explanatory diagram of the detection area and the layout area. In P1 in Fig. 3, the left side is the driver's seat and the right side is the passenger seat with respect to the traveling direction of the vehicle. A first detection area A1 is provided on the left side of the display 21 within reach of the user sitting in the driver's seat. A second detection area A2 is provided on the right side of the display 21 within reach of the user sitting in the passenger seat.

[0022] When a specific operation is performed on the first detection area A1, the information processing device 30 sets up a first layout area B1 within reach of the user seated in the driver's seat, as shown by P2 in FIG. When a specific operation is performed on the second detection area A2, the information processing device 30 sets up a second layout area B2 within reach of the user seated in the passenger seat. As another example, the first and second detection areas may be provided in blank areas where the display contents F1 to F3 are not displayed, or may be dedicated areas indicated by buttons, etc. In these cases, the specific operation may be a single touch operation rather than a special touch operation such as a long press.

[0023] 4 is a flowchart showing the display of the layout screen. The process of displaying the layout screen includes the following steps S101 to S105. S101: The touch operation detection unit 31 detects a specific operation on the touch panel 22. After that, the process proceeds to step S102. In step S102, the operation position determination unit 32 determines whether the user is operating from the left or right side. Then, the process proceeds to step S103. S103: The display control unit 34 displays the layout screen in the vicinity of the user who is the operator. After that, the process proceeds to step S104. S104: The display control unit 34 executes a layout change process for replacing or changing the size of the display contents based on the operation detected by the touch operation detection unit 31. After that, the process proceeds to step S105. S105: The display control unit 34 cancels the display of the layout screen, reflects the changed layout, and displays the entire display 21, and ends the process.

[0024] 5A and 5B are explanatory diagrams of the layout change process. In Fig. 5A, as an initial state, a display content F1 is displayed on the left side of the layout screen 21a, followed by a display content F2, and a display content F3 on the right side.

[0025] When the user drags the display content F1 to the right, the display content F1 moves to the right in accordance with the drag operation. Hereinafter, for convenience, the display content being moved in accordance with the drag operation is referred to as the moving content. Also, the display content existing at the destination of the moving content is referred to as the destination content. In FIG. 5(1), the display content F2 is the destination content.

[0026] The content being moved moves while maintaining its size and shape. When the content being moved enters the area where the destination content was displayed, the destination content shrinks if possible. This shrinking makes room for the content being moved into, and the content being moved and the destination content do not overlap.

[0027] An example of a case where the destination content is reducible is when multiple display shapes of different sizes are prepared for the content, and a display shape that is smaller than the current display shape is available, or when the display size of the content can be arbitrarily enlarged or reduced within a predetermined range, and the content can be displayed smaller than the current display size. In the example of Fig. 5(2), the display content F2, which is the destination content, is prepared in the display format of Fig. 5(1) and a display format that is half the width and height of the display format of Fig. 5(1). Therefore, in Fig. 5(2), it is displayed in the format that is half the width and height.

[0028] When the content being moved moves further to the right and the destination content can no longer be reduced, the content being moved and the destination content are swapped, as shown in Figure 5 (3). At this point, the size of the destination content will be the same as it was before the content being moved started moving.

[0029] After the content has been swapped, the user releases his / her finger from the moving content and performs a specific end operation to finalize the layout change. In Fig. 5(4), the displayed contents are now "F2", "F1", and "F3" from the left after the swap.

[0030] When the finger is released from the content being moved in the state shown in FIG. 5(2), the destination content, display content F2, maintains its reduced state. When an end operation is performed in this state, display content F2 is fixed in its reduced state. In other words, the drag operation of the content being moved not only functions as a swap operation of the layout, but also as a size change operation of the destination content. By carrying out multiple functions with a single operation, layout change operations can be executed easily and efficiently.

[0031] When the movement continues from the state of FIG. 5(2), if the destination content can be further reduced, the reduction of the destination content is repeated as long as it can be reduced.

[0032] 5(3), the display content F3 becomes the destination content. Therefore, it is possible to switch the display content F1 and the display content F3 and to change the size of the display content F3.

[0033] 6 is a flowchart of the layout change process. The layout change process includes the following steps S201 to S208. In step S201, the touch operation detection unit 31 detects a drag of a display content on the layout screen. Then, the process proceeds to step S202. In step S202, the display control unit 34 moves the display content in accordance with the dragging. This display content becomes the moving content. Then, the process proceeds to step S203. S203: The display control unit 34 judges whether or not the moving content will enter the destination content. If the moving content will not enter (S203; No), the process proceeds to step S207. If the moving content will enter (S203; Yes), the process proceeds to step S204.

[0034] S204: The display control unit 34 judges whether the destination content can be reduced. If the destination content can be reduced (S203; Yes), the process proceeds to step S205. If the destination content cannot be reduced (S203; No), the process proceeds to step S206. S205: The display control unit 34 reduces the destination content, and the process proceeds to step S207. In step S206, the display control unit 34 exchanges the moving content with the destination content, and the process proceeds to step S207.

[0035] S207: The touch operation detection unit 31 judges whether or not a predetermined end operation has been received. If the predetermined end operation has not been received (S207; No), the process returns to step S201. If the predetermined end operation has been received (S207; Yes), the process proceeds to step S208. S208: The display control unit 34 confirms the layout and ends the layout change process, and then the process proceeds to S105 shown in FIG.

[0036] As described above, the disclosed information processing device 30 is an information processing device connected to a display 21 and a touch panel 22 stacked on the display 21, and includes a touch operation detection unit 31 that detects operations on the touch panel 22 by a user, an application execution unit 33 that executes a plurality of applications, a display control unit 34 that controls a display signal to be output to the display so as to display a layout screen in which the arrangement of the plurality of display contents is reduced and the arrangement of the plurality of display contents can be changed in accordance with the operation by the user when a predetermined operation on the touch panel is detected by the touch operation detection unit 31, and an operation position determination unit 32 as an operation position determination means for determining whether the user is operating from the left or right. When the operation position determination means determines that the predetermined operation has been performed from the left side of the display 12, the display control unit 34 displays the layout screen in a first layout area located on the left side of the display, and when the operation position determination means determines that the predetermined operation has been performed from the right side of the display 21, the display control unit 34 displays the layout screen in a second layout area located on the right side of the display. This allows the layout screen to be displayed within reach of the user, and layout changes accepted on the layout screen can be reflected on the entire display, improving operability regarding changes to the display layout.

[0037] Further, when a drag operation is performed by the user to bring a first display content, which is one of the plurality of display contents, closer to a second display content adjacent thereto on the layout screen, the display control unit 34 controls the display signal output to the display such that the size of the second display content is reduced, and when the movement distance of the drag operation exceeds a predetermined distance, the positions of the first display content and the second display content are swapped. Also, the display control unit 34 changes the reduction rate of the second display content according to the movement distance of the drag operation. Therefore, size change and arrangement swapping can be realized by the same operation.

[0038] Further, the operation position determination means is characterized in that it detects whether the user is operating from the left side or the right side by recognizing the human body by means of a camera or a sensor. With this configuration, highly accurate determination is possible by recognizing the state of the user.

[0039] Also, the operation position determination means determines from which direction the user is operating based on whether the predetermined operation is performed in a predetermined first detection area on the left side of the display or a predetermined second detection area on the right side of the display. If this operation is adopted, the operation direction can be determined with a simple configuration.

[0040] Further, the display 21 is installed across the left and right of the dashboard at the front part inside the vehicle, and the operation position determination means determines whether the user is operating from the left seat or the right seat. With this configuration, the operability can be improved for changing the layout of the in-vehicle display.

[0041] Further, the display 21 is installed across the left and right sides of the dashboard at the front of the vehicle, the first detection area and the first layout area are within reach of the user seated in the left seat, and the second detection area and the second layout area are within reach of the user seated in the right seat. This configuration improves operability when changing the layout of the in-vehicle display.

[0042] The present invention is not limited to the above-mentioned embodiment, and various modifications are included. For example, the above-mentioned embodiment is described in detail to easily explain the present invention, and is not necessarily limited to the embodiment having all the described configurations. Moreover, the present invention is not limited to the deletion of the configurations, and it is also possible to replace or add the configurations.

[0043] For example, it may be implemented as an in-vehicle device having the functions of the in-vehicle display device 20 and the functions of the information processing device 30. [Explanation of symbols]

[0044] 10: in-vehicle system, 20: in-vehicle display device, 21: display, 22: touch panel, 30: information processing device, 31: touch operation detection unit, 32: operation position determination unit, 33: application execution unit.

Claims

1. An information processing device connected to a display and a touch panel stacked on the display, a touch operation detection unit that detects an operation on the touch panel by a user; an application execution unit that executes a plurality of applications; a display control unit that controls a display signal to be output to the display so as to display a layout screen that displays a reduced arrangement of the plurality of display contents, the layout screen displaying a reduced arrangement of the plurality of display contents when a predetermined operation on the touch panel is detected by the touch operation detection unit, the layout of the plurality of display contents being changeable in accordance with an operation by the user; and an operation position determination means for determining whether the user is operating from the left or right direction; Equipped with The display control unit is when the operation position determination means determines that the predetermined operation has been performed from the left side of the display, displaying the layout screen in a first layout area located on the left side of the display; When the operation position determination means determines that the predetermined operation is performed from the right side of the display, the layout screen is displayed in a second layout area located on the right side of the display.

23. An information processing apparatus comprising:

2. The information processing device according to claim 1, characterized in that the display control unit controls a display signal to be output to the display so that, when the user performs a drag operation on the layout screen to move a first display content, which is one of the multiple display contents, closer to an adjacent second display content, the size of the second display content is reduced, and when the distance traveled by the drag operation exceeds a predetermined distance, the positions of the first display content and the second display content are swapped.

3. The information processing apparatus according to claim 2 , wherein the display control unit changes a reduction ratio of the second display content depending on a moving distance of the drag operation.

4. 2. The information processing apparatus according to claim 1, wherein the operation position determination means detects whether the user is operating from the left side or the right side by recognizing a human body using a camera or a sensor.

5. The information processing device according to claim 1, characterized in that the operation position determination means determines from which direction the user is operating based on whether the predetermined operation is performed in a predetermined first detection area on the left side of the display or whether the predetermined operation is performed in a predetermined second detection area on the right side of the display.

6. 6. The information processing device according to claim 1, 4 or 5, characterized in that the display is installed across the left and right sides of a dashboard at the front of the vehicle, and the operation position determination means determines whether the user is operating from the left seat or the right seat.

7. The information processing device according to claim 5, characterized in that the display is installed across the left and right sides of a dashboard at the front of the vehicle, the first detection area and the first layout area are within reach of the user sitting in the left seat, and the second detection area and the second layout area are within reach of the user sitting in the right seat.

8. an application execution step in which an information processing device connected to a display and a touch panel stacked on the display executes a plurality of applications; a touch operation step of detecting an operation on the touch panel by a user by the information processing device; an operation position determination step in which the information processing device determines whether the user is performing an operation from the left or right direction; a display control step of controlling a display signal to be output to the display so that the information processing device displays a plurality of display contents generated by the execution of the plurality of applications at predetermined positions, and when a predetermined operation on the touch panel is detected, displays a layout screen in which an arrangement of the plurality of display contents is displayed in a reduced scale, and the arrangement of the plurality of display contents can be changed in accordance with an operation by the user; Including, The display control step includes: when it is determined that the predetermined operation has been performed from the left side of the display, displaying the layout screen in a first layout area located on the left side of the display; When it is determined that the predetermined operation is performed from the right side of the display, the layout screen is displayed in a second layout area located on the right side of the display.

23. An information processing method comprising:

Images