Information processing apparatus and information processing method

Abstract

The present invention relates to an information processing apparatus and an information processing method, in order to improve operability when changing a display layout. An information processing apparatus connected to a display and a touch panel, the information processing apparatus including: a touch operation detection unit; a display control unit that controls a display signal output to the display so as to display a reduced layout screen that displays an arrangement of the plurality of display contents and allows a change in the arrangement of the plurality of display contents when a predetermined operation is detected; and an operation position determination means that determines whether the user operates from the left side or the right side; wherein, when it is determined that the predetermined operation has been performed from the left side of the display, the display control unit displays the layout screen on the left side of the display, and when it is determined that the predetermined operation has been performed from the right side of the display, the display control unit displays the layout screen on the right side of the display.

Description

Technical Field

[0001] The present invention relates to an information processing device and an information processing method for controlling display on a display. Background Art

[0002] A technology for changing a display layout on a display is disclosed in Patent Document 1. Patent Document 1 states that "when resizing or moving a window, the mouse must be significantly moved while dragging", and "the system includes: a layout window display device for reducing the entire screen displayed in the original window 1 and displaying it as a layout window 3; a relative position calculation device for calculating the relative position of the original window relative to the entire screen; and an image window display device for displaying the original window relatively positioned in the layout window by the relative position calculation device as an image window 4, wherein the original window is resized and moved by dragging the image window with the mouse pointer 2".

[0003] [Prior art literature]

[0004] [Patent Document]

[0005] Patent Document 1: Japanese Unexamined Patent Application Publication No. H10-293674 Summary of the invention

[0006] Problems to be solved by the present invention

[0007] With the above conventional technology, the amount of mouse movement is reduced, thereby improving operability. However, the above conventional technology does not take into account various usage scenarios of the display. For example, in a usage scenario where a wide touch panel display is used and the user's position is limited, the range to which the user can touch and operate the display with their hands may be limited. A specific example is the following situation, where a touch panel display is installed on the left and right sides of the dashboard in front of a vehicle and is operated by the driver and passenger in the front seats. The display mounted on the dashboard can display a variety of content, including instruments such as speedometers, maps, videos, etc. In addition, the display is required to be able to change the layout of the content they display. In particular, when a vehicle occupant operates the on-board display, it is important to ensure high operability from the perspective of vehicle driving safety.

[0008] An object of the present invention is to improve operability associated with changing the layout of a display.

[0009] Means of solving the problem

[0010] In order to achieve the above-mentioned purpose, a typical information processing device is an information processing device connected to a display and a touch panel covered on the display, the information processing device including: a touch operation detection unit, which detects the user's operation on the touch panel; an application execution unit, which executes multiple applications; a display control unit, which controls the display signal output to the display of multiple display contents generated by the application execution unit executing multiple applications, so that when the touch operation detection unit detects a predetermined operation on the touch panel, the display content allocation can be changed according to the user's operation, and a layout screen can be displayed, which displays a reduced arrangement of multiple display contents; and an operation position determination device, which is used to determine whether the user is operating from the left side or the right side; wherein the display control unit displays the layout screen in a first layout area located on the left side of the display when the operation position determination device determines that the predetermined operation is performed from the left side of the display; and displays the layout screen in a second layout area located on the right side of the display when the operation position determination device determines that the predetermined operation is performed from the right side of the display.

[0011] [Effects of the invention]

[0012] The present invention can improve operability related to changing a display layout.The following description of the embodiments will clarify problems, configurations, and effects other than those described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is an explanatory diagram depicting a layout screen of an information processing apparatus according to Embodiment 1;

[0014] Figure 2 is a configuration diagram of the entire system of implementation mode 1;

[0015] Figure 3 It is an illustration of the detection area and the layout area;

[0016] Figure 4 is a flowchart for displaying the layout screen;

[0017] Figure 5 is an illustration of the layout change process; and

[0018] Figure 6 It is a flow chart of the layout change process. DETAILED DESCRIPTION

[0019] Next, embodiments of the present invention will be described using the drawings.

[0020] [Implementation Method 1]

[0021] Figure 1 : is an explanatory diagram depicting a layout screen of the information processing apparatus according to Embodiment 1. An information processing apparatus 30 to be described later controls display on a display 21 installed in a vehicle.

[0022] The display 21 is on the left and right sides of the instrument panel at the front of the vehicle.

[0023] In this specification, left and right are described based on a state facing the traveling direction of the vehicle.

[0024] A touch panel 22 to be described later is overlaid on the display 21 .

[0025] The information processing device 30 executes a plurality of application programs. The information processing device 30 controls a display signal of the display 21 so as to display a plurality of display contents generated by executing the plurality of application programs on the display 21, respectively.

[0026] exist Figure 1 In (1), the display 21 displays the display contents F1 to F3 in a horizontal row in the order of “F1”, “F2”, and “F3” from the left.

[0027] When the information processing device 30 detects a predetermined operation on the touch panel 22, the information processing device displays the layout screen 21a (2). The predetermined operation is, for example, a long press on a predetermined area. Hereinafter, the predetermined operation is referred to as a specific operation. The layout screen 21a is a screen capable of changing the arrangement of the display contents F1 to F3 according to the user operation. The layout screen 21a is a display area that displays the arrangement of the display contents F1 to F3 in a reduced scale. In other words, the layout screen 21a displays the layout of the display contents F1 to F3 as it is in a reduced size. Figure 1 The screen depicted in (1).

[0028] The information processing apparatus 30 may determine whether the user performs an operation from the left direction or the right direction based on the position where a specific operation is performed or a separately installed camera or sensor.

[0029] When the information processing device 30 determines that a specific operation has been performed from the left side of the display 21, the information processing device displays the layout screen 21a on the left side of the display 21. For example, a first layout area is pre-set on the left side of the display 21, and the layout screen 21a is displayed in the first layout area. Alternatively, the layout screen 21a may also be displayed near the position where the specific operation is received.

[0030] When the information processing device 30 determines that a specific operation has been performed from the right side of the display 21, the information processing device displays the layout screen 21a on the right side of the display 21. For example, a second layout area is pre-set on the right side of the display 21, and the layout screen 21a is displayed in the second layout area. Alternatively, the layout screen 21a may also be displayed near the position where the specific operation is received.

[0031] exist Figure 1 In (2), the information processing device 30 determines that a specific operation is performed from the left side of the display 21 , and displays the layout screen 21 a on the left side of the display 21 .

[0032] The information processing device 30 receives an operation to change the arrangement of the display contents F1 to F3 on the layout screen 21a. When receiving an operation to drag the display content F1 to the right to the display position of the display content F2, the information processing device 30 swaps the positions of the display content F1 and the display content F2 (3).

[0033] When receiving a predetermined end operation after the operation of changing the layout (3), the information processing device 30 terminates the display of the layout screen 21a, reflects the layout change, and cancels the display of the layout screen (4). The predetermined end operation is, for example, an operation of long pressing outside the layout screen 21a. When the display of the layout screen is canceled, the display contents F1 to F3 are displayed on the entire display 21. The layout change has been reflected here, so in Figure 1 In (4), the display 21 displays the display contents F1 to F3 horizontally in the order of "F2", "F1" and "F3" from the left.

[0034] Figure 2 This is a configuration diagram of the overall system of Implementation Example 1.

[0035] The in-vehicle system 10 includes an in-vehicle display device 20 and an information processing device 30 .

[0036] The in-vehicle display device 20 includes a display 21 and a touch panel 22 stacked on the display 21 .

[0037] The information processing device 30 is connected to the display 21 and the touch panel 22 .

[0038] The information processing apparatus 30 includes a touch operation detection unit 31 , an operation position determination unit 32 , an application execution unit 33 , and a display control unit 34 .

[0039] The touch operation detection unit 31 detects a user's operation on the touch panel 22 based on a detection signal from the touch panel 22 .

[0040] The operation position determination unit 32 determines whether the user operates from the left direction or the right direction.

[0041] As an example, the operation position determination unit 32 determines from which direction the user operates based on whether a specific operation is performed in a predetermined first detection area on the left side of the display 21 or whether a specific operation is performed in a predetermined second detection area on the right side of the display.

[0042] As another example, the operation position determination unit 32 detects whether the user is operating from the left side or the right side by recognizing a human body using a camera or a sensor.

[0043] The application program execution unit 33 executes a plurality of application programs including an application program that displays instruments such as a speedometer, an application program that displays a map and provides route guidance, an application program that plays videos or music, and an application program that receives and outputs television or radio signals.

[0044] The display control unit 34 displays a plurality of display contents each generated by the application execution unit 33 at a predetermined position, and controls a display signal output to the display 21 so as to display the layout screen 21a when a specific operation on the touch panel 22 is detected by the touch operation detection unit 31. The layout screen 21a is a screen that displays the arrangement of the plurality of display contents in a reduced scale, thereby allowing the arrangement of the plurality of display contents to be changed according to a user operation.

[0045] When the operation position determination unit 32 determines that the specific operation has been performed from the left side of the display 21 , the display control unit 34 displays the layout screen in the first layout area located on the left side of the display 21 .

[0046] When the operation position determination unit 32 determines that the specific operation has been performed from the right side of the display 21 , the display control unit 34 displays the layout screen in the second layout area located on the right side of the display 21 .

[0047] The display control unit 34 controls the display signal to be output to the display 21 so that when a user performs a drag operation on the layout screen to move a first display content, which is one of a plurality of display contents, closer to an adjacent second display content, the size of the second display content is reduced, and when the distance traveled by the drag operation exceeds a predetermined distance, the positions of the first display content and the second display content are swapped.

[0048] Furthermore, the display control unit 34 changes the reduction ratio of the second display content according to the moving distance of the drag operation.

[0049] These operations are described in more detail below.

[0050] Figure 3 is an illustration of the detection area and layout area. Figure 3At P1 in FIG. 1 , the left side in the vehicle travel direction is the driver's seat and the right side is the passenger seat. The first detection area A1 is set on the left side of the display 21, within the reach of the user sitting in the driver's seat. The second detection area A2 is set on the right side of the display 21, within the reach of the user sitting in the passenger seat.

[0051] When a specific operation is performed in the first detection area A1, the information processing device 30 establishes a first layout area B1 within the reach of the user sitting in the driver's seat, such as Figure 3 As shown in P2.

[0052] When a specific operation is performed in the second detection area A2, the information processing device 30 establishes a second layout area B2 within the reach of the user sitting in the passenger seat.

[0053] As another example, the first detection area and the second detection area may be established in a blank area where the display contents F1 to F3 are not displayed, or may be in a dedicated area indicated by a button, etc. In these cases, the specific operation does not have to be a special touch operation such as a long press, but may be a single-touch operation.

[0054] Figure 4 2 is a flowchart depicting display of a layout screen. The process of displaying the layout screen includes the following steps S101 to S105.

[0055] S101: The touch operation detection unit 31 detects a specific operation on the touch panel 22. Then, the process proceeds to step S102.

[0056] S102: The operation position determination unit 32 determines whether the user operates from the left side or the right side. Then, the process proceeds to step S103.

[0057] S103: The display control unit 34 displays the layout screen near the user who is the operator. Then, the process proceeds to step S104.

[0058] S104: The display control unit 34 performs a layout change process for replacing or changing the size of the displayed content based on the operation detected by the touch operation detection unit 31. Then, the process proceeds to step S105.

[0059] S105: The display control unit 34 cancels the display of the layout screen, reflects the changed layout on the entire display 21, and terminates the process.

[0060] Figure 5 is an illustration of the layout change process. Figure 5In (1), in the initial state, the display content F1 is displayed on the left side of the layout screen 21a, and then the display content F2 and the display content F3 are displayed on the right side.

[0061] When the user drags the display content F1 to the right, the display content F1 moves to the right according to the drag operation. Hereinafter, for convenience, the display content that moves with the drag operation will be referred to as "moving content". In addition, the display content that exists at the destination of the moving content is referred to as the destination content. Figure 5 In (1), the displayed content F2 is the destination content.

[0062] The mobile content maintains size and shape while moving. When the mobile content enters the area where the destination content is displayed, if the size of the content can be reduced, the size of the destination content is reduced. This reduction frees up space for the mobile content to enter and prevents the mobile content from overlapping with the destination content.

[0063] An example of a case where the destination content can be reduced is a case where multiple display shapes of different sizes are provided as content and there is a display shape smaller than the current display shape. Another example is a case where the display size of the content can be arbitrarily enlarged or reduced within a predetermined range and the content can be displayed smaller than the current display size.

[0064] exist Figure 5 In the example of (2), the displayed content F2 as the destination content is Figure 5 The display format described in (1) is prepared with a display format whose width and height are half of that format. Figure 5 In (2), the image is displayed with its length and width halved.

[0065] When the moving content moves further to the right and the destination content can no longer be reduced, the moving content and the destination content are swapped, such as Figure 5 (3) At this time, the size of the destination content becomes the size of the moved content before the moved content starts to be moved.

[0066] After swapping the content, when the user removes their finger from the moved content and performs a predetermined ending operation, the layout change is finalized. Figure 5 In (4), the displayed contents are swapped from the left to "F2", "F1" and "F3".

[0067] When Figure 5When the finger is released from the moving content in the state of (2), the displayed content F2 as the destination content maintains the reduced size. If the ending operation is performed in this state, the displayed content F2 is confirmed to be reduced in size. In other words, the dragging operation of the content being moved serves not only as a rearrangement operation but also as a size change operation of the destination content. A single operation can perform multiple functions, thereby allowing the layout change operation to be performed simply and efficiently.

[0068] When from Figure 5 When the movement continues in the state (2), if the destination content can be further reduced, the reduction of the destination content is repeated as long as the destination content can be reduced.

[0069] If from Figure 5 If the state (3) continues to move, the display content F3 becomes the destination content. Therefore, the display content F1 and the display content F3 can be swapped and the size of the display content F3 can be changed.

[0070] Figure 6 201 to 208.

[0071] S201: The touch operation detection unit 31 detects dragging of display content on the layout screen. Then, the process proceeds to step S202.

[0072] S202: The display control unit 34 moves the display content according to the dragging. The displayed content becomes the moving content. Then, the process proceeds to step S203.

[0073] S203: The display control unit 34 determines whether the mobile content enters the destination content. If not (S203; No), the process proceeds to step S207. If the mobile content does enter the destination content (S203; Yes), the process proceeds to step S204.

[0074] S204: The display control unit 34 determines whether the destination content can be reduced. If the destination content can be reduced (S203; Yes), the process proceeds to step S205. If the destination content cannot be reduced (S203; No), the process proceeds to step S206.

[0075] S205: The display control unit 34 reduces the destination content, and the process proceeds to step S207.

[0076] S206: The display control unit 34 exchanges the movement content with the destination content, and the process proceeds to step S207.

[0077] S207: The touch operation detection unit 31 determines whether a predetermined end operation has been received. If a predetermined end operation has not been received (S207; No), the process returns to step S201. If a predetermined end operation has been received (S207; Yes), the process proceeds to step S208.

[0078] S208: The display control unit 34 confirms the layout and ends the layout change process. Then, the process proceeds to Figure 4 S105 shown.

[0079] As described above, the disclosed information processing device 30 is an information processing device connected to a display 21 and a touch panel 22 covering the display 21, and includes: a touch operation detection unit 31, which detects a user's operation on the touch panel 22; an application execution unit 33, which executes multiple applications; a display control unit 34, which controls a display signal output to the display so as to display multiple display contents generated by executing multiple applications by the application execution unit 33 at a predetermined position, and displays a layout screen when the touch operation detection unit 31 detects a predetermined operation on the touch panel, which displays a reduced arrangement of multiple display contents; and an operation position determination unit 32, which serves as an operation position determination device to determine whether the user is operating from the left or the right.

[0080] When the operation position determination device determines that a predetermined operation has been performed from the left side of the display 12, the display control unit 34 displays the layout screen in a first layout area located on the left side of the display, and when the operation position determination device determines that a predetermined operation has been performed from the right side of the display 21, the display control unit displays the layout screen in a second layout area located on the right side of the display.

[0081] Thereby, the layout screen will be displayed within reach of the user, and a layout change received on the layout screen can be reflected on the entire display, thereby improving operability regarding changes to the display layout.

[0082] In addition, the display control unit 34 controls the display signal to be output to the display so that when a user performs a drag operation on the layout screen to move a first display content, which is one of a plurality of display contents, closer to an adjacent second display content, the size of the second display content is reduced, and when the distance traveled by the drag operation exceeds a predetermined distance, the positions of the first display content and the second display content are swapped.

[0083] Furthermore, the display control unit 34 changes the reduction ratio of the second display content according to the moving distance of the drag operation.

[0084] Thus, the size can be changed and the arrangement can be swapped by performing the same operation.

[0085] Furthermore, the operation position determination device detects whether the user is operating from the left side or the right side by recognizing a human body using a camera or a sensor.

[0086] With this configuration, highly accurate determination can be made by recognizing the state of the user.

[0087] Furthermore, the operation position determination means determines from which direction the user operates based on whether the predetermined operation is performed in a predetermined first detection area on the left side of the display or whether the predetermined operation is performed in a predetermined second detection area on the right side of the display.

[0088] By using this operation, the operation direction can be determined by simple configuration.

[0089] Furthermore, the display 21 is installed on both sides of the instrument panel in the front of the vehicle, and the operation position determination means determines whether the user operates the device from the left seat or the right seat.

[0090] This configuration improves operability when changing the layout of the in-vehicle display.

[0091] In addition, the display 21 is installed on the left and right sides of the dashboard in front of the vehicle, the first detection area and the first layout area are within the reach of the user sitting in the left seat, and the second detection area and the second layout area are within the reach of the user sitting in the right seat.

[0092] This configuration improves operability when changing the layout of the in-vehicle display.

[0093] It should be noted that the present invention is not limited to the above examples, and includes various modified examples. For example, although the above examples are described in detail in order to describe the present invention in an easily understandable manner, the present invention is not necessarily limited to examples having all the above configurations. In addition, not only such configurations can be deleted, but also configurations can be replaced or added.

[0094] For example, this can be realized as an in-vehicle device having the function of the in-vehicle display device 20 and the function of the information processing device 30 .

[0095] Description of Reference Numerals

[0096] 10: In-vehicle system, 20: In-vehicle display device, 21: Display, 22: Touch panel, 30: Information processing device, 31: Touch operation detection unit, 32: Operation position determination unit, 33: Application execution unit.

Claims

1. An information processing device connected to a display and a touch panel covered on the display, the information processing device comprising: a touch operation detection unit, the touch operation detection unit detecting an operation of a user on the touch panel; an application program execution unit, wherein the application program execution unit executes a plurality of application programs; a display control unit that controls a display signal output to the display of a plurality of display contents generated by the application execution unit executing a plurality of applications, so that when the touch operation detection unit detects a predetermined operation on the touch panel, display content allocation can be changed according to a user's operation, and a layout screen that displays a reduced arrangement of the plurality of display contents can be displayed; and An operation position determining device, the operation position determining device is used to determine whether the user is operating from the left side or the right side; in The display control unit displaying the layout screen in a first layout area located on the left side of the display when the operation position determination means determines that the predetermined operation is performed from the left side of the display; and The layout screen is displayed in a second layout area located on the right side of the display when the operation position determination means determines that the predetermined operation is performed from the right side of the display.

2. An information processing device according to claim 1, wherein the display control unit controls a display signal to be output to the display so that when the user performs a drag operation on the layout screen to move a first display content that is one of a plurality of display contents closer to an adjacent second display content, the size of the second display content is reduced, and when the distance traveled by the drag operation exceeds a predetermined distance, the positions of the first display content and the second display content are swapped. 3 . The information processing apparatus according to claim 2 , wherein the display control unit changes a reduction ratio of the second display content according to a moving distance of the drag operation. 4 . The information processing apparatus according to claim 1 , wherein the operation position determination means detects whether the user operates from the left side or the right side by recognizing a human body using a camera or a sensor.

5. An information processing device according to claim 1, wherein the operation position determination device determines from which direction the user operates based on whether the predetermined operation is performed in a predetermined first detection area on the left side of the display or whether the predetermined operation is performed in a predetermined second detection area on the right side of the display.

6. The information processing device according to claim 1, 4 or 5, wherein the display is installed on both sides of a dashboard in front of a vehicle, and the operation position determination means determines whether the user operates the device from a left seat or a right seat.

7. An information processing device according to claim 5, wherein the display is installed on the left and right sides of the dashboard in front of the vehicle, the first detection area and the first layout area are within the reach of a user sitting in a left seat, and the second detection area and the second layout area are within the reach of a user sitting in a right seat.

8. An information processing method, the information processing method comprising: an application program execution step in which an information processing device connected to a display and a touch panel overlaid on the display executes a plurality of application programs; a touch operation step, in which the information processing device detects an operation of the user on the touch panel; an operation position determining step, in which the information processing device determines whether the user performs an operation from the left direction or the right direction; as well as a display control step of controlling a display signal to be output to the display so that the information processing device displays a plurality of display contents generated by executing the plurality of application programs at predetermined positions and displays a layout screen in which, when a predetermined operation on the touch panel is detected, an arrangement of the plurality of display contents is displayed in a reduced scale and the arrangement of the plurality of display contents can be changed according to the operation of the user; in The display control step comprises: when it is determined that the predetermined operation has been performed from the left side of the display, displaying the layout screen in a first layout area located on the left side of the display; as well as When it is determined that the predetermined operation is performed from the right side of the display, the layout screen is displayed in a second layout area located on the right side of the display.

Images