Information processing device and information processing method

Abstract

To improve the ease of operation pertaining to layout changes of a display.SOLUTION: An information processing device is connected to a display and a touch panel, and performs control: to move, when a drag operation on one of a plurality of display contents is detected, a display content being dragged to a position at which the display content is touched; to contract, when a trigger region set to the display content being dragged and a trigger region set to other display contents overlap, the other display contents so as not to overlap the display content being dragged; and to move, when an overlap degree indicating the degree of overlapping exceeds a prescribed threshold, the other display contents so as not to overlap the display content being dragged.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and an information processing method for controlling display on a display.

Background Art

[0002] As a technique for changing the size of content displayed on a display, there is Patent Document 1. Patent Document 1 describes, "In consideration of the characteristic that the content that can be output on one screen of a mobile terminal is limited, first arrange the layout that is optimally next on the screen, and when there is a touch input (dynamic pinch / spread) of the user, the detailed content of the area is gradually output on the screen. It relates to a content control method and its system for optimizing screen output." and "The present invention, when recognizing a touch input of a predetermined first pattern input via a touch screen, enlarges the content in the area where the touch input of the first pattern is input by a predetermined ratio and outputs it to the screen, and reads the detailed information of the content selected by the touch input of the first pattern from the memory and outputs it together to the touch screen."

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] According to the above prior art, the operability regarding the enlargement and reduction of content is improved. However, in the above prior art, layout changes such as the replacement of the arrangement of content are not considered. When a plurality of contents are displayed on a display, the user may desire to customize the layout including changes in the order and position of the arrangement, not limited to the size of the content. If the change in the size of the content and the change in the order and position of the arrangement of the content are realized by individual operations, the operability is low. In particular, when a vehicle occupant operates an in-vehicle display, the operability is very important because it is related to the safety of vehicle driving.

[0005] An object of the present invention is to improve the operability related to the layout change of a display.

Means for Solving the Problem

[0006] To achieve the above object, one of the representative information processing apparatuses of the present invention is an information processing apparatus connected to a display and a touch panel laminated on the display, including a touch operation detection unit that detects an operation by a user on the touch panel, an application execution unit that executes a plurality of applications, and a display control unit that controls a display signal output to the display to display a plurality of display contents respectively generated by the execution of the plurality of applications by the application execution unit in a predetermined layout and change the layout according to the touch operation detected by the touch operation detection unit. When a drag operation on any of the plurality of display contents is detected by the touch operation detection unit, the display control unit moves the display content on which the drag operation is being performed to the touched position, and when a trigger area set for the display content on which the drag operation is being performed overlaps with a trigger area set for another display content, the display control unit reduces the other display content so as not to overlap with the display content on which the drag operation is being performed, and when an overlap degree indicating the degree of overlap exceeds a predetermined threshold, the display control unit performs control to move the other display content so as not to overlap with the display content on which the drag operation is being performed.

Effect of the Invention

[0007] According to the present invention, the operability related to changing the layout of the display is improved. Problems, configurations, and effects other than those described above will be clarified by the description of the following embodiments.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments will be described with reference to the drawings.

Embodiment

[0010] FIG. 1 is an explanatory diagram of the display of a layout screen by the information processing apparatus according to Embodiment 1. The information processing apparatus 30 described later controls the display of the display 21 installed in the vehicle. The display 21 is installed across the left and right of the dashboard at the front inside of the vehicle. In this specification, left and right are expressed based on the state of facing the front of the vehicle from inside the vehicle. A touch panel 22 described later is overlaid on the display 21. The information processing device 30 executes a plurality of applications. The information processing device 30 controls a display signal to the display 21 so as to display a plurality of pieces of display content respectively generated by executing the plurality of applications on the display 21. In FIG. 1(1), the display 21 displays the display contents F1 to F3 in a horizontal row in the order of "F1", "F2", and "F3" from the left.

[0011] When the information processing device 30 detects a predetermined operation on the touch panel 22, it displays a layout screen 21a (2). The predetermined operation is, for example, a long press on a predetermined area. Hereinafter, the predetermined operation is referred to as a specific operation. The layout screen 21a is a screen on which the arrangement of the display contents F1 to F3 can be changed according to an operation by the user. The layout screen 21a is a display area in which the arrangement state of the display contents F1 to F3 is reduced. That is, the layout screen 21a is a reduced display of the screen shown in FIG. 1(1) as it is.

[0012] The information processing device 30 can determine whether the user is operating from the left or right direction based on the position where the specific operation is performed, or a separately installed camera or sensor. When the information processing device 30 determines that the specific operation is performed from the left side of the display 21, it displays the layout screen 21a on the left side of the display 21. For example, a first layout area is preset on the left side of the display 21, and the layout screen 21a is displayed in the first layout area. Alternatively, the layout screen 21a may be displayed in the vicinity of the position where the specific operation is received. When the information processing device 30 determines that the specific operation is performed from the right side of the display 21, it displays the layout screen 21a on the right side of the display 21. For example, a second layout area is preset on the right side of the display 21, and the layout screen 21a is displayed in the second layout area. Alternatively, the layout screen 21a may be displayed in the vicinity of the position where the specific operation is received. In Fig. 1(2), the information processing apparatus 30 determines that a specific operation has been performed from the left side of the display 21, and displays a layout screen 21a on the left side of the display 21.

[0013] The information processing apparatus 30 accepts an operation to change the arrangement of the display contents F1 to F3 on the layout screen 21a. When an operation of dragging the display content F1 to the right until the display position of the display content F2 is received, the information processing apparatus 30 swaps the positions of the display content F1 and the display content F2 (3). Here, the operation of dragging the display content is an operation of touching a finger or the like at the display position of the display content and moving the contact position to another position on the touch panel 22 while maintaining the contact. The information processing apparatus 30 moves the display position of the display content as the contact position moves, and performs display control so that the display content follows the finger or the like and moves on the touch panel 22.

[0014] After receiving a predetermined end operation (3) after the operation of changing the layout, the information processing apparatus 30 ends the display of the layout screen 21a, reflects the layout change, and cancels the display of the layout screen (4). The predetermined end operation is, for example, an operation of long-pressing outside the layout screen 21a after a drop operation. The drop operation is an operation of releasing a finger or the like from the touch panel 22 after dragging. The combination of dragging and dropping is called drag & drop. By the drop operation, the arrangement of the display contents on the layout screen 21a is determined. Thereafter, by long-pressing outside the layout screen 21a, the display of the layout screen 21a is reflected in the entire display 21, and the display of the layout screen is canceled. When the display of the layout screen is canceled, the display contents F1 to F3 are displayed on the entire display 21. Here, since the layout change is reflected, in Fig. 1(4), the display 21 displays the display contents F1 to F3 horizontally in the order of "F2", "F1", and "F3" from the left.

[0015] Fig. 2 is a configuration diagram of the entire system according to the first embodiment. The in-vehicle system 10 includes an in-vehicle display device 20 and an information processing device 30. The in-vehicle display device 20 includes a display 21 and a touch panel 22 laminated on the display 21. The information processing device 30 is connected to the display 21 and the touch panel 22. The information processing device 30 includes a touch operation detection unit 31, an operation position determination unit 32, an application execution unit 33, and a display control unit 34.

[0016] The touch operation detection unit 31 detects an operation on the touch panel 22 by the user from a detection signal from the touch panel 22. The operation position determination unit 32 determines whether the user is operating from the left or right direction. As an example, the operation position determination unit 32 determines from which direction the user is operating based on whether a specific operation is performed in a predetermined first detection area on the left side of the display 21 or a predetermined second detection area on the right side of the display. As another example, the operation position determination unit 32 detects whether the user is operating from the left side or the right side by recognizing the human body using a camera or a sensor.

[0017] The application execution unit 33 executes a plurality of applications. The plurality of applications include an application for displaying instruments such as a speedometer, an application for map display and route guidance, an application for playing videos and music, an application for receiving and outputting TV and radio, and the like.

[0018] The display control unit 34 controls the display signal output to the display 21 so as to display a plurality of pieces of display content respectively generated by the application execution unit 33 at predetermined positions, and to display the layout screen 21a when a specific operation on the touch panel 22 is detected by the touch operation detection unit 31. The layout screen 21a is a screen that displays a reduced layout state of a plurality of pieces of display content, and the arrangement of the plurality of pieces of display content can be changed according to an operation by the user.

[0019] When the operation position determination unit 32 determines that a specific operation has been performed from the left side of the display 21, the display control unit 34 causes the layout screen to be displayed in the first layout area located on the left side of the display 21. When the operation position determination unit 32 determines that a specific operation has been performed from the right side of the display 21, the display control unit 34 causes the layout screen to be displayed in the second layout area located on the right side of the display 21.

[0020] When the user performs a drag operation on the layout screen to move a first piece of display content, which is one of the plurality of pieces of display content, closer to a second adjacent piece of display content, the display control unit 34 controls the display signal output to the display 21 such that the size of the second piece of display content is reduced, and when the movement distance of the drag operation exceeds a predetermined distance, the positions of the first piece of display content and the second piece of display content are swapped. In addition, the display control unit 34 changes the reduction rate of the second piece of display content according to the movement distance of the drag operation. Details of these will be described later.

[0021] FIG. 3 is an explanatory diagram of the detection area and the layout area. In P1 of FIG. 3, when viewed from inside the vehicle towards the front of the vehicle, the left side is the driver's seat and the right side is the passenger seat (left-hand drive vehicle). A first detection area A1 is provided within the reach of the hand of a user sitting in the driver's seat on the left side of the display 21. A second detection area A2 is provided within the reach of the hand of a user sitting in the passenger seat on the right side of the display 21.

[0022] When a specific operation is performed on the first detection area A1, the information processing apparatus 30 provides a first layout area B1 within the reach of the hand of the user seated in the driver's seat, as shown at P2 in FIG. 3. When a specific operation is performed on the second detection area A2, the information processing apparatus 30 provides a second layout area B2 within the reach of the hand of the user seated in the passenger seat. As another example, the first detection area and the second detection area may be provided in a blank area where the display contents F1 to F3 are not displayed, or may be a dedicated area indicated by a button or the like. In these cases, the specific operation may be a single-touch operation rather than a special touch operation such as a long press.

[0023] FIG. 4 is a flowchart of the display of the layout screen. The process of displaying the layout screen includes the following steps S101 to S105. S101 The touch operation detection unit 31 detects a specific operation on the touch panel 22. Then, the process proceeds to step S102. S102 The operation position determination unit 32 determines whether the user is operating from the left or right direction. Then, the process proceeds to step S103. S103 The display control unit 34 displays the layout screen in the vicinity of the user who is the operator. Then, the process proceeds to step S104. S104 The display control unit 34 executes a layout change process such as replacing or resizing the display contents based on the operation detected by the touch operation detection unit 31. Then, the process proceeds to step S105. S105 The display control unit 34 cancels the display of the layout screen, displays the entire display 21 reflecting the changed layout, and ends the process.

[0024] FIG. 5 is an explanatory diagram of the layout change process. In FIG. 5(1), as an initial state, the display content F1 is displayed on the left side of the layout screen 21a, then the display content F2, and the display content F3 is displayed on the right side.

[0025] When the user drags the display content F1 to the right, the display content F1 moves to the right along with the drag operation. Hereinafter, for convenience, the display content moving along with the drag operation is referred to as the moving content. Also, the display content existing at the destination of the moving content is referred to as the destination content. In FIG. 5(1), the display content F2 is the destination content.

[0026] The moving content moves while maintaining its size and shape. When the moving content enters the area where the destination content was being displayed, the destination content shrinks if it can. This shrinking creates a space for the moving content to enter, so that the moving content and the destination content do not overlap.

[0027] The case where the destination content can shrink is, for example, when there are multiple display shapes of different sizes prepared for that content and there is a display format smaller in size than the current display format. Another example is when the display size of that content can be arbitrarily enlarged or reduced within a predetermined range and can be displayed smaller than the current display size. In the example of FIG. 5(2), for the display content F2 which is the destination content, there are the display format of FIG. 5(1) and the display format with the vertical and horizontal dimensions halved from that. Therefore, in FIG. 5(2), it is displayed in the format with the vertical and horizontal dimensions halved.

[0028] When the moving content moves further to the right and the destination content can no longer shrink, as shown in FIG. 5(3), the moving content and the destination content are swapped. At this time, the size of the destination content becomes the size before the moving content started moving.

[0029] After the content is swapped, when the user performs a drop operation of lifting the finger from the moving content and performs a predetermined end operation, the change in the layout is finalized. In FIG. 5(4), due to the swap, the display content is "F2", "F1", "F3" from the left.

[0030] When a drop operation of releasing a finger from the moving content is performed in the state of Fig. 5(2), the display content F2, which is the destination content, maintains the reduced state. When an end operation is performed in this state, the display content F2 is determined with the reduced display. That is, the drag operation of the moving content functions not only as a replacement operation of the arrangement but also as a size change operation of the destination content. By a single operation undertaking a plurality of functions, the operation of changing the layout can be executed simply and efficiently.

[0031] When further movement continues from the state of Fig. 5(2), if the destination content can be further reduced, the reduction of the destination content is repeated as long as it can be reduced.

[0032] When further movement continues from the state of Fig. 5(3), the display content F3 becomes the destination content. Therefore, it is possible to swap the display content F1 and the display content F3 and change the size of the display content F3.

[0033] Fig. 6 is a flowchart of the layout change process. The layout change process includes the following steps S201 to S208. S201 The touch operation detection unit 31 detects the drag of the display content on the layout screen. Then, it proceeds to step S202. S202 The display control unit 34 moves the display content according to the drag. This display content becomes the moving content. Then, it proceeds to step S203. S203 The display control unit 34 determines whether the moving content enters the destination content. If it does not enter (S203; No), it proceeds to step S207. If it enters (S203; Yes), it proceeds to step S204.

[0034] S204 indicates that the display control unit 34 determines whether the destination content can be reduced. If the destination content can be reduced (S203; Yes), it proceeds to step S205. If the destination content cannot be reduced (S203; No), it proceeds to step S206. S205 The display control unit 34 reduces the destination content and proceeds to step S207. S206 The display control unit 34 swaps the moving content and the destination content and proceeds to step S207.

[0035] S207 The touch operation detection unit 31 determines whether a predetermined end operation has been received. If a predetermined end operation has not been received (S207; No), it returns to step S201. If a predetermined end operation has been received (S207; Yes), it proceeds to step S208. S208 The display control unit 34 finalizes the layout and ends the layout change process. Then, it proceeds to S105 shown in FIG. 4.

[0036] FIG. 7 is an explanatory diagram regarding the determination of the position of the display content. The display control unit 34 divides the display area of the display 21 into a grid pattern to set a plurality of grid areas, and sets the grid area occupied by the display content by a predetermined ratio or more as the trigger area of the display content. When one display content exists across a plurality of grid areas, the combination of the plurality of grid areas becomes the trigger area. If the shape, size, and position of the display content change, the trigger area also changes. When the trigger area set for the moving content (the display content on which the drag operation is being performed) by the display control unit 34 overlaps with the trigger area set for the destination content (other display content), the display control unit 34 reduces the destination content so as not to overlap with the moving content. Also, when the overlap degree indicating the degree of overlap exceeds a predetermined threshold value, the display control unit 34 performs control to move the destination content so as not to overlap with the moving content.

[0037] In FIG. 7, a rectangle R11 circumscribing the display content F11 is set, and a grid area in which the rectangle R11 occupies 50% or more is defined as the trigger area of the display content F11. Specifically, the grid G01 and the grid G02 shown in FIG. 7 are not trigger areas, while the grid G31 and the grid G32 are trigger areas.

[0038] FIG. 8 is an explanatory diagram of the display position when the display content is reduced. In FIG. 8(1), the display content F11 is dragged and overlaps with the display content F12 and the display content F13. Note that trigger areas are set for each of the display contents F11 to F13, and when there is a grid area that serves as a trigger area for a plurality of display contents simultaneously, it is determined that an overlap has occurred. When the destination content is smaller than the moving content, the display control unit 34 obtains, as the overlapping degree, the ratio of the trigger area of the destination content that overlaps with the trigger area of the moving content. A threshold is set for this overlapping degree, and when the overlapping degree exceeds the threshold, the destination content is moved. The display content that can be reduced may be reduced at the time when the overlap occurs, and when the overlapping degree exceeds the threshold, it may be regarded as the display content that cannot be further reduced. Alternatively, when the overlapping degree exceeds the threshold, if reduction is possible, it may be reduced, and if reduction is not possible, it may be moved.

[0039] In the state of FIG. 8(1), if both the display contents F12 and F13 can be reduced, as shown in FIG. 8(2), the display contents F12 and F13 are reduced respectively. The display position of the reduced display content is determined so as to be away from the nearby display content. Since there is the display content F13 below the display content F12, the position of the display content F12 is determined to be closer to the upper side. Since there is the display content F12 above the display content F13, the position of the display content F13 is determined to be closer to the lower side. By determining the position in this way so as to be away from the nearby display content, a decrease in visibility can be prevented.

[0040] FIG. 9 is an explanatory diagram of the moving direction of the content during movement. In FIG. 9, the display content F11 is moving to the right. Along with this movement, the grids G43 and G53 located on the right side of the display content F11 newly become the trigger regions of the display content F11. Similarly, the grids G41 and G51 located on the left side of the display content F11 cease to be the trigger regions of the display content F11. If there is destination content having the grids G43 and G53 as trigger regions, the destination content receives the entry of the display content F11 and moves to the left side of the display content F11, and will have the grids G41 and G51 as trigger regions.

[0041] As shown in FIG. 9, the destination content moves in the direction opposite to the content during movement and exchanges positions. However, there may be a case where there is already other content at the exchange destination and the exchange cannot be performed. If the exchange cannot be performed, the destination content moves to an empty region near the exchange destination.

[0042] FIG. 10 is an explanatory diagram of the determination of the moving destination of the display content. In FIG. 10(1), the display contents F21 to F24 are arranged vertically, and the display content F25 exists on the right side of the display content F22. The display content F11, which is the content during movement, approaches from the left and overlaps the display contents F22 to F23. As shown in FIG. 10(2), the display contents F22 to F23 exchange positions with the display content F11. The display content F11 further moves to the right. When the display content F11 passes, the display contents F22 to F23 return to their original positions. When the display content F11 overlaps the display content F25, the display content F25 moves. However, as shown in FIG. 10(3), the display content F22 exists at the moving destination when the display content F25 exchanges positions with the display content F11. Therefore, as shown in FIG. 10(4), the display content F25 moves to a place where there is no other display content.

[0043] Referring to FIGS. 11 and 12, a method for determining the destination of display content will be described. As shown in FIG. 11, the destination candidate level 0 (L0) is the first candidate for the destination of the existing content when the content being moved and the existing content are swapped. If there is no influence from other display content, etc., the existing content moves to the destination candidate L0. Around the destination candidate L0, a destination candidate level 1 (L1) is set as the second candidate for the destination. Around the destination candidate L1, a destination candidate level 2 (L2) is set as the third candidate for the destination. Around the destination candidate L2, a destination candidate level 3 (L3) is set as the fourth candidate for the destination. When the display control unit 34 cannot move the existing content to the destination candidate L0, it searches for the destination of the existing content in order from the destination candidate L1. Here, up to the destination candidate L3 is exemplified, but the destination candidates L4 and later may be set. Also, a location on the side opposite to the destination candidate L0 with respect to the moving direction of the content being moved is excluded from the candidates. Among the remaining candidates at the same level, the candidate at a position more opposite to the moving direction of the content being moved is prioritized. Further, if there are a plurality of candidates at positions equally opposite to the moving direction of the content being moved among the remaining candidates at the same level, the lower candidate is prioritized.

[0044] In FIG. 12, the moving direction of the display content F11, which is the content being moved, is to the right. Therefore, the frame to the left of the destination candidate L0 is excluded from the candidates for the destination. Below the destination candidate L0 is the destination candidate L1-1, and the destination candidate L1-1 has the highest priority. Above the destination candidate L0 is the destination candidate L1-2, and the destination candidate L1-2 has the next highest priority. In this way, the priority of each destination candidate is determined according to the initial destination candidate L0 and the moving direction of the content being moved. In the absence of other display content, the location with the highest priority is the destination of the existing content.

[0045] FIG. 13 is an explanatory diagram of the reduction and movement of display content. In Fig. 13(1), the display contents F21 to F23 are arranged vertically, and the display content F11, which is the content in movement, is approaching them from the left. Among the display contents F21 to F23, the display contents F21 to F22 can be further reduced by one level. The display content F23 cannot be reduced any further.

[0046] When the display content F11 overlaps the display contents F21 to F23, as shown in Fig. 13(2), the display contents F21 to F22 are reduced. The display content F23 that cannot be reduced moves to the left after being replaced with the display content F11. When the display content F11 moves further to the right and overlaps the display contents F21 to F22, as shown in Fig. 13(3), the display contents F21 to F22 that cannot be reduced any further move to the left after being replaced with the display content F11. As a result of the sequential movement of the display contents F21 to F23, the state shown in Fig. 13(4) is obtained.

[0047] Fig. 14 is an explanatory diagram of the deformation of a plurality of display contents. In Fig. 14(1), the display contents F21 to F23 are arranged vertically, and the display content F11, which is the content in movement, is approaching from the left. All of the display contents F21 to F23 can be further reduced by one level. When the display control unit 34 performs reduction on a plurality of display contents, it calculates the angle with respect to the movement direction of the content in movement for each of the existing plurality of display contents, and performs processing related to reduction starting from the display content with the smallest angle. The distance between the center of the destination content and the center of the content in movement may be obtained, and it may be assumed that the smaller the distance, the smaller the angle with respect to the movement direction of the content in movement. In the case of Fig. 14(1), the display content F22 will be reduced first.

[0048] Regarding the processing for reducing a plurality of display contents, even if the order is determined and executed sequentially, the time difference is within a range where the user perceives it as being reduced simultaneously. The difference in the order of reduction is related to the determination of the position after reduction. When the position of the display content that is reduced first is determined, the positions of the subsequent display contents to be reduced are determined so as to be at a sufficient distance from the already reduced display content. By determining the positions in this way, each display content is arranged at a highly visible position. Note that when not restricted by other display contents, as shown in FIG. 14(2), it is preferable from the viewpoint of visibility to display as low as possible. FIG. 14(3) shows the state after reduction.

[0049] FIG. 15 is an explanatory diagram when the display content at the destination of movement is large. When the destination content is large, even if the moving content overlaps, the degree of overlap may not exceed the threshold. When the destination content is large, reduction or movement is performed when an overlap occurs at the specified position of the destination content. In FIG. 15(1), by dividing the circumscribed rectangle of the display content F31 located at the destination of the display content F11 vertically and horizontally, four divided regions are set. The center of each of these four divided regions is set as the default position. In FIG. 15(2), the display content F11 has entered the center of the upper left region among the four divided regions, and an overlap has occurred. In FIG. 15(3), triggered by the occurrence of an overlap at the center of one of the four divided regions, the display content F31 is being reduced.

[0050] FIG. 16 is an explanatory diagram of the enlargement of the display content. After the trigger region set for the display content being dragged (the moving content) overlaps with the trigger region set for another display content (the destination content), when an operation is performed to separate the display content being dragged from the other content, the display control unit 34 enlarges the other content. In Fig. 16(1), the user is dragging the display content F11, which is the moving content, towards the display content F41. In Fig. 16(2), the display content F11, which is the moving content, slightly overlaps the display content F41. When the user drags the display content F11 away from the display content F41 from this state, as shown in Fig. 16(3), the display content F41 expands. Thus, the drag operation of the display content can be applied not only to the position swap and reduction but also to the expansion. Therefore, the user can perform various processes related to the layout change with a sensuously unified and natural operation.

[0051] As described above, when the drag operation on any of the plurality of display contents is detected by the touch operation detection unit 31, the disclosed information processing apparatus 30 moves the display content on which the drag operation is being performed to the touched position, and when the trigger area set for the display content on which the drag operation is being performed overlaps with the trigger area set for another display content, it reduces the other display content so as not to overlap with the display content on which the drag operation is being performed, and when the overlap degree indicating the degree of overlap exceeds a predetermined threshold value, it performs control to move the other display content so as not to overlap with the display content on which the drag operation is being performed. Therefore, the operations of size change and position change can be integrated, and the operability related to the layout change of the display can be improved.

[0052] Further, when the touch operation detection unit 31 detects a drop operation following the drag operation, the display control unit 34 determines the position of the display content on which the drag operation was performed, and the size and position of the other display content. Therefore, size change and position change are possible with a simple operation.

[0053] Further, when the drag operation is performed on the display content where the trigger area is set, and after the trigger area set for the other display content overlaps with the trigger area of the display content where the drag operation is being performed, if an operation to separate the display content where the drag operation is being performed from the other content is performed, the other content is enlarged. Therefore, the operability can also be improved for the enlargement of the display content.

[0054] In addition, when a predetermined operation on the touch panel is detected by the touch operation detection unit, the display control unit 34 displays a layout screen in which the arrangement state of the plurality of display contents displayed on the entire screen of the display is reduced, and accepts the drag operation on the layout screen. Therefore, even when using a large display, the operability can be improved.

[0055] Further, a limit value of the size that can be reduced is set for the plurality of display contents. Even when the trigger area set for the display content where the drag operation is being performed overlaps with the trigger area set for other display content, if the other display content already has the size of the limit value, the other display content is moved without being reduced. As an example, when the degree of overlap exceeds a predetermined threshold value, the display control unit 34 exchanges the positions of the other display content and the display content where the drag operation is being performed. Therefore, reduction and movement can be performed with the same operation.

[0056] In addition, the display control unit 34 changes the trigger area according to the size of the display content. As an example, the display control unit 34 divides the display area of the display into a grid pattern to set a plurality of grid areas, and sets the grid area occupied by the display content at a predetermined ratio or more as the trigger area of the display content. Therefore, operations corresponding to the display content can be easily realized.

[0057] Note that the present invention is not limited to the above embodiments and includes various modifications. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Also, not only deletion of such a configuration is possible, but also replacement or addition of a configuration is possible.

[0058] For example, it may be implemented as an in-vehicle device having the functions of the in-vehicle display device 20 and the information processing device 30. Moreover, it is applicable not only to in-vehicle devices but also to any device such as a tablet terminal or a smartphone.

Explanation of Reference Numerals

[0059] 10: In-vehicle system, 20: In-vehicle display device, 21: Display, 22: Touch panel, 30: Information processing device, 31: Touch operation detection unit, 32: Operation position determination unit, 33: Application execution unit, 34: Display control unit

Claims

1. An information processing apparatus connected to a display and a touch panel laminated on the display, comprising: a touch operation detection unit that detects an operation on the touch panel by a user; an application execution unit that executes a plurality of applications; and a display control unit that controls a display signal output to the display to display a plurality of pieces of display content respectively generated by execution of the plurality of applications by the application execution unit in a predetermined layout, and to change the layout according to a touch operation detected by the touch operation detection unit. The information processing apparatus further comprises: wherein the display control unit: when a drag operation on any one of the plurality of pieces of display content is detected by the touch operation detection unit, moves the display content on which the drag operation is being performed to the position where it is touched; when a trigger area set for the display content on which the drag operation is being performed overlaps with a trigger area set for another piece of display content, reduces the other piece of display content so as not to overlap with the display content on which the drag operation is being performed; when an overlap degree indicating the degree of overlap exceeds a predetermined threshold value, controls to move the other piece of display content so as not to overlap with the display content on which the drag operation is being performed.

2. The information processing apparatus according to claim 1, wherein when a drop operation following the drag operation is detected by the touch operation detection unit, the display control unit determines the position of the display content on which the drag operation was being performed, and the size and position of the other piece of display content.

3. The information processing apparatus according to claim 1, wherein when an operation of separating the display content on which the drag operation is being performed from the other content is performed after the trigger area set for the display content on which the drag operation is being performed overlaps with the trigger area set for the other piece of display content, the display control unit enlarges the other piece of display content.

4. When the predetermined operation on the touch panel is detected by the touch operation detection unit, the display control unit displays a layout screen in which the arrangement state of the plurality of display contents displayed on the entire screen of the display is reduced, and receives the drag operation on the layout screen. The information processing apparatus according to claim 1, characterized in that.

5. A limit value of a size that can be reduced is set for the plurality of display contents, Even when the trigger area set for the display content on which the drag operation is being performed overlaps with the trigger area set for another display content, if the other display content already has the size of the limit value, the display control unit moves the other display content without reducing the other display content. The information processing apparatus according to claim 1, characterized in that.

6. When the degree of overlap exceeds a predetermined threshold value, the display control unit exchanges the positions of the other display content and the display content on which the drag operation is being performed. The information processing apparatus according to claim 1, characterized in that.

7. The display control unit divides the display area of the display into a grid pattern to set a plurality of grid areas, and sets the grid area in which the display content occupies a predetermined ratio or more as the trigger area of the display content. The information processing apparatus according to claim 1, characterized in that.

8. An information processing apparatus connected to a display and a touch panel laminated on the display includes an application execution step of executing a plurality of applications, a touch operation detection step of detecting an operation on the touch panel by a user by the information processing apparatus, a display control step of controlling a display signal output to the display so that the information processing apparatus displays a plurality of display contents respectively generated by executing the plurality of applications in a predetermined layout and changes the layout according to the touch operation detected in the touch operation detection step including, The display control step is, When a drag operation on any one of the plurality of display contents is detected by the touch operation detection step, the display content on which the drag operation is being performed is moved to the touched position. When the trigger area set for the display content on which the drag operation is being performed overlaps with the trigger area set for other display content, the other display content is reduced so as not to overlap with the display content on which the drag operation is being performed, When the overlap degree indicating the degree of overlap exceeds a predetermined threshold, control is performed to move the other display content so as not to overlap with the display content on which the drag operation is being performed. An information processing method characterized by this.

Images