Information processing method, information processing device, and program

Abstract

An information processing device (10) is provided with a controller (11) that controls the screen display of a touch panel display (1), the screen display including a first layer (L1) located on the front surface and a second layer (L2) located closer to the rear surface than the first layer (L1), and the controller (11) performs the following processes: detecting an operation on the screen display; when the operation on the screen display is a scroll operation, a scroll process for scrolling the first layer (L1) is executed, and when objects (W1-W4) disposed on the first layer (L1) are scrolled by the scroll process and arrive at an end of the screen display, a transfer process for transferring the objects (W1-W4) arriving at the end from the first layer (L1) to the second layer (L2) is executed.

Description

Technical Field

[0001] The present invention relates to an information processing method, an information processing device and a program for controlling screen display of a touch panel display. Background Art

[0002] Conventionally, there is known a display method for a display device that displays objects in various ways according to a scrolling speed (Patent Document 1). The display method includes the following steps: displaying at least one object on a screen; receiving a user input, receiving a direction for scrolling the at least one object; and changing the size of an area displaying the at least one object in the screen according to a scrolling speed corresponding to the received user input, and scrolling the at least one object according to a scrolling method.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2014-194773 Summary of the invention

[0006] Problem that the invention aims to solve

[0007] The display method described in Patent Document 1 has a problem in that when the object is scrolled and reaches the end of the screen, the object is displayed as if it is missing at the end of the screen, and the user feels that the display of the object is unnatural.

[0008] The problem to be solved by the present invention is to provide an information processing method, an information processing device, and a program for suppressing a user's feeling of unnaturalness regarding the display of an object in a scene in which a screen display is scrolling.

[0009] Solutions for solving problems

[0010] The present invention solves the above-mentioned problem by the following method: detecting an operation on a screen display including a first layer located on a front surface and a second layer located on a rear surface relative to the first layer, and when the operation on the screen display is a scrolling operation, executing a scrolling process to scroll the first layer, and when an object configured on the first layer scrolls through the scrolling process and reaches an end of the screen display, executing a transfer process to transfer the object that has reached the end of the screen display from the first layer to the second layer.

[0011] Effects of the Invention

[0012] According to the present invention, it is possible to suppress the user's feeling of unnaturalness regarding the display of an object in a scene in which the screen display is scrolling. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is a diagram schematically showing the structure of the information presentation device according to the present embodiment.

[0014] Figure 2 It is a diagram for explaining the information presentation device and the display involved in this embodiment.

[0015] Figure 3 This is a diagram used to explain the main layer and sub-layer.

[0016] Figure 4 This is a diagram for explaining processing performed by the widget migration unit and the sub-layer display control unit.

[0017] Figure 5 This is an example of a flowchart showing the procedure of information processing according to the present embodiment.

[0018] Figure 6 It is a diagram showing a state in which a screen is transitioned by the information processing device according to the comparative example when a scroll operation is performed.

[0019] Figure 7 This is a diagram showing how the screen is transitioned by the information processing device according to the present embodiment when a scroll operation is performed.

[0020] Figure 8 Yes means Figure 7 A subsequent diagram of the screen transition shown.

[0021] Fig. 9 This is a diagram for explaining the processing of the information processing device involved in this embodiment. DETAILED DESCRIPTION

[0022] Hereinafter, embodiments of the information processing method, information processing device, and program according to the present invention will be described with reference to the drawings.

[0023] Figure 1 1 is a schematic diagram of the structure of the information presentation device 100 involved in this embodiment. The information presentation device 100 is a device installed in the vehicle compartment to present various information to the passengers. For example, the information presentation device 100 presents to the passengers an operation screen for operating vehicle-mounted devices such as a navigation device, an audio device, and an air-conditioning device, and an operation screen of the vehicle-mounted device that operates according to the operation of the passengers (such as map information for route guidance of the vehicle).

[0024] like Figure 1 As shown, the information presentation device 100 is configured to include a display 1 , a storage device 2 , and an information processing device 10 .

[0025] The display 1 is a touch panel display mounted on a vehicle. The touch panel display 1 is provided with a pressure-sensitive sensor for detecting the pressing force applied to the display 1 during a contact operation based on a resistance value, a voltage, etc. The mechanism of the pressure-sensitive sensor is not particularly limited, and the mechanism of the pressure-sensitive sensor known at the time of application can be appropriately used. In addition, the touch panel is not limited to a pressure-sensitive type, and may be other types such as an electrostatic type. The display 1 may be a touch panel display 1, and the type of the display 1 is not particularly limited. The display 1 may be either a liquid crystal display or an organic EL (organic electroluminescence: OEL) display.

[0026] For example, the display 1 is arranged between the driver's seat and the front passenger seat in the instrument panel. In addition, the display 1 is arranged in front of the driver's seat and the front passenger seat so that the driver sitting in the driver's seat and the passenger sitting in the front passenger seat (hereinafter referred to as the front passenger seat passenger) can reach it.

[0027] Figure 2 It is a diagram for explaining the information presentation device 100 and the display 1 according to the present embodiment. Figure 2 (A) is a diagram showing the interior of a vehicle, and is an example of the information presentation device 100 and the display 1. Figure 2 As shown in (A), for example, when viewed from the front Figure 2 In the case of (A), the display 1 is arranged at a position on the left side relative to the steering wheel. In the present embodiment, the display 1 is a display having a shape that is long in the left-right direction relative to the up-down direction. The driver and the passenger in the front passenger seat input the operation content for the information presentation device 100 to the display 1 by performing a touch operation on the display 1. The touch operation is an operation of touching an object displayed on the display 1 by a finger or the like.

[0028] Figure 2 (B) is Figure 2 The enlarged view of the display 1 shown in (A) is a view for explaining a widget as an operation target of the passenger. In this embodiment, a widget is taken as an example as an operation target of the passenger. A widget is a shortcut to an application software displayed on the main screen.

[0029] If you use Figure 2, the screen display D of the display 1 includes a widget display area WA and a fixed display area PA (permanent area) arranged around the widget display area WA. The widget display area WA is adjacent to the fixed display area PA. The screen display D is an area in the display 1 that can be operated by the driver or the passenger in the front passenger seat. The widget display area WA is an area for displaying widgets W1 to W4. In the widget display area WA, widgets W1 to W4 are scrolled according to the scrolling action of the main layer described later when viewed from the front. Figure 2 In the case of (B), the display is scrolled to the left or right. The fixed display area PA is an area that displays specific information regardless of the scrolling operation on the screen display D. That is, in the fixed display area PA, specific information is continuously displayed regardless of the scrolling display of the widgets W1 to W4 in the widget display area WA. For example, the set temperature of the air-conditioning equipment on the driver's side, the set temperature of the air-conditioning equipment on the passenger side of the front passenger seat, the current time, icons representing application software other than widgets, etc. are displayed in the fixed display area PA. In addition, in the subsequent description, the abbreviations of "application" or "application" are sometimes used for "application software", but these terms are set to be synonymous.

[0030] exist Figure 2 In the example of (B), in the widget display area WA, the widgets W1 to W4 are Figure 2 In the case of (B), the widget is displayed in an arrangement from left to right. The widget includes an icon portion that clearly indicates the application through a recognizable display, a panel portion that displays information related to the application software, and a shadow portion (not shown) that displays a shadow at the boundary between the icon portion and the panel portion. The panel portion is wider than the icon portion, and the icon portion is superimposed and displayed at a position to the right of the center line of the panel portion.

[0031] exist Figure 2 In the example (B) of FIG. 1 , the widget W1 includes a panel portion p1, an icon portion i1 displayed superimposed on the panel portion p1, and a shadow portion s1. Figure 2 , but the shadow portion s1 is set at the boundary of the icon portion i1 and the boundary of the panel portion p1. The shadow portion refers to a kind of visual effect used to easily distinguish the boundary of the icon portion and the boundary of the panel portion. Regarding the description of widgets W2 to W4, the description of widget W1 is omitted and quoted. In addition, the target application of the widget is not particularly limited. As an example, a call application, a search application, a weather forecast application, a map application, a music application, etc. can be cited.

[0032] Return to Figure 1, the touch operation of the driver or the front passenger seat occupant is explained. The touch operation includes tapping (touching the screen once), double tapping (touching the screen twice), long tapping (long pressing the screen), swiping (sliding the finger touching the screen directly on the screen (tracing with the finger)), flicking (moving the finger touching the screen in a fast flicking manner on the screen), pinching in / out (touching the screen with two fingers and bringing the two fingers close / separated), dragging (sliding the item on the screen while pressing the item with a finger for a long time), dropping (releasing the finger from the screen from the state of pressing the item with a finger in the drag operation), scrolling (moving the finger on the screen in the up-down direction or left-right direction without releasing the finger from the screen), etc. In addition, the touch operation may not be directly touching the screen display of the display 1, but the so-called hovering of bringing the finger etc. close to the screen display. In addition, the operation method of the touch operation is not limited to these, and other methods may also be used.

[0033] When the driver or the passenger in the front passenger seat performs a touch operation on the display 1, the display 1 detects the position where the touch operation was performed on the screen display, and outputs the information of the detected position to the information processing device 10. In addition, the display 1 outputs the detection result of the pressure-sensitive sensor together with the position where the touch operation was performed to the information processing device 10. On the other hand, a control command for displaying image data is input from the information processing device 10 to the display 1. The display 1 displays one or more screens based on the image data.

[0034] The storage device 2 is a storage device such as a HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage device 2 stores various data related to the information presentation device 100. For example, the storage device 2 stores image data of an icon portion, image data of a panel portion, image data of a shadow portion, etc. as information related to a widget. In addition, the storage device 2 outputs the stored data to the information processing device 10 according to a control instruction from the information processing device 10. In addition, the storage device 2 deletes data, updates existing data, stores new data, etc. according to a control instruction from the information processing device 10.

[0035] The information processing device 10 is composed of a computer having hardware and software, specifically, a ROM (Read Only Memory) storing a program, a CPU (Central Processing Unit) executing the program stored in the ROM, and a RAM (Random Access Memory) functioning as an accessible storage device. In addition, as an action circuit, an MPU (Micro Processing Unit), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc. can be used instead of the CPU or together with the CPU. Figure 1 The controller 11 shown is a main body that executes the information processing method according to the present invention described later, and corresponds to a computer.

[0036] In addition, in this embodiment, a structure in which the program executed by the information processing device 10 is pre-stored in the ROM is cited as an example for explanation, but the place where the program is stored is not limited to the ROM. For example, the program can also be readable by a computer and stored in a portable computer-readable recording medium (for example, a disk medium (disk media), a flash memory, etc.). In this case, the information processing device 10 downloads the program from the computer-readable recording medium and executes the downloaded program. In other words, the information processing device 10 can also be a structure that only has an action circuit and downloads the program from the outside.

[0037] like Figure 1 As shown, the controller 11 of the information processing device 10 has an operation detection unit 12, a main layer display control unit 13, a widget display position detection unit 14, a widget transfer unit 15, and a sub-layer display control unit 16 as functional blocks.

[0038] The operation detection unit 12 detects a touch operation performed on the display 1 based on information input from the display 1. Position information on the display 1 on which the touch operation was performed and the detection result of the pressure-sensitive sensor (resistance value, voltage, etc. indicating the pressing force) are input from the display 1 to the operation detection unit 12. For example, the operation detection unit 12 determines whether the operation on the display 1 is a tapping operation, a double-clicking operation, a long tapping operation, a swiping operation, a flicking operation, a pinching / split operation, a dragging operation, a releasing operation, or a scrolling operation based on the information input from the display 1. In addition, the number of touch operations detected by the operation detection unit 12 is not particularly limited. For example, the operation detection unit 12 can also detect that the touch operation on the display 1 is both a dragging operation and a scrolling operation. The operation detection unit 12 can use a known detection method known at the time of applying for this application to detect the touch operation.

[0039] In addition, the operation detection unit 12 detects the operation direction of the touch operation based on the information input from the display 1. For example, when the operation detection unit 12 determines that the operation on the display 1 is a scrolling operation based on the information input from the display 1, it detects the scrolling operation direction. The scrolling operation direction is equivalent to the direction in which the driver or the passenger in the front passenger seat moves the finger on the screen during the scrolling operation. As the scrolling operation direction, for example, the up and down direction (the direction from top to bottom, the direction from bottom to top) and the left and right direction (the direction from left to right, the direction from right to left) can be cited. The detection processing of the touch operation performed by the operation detection unit 12 includes the processing of detecting the scrolling operation direction in the scrolling operation.

[0040] In addition, the operation detection unit 12 detects the operation speed of the touch operation based on the information input from the display 1. For example, when the operation detection unit 12 determines that the operation on the display 1 is a scroll operation based on the information input from the display 1, it detects the operation speed of the scroll operation. The operation speed of the scroll operation is equivalent to the movement speed of the finger when the driver or the passenger in the front passenger seat moves the finger on the screen in the up-down direction or the left-right direction during the scroll operation. The detection process of the touch operation performed by the operation detection unit 12 includes the process of detecting the operation speed of the scroll operation.

[0041] The main layer display control unit 13 controls the display of the main layer in the screen display of the display 1 according to the touch operation detected by the operation detection unit 12. In the present embodiment, the screen display of the display 1 is configured to include a main layer located on the front surface and a sub-layer located on the rear surface relative to the main layer. When the screen display of the display 1 is viewed from the front, the main layer is located on the front surface relative to the sub-layer.

[0042] Here, use Figure 3 This section explains the main layers and sub layers that make up the screen display. Figure 3This is a diagram used to explain the main layer and sub-layer. Figure 3 (A) is Figure 2 (B) is a schematic diagram of the widget display area WA. Figure 3 In (A), Figure 2 The same structure as shown in (B) is annotated with Figure 2 The same reference numerals as those shown in (B) are used. Figure 3 In (A), the x-axis shows the vehicle width direction (left-right direction) of the vehicle, the y-axis shows the depth in the traveling direction (forward direction) of the vehicle, and the z-axis shows the height direction (up-down direction).

[0043] like Figure 3 As shown in (A), the widget display area WA includes a main layer L1 as a display layer along the x-axis and the z-axis, and a sub-layer L2 which is located on the positive side of the y-axis relative to the main layer L1 and is a display layer along the x-axis and the z-axis. The main layer L1 and the sub-layer L2 form a layered structure in which the main layer L1 is the front surface and the sub-layer L2 is the back surface. The sizes of the main layer L1 and the sub-layer L2 are not particularly limited, but in this embodiment, the main layer L1 and the sub-layer L2 are set as display layers of the same size for illustration. The main layer L1 and the sub-layer L2 have a width that allows the widgets W1 to W4 to be arranged in the left-right direction.

[0044] When widgets W1 to W4 are pressed Figure 3 When the positional relationship shown in (A) is configured on the main layer L1, the display 1 is Figure 2 The screen display D (widget display area WA) shown in (B) is displayed. Figure 3 In the case of example (A), widgets W1 to W4 are as follows Figure 3 As shown in (B) of FIG. 1 , the widgets belonging to the main layer L1 are displayed on the display 1 as widgets arranged in the main layer L1 . Figure 3 (B) is used to illustrate the Figure 3 The screen (A) shows a map of the destination to which the corresponding widget belongs. The role and function of the sub-layer L2 will be described later.

[0045] When the touch operation detected by the operation detection unit 12 is a scroll operation, the main layer display control unit 13 performs a scrolling process to scroll the main layer. As the scrolling process, the main layer display control unit 13 outputs a control instruction to the display 1 for scrolling the main layer in a direction corresponding to the scrolling operation direction detected by the operation detection unit 12. Figure 3In the case of the example (A), when a scroll operation direction from left to right along the x-axis is detected, the main layer display control unit 13 outputs a control instruction for scrolling the main layer L1 from left to right to the display 1. As a result, the display 1 displays a screen in which the main layer L1 including the widgets W1 to W4 is scrolled from left to right. Figure 3 In the example of (A), when a scroll operation direction from right to left along the x-axis is detected, the main layer display control unit 13 outputs a control instruction for scrolling the main layer L1 from right to left to the display 1. As a result, the display 1 displays a screen in which the main layer L1 including the widgets W1 to W4 is scrolled from right to left as a whole. In addition, in this embodiment, the left-right direction is taken as an example for description as the scroll operation direction.

[0046] In addition, the main layer display control unit 13 performs a process of delaying the scrolling display of the icon part relative to the scrolling display of the panel part in the widget as a scrolling process. For example, when the touch operation detected by the operation detection unit 12 is a scrolling operation, the main layer display control unit 13 outputs a control instruction to the display 1 for causing the icon part in the widget to scroll with a delay relative to the panel part. As a result, the display 1 displays a screen in which the icon part scrolls with a delay relative to the panel part after the scrolling operation is performed. In other words, the display 1 displays an animated screen in which the icon part follows the panel part after the scrolling operation is performed. In addition, the scrolling of the icon part with a delay relative to the panel part at various distances is not particularly limited, and the display control method of the main layer display control unit 13 can use a known display control method known at the time of applying for this application. The scrolling process performed by the main layer display control unit 13 includes a process of delaying the scrolling display of the icon part relative to the scrolling display of the panel part in the widget.

[0047] In addition, the main layer display control unit 13 performs a process of changing the scrolling display speed of the widget according to the operation speed of the scrolling operation as a scrolling process. The scrolling display speed refers to the moving speed of the widget on the screen. For example, the main layer display control unit 13 outputs a control instruction to the display 1 for making the scrolling display speed of the widget faster as the operation speed of the scrolling operation is faster. As a result, the display 1 displays a screen in which the moving speed of the widget on the screen is faster as the operation speed of the scrolling operation is faster. The scrolling process performed by the main layer display control unit 13 includes a process of changing the scrolling display speed of the widget according to the operation speed of the scrolling operation. In addition, the scrolling process performed by the main layer display control unit 13 includes a process of making the scrolling display speed of the widget faster as the operation speed of the scrolling operation is faster. In addition, in the present embodiment, as a scrolling process, the main layer display control unit 13 scrolls the sub-layer in conjunction with the main layer. That is, the main layer display control unit 13 outputs a control instruction to the display 1 for scrolling the sub-layer in the same scrolling direction as the main layer at the same display speed as the scrolling display speed of the main layer.

[0048] In addition, the main layer display control unit 13 performs display control other than scrolling display according to the touch operation on the display 1. For example, when the operation on the display 1 is a tap operation and the tapped object is a specific widget, the main layer display control unit 13 outputs a control instruction for displaying the screen of the application corresponding to the tapped widget to the display 1. In addition, the processing of the tap operation is only an example, and the main layer display control unit 13 can perform display control other than scrolling display that is known at the time of filing this application according to the touch operation on the display 1.

[0049] Return to Figure 1 , explaining the functional blocks of the information processing device 10. When the scrolling process is started by the main layer display control unit 13, the widget display position detection unit 14 detects the display position of the widget on the display 1. The widget display position detection unit 14 determines whether the widget arranged in the main layer has reached the end of the screen display of the display 1 by scrolling through the scrolling process. In the case where the screen display of the display 1 includes a fixed display area in addition to the widget display area as in the present embodiment (see Figure 2 (B)), the widget display position detection unit 14 sets the boundary between the widget display area and the fixed display area as the end of the screen display. In addition, when a scrolling process is performed to delay the scrolling display of the icon part relative to the scrolling display of the panel part in the widget as in the present embodiment, the panel part reaches the end of the screen display before the icon part, so the widget display position detection unit 14 determines whether the panel part in the widget has reached the end of the screen display.

[0050] When it is determined by the widget display position detection unit 14 that the widget on the main layer has reached the end of the screen display of the display 1 by scrolling through the scrolling process, the widget transfer unit 15 performs a transfer process to transfer the widget that has reached the end of the screen display from the main layer to the sub-layer. In this embodiment, the widget transfer unit 15 performs a transfer process to transfer the entire widget including the panel part, the icon part and the shadow part from the main layer to the sub-layer for the widget whose panel part has reached the boundary between the widget display area and the fixed display area. As a transfer process, the widget transfer unit 15 outputs a control instruction for changing the destination of the widget that has reached the end of the screen display from the main layer to the sub-layer to the display 1. In addition, as a transfer process, the widget transfer unit 15 outputs a control instruction to display the widget after the transfer to the sub-layer while maintaining the relationship between the scrolling display of the panel part in the main layer and the scrolling display of the icon part. The transfer process performed by the widget transfer unit 15 includes a process of displaying the widget as a widget configured in the sub-layer on the display 1 by changing the destination of the widget that has reached the end of the screen display from the main layer to the sub-layer. The transition process performed by the widget transition unit 15 includes a process of displaying the widget after transition to the sub-layer on the display while maintaining the relationship between the scroll display of the panel portion and the scroll display of the icon portion in the main layer.

[0051] In addition, as a transfer process, the widget transfer unit 15 configures the widget on the sub-layer in a manner that the widget after being transferred to the sub-layer is displayed at a position that is closer to the inside than the end of the screen display. In the case where the boundary between the widget display area and the fixed display area is set as the end of the screen display as in the present embodiment, the widget transfer unit 15 configures the widget on the sub-layer in a manner that the widget after being transferred to the sub-layer is displayed at a position that is closer to the inside than the boundary between the widget display area and the fixed display area, that is, closer to the side of the widget display area. As a transfer process, the widget transfer unit 15 outputs a control instruction to the display 1 for displaying the widget after being transferred to the sub-layer at a position that is closer to the inside than the end of the screen display. Thus, it is possible to prevent the fixed display area from being superimposed on the widget after being transferred to the sub-layer, and it is possible to display the widget after being transferred to the sub-layer. In addition, the transfer process performed by the widget transfer unit 15 includes a process of displaying the widget after being transferred to the sub-layer at a position that is closer to the inside than the end of the screen display.

[0052] Figure 4 This is a diagram for explaining processing performed by the widget migration unit 15 and the sub-layer display control unit 16 described later. Figure 4 (A) is shown in Figure 3 The screen display shown in (A) is a diagram showing a state in which the panel portion p4 in the widget W4 reaches the boundary between the widget display area WA and the fixed display area PA after a scroll operation from left to right is performed. Figure 4 (B) shows the Figure 4The screen display shown in (A) is a diagram showing a state after the transition process performed by the widget transition unit 15 and the display control process performed by the sub-layer display control unit 16 described later are executed. Figure 4 (C) is a diagram for explaining the migration process performed by the widget migration unit 15 .

[0053] In such Figure 4 When the end of the panel portion p4 in the scrolling direction reaches the boundary between the widget display area WA and the fixed display area PA as shown in (A) of FIG. 1 , the widget transfer unit 15 outputs a message to the display 1 for displaying the widget WA as shown in FIG. Figure 4 As shown in (C) of FIG. 1 , the destination of the widget W4 is changed from the main layer L1 to the sub-layer L2. Figure 4 As shown in (B), the widget W4 is displayed on the display 1 as a widget arranged on the sub-layer L2, that is, a widget located on the rear surface of the main layer L1. In addition, when the icon part i4 scrolls with a delay relative to the panel part p4 in the scroll display of the main layer L1, the widget transfer unit 15 outputs a control instruction to the display 1 to display the widget W4 after the transfer to the sub-layer while maintaining the relationship between the scroll display of the panel part p4 and the scroll display of the icon part i4 in the main layer L1. As a result, Figure 4 As shown in (B), while maintaining Figure 4 In the state of the positional relationship between the panel portion p4 and the icon portion i4 in the main layer L1 shown in (A), the panel portion p4 and the icon portion i4 are displayed on the sub-layer L2. In addition, the widget transfer unit 15 outputs a control instruction to the display 1 to display the widget W4 transferred to the sub-layer at a position inside the boundary between the widget display area WA and the fixed display area PA. Figure 4 As shown in (B) of FIG. 5 , the widget W4 transferred to the sub-layer L2 is displayed inside the widget display area WA.

[0054] The sub-layer display control unit 16 controls the display of the sub-layer in the screen display of the display 1. The sub-layer display control unit 16 performs a transparency change process and a size change process on the widget that has been transferred from the main layer to the sub-layer by the widget transfer unit 15. The transparency change process is a process that changes the transparency (transmittance) of the widget compared to the transparency before the transfer to the sub-layer. The size change process is a process that changes the transparency of the widget compared to the transparency before the transfer to the sub-layer.

[0055] In this embodiment, as a transparency change process, the sub-layer display control unit 16 outputs a control instruction to the display 1 for making the transparency of the widget after it is transferred to the sub-layer higher than the transparency before it is transferred to the sub-layer. In the transparency change process, the absolute value of the transparency of the widget is not particularly limited, and the sub-layer display control unit 16 outputs a control instruction to the display 1 for making the transparency of the widget after it is transferred to the sub-layer relatively higher than the transparency before it is transferred to the sub-layer. Figure 4 As shown in (B), the widget W4 after transferring to the sub-layer L2 is Figure 4 The widget W4 shown in (A) is displayed transparently, so that the widget W4 can be visually shown to have moved to the rear of the screen. As a result, the driver or passenger in the front passenger seat can easily understand the front-to-back relationship with the widgets W1 to W3 on the main layer L1.

[0056] In addition, in this embodiment, as a size change process, the sub-layer display control unit 16 outputs a control instruction to the display 1 for making the size of the widget after it is transferred to the sub-layer smaller than the size before it is transferred to the sub-layer. In the size change process, the absolute value of the size of the widget is not particularly limited, and the sub-layer display control unit 16 outputs a control instruction to the display 1 for making the size of the widget after it is transferred to the sub-layer relatively smaller than the size before it is transferred to the sub-layer. Figure 4 As shown in (B), the widget W4 after transferring to the sub-layer L2 is Figure 4 The widget W4 shown in (A) is displayed in a small manner, so that the widget W4 can be visually expressed as being moved to the rear of the screen. As a result, the driver or passenger in the front passenger seat can easily understand the front-to-back relationship with the widgets W1 to W3 on the main layer L1.

[0057] In addition, when multiple widgets are transferred to the sub-layer, the sub-layer display control unit 16 performs a transparency change process and a size change process on each widget after the transfer to the sub-layer in accordance with the order of transfer to the sub-layer. The sub-layer display control unit 16 controls the transparency of each widget after the transfer to the sub-layer in a manner that the transparency is from high to low in the order of transfer to the sub-layer. In other words, the sub-layer display control unit 16 performs a process that makes the transparency of the widget higher for the widget that is transferred to the sub-layer earlier. As a result, the widget that arrives at the end of the screen display earlier in the panel unit is displayed in a more transparent manner on the sub-layer. In addition, the sub-layer display control unit 16 controls the size of each widget after the transfer to the sub-layer in a manner that the size is from small to large in the order of transfer to the sub-layer. In other words, the sub-layer display control unit 16 performs a process that makes the size of the widget smaller for the widget that is transferred to the sub-layer earlier in the order of transfer to the sub-layer. As a result, the widget that arrives at the end of the screen display earlier in the panel unit is displayed in a smaller manner on the sub-layer. In addition, the sub-layer display control unit 16 controls the configuration of each widget on the sub-layer in such a manner that the widgets are located from the depth of the screen (the forward direction of the vehicle) to the front of the screen (the backward direction of the vehicle) in the order in which they are transferred to the sub-layer. In other words, the sub-layer display control unit 16 performs image processing so that the earlier the widgets are transferred to the sub-layer, the deeper the position appears on the sub-layer. As a result, the earlier the panel reaches the end of the screen display, the deeper the position is displayed on the sub-layer. A specific example of a situation in which multiple widgets are transferred to a sub-layer will be described later.

[0058] Next, use Figure 5 The information processing method executed by the controller 11 will be described. Figure 5 This is an example of a flowchart showing the procedure of information processing according to the present embodiment. Figure 5 Each process in the flowchart is executed by the controller 11.

[0059] In step S1, the controller 11 obtains information related to the main screen from the storage device 2, and outputs a control instruction for displaying the main screen to the display 1. The display 1 displays the main screen based on the control instruction (including image data) input from the controller 11. Figure 2 As in the example of (B) of FIG. 1 , the widget display area WA for displaying the widgets W1 to W4 and the fixed display area PA provided around the widget display area WA are formed. The controller 11 outputs a control instruction to the display 1 to display the fixed display area PA at the upper and lower ends and the left and right ends of the screen display D. The widgets W1 to W4 are as shown in FIG. Figure 3 As in the example of (A), it is arranged on the main layer L1.

[0060] In step S2, the controller 11 detects a touch operation on the screen display of the display 1. The controller 11 determines the type of the touch operation based on the information input from the display 1. In step S3, the controller 11 determines whether the operation on the screen display is a scroll operation based on the processing result in step S2. If the controller 11 makes an affirmative determination, the process proceeds to step S4, and if the controller 11 makes a negative determination, the process proceeds to step S13.

[0061] If a negative determination is made in step S3, the process proceeds to step S13. In step S13, the controller 11 performs display control of the display according to the operation on the screen display based on the processing result in step S2. For example, if the operation on the display 1 is a tapping operation and the tapped object is a widget, the controller 11 outputs a control instruction for displaying the screen of the application corresponding to the tapped widget to the display 1. When the processing in step S13 is completed, the controller 11 causes the display 1 to Figure 3 The processing in the illustrated flowchart ends.

[0062] On the other hand, if a positive determination is made in step S3, the process proceeds to step S4. In step S4, the controller 11 performs a scrolling process for scrolling the main layer in the screen display based on the processing result in step S2. For example, the controller 11 determines the scrolling direction based on the scrolling operation direction in the scrolling operation. In addition, for example, the controller 11 determines the scrolling operation speed based on the operation speed in the scrolling operation. As a scrolling process, the controller 11 outputs a control instruction to the display 1 for scrolling the main layer in a direction corresponding to the scrolling operation direction. In addition, the controller 11 outputs a control instruction to the display 1 for making the scrolling display speed of the widget faster the faster the operation speed of the scrolling operation. In addition, as a scrolling process, the controller 11 outputs a control instruction to the display 1 for scrolling the icon portion with a delay compared to the panel portion. Through the processing in step S4, the display 1 displays a screen in which the main layer including the widget is scrolled as a whole in the scrolling direction.

[0063] In step S5, the controller 11 determines whether the widget configured in the main layer has reached the end of the screen display of the display by scrolling through the scrolling process in step S4. In this embodiment, the controller 11 determines whether the panel unit has reached the boundary between the widget display area (main layer) and the fixed display area. If the controller 11 makes an affirmative determination, the process proceeds to step S6. If the controller 11 makes a negative determination, the process waits in step S5 until an affirmative determination is made.

[0064] In step S6, the controller 11 performs a transfer process to transfer the widget determined in step S5 to have reached the end of the screen display from the main layer to the sub-layer. As a transfer process, the controller 11 outputs a control instruction to the display 1 for changing the destination of the widget that has reached the end of the screen display from the main layer to the sub-layer. In addition, as a transfer process, the controller 11 outputs a control instruction to the display 1 for displaying the widget after the transfer to the sub-layer while maintaining the relationship between the scrolling display of the panel portion and the scrolling display of the icon portion in the main layer. In addition, as a transfer process, the controller 11 outputs a control instruction to the display 1 for displaying the widget after the transfer to the sub-layer at a position inside the end of the screen display.

[0065] In step S7, the controller 11 determines whether a widget is configured in the sub-layer before step S6. For example, before executing the transfer process in step S6, the controller 11 determines whether there is a widget belonging to the sub-layer. In the case where the controller 11 determines that there is no widget belonging to the sub-layer, that is, the transfer process in step S6 is Figure 5 In the case of the first transfer process in the flowchart shown in FIG. 1 , the process proceeds to step S8. On the other hand, if the controller 11 determines that there are one or more widgets belonging to the sub-layer, that is, the transfer process in step S6 is Figure 5 In the case of the second and subsequent transfer processing in the flowchart shown, the process proceeds to step S11.

[0066] If a negative determination is made in step S7, the process proceeds to step S8. In step S8, the controller 11 performs a transparency change process on the widget that has been transferred from the main layer to the sub-layer by the process in step S6, in which the transparency of the widget is changed compared to the transparency before the transfer to the sub-layer. As the transparency change process, the controller 11 outputs a control instruction to the display 1 for making the transparency of the widget after the transfer to the sub-layer higher than the transparency before the transfer to the sub-layer.

[0067] In step S9, the controller 11 performs a size change process on the widget transferred from the main layer to the sub-layer by the process in step S6 so that the size of the widget is changed compared to the size before the transfer to the sub-layer. As the size change process, the controller 11 outputs a control instruction to the display 1 for making the size of the widget after the transfer to the sub-layer smaller than the size before the transfer to the sub-layer.

[0068] In step S10, the controller 11 determines whether the scrolling display of the main layer is completed through the scrolling process in step S4. For example, the controller 11 determines whether the end of the main layer located in the direction opposite to the scrolling direction has reached the end of the screen display. When the end of the main layer has reached the end of the screen display, the controller 11 determines that the scrolling display of the main layer is completed. On the other hand, when the end of the main layer has not reached the end of the screen display, the controller 11 determines that the scrolling display of the main layer is not completed. In addition, for example, the controller 11 may also determine whether there are widgets belonging to the main layer. In this case, when there are no widgets belonging to the main layer, the controller 11 determines that the scrolling display of the main layer is completed. On the other hand, when at least one widget belongs to the main layer, the controller 11 determines that the scrolling display of the main layer is not completed. In the case of an affirmative determination by the controller 11, the controller 11 makes Figure 5 The processing in the flowchart shown ends. On the other hand, if a negative determination is made by the controller 11, the process returns to step S5, and the processing of steps S5 to S12 is repeatedly executed until an affirmative determination is made in step S10.

[0069] In the event of an affirmative determination in step S7, the process proceeds to step S11. In step S11, the controller 11 performs a transparency change process on the widget that has been transferred from the main layer to the sub-layer by the process in step S6, in which the transparency of the widget is changed compared to the transparency before the transfer to the sub-layer. The transparency change process performed by the controller 11 corresponds to the process in step S8. In addition, in step S11, the controller 11 performs a transparency change process different from the process in step S8. The controller 11 performs a transparency change process on the widget that was configured in the sub-layer before step S6, in which the transparency of the widget is changed compared to the transparency before the process in step S6 is performed. As a transparency change process, the controller 11 outputs a control instruction to the display 1 for making the transparency of the widget that was configured in the sub-layer before step S6 higher than the transparency before the process in step S6 is performed.

[0070] In step S12, the controller 11 performs a size change process on the widget that has been transferred from the main layer to the sub-layer by the process in step S6, so that the size of the widget is changed compared to the size before the transfer to the sub-layer. The size change process performed by the controller 11 corresponds to the process in step S9. In addition, in step S12, the controller 11 performs a size change process different from the process in step S9. The controller 11 performs a size change process on the widget that was configured in the sub-layer before step S6, so that the size of the widget is changed compared to the size before the process in step S6 is performed. As a size change process, the controller 11 outputs a control instruction to the display 1 for making the size of the widget that was configured in the sub-layer before step S6 smaller than the size before the process in step S6 is performed.

[0071] When the process in step S12 is completed, the process proceeds to step S10 , and as described above, the controller 11 determines whether the scroll display of the main layer has been completed by the scroll process in step S4 .

[0072] Next, a comparative example is given to illustrate problems that may be caused by scrolling display. The information processing device involved in the comparative example is different from the information processing device 10 involved in the present embodiment, and does not have functions equivalent to the widget display position detection unit 14, the widget transfer unit 15, and the sub-layer display control unit 16, but is assumed to have the same functions as the information processing device 10 involved in the present embodiment for other functions.

[0073] Figure 6 It is a diagram showing a state in which a screen is transitioned by the information processing device according to the comparative example when a scroll operation is performed.

[0074] (Comparative Example) Scrolling the screen display (scrolling from left to right)

[0075] From the state where the main screen including the widgets W1 to W4 is displayed on the display 1 ( Figure 6 (A)), the driver or the passenger in the front passenger seat scrolls the screen display while viewing from the front. Figure 6 In the case of (A), the finger is moved from left to right on the screen (scrolling operation). The information processing device involved in the comparative example determines that the type of touch operation on the screen display is a scrolling operation, and detects the scrolling direction and operation speed in the scrolling operation. The information processing device involved in the comparative example outputs a control instruction to the display 1 for scrolling the icon portion in the widget from left to right with a delay relative to the panel portion. When a predetermined time has passed since the main layer L1 was scrolled from left to right, the panel portion p4 of the widget W4 reaches the boundary between the widget display area WA and the fixed display area PA ( Figure 6Here, the information processing device involved in the comparative example is different from the present embodiment in that it does not perform any processing on the widget W4 that has reached the end of the screen display. Therefore, the display 1 displays a screen as if the panel p portion 4 of the widget W4 is missing from the end of the screen display ( Figure 6 (C)). When the predetermined time further passes, the display 1 displays a screen in which the widgets W4, W3, and W2 are missing from the end of the screen display in this order ( Figure 6 (D)). If the widget is displayed as if it is gradually missing from the end of the screen display after the scrolling operation, there is a problem that the display of the widget gives the driver or the passenger in the front passenger seat an unnatural feeling.

[0076] Figure 7 The diagram shows how the screen is transitioned by the information processing device 10 according to the present embodiment when a scroll operation is performed. Figure 8 Yes means Figure 7 A subsequent diagram of the screen transition shown. Fig. 9 It is a diagram for explaining the processing of the information processing device 10 according to the present embodiment.

[0077] (Present Embodiment) Scrolling the Screen Display (Scrolling from Left to Right)

[0078] In a state where the main screen including the widgets W1 to W4 is displayed on the display 1 ( Figure 7 (A)), such as Fig. 9 As shown in (A), the widgets W1 to W4 belong to the main layer L1. From this state, the driver or the passenger in the front passenger seat scrolls the screen display. Figure 7 In the case of (A), the finger is moved from left to right on the screen (scrolling operation). The information processing device 10 determines that the type of touch operation on the screen display is a scrolling operation, and detects the scrolling direction and operation speed in the scrolling operation. The information processing device 10 outputs a control instruction to the display 1 for scrolling the icon portion of the widget from left to right with a delay relative to the panel portion. The display 1 displays a screen in which the icon portion scrolls from left to right with a delay relative to the panel portion ( Figure 7 (B)).

[0079] When a predetermined time has passed since the main layer L1 was scrolled from left to right, the panel portion p4 of the widget W4 reaches the boundary between the widget display area WA and the fixed display area ( Figure 7 Here, the information processing device 10 outputs to the display 1 a signal for Fig. 9The information processing device 10 outputs a control instruction to change the destination of the widget W4 from the main layer L1 to the sub-layer L2 as shown in (B). In addition, the information processing device 10 outputs a control instruction to the display 1 to display the widget W4 after it is transferred to the sub-layer L2 while maintaining the relationship between the scrolling display of the panel portion p4 and the scrolling display of the icon portion i4 in the main layer L1. In addition, the information processing device 10 outputs a control instruction to the display 1 to make the transparency of the widget W4 after it is transferred to the sub-layer L2 higher than the transparency before it is transferred to the sub-layer L2. In addition, the information processing device 10 outputs a control instruction to the display 1 to make the size of the widget W4 after it is transferred to the sub-layer L2 smaller than the size before it is transferred to the sub-layer L2. In addition, the information processing device 10 outputs a control instruction to the display 1 to display the widget W4 after it is transferred to the sub-layer L2 at a position inside of the end of the screen display. As a result, the display 1 displays the image with a relative width. Figure 7 The widget W4 shown in (C) is displayed in a transparent and small manner and is located at a deep side on the screen ( Figure 7 (D)).

[0080] from Figure 7 After a specified time ( Figure 7 (E)), the panel portion p3 in the widget W3 reaches the boundary between the widget display area WA and the fixed display area PA ( Figure 7 Here, the information processing device 10 outputs to the display 1 a message for making the destination of the widget W3 as Fig. 9 In addition, the information processing device 10 outputs a control instruction to display the widget W3 after the transfer to the sub-layer L2 while maintaining the relationship between the scroll display of the panel part p3 in the main layer L1 and the scroll display of the icon part i3 to the display 1.

[0081] In addition, the information processing device 10 outputs to the display 1 a control instruction for making the transparency of the widget W4 higher than the transparency of the widget W3 before it was transferred to the sub-layer L2. In addition, the information processing device 10 outputs to the display 1 a control instruction for making the transparency of the widget W3 after it was transferred to the sub-layer L2 higher than the transparency before it was transferred to the sub-layer L2 and lower than the transparency of the widget W4. As a result, the widget W4 on the sub-layer L2 is displayed in a more transparent manner than the widget W3 before it was transferred to the sub-layer L2 ( Figure 7 (G)). In addition, the widget W3 on the sub-layer L2 is displayed in a more transparent manner than before the transfer to the sub-layer L2. The transparency of the widget W4 is higher than that of the widget W3, and the widget W4 is displayed in a more transparent manner than the widget W3 ( Figure 7 (G)).

[0082] In addition, the information processing device 10 outputs a control instruction to the display 1 for making the size of the widget W4 smaller than the size of the widget W3 before it was transferred to the sub-layer L2. In addition, the information processing device 10 outputs a control instruction to the display 1 for making the size of the widget W3 after it was transferred to the sub-layer L2 smaller than the size before it was transferred to the sub-layer and larger than the size of the widget W4. As a result, the widget W4 on the sub-layer L2 is displayed in a smaller size than the size of the widget W3 before it was transferred to the sub-layer L2 ( Figure 7 (G)). In addition, the widget W3 on the sub-layer L2 is displayed in a smaller size than before the transfer to the sub-layer L2. The size of the widget W4 is smaller than the size of the widget W3, and the widget W4 is displayed in a smaller size than the widget W3 ( Figure 7 (G)).

[0083] In addition, the information processing device 10 outputs a control instruction for adjusting the arrangement of the widgets W3 and W4 on the sub-layer L2 to the display 1 as a visual control instruction such as displaying the widgets W4 and W3 in the order from the depth of the screen to the front of the screen. As a result, the sub-layer L2 displays the widget W4 as being located at a position deeper in the screen than the widget W3 ( Figure 7 (G)).

[0084] By controlling the transparency, size, and placement of widgets on the sub-layer, the earlier the widgets are transferred to the sub-layer, the more transparent and smaller they are displayed on the sub-layer, and the closer they are to the back side of the screen. As a result, the driver or passenger in the front passenger seat can see a visual effect that the widgets that have scrolled to the end of the screen are fading out in order to the back side of the screen.

[0085] for Figure 7 (H), Figure 8 (A)~ Figure 8 The screen transition shown in (D) is omitted in detail, but every time the panel portion of the widget reaches the boundary between the widget display area and the fixed display area, the information processing device 10 repeatedly executes the change process of the destination of the widget, and the transparency change process and size change process of the widget after it is transferred to the sub-layer. Figure 7 (E)~ Figure 7 (H), Figure 8 (A)~ Figure 8 The screens shown in the drawings are displayed in the order of (D). Figure 6 (C) and Figure 6 Unlike (D), the widget that reaches the end of the screen display after the scrolling operation continues to be displayed on the back side of the screen until the main layer is scrolled to the end (see Figure 8(D)), thus making it possible to suppress the unnatural feeling of the driver or passenger in the front passenger seat regarding the display of the widget.

[0086] As described above, in the present embodiment, the screen display of the display 1 includes a main layer located on the front surface and a sub-layer located on the rear surface of the main layer. The controller 11 detects an operation on the screen display. When the operation on the screen display is a scrolling operation, the controller 11 performs a scrolling process to scroll the main layer. When the widget configured on the main layer is scrolled through the scrolling process and reaches the end of the screen display, the controller 11 performs a transfer process to transfer the widget that has reached the end from the main layer to the sub-layer. When a widget on the main layer reaches the end of the screen display, the widget that has reached the end can be displayed on the sub-layer on the rear surface of the main layer. Therefore, even if the main layer is scrolled, it is possible to prevent the widget from being displayed as missing at the end of the screen display. As a result, the user's sense of unnaturalness regarding the display of the widget can be suppressed in a scene where the screen display is scrolling.

[0087] In addition, in the present embodiment, the controller 11 performs a transparency change process to make the transparency of the widget after it is transferred to the sub-layer higher than the transparency before it is transferred to the sub-layer. As a result, the widget after it is transferred to the sub-layer is displayed in a more transparent manner than before it is transferred to the sub-layer, so that it can be visually expressed that the widget has moved to the back of the screen. As a result, the driver or the passenger in the front passenger seat can easily understand the front-to-back relationship with the widget on the main layer.

[0088] In addition, in the present embodiment, the controller 11 performs a size change process to change the size of the widget after the transfer to the sub-layer compared to the size before the transfer to the sub-layer. As a result, the widget after the transfer to the sub-layer is more transparent than before the transfer to the sub-layer and the size is changed, so that it can be visually represented that the widget has moved from the main layer located on the front surface.

[0089] In addition, in this embodiment, the size change process includes a process of making the size of the widget after being transferred to the sub-layer smaller than the size before being transferred to the sub-layer. As a result, the widget after being transferred to the sub-layer is displayed in a smaller manner than before being transferred to the sub-layer, so that the widget can be visually expressed as being moved to the back of the screen. As a result, the driver or the passenger in the front passenger seat can easily understand the front-to-back relationship with the widget on the main layer.

[0090] In addition, in this embodiment, the screen display of the display 1 includes a fixed display area not related to the scrolling operation in addition to the widget display area for displaying the widget. The display 1 is shaped to be long in the left-right direction relative to the up-down direction. The controller 11 displays the fixed display area PA at the upper and lower ends and the left and right ends of the screen display. Thus, it is possible to realize the following Figure 2 The screen display is as shown in the example of (B).

[0091] In addition, in this embodiment, the controller 11 sets the boundary between the widget display area and the fixed display area as the end of the screen display, and the controller 11 arranges the widgets on the sub-layer in such a way that the widgets transferred to the sub-layer are displayed at a position inside the end of the screen display. Thus, it is possible to prevent the fixed display area from being superimposed on the widgets transferred to the sub-layer, and to display the widgets on the sub-layer. As a result, it is possible to suppress the user's unnatural feeling about the display of the widgets in the scene where the screen display is scrolling.

[0092] In addition, in the present embodiment, the transfer process includes the following process: by changing the destination of the object that has reached the end of the screen display from the main layer to the sub-layer, the object is displayed as a widget arranged in the sub-layer on the display 1. The transfer from the main layer to the sub-layer can be achieved by the relatively simple process of changing the destination of the widget, so the calculation load can be reduced.

[0093] In addition, in the present embodiment, the object operated by the driver or the passenger in the front passenger seat is a widget of the application software, and the widget includes a panel portion for displaying information related to the application software. When the panel portion in the widget is scrolled by the scrolling process and reaches the end of the screen display, the controller 11 performs a transfer process from the main layer to the sub-layer on the widget including the panel portion that has reached the end.

[0094] In addition, in this embodiment, the widget includes not only the panel portion but also the icon portion of the application software and the shadow portion indicating the boundary between the panel portion and the icon portion. Even an object composed of multiple elements like a widget can be transferred to a sub-layer.

[0095] In the present embodiment, the scrolling process includes a process of delaying the scrolling display of the icon portion relative to the scrolling display of the panel portion. This can provide the driver or the passenger in the front passenger seat with a visual effect that the screen display is scrolling.

[0096] In addition, in the present embodiment, the transfer process includes the following process: while maintaining the relationship between the scroll display of the panel part and the scroll display of the icon part in the main layer, the widget after transfer to the sub-layer is displayed on the display 1. Thus, the positional relationship between the panel part and the icon part is maintained before and after the transfer of the sub-layer, so it is possible to suppress the situation where the driver or the passenger in the front passenger seat feels unnatural about the display of the widget due to the transfer to the sub-layer.

[0097] In addition, in this embodiment, the process of detecting a touch operation on the screen display includes the process of detecting the operation speed of the scrolling operation, and the scrolling process includes the process of changing the scrolling display speed of the widget according to the operation speed of the scrolling operation. Thus, the screen display can be scrolled at a speed corresponding to the operation speed of the scrolling operation.

[0098] In addition, the embodiments described above are described to facilitate understanding of the present invention, and are not described to limit the present invention. Therefore, the elements disclosed in the above embodiments are intended to include all design changes and equivalents belonging to the technical scope of the present invention.

[0099] For example, in the above-mentioned embodiment, the information processing method and information processing device involved in this embodiment are described, but a program for causing a computer to function as the information processing device 10 involved in this embodiment also has the same effect as the above-mentioned embodiment.

[0100] In addition, for example, in the above-mentioned embodiment, the information presentation device 100 is cited as an example for description, but it is not limited to this. The information processing method, information processing device, and program involved in the present invention can be applied to a device with a touch panel display. The information processing method, information processing device, and program involved in the present invention can also be applied to a portable terminal such as a smartphone, a tablet terminal, a notebook personal computer, a display that can be connected to a personal computer, a television, etc.

[0101] In addition, for example, in the above-mentioned embodiment, as the object operated by the driver or the passenger in the front passenger seat, a widget is cited as an example for description, but the information processing method, information processing device and program involved in the present invention can also be applied to objects other than widgets. In addition, for example, in the above-mentioned embodiment, a widget including a panel portion, an icon portion and a shadow portion is cited as an example for description, but the widget may also be a structure including at least one of a panel portion, an icon portion and a shadow portion. In addition, for example, in the above-mentioned embodiment, as the scrolling direction of the scrolling operation, the left and right directions are cited as an example for description, but the scrolling direction may also be the up and down direction. In addition, for example, in the above-mentioned embodiment, a display 1 having a shape that is long in the left and right directions relative to the up and down directions is cited as an example for description, but the display 1 may also be a shape that is long in the up and down directions relative to the left and right directions. In addition, for example, in the above-mentioned embodiment, a display 1 having a rectangular shape is cited as an example for description, but the display 1 may also be a shape other than a rectangle. In addition, for example, in the above-mentioned embodiment, the screen display in which the fixed display area is set around the widget display area is described as an example, but in the case of a display that is long in the up and down direction relative to the left and right directions, the fixed display area can also be a structure displayed at the left end and the right end of the screen display, or at one of the left end and the right end.

[0102] Description of Reference Numerals

[0103] 1: display; 2: storage device; 10: information processing device; 11: controller; 12: operation detection unit; 13: main layer display control unit; 14: widget display position detection unit; 15: widget transfer unit; 16: sub-layer display control unit; 100: information presentation device.

Claims

1. An information processing method, wherein a controller controls a screen display of a touch panel display, in which: The screen display includes a first layer located on the front surface and a second layer located on the rear surface relative to the first layer. The controller performs the following processing: Detecting an operation on the screen display; When the operation is a scrolling operation, performing a scrolling process of scrolling the first layer; and When the object arranged in the first layer is scrolled by the scroll processing and reaches an end of the screen display, a transition processing is performed to transition the object that has reached the end from the first layer to the second layer.

2. The information processing method according to claim 1, wherein: The controller performs a transparency change process in which the transparency of the object after being transferred to the second layer is made higher than the transparency before being transferred to the second layer.

3. The information processing method according to claim 1 or 2, wherein: The controller executes a size change process in which a size of the object after being transferred to the second layer is changed compared to the size before being transferred to the second layer.

4. The information processing method according to claim 3, wherein: The size change process includes a process of making the size of the object after being transferred to the second layer smaller than the size before being transferred to the second layer.

5. The information processing method according to any one of claims 1 to 4, wherein: The screen display further includes a fixed display area unrelated to the scrolling operation in addition to the display area of ​​the object, The display is in a shape that is longer in the left-right direction than in the up-down direction. The controller causes the fixed display area to be displayed at a left end portion and a right end portion of the screen display, or at one of the left end portion and the right end portion.

6. The information processing method according to claim 5, wherein: The controller performs the following processing: setting a boundary between an area for displaying the object and the fixed display area as the end of the screen display; and The object is arranged on the second layer so that the object after being transferred to the second layer is displayed at a position inside the boundary.

7. The information processing method according to any one of claims 1 to 6, wherein: The transition process includes a process of displaying the object arranged in the second layer on the display by changing the belonging destination of the object that has reached the end from the first layer to the second layer.

8. The information processing method according to any one of claims 1 to 7, wherein: The object is a widget of application software, and the widget includes a panel portion for displaying information related to the application software. When the panel unit scrolls through the scrolling process and reaches the end of the screen display, the controller executes the transition process on the widget including the panel unit that has reached the end.

9. The information processing method according to claim 8, wherein: The widget includes, in addition to the panel portion, at least one of an icon portion of the application software and a shadow portion that displays a shadow at a boundary between the panel portion and the icon portion.

10. The information processing method according to any one of claims 1 to 9, wherein: The object is a widget of application software, and the widget includes a panel portion for displaying information related to the application software and an icon portion of the application software. The scroll processing includes a process of delaying scroll display of the icon section relative to scroll display of the panel section.

11. The information processing method according to claim 10, wherein: The transition process includes a process of displaying the widget after transition to the second layer on the display while maintaining the relationship between the scroll display of the panel portion and the scroll display of the icon portion in the first layer.

12. The information processing method according to claim 10 or 11, wherein: The process of detecting the operation on the screen display includes a process of detecting the operation speed of the scroll operation, The scrolling process includes a process of changing a scrolling display speed of the widget according to the operation speed.

13. An information processing device, wherein: A controller is provided, wherein the controller controls the screen display of the touch panel display. The screen display includes a first layer located on the front surface and a second layer located on the rear surface relative to the first layer. The controller performs the following processing: Detecting an operation on the screen display; When the operation is a scrolling operation, performing a scrolling process for scrolling the first layer; as well as When the object arranged in the first layer is scrolled by the scroll processing and reaches an end of the screen display, a transition processing is performed to transition the object that has reached the end from the first layer to the second layer.

14. A program for causing a computer to function as the information processing device according to claim 13.

Images