Information processing method, information processing device, and program

Abstract

An information processing device (10) comprises a controller (11) that controls a screen display of a touch panel-type display (1). The screen display includes a first layer (L1) located at the front and a second layer (L2) located rearward of the first layer (L1). The controller (11): detects an operation with respect to the screen display; executes scroll processing to scroll the first layer (L1) in a case where the operation with respect to the screen display is a scroll operation; and in a case where objects (W1-W4) disposed in the first layer (L1) are scrolled by the scroll processing and reach an edge portion of the screen display, executes transfer processing to transfer the objects (W1-W4), which have reached the edge portion, from the first layer (L1) to the second layer (L2).

Description

[Technical Field]

[0001] The present invention relates to an information processing method, an information processing device, and a program for controlling the screen display of a touch panel display. [Background technology]

[0002] A display method for a display device that displays objects in a variety of ways depending on the scrolling speed is known (Patent Document 1). This display method includes the steps of displaying at least one object on a screen, receiving a user input that receives a direction for scrolling the at least one object, and changing the size of a displayed area of ​​the at least one object on the screen depending on the scrolling speed corresponding to the received user input, and scrolling the at least one object depending on the scrolling method. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-194773 Summary of the Invention [Problem to be solved by the invention]

[0004] The display method described in Patent Document 1 has the problem that when an object scrolls and reaches the edge of the screen, it is displayed as if it is being cut off at the edge of the screen, which causes the user to feel uncomfortable with the display of the object.

[0005] The problem to be solved by the present invention is to provide an information processing method, an information processing device, and a program that suppress a sense of discomfort felt by a user with respect to the display of an object when the screen display is scrolled. [Means for solving the problem]

[0006] The present invention detects an operation on a screen display including a first layer located in the front and a second layer located behind the first layer, and if the operation on the screen display is a scroll operation, executes a scroll process to scroll the first layer, and scrolls an object arranged on the first layer by the scroll process. Object Display Area When the end of Object Display Area The above problem is solved by executing a transition process that transitions an object that has reached the end of the first layer to the second layer. [Effects of the Invention]

[0007] According to the present invention, it is possible to suppress the sense of discomfort felt by the user with respect to the display of objects when the screen display is scrolling. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a schematic diagram illustrating the configuration of an information presentation device according to an embodiment of the present invention. [Figure 2] 1 is a diagram illustrating an information presentation device and a display according to an embodiment of the present invention. [Figure 3] FIG. 2 is a diagram illustrating a main layer and a sub layer. [Figure 4] 10A and 10B are diagrams for explaining processing by a widget transition unit and a sub-layer display control unit. [Figure 5] 10 is a flowchart illustrating an example of an information processing procedure according to the present embodiment. [Figure 6] 10A and 10B are diagrams illustrating screen transitions in an information processing device according to a comparative example when a scroll operation is performed. [Figure 7] 10A to 10C are diagrams illustrating how a screen transition occurs in the information processing device according to the present embodiment when a scroll operation is performed. [Figure 8] FIG. 8 is a diagram showing a continuation of the screen transition shown in FIG. 7. [Figure 9] FIG. 2 is a diagram illustrating a process of the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an information processing method, an information processing device, and a program according to embodiments of the present invention will be described with reference to the accompanying drawings.

[0010] 1 is a schematic diagram of the configuration of an information presentation device 100 according to this embodiment. The information presentation device 100 is installed in the interior of a vehicle and presents various pieces of information to the occupants. The information presentation device 100 presents to the occupants, for example, an operation screen for operating in-vehicle devices such as a navigation device, audio equipment, and air conditioning device, and an operation screen of the in-vehicle devices operating in response to the occupants' operations (such as map information for providing route guidance for the vehicle).

[0011] As shown in FIG. 1, the information presentation device 100 includes a display 1, a storage device 2, and an information processing device .

[0012] The display 1 is a touch panel type display mounted on a vehicle. The touch panel type display 1 is equipped with a pressure sensor, and detects the pressure applied to the display 1 during a touch operation from a resistance value, a voltage, or the like. The mechanism of the pressure sensor is not particularly limited, and any pressure sensor mechanism known at the time of filing may be used as appropriate. The touch panel is not limited to a pressure sensitive type, and other types such as an electrostatic type may also be used. The type of the display 1 is not particularly limited as long as it is a touch panel type display 1. The display 1 may be a liquid crystal display or an organic electroluminescence (OEL) display.

[0013] For example, the display 1 is disposed on the dashboard between the driver's seat and the passenger seat, and is disposed in front of the driver's seat and the passenger seat (hereinafter referred to as the passenger seat occupant) so that the display 1 can be reached by both the driver seat and the passenger seat.

[0014] FIG. 2 is a diagram illustrating an information presentation device 100 and a display 1 according to this embodiment. FIG. 2(A) is a diagram showing the interior of a vehicle, and is an example of the information presentation device 100 and the display 1. As shown in FIG. 2(A), for example, the display 1 is provided on the left side of the steering wheel when FIG. 2(A) is viewed from the front. In this embodiment, the display 1 is a display that is elongated in the left-right direction relative to the up-down direction. The driver and passenger in the front seat input operation details for the information presentation device 100 to the display 1 by performing a touch operation on the display 1. A touch operation is an operation of touching an object displayed on the display 1 with a finger or the like.

[0015] 2(B) is an enlarged view of the display 1 shown in FIG. 2(A) and is a diagram for explaining a widget that is an object to be operated by the occupant. In this embodiment, a widget is used as an example of an object to be operated by the occupant. A widget is a shortcut to application software that is displayed on the home screen.

[0016] Using the example of FIG. 2(B), the screen display D of the display 1 includes a widget display area WA and a fixed display area PA (permanent area) surrounding the widget display area WA. The widget display area WA and the fixed display area PA are adjacent to each other. The screen display D is an area on the display 1 that can be operated by the driver or passenger. The widget display area WA is an area in which widgets W1 to W4 are displayed. In the widget display area WA, widgets W1 to W4 are scrolled left or right when viewed from the front of FIG. 2(B) in accordance with the scrolling operation of the main layer, which will be described later. The fixed display area PA is an area in which specific information is displayed regardless of the scrolling operation of the screen display D. In other words, the fixed display area PA continues to display specific information regardless of the scrolling of widgets W1 to W4 in the widget display area WA. For example, the fixed display area PA may display the temperature setting of the driver's air conditioning unit, the temperature setting of the passenger's air conditioning unit, the current time, and icons representing application software other than widgets. In the following description, "application software" may be abbreviated as "application" or "app," but these terms are synonymous.

[0017] In the example of Fig. 2(B), widgets W1 to W4 are displayed in a row from left to right in the widget display area WA when viewed from the front of Fig. 2(B). The widgets include an icon portion that clearly represents the application, a panel portion that displays information about the application software, and a shadow portion (not shown) that displays shadows on the borders of the icon portion and the panel portion. The panel portion is wider than the icon portion, and the icon portion is displayed superimposed on the right side of the center line of the panel portion.

[0018] In the example of FIG. 2(B), widget W1 includes a panel portion p1, an icon portion i1 superimposed on the panel portion p1, and a shadow portion s1. Although not shown in FIG. 2(B), shadow portion s1 is provided at the boundary between icon portion i1 and panel portion p1. Shadow portion is a type of visual effect that makes it easier to distinguish between the boundary between the icon portion and the panel portion. A description of widgets W2 to W4 will be omitted, and the description of widget W1 will be used instead. Note that the target applications for widgets are not particularly limited, and examples include a calling app, a search app, a weather forecast app, a map app, and a music app.

[0019] Returning to FIG. 1 , touch operations by the driver or front passenger will be described. Touch operations include tapping (touching the screen once), double tapping (touching the screen twice), long tapping (pressing and holding the screen), swiping (sliding a finger that has touched the screen across the screen (tracing the finger)), flicking (moving a finger that has touched the screen across the screen in a quick, flicking motion), pinching in / out (touching the screen with two fingers and moving the two fingers closer / farther apart), dragging (pressing and holding an item on the screen with a finger and then sliding the finger), dropping (pressing and holding an item with a finger by dragging it and then releasing the finger from the screen), scrolling (moving a finger up / down or left / right on the screen without releasing the finger from the screen), and the like. Note that touch operations do not necessarily have to be performed by directly touching the screen display of the display 1; they may be performed by hovering a finger or the like close to the screen display. Note that the touch operation method is not limited to these and may be performed in other ways.

[0020] When the driver or front passenger touches the display 1, the display 1 detects the touched position on the screen and outputs information about the detected position to the information processing device 10. The display 1 also outputs the detection result of the pressure sensor along with the touched position to the information processing device 10. Meanwhile, a control command for displaying image data is input to the display 1 from the information processing device 10. The display 1 displays one or more screens based on the image data.

[0021] The storage device 2 is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage device 2 stores various data related to the information presentation device 100. For example, the storage device 2 stores image data of the icon portion, image data of the panel portion, image data of the shadow portion, and the like as information related to widgets. The storage device 2 also outputs the stored data to the information processing device 10 in response to a control command from the information processing device 10. The storage device 2 also deletes data, updates existing data, stores new data, and the like in response to a control command from the information processing device 10.

[0022] The information processing device 10 is configured by a computer equipped with hardware and software, specifically, by a ROM (Read Only Memory) storing a program, a CPU (Central Processing Unit) that executes the program stored in the ROM, and a RAM (Random Access Memory) that functions as an accessible storage device. Note that, as an operating circuit, an MPU (Micro Processing Unit), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc. can be used instead of or in addition to the CPU. The controller 11 shown in FIG. 1 is an entity that executes the information processing method according to the present invention, which will be described later, and corresponds to a computer.

[0023] In this embodiment, a configuration in which the program executed by the information processing device 10 is pre-stored in ROM will be described as an example, but the location where the program is stored is not limited to ROM. For example, the program may be stored in a computer-readable and portable computer-readable recording medium (e.g., disk media, flash memory, etc.). In this case, the information processing device 10 downloads the program from the computer-readable recording medium and executes the downloaded program. In other words, the information processing device 10 may be configured to include only an operating circuit, and the program may be downloaded from an external device.

[0024] As shown in FIG. 1, the controller 11 of the information processing device 10 has, as functional blocks, an operation detection unit 12, a main layer display control unit 13, a widget display position detection unit 14, a widget transition unit 15, and a sub-layer display control unit 16.

[0025] The operation detection unit 12 detects a touch operation performed on the display 1 based on information input from the display 1. The operation detection unit 12 receives, from the display 1, information on the position on the display 1 where the touch operation was performed and the detection result by the pressure sensor (such as a resistance value or voltage indicating the pressure). For example, based on the information input from the display 1, the operation detection unit 12 determines whether the operation on the display 1 is any one of a tap operation, a double tap operation, a long tap operation, a swipe operation, a flick operation, a pinch-in / pinch-out operation, a drag operation, a drop operation, and a scroll operation. Note that the number of touch operations detected by the operation detection unit 12 is not particularly limited. For example, the operation detection unit 12 may detect that the touch operation on the display 1 is two types of touch operations, a drag operation and a scroll operation. The method of detecting a touch operation by the operation detection unit 12 can be a publicly known detection method known at the time of filing of the present application.

[0026] Furthermore, the operation detection unit 12 detects the direction of the touch operation based on information input from the display 1. For example, when the operation detection unit 12 determines that the operation on the display 1 is a scroll operation based on the information input from the display 1, it detects the direction of the scroll operation. The scroll operation direction corresponds to the direction in which the driver or passenger in the front passenger seat moves their finger on the screen during the scroll operation. Examples of the scroll operation direction include the up-down direction (from top to bottom, from bottom to top) and the left-right direction (from left to right, from right to left). The touch operation detection process executed by the operation detection unit 12 includes a process of detecting the scroll operation direction during the scroll operation.

[0027] Furthermore, the operation detection unit 12 detects the operation speed of the touch operation based on information input from the display 1. For example, when the operation detection unit 12 determines that the operation on the display 1 is a scroll operation based on information input from the display 1, it detects the operation speed of the scroll operation. The operation speed of the scroll operation corresponds to the moving speed of the finger when the driver or passenger in the front passenger seat moves the finger up and down or left and right on the screen during the scroll operation. The touch operation detection process executed by the operation detection unit 12 includes a process of detecting the operation speed of the scroll operation.

[0028] The main layer display control unit 13 controls the display of the main layer of the screen display of the display 1 in response to the touch operation detected by the operation detection unit 12. In this embodiment, the screen display of the display 1 is configured to include a main layer located in the front and a sub-layer located behind the main layer. When the screen display of the display 1 is viewed from the front, the main layer is located in front of the sub-layer.

[0029] Here, the main layer and sub-layer constituting the screen display will be described with reference to Fig. 3. Fig. 3 is a diagram for explaining the main layer and sub-layer. Fig. 3(A) is a schematic diagram of the widget display area WA shown in Fig. 2(B). In Fig. 3(A), components similar to those shown in Fig. 2(B) are assigned the same reference numerals as those shown in Fig. 2(B). Also, in Fig. 3(A), the x-axis indicates the width direction (left-right direction) of the vehicle, the y-axis indicates the depth in the traveling direction (forward direction) of the vehicle, and the z-axis indicates the height direction (up-down direction).

[0030] As shown in FIG. 3A, the widget display area WA includes a main layer L1, which is a display layer aligned along the x-axis and z-axis, and a sub-layer L2, which is located on the positive y-axis side of the main layer L1 and is aligned along the x-axis and z-axis. The main layer L1 and the sub-layer L2 form a hierarchical structure in which the main layer L1 is in the foreground and the sub-layer L2 is in the background. The sizes of the main layer L1 and the sub-layer L2 are not particularly limited, but in this embodiment, the main layer L1 and the sub-layer L2 are described as display layers of the same size. The main layer L1 and the sub-layer L2 are large enough to arrange widgets W1 to W4 side by side in the horizontal direction.

[0031] When widgets W1 to W4 are arranged on the main layer L1 in the positional relationship shown in FIG. 3(A), they are displayed on the display 1 as screen display D (widget display area WA) shown in FIG. 2(B). In the example of FIG. 3(A), widgets W1 to W4 belong to the main layer L1 as shown in FIG. 3(B). The widgets belonging to the main layer L1 are displayed on the display 1 as widgets arranged on the main layer L1. FIG. 3(B) is a diagram for explaining the belonging destinations of the widgets corresponding to the screen display of FIG. 3(A). The role and functions of the sub-layer L2 will be described later.

[0032] When the touch operation detected by the operation detection unit 12 is a scroll operation, the main layer display control unit 13 executes a scroll process to scroll the main layer. As the scroll process, the main layer display control unit 13 outputs a control command to the display 1 to scroll the main layer in a direction corresponding to the scroll operation direction detected by the operation detection unit 12. In the example of FIG. 3(A), when the main layer display control unit 13 detects a scroll operation direction from left to right along the x-axis, it outputs a control command to the display 1 to scroll the main layer L1 from left to right. As a result, the display 1 displays a screen in which the entire main layer L1 including widgets W1 to W4 is scrolled from left to right. Also, in the example of FIG. 3(A), when the main layer display control unit 13 detects a scroll operation direction from right to left along the x-axis, it outputs a control command to the display 1 to scroll the main layer L1 from right to left. As a result, the display 1 displays a screen in which the entire main layer L1 including widgets W1 to W4 is scrolled from right to left. In this embodiment, the left and right directions will be described as an example of the scroll operation direction.

[0033] Furthermore, the main layer display control unit 13 executes a scroll process to delay the scrolling of the icon portion of the widget relative to the scrolling of the panel portion of the widget. For example, when the touch operation detected by the operation detection unit 12 is a scroll operation, the main layer display control unit 13 outputs a control command to the display 1 to cause the icon portion of the widget to scroll later than the panel portion. As a result, after the scroll operation, the display 1 displays a screen in which the icon portion scrolls later than the panel portion. In other words, after the scroll operation, the display 1 displays an animation screen in which the icon portion follows the panel portion. Note that the distance by which the icon portion scrolls relative to the panel portion is not particularly limited, and the display control method by the main layer display control unit 13 can use a publicly known display control method known at the time of filing of this application. The scroll process executed by the main layer display control unit 13 includes a process to delay the scrolling of the icon portion of the widget relative to the scrolling of the panel portion of the widget.

[0034] The main layer display control unit 13 also executes a process of changing the scroll display speed of a widget according to the speed of the scroll operation as a scrolling process. The scroll display speed corresponds to the movement speed of the widget on the screen. For example, the main layer display control unit 13 outputs a control command to the display 1 to increase the scroll display speed of the widget as the speed of the scroll operation increases. As a result, the display 1 displays a screen in which the widget moves faster on the screen as the speed of the scroll operation increases. The scroll process executed by the main layer display control unit 13 includes a process of changing the scroll display speed of the widget according to the speed of the scroll operation. The scroll process executed by the main layer display control unit 13 also includes a process of increasing the scroll display speed of the widget as the speed of the scroll operation increases. Note that in this embodiment, the main layer display control unit 13 also scrolls the sub-layer in conjunction with the main layer as a scrolling process. That is, the main layer display control unit 13 outputs a control command to the display 1 to scroll the sub-layer in the same scroll direction as the scroll direction of the main layer and at the same display speed as the scroll display speed of the main layer.

[0035] Furthermore, main layer display control unit 13 executes display control other than scrolling display in response to a touch operation on display 1. For example, when the operation on display 1 is a tap operation and the tapped target is a specific widget, main layer display control unit 13 outputs a control command to display 1 to display the screen of an application corresponding to the tapped widget. Note that the tap operation process is merely an example, and main layer display control unit 13 can execute display control other than scrolling display that was known at the time of filing of this application in response to a touch operation on display 1.

[0036] Returning to FIG. 1 , the functional blocks of the information processing device 10 will be described. When the main layer display control unit 13 starts scrolling, the widget display position detection unit 14 detects the display position of a widget on the display 1. The widget display position detection unit 14 determines whether a widget arranged on the main layer has scrolled by scrolling and reached an edge of the screen display of the display 1. When the screen display of the display 1 includes a fixed display area in addition to a widget display area (see FIG. 2(B)), as in the present embodiment, the widget display position detection unit 14 sets the boundary between the widget display area and the fixed display area as the edge of the screen display. Furthermore, when scrolling is performed to delay the scrolling of the icon portion of the widget relative to the scrolling of the panel portion of the widget, as in the present embodiment, the panel portion reaches the edge of the screen display before the icon portion. Therefore, the widget display position detection unit 14 determines whether the panel portion of the widget has reached the edge of the screen display.

[0037] When the widget display position detection unit 14 determines that a widget on the main layer has reached an edge of the screen display of the display 1 through scrolling, the widget transition unit 15 executes transition processing to transition the widget that has reached the edge of the screen display from the main layer to the sub-layer. In this embodiment, for a widget whose panel portion has reached the boundary between the widget display area and the fixed display area, the widget transition unit 15 executes transition processing to transition the entire widget, including the panel portion, icon portion, and shadow portion, from the main layer to the sub-layer. As part of the transition processing, the widget transition unit 15 outputs a control command to the display 1 to change the belonging location of the widget that has reached the edge of the screen display from the main layer to the sub-layer. As part of the transition processing, the widget transition unit 15 also outputs a control command to the display 1 to display the widget that has been transitioned to the sub-layer while maintaining the relationship between the scrolling display of the panel portion and the scrolling display of the icon portion on the main layer. The transition processing executed by the widget transition unit 15 includes a process of changing the belonging location of the widget that has reached the edge of the screen display from the main layer to the sub-layer, thereby displaying the widget on the display 1 as a widget placed on the sub-layer. The transition process executed by the widget transition unit 15 displays the widgets that have been transitioned to the sub-layer while maintaining the relationship between the scroll display of the panel section and the scroll display of the icon section on the main layer. 1 This includes processing to display the image.

[0038] As part of the transition process, the widget transition unit 15 arranges widgets on the sublayer so that the widgets that have been moved to the sublayer are displayed inside the edges of the screen display. In the present embodiment, when the boundary between the widget display area and the fixed display area is set as the edge of the screen display, the widget transition unit 15 arranges widgets on the sublayer so that the widgets that have been moved to the sublayer are displayed inside the boundary between the widget display area and the fixed display area, i.e., on the widget display area side. As part of the transition process, the widget transition unit 15 outputs a control command to the display 1 to display the widgets that have been moved to the sublayer inside the edges of the screen display. This prevents the fixed display area from being displayed overlapping the widgets that have been moved to the sublayer, allowing the widgets that have been moved to the sublayer to be displayed. The transition process performed by the widget transition unit 15 also includes a process of displaying the widgets that have been moved to the sublayer inside the edges of the screen display.

[0039] 4A and 4B are diagrams illustrating the processing performed by the widget transition unit 15 and the sub-layer display control unit 16 (described later). FIG. 4A is a diagram illustrating a state in which a panel portion p4 of a widget W4 reaches the boundary between the widget display area WA and the fixed display area PA after a left-to-right scroll operation is performed on the screen display shown in FIG. 3A. FIG. 4B is a diagram illustrating a state in which a transition process performed by the widget transition unit 15 and a display control process performed by the sub-layer display control unit 16 (described later) are performed on the screen display shown in FIG. 4A. FIG. 4C is a diagram illustrating the transition process performed by the widget transition unit 15.

[0040] As shown in FIG. 4A, when an end of the panel unit p4 in the scrolling direction reaches the boundary between the widget display area WA and the fixed display area PA, the widget transition unit 15 outputs a control command to the display 1 to change the Widget W4's location from the main layer L1 to the sub-layer L2, as shown in FIG. 4C. As a result, as shown in FIG. 4B, the Widget W4 is displayed on the display 1 as a widget arranged on the sub-layer L2, i.e., as a widget located behind the main layer L1. Furthermore, when the icon unit i4 scrolls later than the panel unit p4 in the scrolling display on the main layer L1, the widget transition unit 15 outputs a control command to the display 1 to transition the Widget W4 to the sub-layer L2 and display it while maintaining the relationship between the scrolling display of the panel unit p4 and the scrolling display of the icon unit i4 on the main layer L1. As a result, as shown in FIG. 4B, the panel unit p4 and the icon unit i4 are displayed on the sub-layer L2 while maintaining the positional relationship between the panel unit p4 and the icon unit i4 on the main layer L1, as shown in FIG. 4A. The widget transition unit 15 also outputs a control command to the display 1 to display the widget W4 that has been transitioned to the sublayer L2 inside the boundary between the widget display area WA and the fixed display area PA. As a result, the widget W4 that has been transitioned to the sublayer L2 is displayed inside the widget display area WA, as shown in FIG. 4B.

[0041] The sub-layer display control unit 16 controls the display of the sub-layer among the screen displays of the display 1. The sub-layer display control unit 16 executes a transparency change process and a size change process for a widget that has been moved from the main layer to the sub-layer by the widget mover 15. The transparency change process is a process for changing the transparency of the widget compared to before it was moved to the sub-layer. The size change process is a process for changing the size of the widget. size This is a process of changing the image data from the state before transitioning to the sublayer.

[0042] In this embodiment, the sub-layer display control unit 16 performs a transparency change process by outputting a control command to the display 1 to increase the transparency of the widget that has been moved to the sub-layer compared to before the widget was moved to the sub-layer. In the transparency change process, the absolute value of the transparency of the widget is not particularly limited, and the sub-layer display control unit 16 outputs a control command to the display 1 to increase the transparency of the widget that has been moved to the sub-layer relatively compared to before the widget was moved to the sub-layer. As a result, as shown in FIG. 4(B), the widget W4 that has been moved to the sub-layer L2 is displayed more transparently than the widget W4 shown in FIG. 4(A), which visually indicates that the widget W4 has moved to the rear of the screen. As a result, the driver or passenger in the front seat can easily grasp the anteroposterior relationship between the widgets W1 to W3 on the main layer L1.

[0043] In this embodiment, the sub-layer display control unit 16 performs a size change process by outputting a control command to the display 1 to reduce the size of the widget that has been moved to the sub-layer compared to before the widget was moved to the sub-layer. In the size change process, the absolute value of the widget size is not particularly limited, and the sub-layer display control unit 16 outputs a control command to the display 1 to reduce the size of the widget that has been moved to the sub-layer relatively compared to before the widget was moved to the sub-layer. As a result, as shown in FIG. 4(B), the widget W4 that has been moved to the sub-layer L2 is displayed smaller than the widget W4 shown in FIG. 4(A), which visually indicates that the widget W4 has moved to the rear of the screen. As a result, the driver or passenger in the front seat can easily grasp the anteroposterior relationship between the widgets W1 to W3 on the main layer L1.

[0044] Furthermore, when multiple widgets are shifted to the sub layer, the sub layer display control unit 16 executes a transparency change process and a size change process for each widget shifted to the sub layer according to the order in which the widgets were shifted to the sub layer. The sub layer display control unit 16 controls the transparency of each widget shifted to the sub layer so that the transparency increases in the order in which the widgets were shifted to the sub layer. In other words, the sub layer display control unit 16 executes a process to increase the transparency of a widget that is shifted to the sub layer earlier. As a result, the widget whose panel unit reaches the edge of the screen display earlier is displayed more transparently on the sub layer. The sub layer display control unit 16 also controls the dimensions of each widget shifted to the sub layer so that the dimensions decrease in the order in which the widgets were shifted to the sub layer earlier. In other words, the sub layer display control unit 16 executes a process to decrease the dimensions of a widget that is shifted to the sub layer earlier. As a result, the widget whose panel unit reaches the edge of the screen display earlier is displayed smaller on the sub layer. The sub-layer display control unit 16 also controls the placement of widgets on the sub-layer so that the widgets are positioned from the back of the screen (the forward direction of the vehicle) to the front of the screen (the backward direction of the vehicle) in the order in which they were transferred to the sub-layer. In other words, the sub-layer display control unit 16 performs image processing so that the earlier a widget is transferred to the sub-layer, the deeper it appears to be on the sub-layer. As a result, the earlier a widget reaches the edge of the screen display, the deeper it appears to be on the sub-layer. A specific example of when multiple widgets are transferred to the sub-layer will be described later.

[0045] Next, an information processing method executed by the controller 11 will be described with reference to Fig. 5. Fig. 5 is an example of a flowchart showing the procedure of information processing according to this embodiment. Each process in the flowchart of Fig. 5 is executed by the controller 11.

[0046] In step S1, the controller 11 acquires information about the home screen from the storage device 2 and outputs a control command to the display 1 to display the home screen. The display 1 displays the home screen based on the control command (including image data) input from the controller 11. As shown in the example of FIG. 2(B), the home screen is composed of a widget display area WA in which widgets W1 to W4 are displayed, and a fixed display area PA provided around the widget display area WA. The controller 11 outputs a control command to the display 1 to display the fixed display area PA at the top and bottom edges and the left and right edges of the screen display D. As shown in the example of FIG. 3(A), the widgets W1 to W4 are arranged on the main layer L1.

[0047] In step S2, the controller 11 detects a touch operation on the screen display of the display 1. The controller 11 determines the type of the touch operation based on information input from the display 1. In step S3, the controller 11 determines whether or not the operation on the screen display is a scroll operation based on the processing result of step S2. If the controller 11 makes a positive determination, the process proceeds to step S4, and if the controller 11 makes a negative determination, the process proceeds to step S13.

[0048] If a negative determination is made in step S3, the process proceeds to step S13. In step S13, the controller 11 executes display control of the display in accordance with the operation on the screen display based on the processing result of step S2. For example, if the operation on the display 1 is a tap operation and the tapped object is a widget, the controller 11 outputs a control command to the display 1 to display the screen of the application corresponding to the tapped widget. When the processing in step S13 ends, the controller 11 ends the processing in the flowchart shown in FIG.

[0049] On the other hand, if the determination in step S3 is affirmative, the process proceeds to step S4. In step S4, the controller 11 executes a scroll process for scrolling the main layer of the screen display based on the processing result of step S2. For example, the controller 11 determines the scroll direction based on the scroll operation direction of the scroll operation. Also, for example, the controller 11 determines the scroll operation speed based on the operation speed of the scroll operation. As the scroll process, the controller 11 outputs a control command to the display 1 for scrolling the main layer in a direction corresponding to the scroll operation direction. Furthermore, the controller 11 outputs a control command to the display 1 for increasing the scroll display speed of the widgets as the operation speed of the scroll operation increases. Furthermore, as the scroll process, the controller 11 outputs a control command to the display 1 for scrolling the icon section with a delay compared to the panel section. Through the processing in step S4, the display 1 displays a screen in which the entire main layer including the widgets is scrolled in the scroll direction.

[0050] In step S5, the controller 11 scrolls the widgets arranged on the main layer to the display by the scroll process in step S4. 1 In this embodiment, the controller 11 determines whether the panel unit has reached the boundary between the widget display area (main layer) and the fixed display area. If the controller 11 makes a positive determination, the process proceeds to step S6, and if the controller 11 makes a negative determination, the process waits in step S5 until a positive determination is made.

[0051] In step S6, the controller 11 executes a transition process to transition the widget determined in step S5 to have reached the edge of the screen display from the main layer to the sub-layer. As part of the transition process, the controller 11 outputs a control command to the display 1 to change the belonging layer of the widget that has reached the edge of the screen display from the main layer to the sub-layer. As part of the transition process, the controller 11 also outputs a control command to the display 1 to display the widget that has transitioned to the sub-layer while maintaining the relationship between the scrolling display of the panel section and the scrolling display of the icon section in the main layer. As part of the transition process, the controller 11 also outputs a control command to the display 1 to display the widget that has transitioned to the sub-layer inside the edge of the screen display.

[0052] In step S7, the controller 11 determines whether a widget has been placed on the sublayer before step S6. For example, the controller 11 determines whether a widget belongs to the sublayer before executing the transition process in step S6. If the controller 11 determines that no widget belongs to the sublayer, i.e., if the transition process in step S6 is the first transition process in the flowchart shown in FIG. 5, the process proceeds to step S8. On the other hand, if the controller 11 determines that one or more widgets belong to the sublayer, i.e., if the transition process in step S6 is the second or subsequent transition process in the flowchart shown in FIG. 5, the process proceeds to step S11.

[0053] If the determination in step S7 is negative, the process proceeds to step S8. In step S8, the controller 11 executes a transparency change process for the widget that has been shifted from the main layer to the sub layer by the process in step S6, changing the transparency of the widget compared to before the shift to the sub layer. As the transparency change process, the controller 11 outputs a control command to the display 1 to increase the transparency of the widget that has been shifted to the sub layer compared to before the shift to the sub layer.

[0054] In step S9, the controller 11 executes a size change process for the widget that has been moved from the main layer to the sub layer by the process in step S6, to change the size of the widget from the size before the move to the sub layer. As the size change process, the controller 11 outputs a control command to the display 1 to make the size of the widget that has been moved to the sub layer smaller than the size before the move to the sub layer.

[0055] In step S10, the controller 11 determines whether the scrolling of the main layer is completed by the scrolling process in step S4. For example, the controller 11 determines whether the edge of the main layer located in the opposite direction to the scrolling direction has reached the edge of the screen display. If the edge of the main layer has reached the edge of the screen display, the controller 11 determines that the scrolling of the main layer is completed. On the other hand, if the edge of the main layer has not reached the edge of the screen display, the controller 11 determines that the scrolling of the main layer is not completed. For example, the controller 11 may also determine whether there are widgets belonging to the main layer. In this case, if there are no widgets belonging to the main layer, the controller 11 determines that the scrolling of the main layer is completed. On the other hand, if at least one widget belongs to the main layer, the controller 11 determines that the scrolling of the main layer is not completed. If the controller 11 makes a positive determination, the controller 11 terminates the processing in the flowchart shown in FIG. 5. On the other hand, if the controller 11 makes a negative determination, the process returns to step S5, and the processes of steps S5 to S12 are repeatedly executed until a positive determination is made in step S10.

[0056] If the determination in step S7 is affirmative, the process proceeds to step S11. In step S11, the controller 11 executes a transparency change process for the widget that has been shifted from the main layer to the sub layer by the process in step S6, to change the transparency of the widget compared to before the shift to the sub layer. This transparency change process by the controller 11 corresponds to the process in step S8. In step S11, the controller 11 executes a transparency change process different from the process in step S8. The controller 11 executes a transparency change process for the widget that was placed on the sub layer before step S6, to change the transparency of the widget compared to before the process in step S6. As the transparency change process, the controller 11 outputs a control command to the display 1 to increase the transparency of the widget that was placed on the sub layer before step S6 compared to before the process in step S6.

[0057] In step S12, the controller 11 executes a size change process for the widget that has been moved from the main layer to the sub layer by the process in step S6, to change the dimensions of the widget compared to those before the move to the sub layer. This size change process by the controller 11 corresponds to the process in step S9. Also, in step S12, the controller 11 executes a size change process different from the process in step S9. The controller 11 executes a size change process for the widget that was placed on the sub layer before step S6, to change the dimensions of the widget compared to those before the process in step S6. As the size change process, the controller 11 outputs a control command to the display 1 to reduce the dimensions of the widget that was placed on the sub layer before step S6 compared to those before the process in step S6.

[0058] When the process in step S12 is completed, the process proceeds to step S10, where the controller 11 determines whether or not the scroll display of the main layer has been completed by the scroll process in step S4, as explained above.

[0059] Next, problems that may occur due to scrolling display will be described using a comparative example. Unlike the information processing device 10 according to this embodiment, the information processing device according to the comparative example does not have functions corresponding to the widget display position detection unit 14, the widget transition unit 15, and the sublayer display control unit 16. However, the other functions are the same as those of the information processing device 10 according to this embodiment.

[0060] FIG. 6 is a diagram showing how a screen transition occurs in an information processing device according to a comparative example when a scroll operation is performed.

[0061] (Comparison example) Scrolling the screen display (scrolling from left to right) When a home screen including widgets W1 to W4 is displayed on the display 1 (FIG. 6(A)), the driver or front passenger moves their finger on the screen from left to right when looking straight ahead at FIG. 6(A) in order to scroll the screen display (scroll operation). The information processing device according to the comparative example determines that the type of touch operation on the screen display is a scroll operation, and detects the scroll direction and operation speed of the scroll operation. The information processing device according to the comparative example outputs a control command to the display 1 to scroll the icon portion of the widget from left to right with a delay relative to the panel portion. When a predetermined time has elapsed since the main layer L1 has scrolled from left to right, the panel portion p4 of the widget W4 reaches the boundary between the widget display area WA and the fixed display area PA (FIG. 6(B)). Unlike this embodiment, the information processing device according to the comparative example does not perform any processing on the widget W4 that has reached the edge of the screen display. Therefore, the display 1 does not move the panel portion of the widget W4. pAfter a predetermined time has elapsed, the display 1 displays a screen in which widget W4, widget W3, and widget W2 are gradually removed from the edge of the screen (FIG. 6(C)). If the widgets are gradually removed from the edge of the screen after the scrolling operation, the driver or front passenger may feel uncomfortable with the widget display.

[0062] Fig. 7 is a diagram showing how a screen transition occurs in the information processing device 10 according to this embodiment when a scroll operation is performed. Fig. 8 is a diagram showing a continuation of the screen transition shown in Fig. 7. Fig. 9 is a diagram for explaining the processing of the information processing device 10 according to this embodiment.

[0063] (This embodiment) Scrolling the screen display (scrolling from left to right) When a home screen including widgets W1 to W4 is displayed on the display 1 (FIG. 7(A)), widgets W1 to W4 belong to the main layer L1 as shown in FIG. 9(A). From this state, the driver or front passenger moves their finger on the screen from left to right when looking straight ahead at FIG. 7(A) in order to scroll the screen display (scroll operation). The information processing device 10 determines that the type of touch operation on the screen display is a scroll operation, and detects the scroll direction and operation speed of the scroll operation. The information processing device 10 outputs a control command to the display 1 to scroll the icon portion of the widget from left to right with a delay relative to the panel portion. The display 1 displays a screen in which the icon portion scrolls from left to right with a delay relative to the panel portion (FIG. 7(B)).

[0064] When a predetermined time has elapsed since the main layer L1 was scrolled from left to right, the panel portion p4 of the widget W4 reaches the boundary between the widget display area WA and the fixed display area (FIG. 7C). At this time, the information processing device 10 outputs a control command to the display 1 to change the Widget W4's belonging layer from the main layer L1 to the sub-layer L2, as shown in FIG. 9B. The information processing device 10 also outputs a control command to the display 1 to display the Widget W4 that has been moved to the sub-layer L2 while maintaining the relationship between the scrolling display of the panel portion p4 and the scrolling display of the icon portion i4 in the main layer L1. The information processing device 10 also outputs a control command to the display 1 to increase the transparency of the Widget W4 that has been moved to the sub-layer L2 compared to before the Widget W4 was moved to the sub-layer L2. The information processing device 10 also outputs a control command to the display 1 to reduce the dimensions of the Widget W4 that has been moved to the sub-layer L2 compared to before the Widget W4 was moved to the sub-layer L2. The information processing device 10 also outputs a control command to the display 1 to display the widget W4, which has been moved to the sublayer L2, inside the edges of the screen display. As a result, the display 1 displays the widget W4 as a smaller, transparent widget compared to the widget W4 shown in FIG. 7C, and positioned further back on the screen (FIG. 7D).

[0065] A predetermined time has passed since the scene shown in Fig. 7(D) (Fig. 7(E)), and the panel portion p3 of the widget W3 reaches the boundary between the widget display area WA and the fixed display area PA (Fig. 7(F)). At this point, the information processing device 10 outputs a control command to the display 1 to change the Widget W3's belonging layer from the main layer L1 to the sub-layer L2, as shown in Fig. 9(C). The information processing device 10 also outputs a control command to the display 1 to display the widget W3 that has moved to the sub-layer L2, while maintaining the relationship between the scrolling display of the panel portion p3 and the scrolling display of the icon portion i3 on the main layer L1.

[0066] The information processing device 10 also outputs a control command to the display 1 to increase the transparency of the Widget W4 compared to before the Widget W3 was transferred to the sublayer L2. The information processing device 10 also outputs a control command to the display 1 to increase the transparency of the Widget W3 that has been transferred to the sublayer L2 compared to before the Widget W3 was transferred to the sublayer L2, but to decrease the transparency below that of the Widget W4. As a result, the Widget W4 on the sublayer L2 appears more transparent than before the Widget W3 was transferred to the sublayer L2 (FIG. 7(G)). The Widget W3 on the sublayer L2 appears more transparent than before the Widget W3 was transferred to the sublayer L2. The transparency of the Widget W4 becomes higher than that of the Widget W3, and the Widget W4 appears more transparent than the Widget W3 (FIG. 7(G)).

[0067] The information processing device 10 also outputs a control command to the display 1 to make the size of the Widget W4 smaller than before the Widget W3 was moved to the sublayer L2. The information processing device 10 also outputs a control command to the display 1 to make the size of the Widget W3 that has been moved to the sublayer L2 smaller than before the Widget W3 was moved to the sublayer L2, but larger than the size of the Widget W4. As a result, the Widget W4 on the sublayer L2 is displayed smaller than before the Widget W3 was moved to the sublayer L2 (FIG. 7(G)). The Widget W3 on the sublayer L2 is displayed smaller than before the Widget W3 was moved to the sublayer L2. The size of the Widget W4 is smaller than the size of the Widget W3, and the Widget W4 is displayed smaller than the Widget W3 (FIG. 7(G)).

[0068] The information processing device 10 also outputs a control command to the display 1 to adjust the placement of the widgets W3 and W4 on the sublayer L2, as a visual control command to display the widgets W4 and W3 in that order from the back of the screen to the front of the screen. As a result, the widget W4 appears to be positioned further back on the sublayer L2 than the widget W3 (FIG. 7G).

[0069] In this way, by controlling the transparency, dimensions, and placement of widgets on the sublayer, widgets that are moved to the sublayer earlier are displayed on the sublayer as more transparent, smaller, and further back on the screen, which gives the driver or front passenger a visual effect of widgets gradually fading out toward the back of the screen as they scroll to the edge of the screen display.

[0070] Although detailed description of the screen transitions shown in FIGS. 7(H) and 8(A) to 8(D) is omitted, each time a widget panel reaches the boundary between the widget display area and the fixed display area, the information processing device 10 repeatedly executes a process of changing the widget's belonging destination and a process of changing the transparency and size of the widget that has been moved to the sublayer. As a result, the display 1 displays the screens shown in FIGS. 7(E) to 7(H) and 8(A) to 8(D) in that order over time. Unlike the comparative examples shown in FIGS. 6(C) and 6(D), after a scrolling operation, a widget that reaches the edge of the screen display continues to be displayed at the back of the screen until the scrolling of the main layer ends (see FIG. 8(D)). This reduces the discomfort felt by the driver or front passenger in the widget display.

[0071] As described above, in this embodiment, the screen display of the display 1 includes a main layer located in the foreground and a sub-layer located behind the main layer. The controller 11 detects an operation on the screen display, and if the operation on the screen display is a scroll operation, executes a scroll process to scroll the main layer. If a widget arranged on the main layer reaches an edge of the screen display due to the scroll process, the controller 11 executes a transition process to transition the widget that has reached the edge from the main layer to the sub-layer. When a widget on the main layer reaches the edge of the screen display, the widget can be displayed on the sub-layer behind the main layer. This prevents the widget from being displayed as if it is being cut off at the edge of the screen display even when the main layer is scrolled. As a result, the user's discomfort with the widget display can be reduced when the screen display is scrolled.

[0072] In this embodiment, the controller 11 executes a transparency change process to increase the transparency of the widget that has been moved to the sub layer compared to before the widget was moved to the sub layer. This makes the widget that has been moved to the sub layer appear more transparent than before the widget was moved to the sub layer, visually indicating that the widget has been moved to the rear of the screen. As a result, the driver or passenger in the front seat can easily understand the anteroposterior relationship between the widget on the main layer and the widget on the sub layer.

[0073] In this embodiment, the controller 11 executes a size change process to change the size of the widget that has been moved to the sub layer compared to before the move to the sub layer. This allows the widget that has been moved to the sub layer to be transparently changed in size compared to before the move to the sub layer, visually indicating that the widget has been moved from the main layer located in the foreground.

[0074] In this embodiment, the size change process includes a process of reducing the size of the widget that has been moved to the sub layer compared to before the widget was moved to the sub layer. This causes the widget that has been moved to the sub layer to appear smaller than before the widget was moved to the sub layer, visually expressing that the widget has been moved to the rear of the screen. As a result, the driver or passenger in the front seat can easily understand the anteroposterior relationship between the widget on the main layer and the widget on the sub layer.

[0075] In this embodiment, the screen display of the display 1 includes a fixed display area that is unrelated to scrolling operations, separate from the widget display area where widgets are displayed. The display 1 is longer in the left-right direction than in the up-down direction. The controller 11 displays the fixed display area PA at the top and bottom edges and the left and right edges of the screen display. This makes it possible to realize a screen display such as the example shown in FIG. 2(B).

[0076] In this embodiment, the controller 11 sets the boundary between the widget display area and the fixed display area as the edge of the screen display, and places the widget on the sublayer so that the widget moved to the sublayer is displayed inside the edge of the screen display. This prevents the fixed display area from overlapping the widget moved to the sublayer, allowing the widget on the sublayer to be displayed. As a result, the user's discomfort with the widget display can be reduced when the screen display is scrolled.

[0077] In this embodiment, the transition process includes a process of changing the belonging layer of an object that has reached the edge of the screen display from the main layer to the sub-layer, thereby displaying the widget as a widget placed in the sub-layer on the display 1. Because the transition from the main layer to the sub-layer can be achieved by a relatively simple process of changing the belonging layer of a widget, the computational load can be reduced.

[0078] In this embodiment, the object operated by the driver or the front passenger is a widget of the application software, including a panel portion on which information about the application software is displayed. When the panel portion of the widget is scrolled by the scroll process and reaches an end of the screen display, the controller 11 executes a process of transitioning the widget including the panel portion that has reached the end from the main layer to the sub layer.

[0079] In this embodiment, a widget includes not only a panel portion but also an icon portion of the application software and a shadow portion indicating the boundary between the panel portion and the icon portion. Even an object composed of multiple elements, such as a widget, can be transitioned to a sublayer.

[0080] In this embodiment, the scrolling process includes delaying the scrolling of the icon section relative to the scrolling of the panel section, thereby providing the driver or front passenger with the visual effect of the screen display scrolling.

[0081] In this embodiment, the transition process includes a process of displaying the widgets that have been transitioned to the sub-layer on the display 1 while maintaining the relationship between the scrolling display of the panel part and the scrolling display of the icon part in the main layer. This maintains the positional relationship between the panel part and the icon part before and after the transition to the sub-layer, thereby preventing the driver or front passenger from feeling uncomfortable with the display of the widgets due to the transition to the sub-layer.

[0082] In this embodiment, the process of detecting a touch operation on the screen display includes a process of detecting the operation speed of the scroll operation, and the scroll process includes a process of changing the scroll display speed of the widget according to the operation speed of the scroll operation, thereby realizing a screen display that scrolls at a speed according to the operation speed of the scroll operation.

[0083] It should be noted that the above-described embodiments have been described to facilitate understanding of the present invention, and are not intended to limit the present invention. Therefore, each element disclosed in the above-described embodiments is intended to include all design modifications and equivalents that fall within the technical scope of the present invention.

[0084] For example, in the above-described embodiment, an information processing method and an information processing device according to this embodiment are described, but even a program for causing a computer to function as the information processing device 10 according to this embodiment can achieve the same effects as the above-described embodiment.

[0085] For example, in the above-described embodiment, the information presentation device 100 has been described as an example, but the present invention is not limited to this. The information processing method, information processing device, and program according to the present invention can be applied to a device equipped with a touch panel display. The information processing method, information processing device, and program according to the present invention can also be applied to, for example, a display to which a mobile terminal such as a smartphone, a tablet terminal, a laptop computer, a personal computer, or the like can be connected, a television, or the like.

[0086] For example, in the above-described embodiments, a widget is used as an example of an object operated by a driver or a front passenger. However, the information processing method, information processing device, and program according to the present invention may also be applied to objects other than widgets. For example, in the above-described embodiments, a widget including a panel portion, an icon portion, and a shadow portion is used as an example. However, a widget may include at least one of the panel portion, the icon portion, and the shadow portion. For example, in the above-described embodiments, the scroll direction of a scroll operation is described as being horizontal, but the scroll direction may also be vertical. For example, in the above-described embodiments, a display 1 having a shape longer in the horizontal direction than in the vertical direction is used as an example. However, the display 1 may also have a shape longer in the vertical direction than in the horizontal direction. For example, in the above-described embodiments, a rectangular display is used as an example. However, the display 1 may have a shape other than a rectangle. For example, in the above-described embodiment, a screen display in which a fixed display area is arranged around a widget display area was used as an example. However, in the case of a display that is longer vertically than horizontally, the fixed display area may be configured to be displayed at either the left or right end of the screen display, or at either the left or right end.

[0087] 1. Display 2…Storage device 10...Information processing device 11...Controller 12...Operation detection unit 13...Main layer display control unit 14...Widget display position detection section 15...Widget transition section 16...Sublayer display control unit 100...Information presentation device

Claims

1. An information processing method in which a controller controls a screen display on a touch panel display, the screen display includes a first layer located in front and a second layer located behind the first layer, The controller detecting an operation on the screen display; If the operation is a scroll operation, a scroll process is performed to scroll the first layer; When an object arranged on the first layer is scrolled by the scroll process and reaches an end of an object display area, a transition process is executed to transition the object that has reached the end from the first layer to the second layer so that the object that has reached the end is displayed within the object display area; An information processing method, wherein the object display area is an area in which the object is displayed within the screen display.

2. 2. The information processing method according to claim 1, The information processing method includes the step of: executing a transparency change process in which the controller increases the transparency of the object that has been moved to the second layer compared to the transparency before the object was moved to the second layer.

3. 3. The information processing method according to claim 1, further comprising: The information processing method includes: executing a dimension change process in which the controller changes the dimensions of the object that has been moved to the second layer compared to the dimensions before the object was moved to the second layer.

4. 4. The information processing method according to claim 3, The information processing method, wherein the size change process includes a process of reducing the size of the object that has been transferred to the second layer compared to the size before being transferred to the second layer.

5. 3. The information processing method according to claim 1, further comprising: the screen display includes a fixed display area that is independent of the object display area and is unrelated to the scrolling operation, The display has a shape that is longer in the left-right direction than in the up-down direction, The information processing method, wherein the controller displays the fixed display area at either the left edge and the right edge of the screen display, or at either the left edge or the right edge.

6. 6. The information processing method according to claim 5, The controller setting a boundary between the object display area and the fixed display area; An information processing method for arranging the object on the second layer so that the object that has been moved to the second layer is displayed inside the boundary.

7. 3. The information processing method according to claim 1, further comprising: The information processing method includes a process of changing the belonging layer of the object that has reached the end from the first layer to the second layer, thereby displaying the object on the display as being placed on the second layer.

8. 3. The information processing method according to claim 1, further comprising: the object is a widget of the application software, including a panel portion on which information about the application software is displayed; an information processing method in which, when the panel unit is scrolled by the scrolling process and reaches the end of the object display area, the controller executes the transition process on the widget including the panel unit that has reached the end.

9. 9. The information processing method according to claim 8, The information processing method, wherein the widget includes, in addition to the panel portion, at least one of an icon portion of the application software and a shadow portion that displays a shadow at the boundary between the panel portion and the icon portion.

10. 3. The information processing method according to claim 1, further comprising: the object is a widget of the application software, including a panel portion on which information about the application software is displayed and an icon portion of the application software; The information processing method, wherein the scrolling process includes a process of delaying the scrolling display of the icon portion relative to the scrolling display of the panel portion.

11. 11. The information processing method according to claim 10, the transition processing includes processing of displaying the widget that has been transitioned to the second layer on the display while maintaining the relationship between the scrolling display of the panel section and the scrolling display of the icon section on the first layer.

12. 11. The information processing method according to claim 10, the process of detecting the operation on the screen display includes a process of detecting an operation speed of the scrolling operation, The information processing method, wherein the scrolling process includes a process of changing a scrolling display speed of the widget in accordance with the operation speed.

13. A controller is provided to control the screen display on the touch panel display, the screen display includes a first layer located in front and a second layer located behind the first layer, The controller detecting an operation on the screen display; If the operation is a scroll operation, a scroll process is performed to scroll the first layer; When an object arranged on the first layer is scrolled by the scroll process and reaches an end of an object display area, a transition process is executed to transition the object that has reached the end from the first layer to the second layer so that the object that has reached the end is displayed within the object display area; The object display area is an area in the screen display where the object is displayed.

14. A program for causing a computer to function as the information processing device according to claim 13.

Images