Information processing device and information processing method

Abstract

To expand the flexibility of drag operations, and improve the operability for a user.SOLUTION: An information processing apparatus includes: a display unit that displays various kinds of screens; an operation receiving unit that is layered on the display unit to receive operation input from a user with respect to the screen; an operation determination unit that determines a content of the operation performed by the user with respect to the operation receiving unit; and a screen generation unit that generates the screen including an operation target, and modifies the screen in accordance with the determined content of operation. The operation determination unit, in a first mode in an initial state, transits to a second mode in response to a drag operation in a longitudinal direction of the operation target with respect to the operation target on the screen. The operation determination unit determines the same kind of drag operations in a direction different from the longitudinal direction of the operation target in the first mode and the second mode, as different instruction operations.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and an information processing method.

Background Art

[0002] As a method of operating a touch panel, for example, Patent Document 1 describes "A touch-based operation method in a mobile terminal, comprising steps of displaying a communication-related list having at least one item in a first direction, selecting a specific one of the at least one item in response to a first touch event, checking whether a second touch event occurs in a second direction on the selected specific one item, and performing a specific function preset for the selected specific one item in response to the second touch event occurring in the second direction."

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technique described in Patent Document 1, for example, in a list screen in which a plurality of items are arranged vertically, when a user performs a drag operation of sliding vertically while keeping his or her finger or the like in contact with the screen, one item in the list can be selected. Subsequently, when a drag operation is performed horizontally on the selected one item, a process corresponding to the direction of the drag operation (right direction or left direction) can be executed for the selected one item. In other words, two types of processes can be selected and executed.

[0005] However, in prior art such as the technology described in Patent Document 1, the direction of drag operations in a list is dominated by the direction of the list, resulting in a low degree of freedom in drag operations. That is, for example, in a list screen where items are arranged vertically, drag operations are limited to the vertical direction. Furthermore, drag operations on a single item selected by vertical drag operations are limited to the horizontal direction. Therefore, it is not possible to realize a UI (User Interface) that allows multiple selections of operations to be performed on a single item selected in a vertically oriented list using vertical drag operations.

[0006] This invention has been made in view of these circumstances, and aims to expand the degree of freedom of drag operations and improve user operability. [Means for solving the problem]

[0007] This application includes several means to solve at least some of the above problems, and some examples are as follows.

[0008] To solve the above problems, an information processing device according to one aspect of the present invention includes a display unit for displaying various screens, an operation reception unit stacked on the display unit for receiving user operation input to the screen, an operation determination unit for determining the user's operation content to the operation reception unit, and a screen generation unit for generating the screen including the operation target and changing the screen according to the determined operation content. In the initial first mode, the operation determination unit transitions to a second mode in response to a drag operation of the operation target on the screen in the longitudinal direction of the operation target. The operation determination unit determines that the same drag operation of the operation target in a direction different from the longitudinal direction in the first mode and the second mode are different instruction operations. [Effects of the Invention]

[0009] According to one aspect of the present invention, it is possible to expand the degree of freedom of drag operations and improve user operability.

[0010] Other issues, configurations, and effects not mentioned above will be clarified by the following description of the embodiments. [Brief explanation of the drawing]

[0011] [Figure 1] Figure 1 is a block diagram showing an example configuration of a functional block of an in-vehicle device according to one embodiment of the present invention. [Figure 2] Figure 2 shows an example of a computer configuration. [Figure 3] Figure 3 shows an example of the list screen display. [Figure 4] Figure 4 illustrates an example of a drag operation on a list screen. [Figure 5] Figure 5 is a flowchart illustrating an example of the process when displaying a list screen. [Figure 6] Figure 6 shows an example of a split-screen display. [Figure 7] Figure 7 illustrates an example of a drag operation on a split screen. [Figure 8] Figure 8 illustrates an example of a drag operation on a split screen. [Figure 9] Figure 9 is a flowchart illustrating an example of the processing when displaying a split screen. [Modes for carrying out the invention]

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In all drawings used to describe the embodiment, the same reference numerals will be used for identical components, and repeated descriptions will be omitted as appropriate. Furthermore, in the following embodiment, the components (including element steps, etc.) are not necessarily essential unless specifically stated or considered to be clearly essential in principle. Also, when referring to "consisting of A," "being made of A," "having A," or "including A," other elements are not excluded unless specifically stated to refer only to that element. Similarly, in the following embodiment, when referring to the shape, positional relationship, etc. of components, etc., it includes those that are substantially similar or approximate to their shape, etc., unless specifically stated or considered to be clearly not the case in principle.

[0013] <Example of the configuration of an in-vehicle device 10 according to one embodiment of the present invention> The following describes an in-vehicle device 10 according to one embodiment of the present invention.

[0014] Figure 1 shows an example of the configuration of a functional block of an in-vehicle device 10 according to one embodiment of the present invention. The in-vehicle device 10 is an electronic device in which a touch panel is stacked on a display, and is intended to be operated by a finger while driving. The in-vehicle device 10 has, for example, a navigation function, a call function, a music playback function, an air conditioning adjustment function, various setting functions, etc. The in-vehicle device 10 corresponds to the information processing device of the present invention.

[0015] The in-vehicle device 10 can be realized by a general computer. FIG. 2 shows an example of the configuration of a computer 100 that realizes the in-vehicle device 10. The computer 100 includes a processor 101 such as a CPU (Central Processing Unit), a RAM (Random Access Memory) 102 that temporarily stores programs and data, a ROM (Read Only Memory) that stores a boot program and the like realized by the processor 101, a storage device 104 such as an HDD (Hard Disc drive), an SSD, or a non-volatile memory card, a communication module 105 that connects to a network represented by the Internet and communicates, a display 106 such as a liquid crystal panel or an organic EL (Electro-Luminescence) panel, and a touch panel 107 laminated on the display 106.

[0016] Returning to FIG. 1. The in-vehicle device 10 includes a processing unit 11, an operation reception unit 12, and a display unit 13. The processing unit 11 has functional blocks of an operation determination unit 111, a function execution unit 112, and a screen generation unit 113.

[0017] The processing unit 11 consists of the processor 101 of the computer 100, and the operation determination unit 111, the function execution unit 112, and the screen generation unit 113 are realized by the processor 101 executing a predetermined program.

[0018] The operation determination unit 111 determines the operation content from the user based on the operation signal from the operation reception unit 12. The function execution unit 112 executes processing in various functions such as a navigation function, a call function, a music playback function, an air conditioner adjustment function, and various setting functions according to the operation content from the user. The screen generation unit 113 generates various screens based on the processing by the function execution unit 112 and the determination result of the user operation by the operation determination unit 111, and causes them to be displayed on the display unit 13.

[0019] The operation reception unit 12 consists of the touch panel 107 of the computer 100 and outputs operation signals corresponding to user operations (drag operations, touch operations, etc.) to the operation determination unit 111 of the processing unit 11. The display unit 13 consists of the display 106 of the computer 100 and displays various screens according to the control of the screen generation unit 113.

[0020] The functional blocks shown in Figure 1 are classified according to their main processing content in order to facilitate understanding of the components of the in-vehicle device 10 realized in this embodiment. Therefore, the present invention is not limited by the way each component is classified or its name. Furthermore, each functional block of the in-vehicle device 10 can be further classified into more functional blocks according to its processing content. It is also possible to classify a single functional block so that it performs even more processing.

[0021] Furthermore, all or part of each functional block may be constructed using hardware (such as integrated circuits like ASICs) implemented in the computer. Also, the processing of each functional block may be performed on one piece of hardware or on multiple pieces of hardware.

[0022] <Regarding drag operations on the list screen> Next, we will explain how the list screen 200 (Figure 3) displayed on the display unit 13 of the in-vehicle device 10 handles drag operations.

[0023] Figure 3 shows an example of the display of list screen 200. Figure 4 is a diagram illustrating the drag operation on list screen 200.

[0024] The list screen 200 displays a list of options 201 arranged vertically, with multiple options positioned vertically. Each option in the list of options 201 has an operation area 203 that indicates the user's position for operation. Additionally, an operation icon 204 representing a typical action for each option is displayed at the right end of each option. The provision of the operation area 203 helps prevent user errors. However, this operation area 203 does not necessarily have to be provided separately. In that case, the entire area of ​​each option (the long rectangular area arranged vertically as the list of options 201) can be considered as the operation area.

[0025] For example, Figure 3 shows an example of the display of the list screen 200 corresponding to the calling function. The list of options 201 displays the names of people, etc., whose phone numbers, etc., have been registered as options. At the far right of each option, a processing icon 204 is displayed, which represents making a phone call as a typical action for that option.

[0026] The user can scroll through the list of options 201 on the list screen 200 by dragging vertically. By scrolling, the user can move the desired option to the center of the list of options 201 and select that option as the target of operation 210. Alternatively, the user may select options in the list of options 201 by touch.

[0027] Furthermore, if the user drags up or down again while an option is selected in the option list 201, the selected target 210 will change. Therefore, when maintaining the selection of an option in the option list 201, the next drag operation can be considered restricted to the left or right direction of the target 210. This state in which the direction of drag operations is restricted under specific circumstances (in this case, when maintaining the selection of an option) is referred to as "first mode." The initial state of the list screen 200 is first mode.

[0028] When a user drags the operation area 203 of the target 210 in the list of options 201 to the right, the process represented by the process icon 204 is executed on the target 210. For example, in Figure 3, a phone call is made to the option "Michael," which is the target 210.

[0029] In Figure 3, the left-right direction corresponds to the longitudinal direction of the object being operated on in this invention, and the up-down direction corresponds to the direction intersecting the longitudinal direction of the object being operated on in this invention. However, the up-down direction (direction intersecting the longitudinal direction) relative to the left-right direction (longitudinal direction of the object being operated on) includes not only cases where the intersection is exactly 90 degrees, but also cases where the intersection is greater than a predetermined angle (for example, 80 degrees or more).

[0030] Next, as shown in the upper and middle sections of Figure 4, when the user performs a drag operation to the left on the operation area 203 of the target 210, as shown in the lower section of Figure 4, the restriction on the direction of drag operation under specific circumstances (in this case, the situation where the selection of an option is maintained) is released, and vertical drag operation becomes possible. This state in which the restriction on the direction of drag operation under specific circumstances is released is called the "second mode".

[0031] However, the vertical drag operation shown in the lower part of Figure 4 is possible only if the touch-on state is maintained (the finger is in contact with the touch panel 107) following the leftward drag operation shown in the middle part of Figure 4. When the touch-off state is reached (the finger is lifted from the touch panel 107), the system returns from the second mode to the first mode, and the operation area 203 also returns to its original position.

[0032] In the second mode, as shown in the lower part of Figure 4, a release icon 214 is displayed on the target object 210, indicating that the directional restriction on drag operations has been removed. Additionally, at the right edge of the target object 210, several processing icons 215, 204, and 216, which represent the processing of the selected option and can be selected by dragging in the vertical direction, are displayed arranged vertically.

[0033] For example, if the user drags downwards from the state shown in the lower part of Figure 4, the process icon 215 representing sending a message moves downwards and is displayed on the target object 210. In this state, if the user drags to the right, a message is sent to the option "Michael". Alternatively, if the user drags upwards from the state shown in the lower part of Figure 4, the process icon 216 representing a video call moves upwards and is displayed on the target object 210. In this state, if the user drags to the right, a video call is started to the option "Michael".

[0034] <Processing when the list screen is displayed> Next, Figure 5 is a flowchart illustrating an example of the processing that occurs when a list screen is displayed.

[0035] The processing for displaying the list screen begins when the list screen 200 is generated by the screen generation unit 113 and displayed on the display unit 13, and continues to run while the list screen 200 is displayed.

[0036] First, the operation determination unit 111 sets the initial operating mode to the first mode (step S1).

[0037] Next, the operation determination unit 111 determines whether or not the user has performed a drag operation on the operation area 203 based on the operation signal from the operation reception unit 12 (step S2). If it is determined that there is no drag operation (NO in step S2), the determination is repeated. If it is determined that there is a drag operation (YES in step S2), the operation determination unit 111 then determines whether the user's drag operation is in the up / down direction or the left / right direction (step S3).

[0038] In step S3, if it is determined that the user's drag operation is in the vertical direction, the screen generation unit 113 then scrolls the list of options 201 on the list screen 200. The option that has been moved to the center of the list of options 201 by scrolling is then selected as the target of operation 210 (step S4). After this, the process returns to step S2 and steps S2 onward are repeated.

[0039] If it is determined in step S3 that the user's drag operation is in the left-right direction, the operation determination unit 111 then determines whether the user's drag operation is in the left or right direction (step S5).

[0040] If, in step S5, it is determined that the user's drag operation is to the left, the operation determination unit 111 then transitions the operation mode to the second mode (step S6).

[0041] Upon transitioning to the second mode, dragging operations in the up and down directions become possible until the user releases the touch. Also, as shown in the lower part of Figure 4, a release icon 214 is displayed on the selected option, the target 210, indicating that the directional restrictions on dragging operations have been removed. At the right edge of the target 210, multiple processing icons 215, 204, and 216, representing the processing of the selected option, are displayed arranged vertically.

[0042] Next, the operation determination unit 111 determines whether the user has touched off the device (step S7). If the operation determination unit 111 determines that the user has touched off the device (YES in step S7), the process returns to step S1, and steps S1 onward are repeated. In this case, the operation mode returns to the first mode.

[0043] Conversely, if the operation determination unit 111 determines that the touch-on state is continuing and the touch-off state has not been reached (NO in step S7), the operation determination unit 111 then determines whether or not there is a drag operation from the user (step S8). If it determines that there is no drag operation (NO in step S8), the process returns to step S7. If it determines that there is a drag operation (YES in step S8), the operation determination unit 111 then determines whether the drag operation from the user is in the up / down direction or the right direction (step S9).

[0044] If the user's drag operation is determined to be in the vertical direction, the screen generation unit 113 then scrolls the multiple processing icons 216 that are displayed vertically on the right edge of the selected item, the target of operation 210, in the list screen 200. The processing corresponding to the processing icon that has been moved onto the target of operation 210 by scrolling is then selected as the processing to be performed on the target of operation 210 (step S10). After this, the process returns to step S7, and steps S7 and beyond are repeated.

[0045] Conversely, if in step S9 it is determined that the user's drag operation is to the right, the function execution unit 112 then executes the process corresponding to the selected process icon on the target 210 (step S11). After this, the process returns to step S1, and steps S1 and onward are repeated.

[0046] If, in step S5, it is determined that the user's drag operation is to the right, the function execution unit 112 executes a typical process indicated by the processing icon 204 on the target 210 (step S11). After this, the process returns to step S1, and steps S1 and beyond are repeated.

[0047] As described above, the processing when displaying the list screen allows the user to transition from the first mode to the second mode by dragging the operation area 203 of the target 210 to the left. This temporarily removes restrictions on drag operations, expands the freedom of drag operations, and improves user operability. Specifically, the user can perform a series of operations on the list screen, from selecting an option by dragging up or down, transitioning to the second mode by dragging left, and selecting an action for the selected option by dragging up or down. Therefore, it is possible to omit the display of a separate pop-up screen or similar screen, which is cumbersome for the user while driving, for selecting an action for the selected option.

[0048] <Regarding drag operations in split-screen mode> Next, we will explain how the split screen 300 (Figure 6) displayed on the display unit 13 of the in-vehicle device 10 handles drag operations.

[0049] Figure 6 shows an example of the split-screen 300 display.

[0050] The split screen 300 is a screen in which the display area of ​​the display unit 13 is divided into multiple divided areas, and information corresponding to different functions (navigation function, call function, music playback function, air conditioning adjustment function, various settings function, etc.) is displayed in each divided area. In the split screen 300, the boundaries between the divided areas can be moved by dragging.

[0051] In Figure 6, the split screen 300 is divided into three sections 301 to 303. Section 301 is assigned to various setting functions, section 302 to music playback functions, and section 303 to air conditioning adjustment functions.

[0052] The boundary line 3111 of the divided regions 301 and 302 is provided with an operation area 3121 that represents the user's position relative to the boundary line 3111 as the target of operation. Similarly, the boundary line 3112 of the divided regions 302 and 303 is provided with an operation area 3122 that represents the user's position relative to the boundary line 3112 as the target of operation. By providing operation areas 3121 and 3122, user errors can be prevented. Hereafter, when it is not necessary to distinguish between boundary lines 3111 and 3112 individually, boundary lines 3111 and 3112 will be collectively referred to simply as boundary line 311. The same applies to operation areas 3121 and 3122. Note that the operation area 312 is not limited to being located in the upper part of boundary line 311 as shown in the figure, but may also be located in the lower part.

[0053] In Figure 6, the vertical direction corresponds to the longitudinal direction of the object being operated on in the present invention, and the horizontal direction in Figure 6 corresponds to the direction intersecting the longitudinal direction of the object being operated on in the present invention. However, the horizontal direction (direction intersecting the longitudinal direction) with respect to the vertical direction (longitudinal direction of the object being operated on) includes not only cases where they are strictly orthogonal, but also cases where they intersect at a predetermined angle (for example, 80 degrees) or more.

[0054] Figure 7 illustrates the asynchronous movement of the boundary line in the split screen 300 (first mode). As shown in the figure, the user can move the boundary line 311 of the target of the operation in the left-right direction by dragging the operation area 312 at its initial position in the left-right direction. For example, by dragging the operation area 3121 to the right from its initial position, the split area 301 can be enlarged (and the split area 302 can be simultaneously reduced). Alternatively, by dragging the operation area 3121 to the left from its initial position, the split area 302 can be enlarged (and the split area 301 can be simultaneously reduced).

[0055] Next, Figure 8 is a diagram illustrating the synchronous movement of the boundary lines in the split screen 300 (second mode). As shown in the figure, the user can transition the operation mode from the initial first mode (asynchronous movement of boundary lines) to the second mode (synchronous movement of boundary lines) by dragging the operation area 312 (for example, operation area 3122) in the vertical direction (downward in this figure) relative to its initial position. At this time, operation areas 312 that have not been dragged in the vertical direction (downward in this figure) (in this case, operation area 3121) are also moved downward in sync with the movement of the operation area 312 that has been dragged (in this case, operation area 3122). Then, if the user drags in the horizontal direction while maintaining touch on the operation area 312, the target boundary line 311 (in this case, boundary line 3112) and the other boundary lines 311 (in this case, boundary line 3111) can be moved simultaneously in the horizontal direction. Furthermore, in the second mode, the user can switch back to the first mode from the second mode by touching off or by dragging the operation area 312 upwards to its initial position.

[0056] For example, if the user transitions to the second mode by dragging downwards on the initial operating area 3122, and then drags to the left, the boundary lines 3111 and 3112 move synchronously to the left. As a result, the divided area 301 shrinks, the divided area 302 moves to the left while maintaining its size, and the divided area 303 expands. Conversely, if the user transitions to the second mode and then drags to the right, the boundary lines 3111 and 3112 move synchronously to the right. As a result, the divided area 301 expands, the divided area 302 moves to the right while maintaining its size, and the divided area 303 shrinks.

[0057] <Processing when displaying split screen> Next, Figure 9 is a flowchart illustrating an example of the processing when displaying a split screen.

[0058] The split-screen display process begins when the split screen 300 is generated by the screen generation unit 113 and displayed on the display unit 13, and continues to run while the split screen 300 is displayed.

[0059] First, the operation determination unit 111 sets the operation mode to the first mode in which the boundary line 311 is moved asynchronously (step S21).

[0060] Next, the operation determination unit 111 determines whether or not the user has performed a drag operation on the operation area 312 based on the operation signal from the operation reception unit 12 (step S22). If it is determined that there is no drag operation (NO in step S22), the determination is repeated. If it is determined that there is a drag operation (YES in step S22), the operation determination unit 111 then determines whether the user's drag operation is in the downward or left-right direction (step S23).

[0061] If it is determined that the user's drag operation is in the downward direction, the operation determination unit 111 then transitions the operation mode to a second mode in which all boundary lines 311 are moved synchronously (step S24).

[0062] Next, the operation determination unit 111 determines whether the user has touched off the device (step S25). If the operation determination unit 111 determines that the user has touched off the device (YES in step S25), the process returns to step S21, and steps S21 onward are repeated. In this case, the operation mode returns to the first mode.

[0063] Conversely, if it is determined that the touch-on state is continuing and the touch-off state has not been reached (NO in step S25), the operation determination unit 111 then determines whether or not there is a drag operation from the user (step S26). If it is determined that there is no drag operation (NO in step S26), the process returns to step S25. If it is determined that there is a drag operation (YES in step S26), the operation determination unit 111 then determines whether the drag operation from the user is upward or to the left or right (step S27).

[0064] If it is determined that the user's drag operation is in the left-right direction, the screen generation unit 113 then synchronizes all the boundary lines 311 of the split screen 300 and moves them in the direction of the drag operation (step S28). After this, the process returns to step S25, and steps S25 onward are repeated.

[0065] Conversely, if it is determined in step S27 that the user's drag operation is upward, the process returns to step S21, and steps S21 onward are repeated. In this case, the operation mode returns to the first mode.

[0066] If, in step S23, it is determined that the user's drag operation is in the left-right direction, the screen generation unit 113 then moves the boundary line 311 corresponding to the dragged operation area 312 in the direction of the drag operation (step S29). After this, the process returns to step S22, and steps S22 and beyond are repeated.

[0067] According to the split-screen display processing described above, the operation mode can be transitioned to the second mode by dragging the operation area 312 on the boundary line 311 downwards, thereby improving user operability. Specifically, the user can move the boundary line 311 individually by dragging the operation area 312 on the boundary line 311 left or right, and after transitioning to the second mode, all boundary lines 311 can be moved synchronously.

[0068] Furthermore, each of the above configurations, functions, processing units, and processing means may be partially or entirely implemented in hardware, such as integrated circuits. Alternatively, each of the above configurations and functions may be implemented in software, where the processor interprets and executes programs that implement each function. Information such as programs, decision tables, and files that implement each function can be stored in memory, storage devices such as HDDs and SSDs, or recording media such as IC cards, SD cards, and DVDs. Also, control lines and information lines are shown only if deemed necessary for explanation, and not all control lines and information lines are necessarily shown in the actual product. In practice, almost all configurations can be considered interconnected.

[0069] The present invention can be provided not only as an information processing device, but also in various forms such as an information processing method using an information processing device and a computer-readable program. [Explanation of symbols]

[0070] 10...In-vehicle device, 11...Processing unit, 111...Operation determination unit, 112...Function execution unit, 113...Screen generation unit, 12...Operation reception unit, 13...Display unit

Claims

1. A display unit that displays various screens, An operation reception unit is stacked on the display unit and receives user input for the screen, An operation determination unit that determines the user's operation content to the operation reception unit, The system includes a screen generation unit that generates the screen containing the object to be operated on and changes the screen according to the determined operation content, The aforementioned screen generation unit, A list screen is generated that includes a list of multiple options to be used as the target of the operation. The operation determination unit is, In the initial first mode, a drag operation in a direction intersecting the longitudinal direction of the object being operated on in the list screen is determined to be a scroll operation to the list. In the first mode, a drag operation on the target object in the first longitudinal direction of the target object is determined to be an operation that instructs the selected target object to perform a predetermined process that has been set in advance. In the first mode, the system transitions to the second mode in response to a drag operation on the target object in the second longitudinal direction of the target object. In the second mode, a drag operation on the target object in a direction intersecting the longitudinal direction of the target object is determined to be a selection operation for a process to be performed on the selected target object. In the second mode, a drag operation on the target object in the first longitudinal direction of the target object is determined to be an operation that instructs the selected target object to execute the selected process. Information processing device.

2. A display unit that displays various screens, An operation reception unit is stacked on the display unit and receives user input for the screen, An operation determination unit that determines the user's operation content to the operation reception unit, The system includes a screen generation unit that generates the screen containing the object to be operated on and changes the screen according to the determined operation content, The aforementioned screen generation unit, A split screen is generated in which the display area is divided into multiple divided areas by the boundary lines of the object to be operated on, The operation determination unit is, In the initial first mode, a drag operation on the boundary line in a direction intersecting the boundary line is determined as an operation to move the dragged boundary line. In the first mode, the system transitions to the second mode in response to a drag operation on the boundary line in a direction parallel to the boundary line. In the second mode, a drag operation on the boundary line in a direction intersecting the boundary line is determined as an operation to move multiple boundary lines, including the boundary line that has not been dragged, in a synchronous manner. Information processing device.

3. An information processing apparatus according to claim 1 or 2, The aforementioned screen generation unit, The screen is generated with an operation area provided on the target of operation, The operation determination unit determines the user's operation content for the area of ​​the operation reception unit corresponding to the operation area. Information processing device.

4. A display unit that displays various screens, An information processing method using an information processing device comprising an operation reception unit stacked on the display unit and receiving user operation input for the screen, An operation determination step for determining the user's operation content to the operation reception unit, The process includes a screen generation step of generating the screen containing the target of the operation and changing the screen according to the determined operation content, The aforementioned screen generation step is: A list screen is generated that includes a list of multiple options to be used as the target of the operation. The aforementioned operation determination step is: In the initial first mode, a drag operation in a direction intersecting the longitudinal direction of the object being operated on in the list screen is determined to be a scroll operation to the list. In the first mode, a drag operation on the target object in the first longitudinal direction of the target object is determined to be an operation that instructs the selected target object to perform a predetermined process that has been set in advance. In the first mode, the system transitions to the second mode in response to a drag operation on the target object in the second longitudinal direction of the target object. In the second mode, a drag operation on the target object in a direction intersecting the longitudinal direction of the target object is determined to be a selection operation for a process to be performed on the selected target object. In the second mode, a drag operation on the target object in the first longitudinal direction of the target object is determined to be an operation that instructs the selected target object to execute the selected process. Information processing methods.

5. A display unit that displays various screens, An information processing method using an information processing device comprising an operation reception unit stacked on the display unit and receiving user operation input for the screen, An operation determination step for determining the user's operation content to the operation reception unit, The process includes a screen generation step of generating the screen containing the target of the operation and changing the screen according to the determined operation content, The aforementioned screen generation step is: A split screen is generated in which the display area is divided into multiple divided areas by the boundary lines of the object to be operated on, The aforementioned operation determination step is: In the initial first mode, a drag operation on the boundary line in a direction intersecting the boundary line is determined as an operation to move the dragged boundary line. In the first mode, the system transitions to the second mode in response to a drag operation on the boundary line in a direction parallel to the boundary line. In the second mode, a drag operation on the boundary line in a direction intersecting the boundary line is determined as an operation to move multiple boundary lines, including the boundary line that has not been dragged, in a synchronous manner. Information processing methods.

Images