Display control method, program and display device

Abstract

To simplify the operations of moving a displayed image.SOLUTION: The method for controlling display of a display device includes the steps of: displaying a second image in a first image, in the display device; moving the second image displayed in the display device in a first direction on the basis of a first operation by a user to the second image displayed in the display device; and moving a fourth image displayed in the display device in a second direction based on the position of a predetermined region in a third image, the second direction being different from the first direction, on the basis of the first operation by the user to a fourth image in the third image displayed in the display device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a display control method, a program, and a display device. [Background technology]

[0002] In recent years, techniques for displaying predetermined content on a terminal have been developed. For example, Patent Document 1 discloses a technique for displaying content (such as map information) provided from a server on a terminal. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-186603 A Summary of the Invention

[0004] According to a first aspect of the present invention, a display control method for a display device includes displaying a second image included in a first image on the display device, moving the second image displayed on the display device in a first direction based on a first operation by a user with respect to the second image displayed on the display device, and moving the fourth image displayed on the display device in a second direction different from the first direction and based on a position of a predetermined area within the third image based on the first operation by a user with respect to a fourth image included in a third image displayed on the display device. According to a second aspect of the present invention, a program to be executed by a computer of a display device includes displaying a second image included in a first image on the display device, moving the second image displayed on the display device in a first direction based on a first operation by a user on the second image displayed on the display device, and moving the fourth image displayed on the display device in a second direction different from the first direction and based on the position of a predetermined area within the third image based on the first operation by a user on a fourth image included in a third image displayed on the display device. According to a third aspect of the present invention, a display device is provided, comprising: a display unit that displays a second image included in a first image; and a control unit that controls, based on a first operation by a user on the second image displayed on the display unit, to move the second image displayed on the display unit in a first direction; and, based on the first operation by a user on a fourth image included in a third image displayed on the display unit, to move the fourth image displayed on the display unit in a second direction different from the first direction and based on the position of a predetermined area within the third image. [Brief description of the drawings]

[0005] [Figure 1] FIG. 1 is a diagram showing a configuration of a communication system according to an embodiment. [Diagram 2] FIG. 1 is a diagram showing an overview of a configuration of a communication system according to an embodiment. [Diagram 3] 3A and 3B are views showing examples of a first image and a second image according to the embodiment. [Figure 4] 6A to 6C are views showing examples of a third image and a fourth image according to the embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of position information of a predetermined area according to the embodiment; [Figure 6] FIG. 4 is a diagram showing an example of the operation of a control unit included in the terminal of the present embodiment. [Figure 7] FIG. 11 is a diagram showing an example of movement of a fourth image in this embodiment. [Figure 8] 5A to 5C are diagrams showing a first example of a movement direction determination operation performed by a display control unit of the embodiment. [Figure 9] 11A to 11C are diagrams showing a second example of the movement direction determination operation performed by the display control unit of this embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a third image according to the embodiment. [Figure 11] 13A to 13C are diagrams showing a third example of the movement direction determination operation performed by the display control unit of this embodiment. [Figure 12] 13A to 13C are diagrams showing a fourth example of the movement direction determination operation performed by the display control unit of this embodiment. [Figure 13] FIG. 11 is a diagram showing another example of the third image of the embodiment. [Figure 14] FIG. 2 is a diagram showing an example of a three-dimensional image according to the embodiment. [Figure 15] 6A to 6C are views showing examples of a third image and a fourth image according to the embodiment. [Figure 16] 5A to 5C are diagrams showing an example of a movement direction determination operation performed by a display control unit of the embodiment. [Figure 17] 13 is a diagram showing the positional relationship between a movement path set in a third image and a fourth image in this embodiment. FIG. [Figure 18] 5A and 5B are diagrams showing the relationship between a movement path and an operation direction in the embodiment. [Figure 19] 13 is a diagram showing the relationship between the amount of operation and the movement direction of a fourth image in this embodiment. [Figure 20] FIG. 11 is a diagram showing an example of a display form of a display unit in a modified example of the embodiment. [Figure 21] FIG. 11 is a diagram showing a first modified example of the third image of the embodiment. [Figure 22] FIG. 11 is a diagram showing a second modified example of the third image of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0006] <Compliance with legal matters> It should be noted that the disclosures described herein are subject to compliance with the laws of the country of implementation, such as communications secrecy, as necessary for the implementation of the disclosure.

[0007] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment for implementing a display control method, a program, and a display device according to the present disclosure will be described with reference to the drawings.

[0008] <System configuration> FIG. 1 illustrates a configuration of a communication system 1 according to an embodiment of the present disclosure. FIG. 2 illustrates an overview of a configuration of the communication system 1 according to an embodiment of the present disclosure. As disclosed in FIG. 1 or 2, in the communication system 1, a server 10 and terminals 20 (terminals 20A, 20B, and 20C) are connected via a network 30. The server 10 provides a service that enables transmission and reception of messages between the terminals 20 to the terminals 20 owned by users via the network 30. The number of terminals 20 connected to the network 30 is not limited.

[0009] The network 30 plays a role of connecting one or more terminals 20 and one or more servers 10. In other words, the network 30 refers to a communication network that provides a connection path so that the terminals 20 can connect to the server 10 and then transmit and receive data.

[0010] One or more portions of network 30 may or may not be a wired or wireless network. Network 30 may include, by way of example and without limitation, an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless WAN (WWAN), a metropolitan area network (MAN), a portion of the Internet, a portion of the Public Switched Telephone Network (PSTN), a cellular network, integrated service digital networks (ISDN), wireless LAN, long term evolution (LTE), code division multiple access (CDMA), Bluetooth, satellite communications, or the like, or a combination of two or more thereof. Network 30 may include one or more networks 30.

[0011] The terminal 20 (terminal 20A, terminal 20B, terminal 20C) may be any information processing terminal capable of implementing the functions described in each embodiment. The terminal 20 includes, but is not limited to, a smartphone, a mobile phone (feature phone), a computer (such as, but not limited to, a desktop, laptop, tablet, etc.), a media computer platform (such as, but not limited to, a cable or satellite set-top box, digital video recorder, etc.), a handheld computer device (such as, but not limited to, a PDA (personal digital assistant), an email client, etc.), a wearable device (such as, but not limited to, a glasses-type device, a watch-type device, etc.), or other types of computers or communication platforms. The terminal 20 may also be expressed as an information processing terminal.

[0012] Since the configurations of the terminals 20A, 20B, and 20C are basically the same, the terminal 20 will be described below. In addition, as necessary, the terminal used by the user X will be expressed as the terminal 20X, and the user information in a predetermined service associated with the user X or the terminal 20X will be expressed as the user information X. Note that the user information is information of a user associated with an account used by the user in a predetermined service. The user information includes, by way of example and without limitation, information associated with a user, such as the user's name, the user's icon image, the user's age, the user's sex, the user's address, the user's hobbies and interests, and the user's identifier, which is input by the user or given by the predetermined service, and may be any one of these, or a combination thereof, or may not be the same.

[0013] The server 10 has a function of providing a predetermined service to the terminal 20. The server 10 may be any device as long as it is an information processing device capable of realizing the functions described in each embodiment. The server 10 includes, but is not limited to, a server device, a computer (for example, but not limited to, a desktop, a laptop, a tablet, etc.), a media computer platform (for example, but not limited to, a cable or satellite set-top box, a digital video recorder), a handheld computer device (for example, but not limited to, a PDA, an email client, etc.), or other types of computers or communication platforms. The server 10 may also be expressed as an information processing device. When it is not necessary to distinguish between the server 10 and the terminal 20, the server 10 and the terminal 20 may or may not be expressed as information processing devices.

[0014] <Hardware (HW) configuration> The HW configuration of each device included in the communication system 1 will be described with reference to FIG.

[0015] (1) Terminal hardware configuration

[0016] The terminal 20 includes a control unit 21 (CPU: central processing unit), a memory unit 28, a communication I / F 22 (interface), an input / output unit 23, a display unit 24, a microphone 25, a speaker 26, and a camera 27. The HW components of the terminal 20 are connected to each other via a bus B, for example and not for limitation. It is not essential that the HW configuration of the terminal 20 includes all of the components. For example and not for limitation, the terminal 20 may or may not be configured such that individual components, such as the microphone 25, the camera 27, or multiple components, are removable.

[0017] The communication I / F 22 transmits and receives various data via the network 30. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as the communication between the two is possible. The communication I / F 22 has a function of communicating with the server 10 via the network 30. The communication I / F 22 transmits various data to the server 10 according to instructions from the control unit 21. The communication I / F 22 also receives various data transmitted from the server 10 and transmits it to the control unit 21. The communication I / F 22 may also be simply referred to as a communication unit. When the communication I / F 22 is configured from a physically structured circuit, it may also be referred to as a communication circuit.

[0018] The input / output unit 23 includes a device for inputting various operations to the terminal 20, and a device for outputting the results of processing performed by the terminal 20. The input / output unit 23 may be an integrated input unit and an output unit, or may be separate from the input unit and the output unit, or may not be.

[0019] The input unit is realized by any one or a combination of all kinds of devices that can receive input from a user and transmit information related to the input to the control unit 21. Examples of the input unit include, but are not limited to, a touch panel, a touch display, hardware keys such as a keyboard, a pointing device such as a mouse, a camera (operation input via moving images), and a microphone (operation input by voice).

[0020] The output unit is realized by any one or a combination of all kinds of devices capable of outputting the processing results processed by the control unit 21. Examples of the output unit include, but are not limited to, a touch panel, a touch display, a speaker (audio output), a lens (for example, but not limited to, 3D (three dimensions) output and hologram output), a printer, etc.

[0021] The display unit 24 is realized by any one of all kinds of devices capable of displaying according to the display data written in the frame buffer, or a combination thereof. The display unit 24 includes, but is not limited to, a touch panel, a touch display, a monitor (for example, but not limited to, a liquid crystal display or an organic electroluminescence display (OLED)), a head mounted display (HDM), a projection mapping, a hologram, a device capable of displaying images, text information, and the like in air (which may or may not be a vacuum). Note that these display units 24 may or may not be capable of displaying display data in 3D.

[0022] When the input / output unit 23 is a touch panel, the input / output unit 23 and the display unit 24 may be disposed facing each other and have approximately the same size and shape.

[0023] The control unit 21 has a circuit physically structured to execute the functions realized by the code or instructions contained in the program, and is realized by a data processing device built into hardware, for example and without limitation. Therefore, the control unit 21 may or may not be expressed as a control circuit.

[0024] The control unit 21 includes, by way of example and not limitation, a central processing unit (CPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), and a field programmable gate array (FPGA).

[0025] The storage unit 28 has a function of storing various programs and various data required for the operation of the terminal 20. The storage unit 28 includes, by way of example and without limitation, various storage media such as a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a random access memory (RAM), and a read only memory (ROM). In addition, the storage unit 28 may or may not be expressed as a memory.

[0026] Terminal 20 stores program P in storage unit 28, and executes this program P, causing control unit 21 to execute processing as each unit included in control unit 21. In other words, program P stored in storage unit 28 causes terminal 20 to realize each function executed by control unit 21. Also, this program P may or may not be expressed as a program module.

[0027] The microphone 25 is used to input voice data, the speaker 26 is used to output voice data, and the camera 27 is used to obtain video data.

[0028] (2) Server hardware configuration The server 10 includes a control unit 11 (CPU), a storage unit 15, a communication I / F 14 (interface), an input / output unit 12, and a display 13. The components of the HW of the server 10 are connected to each other via a bus B, for example and not for limitation. It is not essential that the HW of the server 10 includes all the components as the configuration of the HW of the server 10. For example and not for limitation, the HW of the server 10 may or may not be configured such that the display 13 is detachable.

[0029] The control unit 11 has circuits physically structured to execute functions realized by codes or instructions contained in a program, and is realized, for example and not by way of limitation, by a data processing device embedded in hardware.

[0030] The control unit 11 is typically a central processing unit (CPU), but may also be a microprocessor, a processor core, a multiprocessor, an ASIC, or an FPGA, but is not limited to these in the present disclosure.

[0031] The storage unit 15 has a function of storing various programs and various data required for the operation of the server 10. The storage unit 15 is realized by various storage media such as an HDD, an SSD, and a flash memory. However, in the present disclosure, the storage unit 15 is not limited to these. Furthermore, the storage unit 15 may or may not be expressed as a memory.

[0032] The communication I / F 14 transmits and receives various data via the network 30. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as the communication between the two is possible. The communication I / F 14 has a function of communicating with the terminal 20 via the network 30. The communication I / F 14 transmits various data to the terminal 20 according to instructions from the control unit 11. The communication I / F 14 also receives various data transmitted from the terminal 20 and transmits it to the control unit 11. The communication I / F 14 may also be simply referred to as a communication unit. When the communication I / F 14 is configured from a physically structured circuit, it may also be referred to as a communication circuit.

[0033] The input / output unit 12 is realized by a device that inputs various operations to the server 10. The input / output unit 12 is realized by any of all types of devices that can receive input from a user and transmit information related to the input to the control unit 11, or a combination thereof. The input / output unit 12 is typically realized by hardware keys such as a keyboard, or a pointing device such as a mouse. Note that the input / output unit 12 may or may not include, as non-limiting examples, a touch panel, a camera (operation input via moving images), or a microphone (operation input by voice). However, in the present disclosure, the input / output unit 12 is not limited to these.

[0034] The display 13 is typically realized by a monitor (for example, but not limited to, a liquid crystal display or an organic electroluminescence display (OLED)). The display 13 may or may not be a head mounted display (HDM) or the like. These displays 13 may or may not be capable of displaying display data in 3D. However, in the present disclosure, the display 13 is not limited to these. The server 10 stores a program P in the storage unit 15, and by executing this program P, the control unit 11 executes the processes of each unit included in the control unit 11. In other words, the program P stored in the storage unit 15 causes the server 10 to realize each function executed by the control unit 11. This program P may or may not be expressed as a program module.

[0035] In each embodiment of the present disclosure, the description will be given assuming that the CPU of the terminal 20 and / or the server 10 executes the program P to realize the present invention.

[0036] The control unit 21 of the terminal 20 and / or the control unit 11 of the server 10 may or may not realize each process by a CPU having a control circuit, but may also realize each process by a logic circuit (hardware) formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or a dedicated circuit. These circuits may or may not be realized by one or more integrated circuits, and the multiple processes shown in each embodiment may or may not be realized by one integrated circuit. Furthermore, an LSI may be called a VLSI, a super LSI, an ultra LSI, or the like, depending on the degree of integration. Therefore, the control unit 21 may or may not be expressed as a control circuit.

[0037] Furthermore, the program P (for example, but not limited to, a software program, a computer program, or a program module) of each embodiment of the present disclosure may or may not be provided in a state stored in a computer-readable storage medium. The storage medium is a "non-transitory tangible medium" capable of storing a program P. The program P may or may not be for realizing part of the functions of each embodiment of the present disclosure. Furthermore, the program P may or may not be a so-called difference file (difference program) that can realize the functions of each embodiment of the present disclosure in combination with a program P already recorded in the storage medium.

[0038] The storage medium may include one or more semiconductor-based or other integrated circuits (ICs) (such as, by way of example and not limitation, a field programmable gate array (FPGA) or an application specific IC (ASIC)), a hard disk drive (HDD), a hybrid hard drive (HHD), an optical disk, an optical disk drive (ODD), a magneto-optical disk, a magneto-optical drive, a floppy diskette, a floppy disk drive (FDD), a magnetic tape, a solid state drive (SSD), a RAM drive, a secure digital card, or a drive, any other suitable storage medium, or a suitable combination of two or more of these. The storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate. It should be noted that the storage medium is not limited to these examples and may be any device or medium capable of storing the program P. In addition, the storage medium may or may not be referred to as a memory.

[0039] The server 10 and / or the terminal 20 can realize the functions of the multiple functional units shown in each embodiment by reading out the program P stored in a storage medium and executing the read out program P.

[0040] Furthermore, the program PDD of the present disclosure may or may not be provided to the server 10 and / or the terminal 20 via any transmission medium capable of transmitting the program (such as a communication network or broadcast waves). The server 10 and / or the terminal 20 executes the program P downloaded via the Internet or the like, for example and not for limitation, to realize the functions of the multiple functional units shown in each embodiment.

[0041] Furthermore, each embodiment of the present disclosure may also be realized in the form of a data signal embedded in a carrier wave in which the program P is embodied by electronic transmission. At least a part of the processing in the server 10 and / or the terminal 20 may or may not be realized by cloud computing configured with one or more computers. At least a part of the processing in the terminal 20 may or may not be configured to be performed by the server 10. In this case, at least a part of the processing of each functional unit of the control unit 21 of the terminal 20 may or may not be configured to be performed by the server 10. At least a part of the processing in the server 10 may or may not be performed by the terminal 20. In this case, at least a part of the processing of each functional unit of the control unit 11 of the server 10 may or may not be performed by the terminal 20. Unless explicitly stated, the judgment configuration in the embodiments of the present disclosure is not essential, and a specified process may or may not be executed when the judgment condition is satisfied, or a specified process may or may not be executed when the judgment condition is not satisfied.

[0042] Note that the programs of the present disclosure are implemented using, by way of example and not limitation, scripting languages ​​such as ActionScript and JavaScript (registered trademark), object-oriented programming languages ​​such as Objective-C and Java (registered trademark), and markup languages ​​such as HTML5.

[0043] First Embodiment The first embodiment is an embodiment in which the display range of an image displayed on the terminal 20 is changed based on a user operation (e.g., a scroll operation). In this embodiment, a part of the entire image is displayed on the terminal 20. This embodiment is an embodiment in which the display range of an image displayed on the terminal 20 can be changed to a direction according to the user's operation direction, or to a direction different from the user's operation direction. For example, when a predetermined area (predetermined area ROI) is set in an image, the terminal 20 of this embodiment can change the display range of the image to the direction of the predetermined area ROI (i.e., a direction different from the user's operation direction) even if the user's operation direction does not necessarily match the direction of the predetermined area ROI. The contents described in the first embodiment are applicable to any of the other embodiments.

[0044] [Image displayed on display device D] An example of the first image IM1 and the second image IM2 of this embodiment will be described with reference to FIG. 3. These first image IM1 and second image IM2 are displayed on a display device D. The above-mentioned terminal 20 will be described as an example of the display device D. When necessary in the following description, a position or direction is indicated by a two-dimensional orthogonal coordinate system having an x-axis and a y-axis. This two-dimensional orthogonal coordinate system is an example for the purpose of explanation, and may be expressed by a three-dimensional coordinate system or a coordinate system other than the orthogonal coordinate system.

[0045] 3 shows an example of a first image IM1 and a second image IM2 according to this embodiment. The second image IM2 is displayed on the terminal 20. In the figure, as an example of the second image IM2, a second image IM2o displayed before a user's operation and a second image IM2a displayed after a user's operation are shown. These second images IM2 are a part of the first image IM1. The first image IM1 includes images such as display object OBJ1 to display object OBJ3. In the example shown in the figure, the first image IM1 is a map image showing the scenery of a certain area, the display object OBJ1 is an image of a lake, the display object OBJ2 is an image of a building, and the display object OBJ3 is an image of stars. A part of the first image IM1 is displayed as the second image IM2 on the display unit 24 of the terminal 20.

[0046] In this embodiment, the first image IM1 is stored in the storage unit 15 of the server 10, and the first image IM1 provided from the server 10 to the terminal 20 is stored in the storage unit 28 of the terminal 20, but this is not limited to the above. For example, the first image IM1 may or may not be provided to the terminal 20 from a device or medium other than the server 10. In addition, the second image IM2 is described as an image selected by the terminal 20 from the first image IM1 provided from the server 10, but this is not limited to the above. For example, the second image IM2 may be an image selected by the server 10 from the first image IM1, or may be an image selected from the first image IM1 by a device other than the server 10 and the terminal 20.

[0047] [User operations] A user operation on the terminal 20 will be described. The control unit 21 of the terminal 20 detects the user operation on the above-mentioned input unit (for example, a touch panel). This user operation includes a scroll operation. As an example, the scroll operation is an operation performed when the display size of the original image to be displayed does not fit within the screen size of the display unit 24, and an image of a partial area of ​​the original image is displayed on the display unit 24 as the image to be displayed. Specifically, the scroll operation is an operation of moving the display target area of ​​the original image in any one of the directions of the screen, up, down, left, and right, or any direction combining these directions, so that a part of the original image that was not displayed on the screen before the operation is displayed on the screen as a new display target area. In other words, the scroll operation is an operation of changing the range of the image displayed on the display unit 24 in the original image. In the following description, the scroll direction indicated by the scroll operation is also referred to as the operation direction OD.

[0048] The scroll operation may or may not be performed by a so-called swipe operation, flick operation, etc. Here, the swipe operation or flick operation is an operation of moving a contact position on the touch panel on the touch panel when the input unit is a touch panel. In addition, the scrolling operation may or may not be performed by operating an operation image indicating the scrolling direction displayed on the screen of the display unit 24, or by operating an operation switch provided on the terminal 20.

[0049] In the example shown in FIG. 3, the display size of the first image IM1 does not fit within the screen size of the display unit 24. A part of the first image IM1 is displayed on the display unit 24. In this example, before the scroll operation, the second image IM2o is displayed on the display unit 24. The second image IM2 is an image included in the first image IM1. When the user performs a scroll operation to move the display area in the operation direction OD, the control unit 21 moves the display area in the first direction DR1. As a result, the second image IM2a is displayed on the display unit 24. That is, the control unit 21 displays the second image IM2 included in the first image IM1 on the display device D. Furthermore, the control unit 21 moves the second image IM2 displayed on the display device D in the first direction DR1 based on a first operation OP1 by the user on the second image IM2 displayed on the display device D.

[0050] In the following description, changing the position of the second image IM2 within the first image IM1 by scrolling will also be described as "moving the display area," "moving the second image IM2 within the first image IM1," or simply "moving the second image IM2."

[0051] In addition, the operation direction OD of the scroll operation and the first direction DR1 are described as being the same, but this is not limited thereto. The operation direction OD of the scroll operation and the first direction DR1 may or may not be the same. For example, the operation direction OD of the scroll operation and the first direction DR1 may be opposite to each other. The above-mentioned scroll operation is an example of a first operation OP1 by the user on the second image IM2 displayed on the display device D. In the following, the first operation OP1 will be described as a scroll operation whose operation direction is the operation direction OD.

[0052] [Regarding the specified region ROI] With reference to FIG. 4, an example of the third image IM3 and the fourth image IM4 will be described. 4 shows an example of the third image IM3 and the fourth image IM4 according to the present embodiment. The fourth image IM4 is displayed on the terminal 20. In the figure, as an example of the fourth image IM4, a fourth image IM4o that is displayed before a user operation is shown. The fourth image IM4 is a part of the third image IM3. The third image IM3 includes images of display objects OBJ1 to OBJ3, etc. These display objects OBJ1 to OBJ3 are similar to the above-mentioned first image IM1, so a description thereof will be omitted.

[0053] The third image IM3 may have a predetermined region ROI set therein. That is, the third image IM3 may or may not have a predetermined region ROI set therein. Also, the third image IM3 may or may not have a plurality of predetermined regions ROI set therein. When the predetermined region ROI is set in the third image IM3, the predetermined region ROI is set, for example, in a region of interest in the third image IM3. In the example shown in the same figure, the predetermined region ROI is set at the position of the display object OBJ2 in the third image IM3. In addition, when a specified region ROI is set in the third image IM3, it may be set by the creator or administrator of the third image IM3, it may be set by artificial intelligence, or it may be set by the user.

[0054] When a predetermined region ROI is set in the third image IM3, position information indicating the position of the predetermined region ROI in the third image IM3 is stored together with the third image IM3 in the storage unit 28. The position information of the predetermined region ROI will be described with reference to FIG.

[0055] 5 shows an example of the position information of the predetermined region ROI in this embodiment. An identifier RID that uniquely identifies the predetermined region ROI, an x ​​coordinate of the center position of the predetermined region ROI in the third image IM3, and a y coordinate of the center position of the predetermined region ROI in the third image IM3 are associated with each other and stored in the storage unit 28 as the position information of the predetermined region ROI. In the example shown in the same figure, the x and y coordinates of the center position are stored as position information, but as long as the position of the specified region ROI can be identified, the means of expressing the position of the specified region ROI is not limited to this. Furthermore, when a plurality of predetermined regions ROI are set in the third image IM3, the storage unit 28 stores position information for each of the predetermined regions ROI.

[0056] In the above description, the first image IM1 is described as an image in which a predetermined region ROI is not set, but this is not limited to the above. A predetermined region ROI may or may not be set in the first image IM1. In addition, when a predetermined region ROI is set in the first image IM1, the first image IM1 may be the third image IM3. In addition, when a predetermined region ROI is set in the first image IM1, the second image IM2 may be the fourth image IM4. That is, the first image IM1 may be the third image IM3 or may be an image other than the third image IM3, and the second image IM2 may be the fourth image IM4 or may be an image other than the fourth image IM4. In the following description, the above-mentioned first image IM1 may be interpreted as a third image IM3 in which no predetermined region ROI is set, and the above-mentioned second image IM2 may be interpreted as a fourth image IM4 included in the third image IM3 in which no predetermined region ROI is set.

[0057] <Functional configuration of the terminal control unit> The functional configuration of the control unit 21 included in the terminal 20 will be described with reference to Fig. 1. The terminal 20 includes an image information acquisition unit 211, an operation determination unit 212, and a display control unit 213 as functions realized by the control unit 21.

[0058] The image information acquisition unit 211 acquires image information from the storage unit 28. The image information acquired by the image information acquisition unit 211 includes image information on the third image IM3. Furthermore, when a predetermined region ROI is set in the third image IM3, the image information acquisition unit 211 acquires the position information of the predetermined region ROI. The image information acquisition unit 211 outputs the acquired image information and position information of the predetermined region ROI to the display control unit 213.

[0059] The operation determination unit 212 determines the state of a user's operation on the input / output unit 23 of the terminal 20. The state of the operation includes the operation position on the display unit 24, the operation direction, and the operation amount. Among these, the operation amount includes the strength of the operation, the operation time, the length of the operation trajectory, etc. The operation determination unit 212 outputs the determined state of the operation to the display control unit 213.

[0060] The display control unit 213 determines the position of the image to be displayed on the display unit 24 from the third image IM3, based on the image information and position information of the predetermined region ROI output by the image information acquisition unit 211 and the determination result of the operation state output by the operation determination unit 212. The display control unit 213 causes the display unit 24 to display the image at the determined position as the fourth image IM4.

[0061] <Operation of the control unit of the terminal> The operation of the control unit 21 included in the terminal 20 of this embodiment will be described with reference to FIG. FIG. 6 shows an example of the operation of the control unit 21 included in the terminal 20 of this embodiment.

[0062] (Step S10) The image information acquisition unit 211 of the control unit 21 acquires image information of the third image IM3 from the storage unit 28. When a predetermined region ROI is set in the third image IM3, the image information acquisition unit 211 acquires, from the storage unit 28, position information of the predetermined region ROI set in the third image IM3.

[0063] (Step S20) The display control unit 213 sets a display range of the third image IM3 to be displayed on the display unit 24. In this step S20, the display control unit 213 sets the display range in a state before a user operation is performed (for example, an initial display state). An example of the display range set by the display control unit 213 in the initial display state is shown in FIG.

[0064] 7 shows an example of movement of the fourth image IM4 in this embodiment. The display control unit 213 sets the fourth image IM4o of the third image IM3 as the display range in the initial display state.

[0065] (Step S30) The display control unit 213 causes the display unit 24 to display an image of the third image IM3 within the display range set in the previous step. For example, in step S20, the display control unit 213 sets the fourth image IM4o as an image in the display range. When transitioning from step S20 to step S30, the display control unit 213 causes the fourth image IM4o to be displayed on the display unit 24. As a result, the fourth image IM4o shown in FIG. 7 is displayed on the display unit 24. (Step S40) The operation determination unit 212 acquires operation information indicating a user's operation on an image. The user's operation includes the above-mentioned scroll operation and an operation to end the display of the image. (Step S50) If the operation indicated by the operation information acquired in step S40 is an operation to end the image display (step S50; YES), the operation determination unit 212 ends the process. If the operation indicated by the operation information acquired in step S40 is not an operation to end the image display (step S50; NO), the operation determination unit 212 advances the process to step S60. In addition, in one example of this embodiment, the above-mentioned "when the operation indicated by the operation information is not an operation to end the display of an image" means "when the operation indicated by the operation information is a scroll operation."

[0066] (Step S60) The display control unit 213 determines the moving direction of the fourth image IM4 based on the position information of the predetermined region ROI acquired in step S10 and the operation information acquired in step S40. An example of a procedure for determining the moving direction of the fourth image IM4 by the display control unit 213 will be described with reference to FIG.

[0067] [Example of determining movement direction (1)] 8 shows a first example of a movement direction determination operation by the display control unit 213 of this embodiment. In this example, the display control unit 213 determines the movement direction of the fourth image IM4 based on whether or not a predetermined region ROI is set in the third image IM3. (Step S110) The display control unit 213 determines whether or not a predetermined region ROI is set in the third image IM3 acquired in step S10. If a predetermined region ROI is not set in the third image IM3 (step S110; NO), the display control unit 213 advances the process to step S120. If a predetermined region ROI is set in the third image IM3 (step S110; YES), the display control unit 213 advances the process to step S130. (Step S120) The display control unit 213 moves the fourth image IM4 in the operation direction OD of the scroll operation indicated by the operation information acquired in step S40. In the example shown in Fig. 7, the display control unit 213 moves the fourth image IM4 in the first direction DR1 which is the direction matching the operation direction OD of the scroll operation.

[0068] (Step S130) The display control unit 213 moves the fourth image IM4 in the second direction DR2 based on the position of the predetermined region ROI in the third image IM3. In the example shown in Fig. 7, the display control unit 213 moves the fourth image IM4 in the second direction DR2, which is the direction of the predetermined region ROI. In this example, the display control unit 213 moves the fourth image IM4 from the fourth image IM4o to the fourth image IM4b. Here, the second direction DR2 is a direction different from the first direction DR1 and is a direction based on the position of the predetermined region ROI in the third image IM3. That is, based on a first operation OP1 by the user on a fourth image IM4 included in a third image IM3 displayed on the display device D, the display control unit 213 moves the fourth image IM4 displayed on the display device D in a second direction DR2 which is different from the first direction DR1 and is based on the position of a specified region ROI within the third image IM3.

[0069] In other words, when the position of the specified region ROI is not set in the third image IM3 (or the first image IM1), the display control unit 213 moves the fourth image IM4 (or the second image IM2) displayed on the display device D in the first direction DR1 based on the first operation OP1, and when the position of the specified region ROI is set in the third image IM3 (or the first image IM1), the display control unit 213 moves the fourth image IM4 (or the second image IM2) displayed on the display device D in the second direction DR2 based on the first operation OP1.

[0070] Moreover, the predetermined region ROI is a region that includes via points on the trajectory of the movement of the fourth image IM4 in the second direction DR2. Here, the trajectory of the movement of the fourth image IM4 is a line that chronologically connects the positions of the fourth image IM4 in the third image IM3 when the fourth image IM4 is moved. In other words, the trajectory of the movement of the fourth image IM4 is a line that is shown as the movement path of the fourth image IM4 as a result of the fourth image IM4 moving in the third image IM3 by the user's operation.

[0071] [Example of determining movement direction (2)] 9 shows a second example of the movement direction determination operation by the display control unit 213 of this embodiment. In this example, the display control unit 213 determines the movement direction of the fourth image IM4 based on whether a predetermined region ROI is set in the third image IM3, as well as whether multiple predetermined regions ROI are set. (Step S210) The display control unit 213 determines whether or not a predetermined region ROI is set in the third image IM3 acquired in step S10. If a predetermined region ROI is not set in the third image IM3 (step S210; NO), the display control unit 213 advances the process to step S220. If a predetermined region ROI is set in the third image IM3 (step S210; YES), the display control unit 213 advances the process to step S230.

[0072] (Step S220) The display control unit 213 moves the fourth image IM4 in the operation direction OD of the scroll operation indicated by the operation information acquired in step S40. An example of the movement of the fourth image IM4 will be described with reference to FIG.

[0073] FIG. 10 shows an example of the third image IM3 of this embodiment. In the example shown in the figure, two predetermined regions ROI, a predetermined region ROI1a and a predetermined region ROI1b, can be set in the third image IM3. When describing the operation direction OD and the movement direction of the fourth image IM4 with reference to the figure, the position of the fourth image IM4o shown in the figure will be described as the reference position POSo of the direction. For example, in the example shown in the figure, the operation direction OD is the positive x-axis direction with reference to the reference position POSo.

[0074] When neither the predetermined region ROI1a nor the predetermined region ROI1b is set in the third image IM3, the display control unit 213 moves the fourth image IM4 in the direction of the operation direction OD, i.e., the first direction DR11. In the example shown in the figure, the display control unit 213 moves the fourth image IM4o at the reference position POSo (coordinates x0, y0) to the fourth image IM4a at the position POSa (coordinates xa, ya).

[0075] The direction of the operation OD here is the direction of the first operation OP1 (for example, a scroll operation) described above. That is, the first direction DR11 is a direction based on the direction of the first operation OP1.

[0076] (Step S230) Returning to Fig. 9, the display control unit 213 determines whether or not multiple predetermined regions ROI are set in the third image IM3 acquired in step S10. If multiple predetermined regions ROI are set in the third image IM3 (step S230; YES), the display control unit 213 advances the process to step S250. Furthermore, when multiple predetermined regions ROI are not set in the third image IM3, that is, when a single predetermined region ROI is set (step S110; NO), the display control unit 213 advances the process to step S240. In the third image IM3 shown in FIG. 12, a case where only a predetermined region ROI1a is set and a predetermined region ROI1b is not set will be described as an example of a case where a single predetermined region ROI is set in the third image IM3.

[0077] (Step S240) The display control unit 213 moves the fourth image IM4 in the second direction DR12 based on the position of the predetermined region ROI in the third image IM3. In the example shown in Fig. 10, when a predetermined region ROI1a is set as a single predetermined region ROI, the display control unit 213 moves the fourth image IM4 in the second direction DR12, which is the direction of the predetermined region ROI1a. In this example, the display control unit 213 moves the fourth image IM4 from the fourth image IM4o to the fourth image IM4b.

[0078] (Step S250) The display control unit 213 moves one of the plurality of predetermined regions ROI in the third image IM3 from the reference position POSo in the second direction DR12 based on the position of the predetermined region ROI in the operation direction OD (for example, the first direction DR11).

[0079] That is, the second direction DR12 is a direction based on the direction of the first operation OP1 and the position of the predetermined region ROI.

[0080] 10, a case will be described in which a plurality of predetermined regions ROI (for example, a predetermined region ROI1a and a predetermined region ROI1b) are set. In this case, the display control unit 213 determines which of the predetermined region ROI1a and the predetermined region ROI1b is in the operation direction OD. An example of a determination procedure by the display control unit 213 will be described. As shown in the figure, the display control unit 213 sets a line that passes through the reference position POSo and is perpendicular to the operation direction OD (for example, the positive direction of the x-axis) as a reference line Lo. The display control unit 213 determines that the predetermined region ROI set on the operation direction OD side from the reference line Lo among the multiple predetermined regions ROI is the predetermined region ROI in the operation direction OD. In the example shown in the figure, the display control unit 213 determines that the predetermined region ROIa set in the operation direction OD from the reference line Lo among the predetermined regions ROI1a and ROI1b is the predetermined region ROI in the operation direction OD. In this case, the display control unit 213 moves the fourth image IM4 in the second direction DR12, which is the direction of the predetermined region ROI1a. In this example, the display control unit 213 moves the fourth image IM4 from the fourth image IM4o to the fourth image IM4b.

[0081] That is, the third image IM3 includes a plurality of predetermined regions ROI, and the second direction DR12 is a direction based on the position of a predetermined region ROI among the plurality of predetermined regions ROI that is located in the first direction DR11 from the reference position POSo in the fourth image IM4 displayed on the display device D. When a plurality of predetermined regions ROI are set, the display control unit 213 may or may not move the fourth image IM4 through these plurality of predetermined regions ROI in order. For example, in the example shown in Fig. 10, when the predetermined region ROI1a and the predetermined region ROI1b are set, the display control unit 213 may move the fourth image IM4 from the reference position POSo to the predetermined region ROI1a via the predetermined region ROI1b.

[0082] [Example of determining movement direction (3)] 11 shows a third example of the movement direction determination operation by the display control unit 213 of this embodiment. In this example, a procedure for determining the movement direction of the fourth image IM4 in a case where a plurality of predetermined regions ROI are set in a relatively close direction will be described. The display control unit 213 determines which of the predetermined region ROI 2a and the predetermined region ROI 2b is the predetermined region ROI located in the operation direction OD. The display control unit 213 sets an arc having the reference position POSo as the center and including the operation direction OD (for example, the positive direction of the x-axis) as the reference arc Co. The display control unit 213 determines that, among the multiple predetermined regions ROI, the predetermined region ROI included within the range of the reference arc Co is the predetermined region ROI in the operation direction OD. In the example shown in the same figure, among the predetermined regions ROI2a and ROI2b, the predetermined region ROI2a is set within the range of the reference arc Co, and the predetermined region ROI2b is set outside the range of the reference arc Co. In this case, the display control unit 213 determines that the predetermined region ROI2a set within the range of the reference arc Co is the predetermined region ROI in the operation direction OD.

[0083] [Example of determining movement direction (4)] 12 shows a fourth example of the movement direction determination operation by the display control unit 213 of this embodiment. In this example, the display control unit 213 determines the movement direction of the fourth image IM4 based on whether or not a predetermined region ROI is set in the third image IM3, as well as based on the relationship between the operation direction OD and the direction of the predetermined region ROI relative to the reference position POSo. (Step S310) The display control unit 213 determines whether or not a predetermined region ROI is set in the third image IM3 acquired in step S10. If a predetermined region ROI is not set in the third image IM3 (step S310; NO), the display control unit 213 advances the process to step S320. If a predetermined region ROI is set in the third image IM3 (step S310; YES), the display control unit 213 advances the process to step S330.

[0084] (Step S320) The display control unit 213 moves the fourth image IM4 in the operation direction OD of the scroll operation indicated by the operation information acquired in step S40.

[0085] (Step S330) The display control unit 213 compares the operation direction OD with the second direction DR12 based on the position of the predetermined region ROI in the third image IM3. Specifically, the display control unit 213 determines whether the direction of the predetermined region ROI relative to the reference position POSo is within a predetermined range of the operation direction OD. The relationship between the operation direction OD and the direction of the predetermined region ROI will be described with reference to FIG. 13.

[0086] 13 shows another example of the third image IM3 of this embodiment. In the example shown in the figure, a predetermined region ROI3 is set in the third image IM3. When describing the operation direction OD and the movement direction of the fourth image IM4 with reference to the figure, the position of the fourth image IM4o shown in the figure will be described as the reference position POSo of the direction. For example, in the example shown in the figure, the operation direction OD is the negative y-axis direction with reference to the reference position POSo.

[0087] The display control unit 213 sets an arc having the reference position POSo as a center and including the operation direction OD (the negative y-axis direction in the example shown in the figure) as a reference arc Co. This reference arc Co indicates a predetermined range of the operation direction OD. The display control unit 213 determines whether the direction of the predetermined region ROI relative to the reference position POSo (the second direction DR32 shown in the figure) is included within the range of the reference arc Co. In the example shown in the figure, the direction of the predetermined region ROI relative to the reference position POSo (the second direction DR32 shown in the figure) is not included in the range of the reference arc Co. In this case, the display control unit 213 determines that the direction of the predetermined region ROI relative to the reference position POSo is not within the predetermined range of the operation direction OD (step S330; NO), and returns the process to the above-mentioned step S320. That is, the display control unit 213 moves the fourth image IM4 in the direction (first direction DR31) according to the operation direction OD. Furthermore, when the display control unit 213 determines that the direction of the predetermined region ROI relative to the reference position POSo is within the predetermined range of the operation direction OD (step S330; YES), the process proceeds to step S340. Note that the operation of the display control unit 213 in step S340 is the same as that in step S130 described above, and therefore the description thereof will be omitted.

[0088] That is, in this example, the display control unit 213 selects whether to move the fourth image IM4 in the first direction DR1 or the second direction DR2 based on the relationship between the direction of the first operation OP1 and the second direction DR2.

[0089] [Example of determining movement direction (5)] In addition, in each of the judgment examples described above, the display control unit 213 may select whether to move the fourth image IM4 in the first direction DR1 or the second direction DR2 based on the amount of operation of the first operation OP1. As described above, the operation information acquired by the operation determination unit 212 includes information indicating the amount of operation by the user. The amount of operation by the user includes the strength of the operation, the time of the operation, the speed of the operation, the length of the trajectory of the operation, and the like. In this example, the display control unit 213 moves the fourth image IM4 in the first direction DR1, which is the direction corresponding to the operation direction OD, when the strength of the operation is relatively strong, regardless of whether a specified region ROI is set or not. Also, for example, when a specified region ROI is set, if the strength of the operation is relatively strong, the display control unit 213 moves the fourth image IM4 in the first direction DR1, and if the strength of the operation is relatively weak, the display control unit 213 moves the fourth image IM4 in the second direction DR2, which is the direction according to the specified region ROI.

[0090] <Advantages of the First Embodiment>

[0091] Conventionally, when moving an image displayed on a display screen in the direction of a predetermined region ROI, for example, it was required to perform an operation to move the image in the direction in which the predetermined region ROI exists within the image. In the case of this conventional technology, there were problems such as it being difficult for a user to grasp the direction in which the predetermined region ROI exists, or it being difficult to perform an accurate operation toward the direction in which the predetermined region ROI exists. According to the display device D (e.g., the terminal 20) of the present embodiment configured as described above, an image (e.g., the fourth image IM4) can be moved in the direction of the predetermined region ROI by a simplified operation. Here, the simplified operation is, for example, an operation that does not depend on the exact direction of the predetermined region ROI. Furthermore, according to the display device D (e.g., terminal 20) of this embodiment configured as described above, the operation is simplified, thereby reducing the amount of calculation required to display an image based on the operation, thereby resulting in an effect of reducing the calculation processing load on the display device D.

[0092] Furthermore, in the display device D (for example, the terminal 20) of this embodiment, a predetermined region ROI is set in an image (for example, the third image IM3). According to the display device D (for example, the terminal 20) of the present embodiment configured as described above, since a predetermined region ROI is set for the third image IM3, the operation on the third image IM3 is simplified. Therefore, according to the display device D (for example, the terminal 20) of the present embodiment, the amount of calculation for displaying an image based on the user's operation on the third image IM3 is reduced, and as a result, the effect of reducing the calculation processing load of the display device D is obtained.

[0093] In addition, in the display device D (for example, the terminal 20) of this embodiment, the above-mentioned first image IM1 is the third image IM3, and the second image IM2 is the fourth image IM4. In the display device D (for example, the terminal 20) of this embodiment, when a predetermined region ROI is set in the first image IM1 (i.e., the third image IM3), it is possible to move the second image IM2 (i.e., the fourth image IM4) in a certain direction (for example, the direction of the user's operation) or in the direction of the predetermined region ROI. Therefore, according to the display device D (for example, the terminal 20) of this embodiment, the amount of calculation for displaying an image based on the user's operation on the third image IM3 is reduced, and as a result, the effect of reducing the calculation processing load of the display device D is obtained.

[0094] Moreover, according to the display device D (for example, the terminal 20) of the present embodiment, the direction of movement of the image by the first operation OP1 (for example, a scroll operation) can be changed between a case where a predetermined region ROI is set in the image (for example, the third image IM3) and a case where the predetermined region ROI is not set. Specifically, the display device D (for example, the terminal 20) of the present embodiment can set the direction of movement of the image by the first operation OP1 to the direction of the predetermined region ROI when the predetermined region ROI is set, and can set the direction of movement of the image by the scroll operation to the direction of the scroll operation when the predetermined region ROI is not set. Therefore, according to the display device D (for example, the terminal 20) of the present embodiment, it is possible to allow the user to operate without being aware of whether or not the predetermined region ROI is set, and it is possible to provide the user with an intuitive feeling of operation. Furthermore, according to the display device D (for example, the terminal 20) of the present embodiment, by providing the user with an intuitive feeling of operation, the frequency of operation is reduced because erroneous operations are reduced, and the amount of calculation for moving the image is reduced, and as a result, it is possible to obtain an effect that the load of the display device D can be reduced in calculation processing.

[0095] Furthermore, according to the display device D (for example, the terminal 20) of this embodiment, an image is moved in a direction based on the direction of the first operation OP1 (for example, a scroll operation) and the position of the predetermined region ROI. According to the display device D (for example, the terminal 20) of this embodiment configured in this manner, even if multiple predetermined regions ROI are set in an image (for example, the third image IM3), it is possible to select a predetermined region ROI set in the direction of the first operation OP1 from among the multiple predetermined regions ROI, and move the image in the direction of the predetermined region ROI. According to the display device D (for example, the terminal 20) of this embodiment, it is possible to move an image (for example, the fourth image IM4) in the direction of the predetermined region ROI by a simplified operation.

[0096] Moreover, in the display device D (for example, the terminal 20) of this embodiment, the third image IM3 includes a plurality of predetermined regions ROI. Moreover, in the display device D (for example, the terminal 20) of this embodiment, the second direction DR2 is a direction based on the position of the predetermined region ROI in the first direction DR1 (for example, the direction of the scroll operation) from the reference position POSo among the plurality of predetermined regions ROI. That is, the display device D (for example, the terminal 20) of this embodiment moves the image in a direction based on the direction of the first operation OP1 (for example, the scroll operation) and the position of the predetermined region ROI. According to the display device D (for example, the terminal 20) of this embodiment configured in this way, for example, even if a plurality of predetermined regions ROI are set in an image (for example, the third image IM3), it is possible to select a predetermined region ROI set in the direction of the first operation OP1 from among the plurality of predetermined regions ROI, and move the image in the direction of the predetermined region ROI. According to the display device D (for example, the terminal 20) of this embodiment, it is possible to move an image (for example, the fourth image IM4) in the direction of the predetermined region ROI by a simplified operation.

[0097] Moreover, in the display device D (e.g., the terminal 20) of this embodiment, the predetermined region ROI is a region including the via points of the trajectory of the movement of the fourth image IM4 in the second direction DR2. That is, the display device D (e.g., the terminal 20) of this embodiment sets the trajectory of the movement of the fourth image IM4 based on the position of the predetermined region ROI. According to the display device D (e.g., the terminal 20) of this embodiment configured in this manner, even if the operation direction of the user's scroll operation is a direction different from the direction in which the predetermined region ROI is located, the fourth image IM4 can be moved in the direction of the predetermined region ROI. According to the display device D (e.g., the terminal 20) of this embodiment, an image (e.g., the fourth image IM4) can be moved in the direction of the predetermined region ROI by a simplified operation.

[0098] Further, the display device D (for example, the terminal 20) of the present embodiment selects whether to move the fourth image IM4 in the first direction DR1 or the second direction DR2 based on the relationship between the direction of the first operation (for example, the operation direction OD) and the second direction DR2 (for example, the direction based on the position of the predetermined region ROI). According to the display device D (for example, the terminal 20) of the present embodiment configured in this manner, for example, when the difference between the operation direction of the user's scroll operation and the direction in which the predetermined region ROI is located is relatively large, the fourth image IM4 can be moved in the direction of the scroll operation, and when the difference between the operation direction of the user's scroll operation and the direction in which the predetermined region ROI is located is relatively small, the fourth image IM4 can be moved in the direction in which the predetermined region ROI is located. According to the display device D (for example, the terminal 20) of the present embodiment, an image (for example, the fourth image IM4) can be moved in the direction of the predetermined region ROI by a simplified operation.

[0099] Furthermore, according to the display device D (e.g., terminal 20) of this embodiment, the image movement direction is selected from the direction of the predetermined region ROI and the direction of the first operation OP1 depending on the amount of the first operation OP1 (e.g., a scroll operation). For example, the display device D (e.g., terminal 20) of this embodiment can move an image (e.g., the fourth image IM4) in the direction of the predetermined region ROI if the amount of the first operation OP1 is small, and in the direction of the first operation OP1 if the amount of the first operation OP1 is large. Therefore, according to the display device D (e.g., terminal 20) of this embodiment, it is possible to provide the user with an intuitive sense of operation.

[0100] [Modification: Example (1) of Movement of Fourth Image IM4] In the above-mentioned specific example, the first image IM1 to the fourth image IM4 are described as two-dimensional images, but this is not limited thereto. Each of these images may or may not be a three-dimensional image. When each image is a three-dimensional image, for example, the movement of the fourth image IM4 in the first direction DR1 or the second direction DR2 may be performed by enlarging or reducing the fourth image IM4 to move the fourth image IM4. Here, the three-dimensional image is an image presented in a format that allows the user to recognize a position in the depth direction (depth position). For example, the three-dimensional image may be an image expressed by the parallax between a left-eye image presented to the left eye of the user and a right-eye image presented to the right eye of the user, or may be an image presented in another format. Enlarging or reducing the fourth image IM4 also includes enlarging or reducing the size of the display object OBJ recognized by the user by changing the depth position of the display object OBJ included in the three-dimensional image. As an example, when the terminal 20 is a device equipped with a VR (virtual reality) headset and the third image IM3 and the fourth image IM4 are each a three-dimensional image, the terminal 20 can present a VR image to the user. When the terminal 20 is a VR headset terminal, the fourth image IM4 can be enlarged or reduced based on the operation direction OD, thereby giving the user a sensation of moving in the operation direction OD. FIG. 14 shows an example of a three-dimensional image according to this embodiment. When the terminal 20 is a VR headset terminal, a fourth image IM4L (image for the left eye) is presented to the left eye of the user, and a fourth image IM4R (image for the right eye) is presented to the right eye. These fourth images IM4L (image for the left eye) and IM4R (image for the right eye) have a parallax with each other, and are images that allow the user to recognize the depth position of the display target OBJ. In this example, the display target OBJ is an image of a road. A predetermined area ROI is set in this display target OBJ (for example, a road). Specifically, a predetermined area ROI41 (predetermined area ROI41L and predetermined area ROI41R) and a predetermined area ROI42 (predetermined area ROI42L and predetermined area ROI42R) are respectively set in the display target OBJ. The display control unit 213 of the terminal 20 moves the fourth image IM4 in the second direction DR2 based on a user operation. In this example, when the user performs a scroll operation to move forward on the road, the terminal 20 moves the position of the fourth image IM4L along the second direction DR2L and the position of the fourth image IM4R along the second direction DR2R. That is, according to the display device D (for example, the terminal 20) configured in this way, the image representation method can be expanded, and therefore it can be applied to various applications that use two-dimensional images and three-dimensional images. Furthermore, according to the display device D (for example, the terminal 20) configured in this manner, the fourth image IM4 can be moved in the direction of the predetermined region ROI by a simplified operation. Furthermore, according to the display device D (e.g., terminal 20) configured in this manner, the operation is simplified, thereby reducing the amount of calculation required to display an image based on the operation, which ultimately results in the effect of reducing the load on the terminal 20 and the server 10.

[0101] [Modification: Example (2) of Movement of Fourth Image IM4] In the above-mentioned specific example, the fourth image IM4 is assumed to move continuously from the reference position POSo toward the predetermined region ROI, but the present invention is not limited to this. For example, the fourth image IM4 may be moved discontinuously from the reference position POSo in the third image IM3 displayed on the display device D to the position of the predetermined region ROI in the third image IM3 based on the amount of the first operation OP1. Here, moving continuously means that when the movement of the fourth image IM4 is expressed by frame images (or frames) of a moving image, the displacement amount of the fourth image IM4 between frame images is relatively small and the number of frame images per unit time (or frame rate) is relatively high to play the moving image. As a result, the user perceives the fourth image IM4 as moving smoothly and continuously. On the other hand, moving discontinuously means that when the movement of the fourth image IM4 is expressed by frame images (or frames) of a moving image, the displacement amount of the fourth image IM4 between frame images is relatively large, or the number of frame images per unit time (or frame rate) is relatively low, and the moving image is played back. As a result, the user perceives the position of the fourth image IM4 as changing discontinuously. According to the display device D (for example, the terminal 20) configured in this manner, it is possible to move the fourth image IM4 to the position of the predetermined region ROI more quickly than in the case of continuously moving the fourth image IM4. Therefore, according to the display device D (for example, the terminal 20) configured in this manner, it is possible to simplify the operation of moving the fourth image IM4 in the direction of the predetermined region ROI. Furthermore, according to the display device D (for example, the terminal 20) configured in this manner, the simplified operation reduces the amount of calculation for displaying an image based on the operation, which results in an effect of reducing the load on the terminal 20 and the server 10. Furthermore, when the display device D (for example, the terminal 20) is a device that presents three-dimensional images such as a VR headset terminal, the user may experience discomfort (for example, so-called VR sickness) depending on the image representation format. This discomfort (for example, VR sickness) may occur significantly when the timing of the user's head displacement does not match the timing of the image displayed on the VR headset terminal. In general, when the generation time of an image displayed on the VR headset terminal is relatively long, the display delay becomes relatively large, and the difference between the timing of the user's head displacement and the timing of the image displayed on the VR headset terminal may become large. According to the display device D (for example, the terminal 20) of this embodiment, the amount of calculation for displaying an image is reduced as described above, and therefore the discomfort felt by the user can be reduced.

[0102] <Second embodiment> The second embodiment is a mode in which the movement path PT of the fourth image IM4 is determined in advance. The contents described in the second embodiment are applicable to any of the other embodiments.

[0103] FIG. 15 shows an example of a third image IM3 and a fourth image IM4 according to this embodiment. The third image IM3 of this embodiment differs from the third image IM3 of the above-mentioned embodiment in that a movement path PT is set in the third image IM3. In this embodiment, a predetermined area ROI1 to a predetermined area ROI3 are set for display objects OBJ1 to OBJ3 in the third image IM3, respectively. In the example shown in the figure, the fourth image IM4 moves along the movement path PT (for example, to the fourth image IM4p). The same configurations and operations as those in the above-described embodiment are denoted by the same reference numerals and their description will be omitted.

[0104] In the above embodiment, the first image IM1 is described as an image in which a predetermined region ROI is not set, but this is not limited to the above. A predetermined region ROI may or may not be set in the first image IM1. In addition, when a predetermined region ROI is set in the first image IM1, the first image IM1 may be the third image IM3. In addition, when a predetermined region ROI is set in the first image IM1, the second image IM2 may be the fourth image IM4. That is, the first image IM1 may be the third image IM3 or may be an image other than the third image IM3, and the second image IM2 may be the fourth image IM4 or may be an image other than the fourth image IM4. In the following description, the above-mentioned first image IM1 may be interpreted as a third image IM3 in which no predetermined region ROI is set, and the above-mentioned second image IM2 may be interpreted as a fourth image IM4 included in the third image IM3 in which no predetermined region ROI is set.

[0105] A movement path PT is set in the third image IM3. The movement path PT is information that is determined as a movement path of the fourth image IM4 within the third image IM3 based on the position of a predetermined region ROI within the third image IM3. In this embodiment, the movement of the fourth image IM4 in the second direction DR2 is movement on a movement path PT that is determined based on the position of the predetermined region ROI in the first image IM1. In addition, when the movement path PT is set in the third image IM3, it may be set by the creator or administrator of the third image IM3, may be set by artificial intelligence, or may be set by the user. As an example, when the movement path PT is set by artificial intelligence, the artificial intelligence performs object recognition on the display targets OBJ included in the third image IM3, and selects the display targets OBJ to be presented to the user from among the object-recognized display targets OBJ, thereby setting the movement path PT so as to overlap with the selected display target OBJ.

[0106] In the example shown in the figure, the movement path PT is set by connecting the positions of each of the predetermined regions ROI in the order of predetermined region ROI1, predetermined region ROI2, and predetermined region ROI3 with straight lines or curves.

[0107] [Example of determining movement direction (2-1)] 16 shows an example of a movement direction determination operation by the display control unit 213 of this embodiment. This example differs from each determination example of the above-described embodiment in that, when a movement path PT is set in the third image IM3, the display control unit 213 determines the movement direction of the fourth image IM4 based on the movement path PT. The operations from step S410 to step S440 below correspond to the operation in step S60 described with reference to FIG.

[0108] (Step S410) The display control unit 213 determines whether or not a movement path PT is set in the third image IM3 acquired in step S10 shown in Fig. 8. If a movement path PT is not set in the third image IM3 (step S410; NO), the display control unit 213 advances the process to step S420. If a movement path PT is set in the third image IM3 (step S410; YES), the display control unit 213 advances the process to step S430.

[0109] (Step S420) The display control unit 213 moves the fourth image IM4 in the operation direction OD of the scroll operation indicated by the operation information acquired in step S40 shown in Fig. 8. That is, when a movement path PT is not set in the third image IM3, the display control unit 213 moves the fourth image IM4 in the operation direction OD.

[0110] In the example shown in the figure, when the movement path PT is not set in the third image IM3, the display control unit 213 moves the fourth image IM4 in the operation direction OD, but this is not limited to this. When the movement path PT is not set in the third image IM3, the display control unit 213 may move the fourth image IM4 based on any one of the determination procedures shown in the respective determination examples described in the above-mentioned embodiment, or a combination thereof, or may move the fourth image IM4 based on another determination procedure.

[0111] (Step S430) The display control unit 213 determines whether or not the display range of the fourth image IM4 overlaps with the movement path PT. The relationship between the display range of the fourth image IM4 and the movement path PT will be described with reference to FIG.

[0112] FIG. 17 shows the positional relationship between the movement path PT set in the third image IM3 and the fourth image IM4 in this embodiment. The movement path of the fourth image IM4 will be described in chronological order with reference to the same figure. In this example, the user performs a scroll operation to move the fourth image IM4 in the x-axis positive direction at each time from time t0 to time t3. For example, the user performs a scroll operation to move the fourth image IM41 in the operation direction OD40 at time t0. Also, the user performs a scroll operation to move the fourth image IM41a in the operation direction OD41 at time t1. The user performs a scroll operation in the same manner at times t2 to t3. In this example, the operation direction OD of the scroll operation at each time t is the x-axis positive direction (for example, the direction of the first direction DR41).

[0113] At time t0, the fourth image IM41 is located at the display position POS10. At the display position POS10, the display range of the fourth image IM41 does not overlap with the movement path PT. The display control unit 213 determines that the display range of the fourth image IM4 does not overlap with the movement path PT (step S430; NO), and proceeds to the process at step S420. Note that in step S420, the display control unit 213 moves the fourth image IM41 in the operation direction OD (for example, the first direction DR41). As a result, as shown in FIG. 17, the fourth image IM41 is moved to the position of the fourth image IM41a (for example, the display position POS11).

[0114] At time t1, the fourth image IM41a is located at a display position POS11. At the display position POS11, the display range of the fourth image IM41a overlaps with the movement path PT. The display control unit 213 determines that the display range of the fourth image IM4a overlaps with the movement path PT (step S430; YES), and proceeds to step S440.

[0115] (Step S440) Returning to Fig. 16, the display control unit 213 moves the fourth image IM41a in the direction of the movement path PT according to the operation direction OD. A case will be described where a scroll operation in the operation direction OD41 is performed at time t1 shown in Fig. 17. In this case, the display control unit 213 moves the fourth image IM41a in the tangent direction (in this example, the second direction DR42a) of the movement path PT at the display position POS11.

[0116] Thereafter, at times t2 and t3, the display control unit 213 moves the fourth image IM4 in the same manner as at time t1. That is, at time t2, the display control unit 213 moves the fourth image IM41b in the direction of the movement path PT (for example, the second direction DR42b) based on the operation direction OD42. At time t3, the display control unit 213 moves the fourth image IM41c in the direction of the movement path PT (for example, the second direction DR42c) based on the operation direction OD43.

[0117] As described above, the display control unit 213 changes the movement direction of the fourth image IM4 based on whether or not the display range of the fourth image IM4 overlaps with the movement path PT. Specifically, when the display range of the fourth image IM4 does not overlap with the movement path PT, the display control unit 213 sets the operation direction OD as the movement direction of the fourth image IM4. When the display range of the fourth image IM4 overlaps with the movement path PT, the display control unit 213 sets the direction of the movement path PT (for example, the tangent direction of the movement path PT) as the movement direction of the fourth image IM4. In other words, when the fourth image IM4 moves in the first direction DR1 such that the reference point in the fourth image IM4 is located on the movement path PT, the display control unit 213 sets the movement direction of the second image IM2 to the direction of the movement path PT (e.g., the second direction DR2).

[0118] [Example of determining movement direction (2-2)] 18 shows the relationship between the movement path PT and the operation direction OD in this embodiment. When the operation direction OD and the direction of the movement path PT are different from each other, the display control unit 213 may select the movement direction of the fourth image IM4 based on the amount of operation of the operation direction OD. For example, the user performs a scroll operation on the fourth image IM41d in the direction of the operation direction OD44 (in this example, the negative y-axis direction). In this example, the display position POS14 of the fourth image IM41d is located on the movement path PT. In this case, the fourth image IM41d is movable along the direction of the movement path PT. Also, in this example, the operation direction OD44 and the direction of the movement path PT are different from each other. When the fourth image IM41d is located on the movement path PT, if the operation direction OD44 and the direction of the movement path PT are different from each other, the display control unit 213 selects the movement direction of the fourth image IM41d based on the amount of operation in the operation direction OD44. For example, when the fourth image IM41d is located on the movement path PT, if the operation direction OD44 and the direction of the movement path PT are different from each other and the amount of operation in the operation direction OD44 is relatively strong, the display control unit 213 moves the fourth image IM41d in a direction corresponding to the operation direction OD44 (first direction DR41d). As described above, the amount of operation includes the strength of the operation, the time of the operation, the speed of the operation, the length of the operation trajectory, and the like. As a result of the movement of the fourth image IM41d in the first direction DR41d, the position of the fourth image IM41f becomes the display position POS15. This display position POS15 is not located on the movement path PT. In other words, when the fourth image IM41d is located on the movement path PT, if a scroll operation is performed with a large amount of operation (for example, strongly) in a direction different from the direction of the movement path PT (for example, the operation direction OD44), the display control unit 213 moves the fourth image IM41d away from the movement path PT.

[0119] [Example of determining movement direction (2-3)] 19 shows the relationship between the amount of operation and the movement direction of the fourth image IM4 in this embodiment. As described above, when the display position POS of the fourth image IM4 is located on the movement path PT, if the operation direction OD by the user's scroll operation matches the direction of the movement path PT within a predetermined range, the display control unit 213 moves the fourth image IM4 along the movement path PT. In this example, when the display control unit 213 moves the fourth image IM4 along the movement path PT, the range in which it is determined that the operation direction OD and the direction of the movement path PT are consistent is varied based on the amount of scrolling operation performed by the user. That is, the display control unit 213 changes the range in which it is determined that the operation direction OD and the direction of the movement path PT match, based on the amount of the scroll operation by the user. 18, when the display position POS16 of the fourth image IM41g is located on the movement path PT, if the amount of operation by the user is relatively small, the display control unit 213 sets the range in which it is determined that the operation direction OD and the direction of the movement path PT match as the range of the reference arc Co. That is, in this case, when the movement path PT is included within the range of the reference arc Co, the display control unit 213 determines that the operation direction OD and the direction of the movement path PT match. Furthermore, when the display position POS16 of the fourth image IM41g is located on the movement path PT, if the amount of operation by the user is relatively strong, the display control unit 213 determines that the operation direction OD and the direction of the movement path PT match with each other as the range of the arc Cst, which is wider than the range of the reference arc Co. That is, in this case, the display control unit 213 determines that the operation direction OD and the direction of the movement path PT match with each other when the movement path PT is included in the range of the arc Cst.

[0120] <Effects of the second embodiment> At the display position POS13 shown in FIG. 17, a predetermined region ROI is set on the movement path PT. The display control unit 213 of this embodiment moves the fourth image IM4 along the movement path PT. At each time t from time t0 to time t2, the user performs a scroll operation with the operation direction OD set to the positive direction of the x-axis. That is, at each time t from time t0 to time t2, the user performs a scroll operation with the operation direction OD set to a direction different from the direction of the predetermined region ROI. In this way, even if the user performs a scroll operation with the operation direction OD set to a direction different from the direction of the predetermined region ROI, the display control unit 213 moves the fourth image IM4 so that it reaches the predetermined region ROI. According to the display device D (for example, the terminal 20) configured in this manner, even if the direction of the user's scroll operation does not necessarily match the direction of the predetermined region ROI, the fourth image IM4 can be moved to the position of the predetermined region ROI. Therefore, according to the display device D (for example, the terminal 20) configured in this manner, the operation of moving the fourth image IM4 in the direction of the predetermined region ROI can be simplified. Furthermore, according to the display device D (for example, the terminal 20) configured in this manner, the simplified operation reduces the amount of calculation for displaying an image based on the operation, which ultimately provides the effect of reducing the load on the terminal 20 and the server 10.

[0121] In addition, when a movement path PT is set as in this embodiment and the fourth image IM4 is moved along the movement path PT, if the state of the scroll operation by the user is in a predetermined state, the fourth image IM4 may or may not be moved in the operation direction OD rather than in the direction of the movement path PT. Specifically, when there is a deviation of a predetermined angle or more between the operation direction OD of the scroll operation and the direction of the movement path PT, the display control unit 213 may move the fourth image IM4 in the operation direction OD instead of in the direction of the movement path PT. In addition, when the amount of scrolling operation (strength of the operation, duration of the operation, speed of the operation, length of the operation trajectory, etc.) exceeds a predetermined value, the display control unit 213 may move the fourth image IM4 in the operation direction OD instead of in the direction of the movement path PT.

[0122] The display control unit 213 may or may not display the set movement path PT on the display unit 24. Furthermore, the display control unit 213 may display the movement path PT on the fourth image IM4 when the movement direction of the fourth image IM4 is the operation direction OD (for example, the first direction DR1). In this case, when the movement direction of the fourth image IM4 switches from the operation direction OD to the direction of the movement path PT, the display control unit 213 may continue to display the movement path PT or may erase the display of the movement path PT.

[0123] <Modification> FIG. 20 shows an example of a display form of the display unit 24 in a modified example of this embodiment. In this modified example, a main image IMM and a sub-image IMS are displayed on the display unit 24. In this example, the above-mentioned fourth image IM4 is displayed as the main image IMM. Also, the third image IM3 is displayed as the sub-image IMS. As described above, when the third image IM3 is a map image showing the scenery of a certain area, the entire map image is displayed as the sub-image IMS. As an example, the third image IM3 includes a plurality of display objects OBJ (for example, display object OBJ1 to display object OBJ3), and each display object OBJ is set as a predetermined area ROI (for example, predetermined area ROI1 to predetermined area ROI3). In the following description, the sub-image IMS is also referred to as the fifth image IM5.

[0124] That is, the display control unit 213 may or may not display on the display device D the fifth image IM5 indicating the predetermined region ROI and the second image IM2 or the fourth image IM4.

[0125] In this modification, the scroll operation for instructing the movement direction of the fourth image IM4 includes an operation on a predetermined region ROI shown in the fifth image IM5. An example of an operation on a predetermined region ROI shown in the fifth image IM5 is an operation in which the user selects a predetermined region ROI shown in the sub-image IMS (fifth image IM5). Specifically, when the user selects the position of the predetermined region ROI shown in the sub-image IMS (fifth image IM5) by tapping, the display control unit 213 moves the fourth image IM4 displayed as the main image IMM in the direction of the selected predetermined region ROI. Here, the tap operation is an operation of touching and then releasing the position of the selection target on the screen of the display unit 24. That is, the second direction DR2 with respect to the predetermined region ROI may be an operation with respect to the predetermined region ROI shown in the fifth image IM5 showing the predetermined region ROI, or may be another operation.

[0126] Furthermore, the display control unit 213 may or may not set the movement direction of the fourth image IM4 to the second direction DR2 based on a predetermined operation (for example, a second operation OP2) on the predetermined region ROI. Here, the second operation OP2 includes a tap operation, a flick operation, or a swipe operation on the position of the predetermined region ROI. According to the display device D (e.g., the terminal 20) of the present embodiment configured in this manner, an image (e.g., the fourth image IM4) can be moved in the direction of the predetermined region ROI by a simplified operation. Moreover, according to the display device D (e.g., the terminal 20) of the present embodiment configured as described above, the amount of calculation required to display an image based on the operation is reduced by simplifying the operation, and as a result, an effect is obtained in that the calculation processing load of the display device D can be reduced.

[0127] <Other Modifications> Although the third image IM32 is a map image showing a landscape of a certain area, the content shown by the third image IM32 is not limited to this. In this modified example, the third image IM32 is an order screen for a product (for example, a dish).

[0128] 21 shows a first modified example of the third image IM3 of this embodiment. As images to be viewed by the user in the third image IM32, a display object OBJ50, a display object OBJ51, and display objects OBJ5a to OBJ5d in the third image IM32 are set. Among these display objects, the display object OBJ50 and the display object OBJ51 are images that have already been viewed by the user. The display objects OBJ5a to OBJ5d are images that have not yet been viewed. Predetermined regions ROI5a to ROI5d are set in display object OBJ5a to display object OBJ5d, respectively. In the third image IM32 of this modification, a movement path PT that sequentially connects the predetermined regions ROI5a to ROI5d is set. In this example, when the user performs a scroll operation on the fourth image IM42o, the display control unit 213 moves the fourth image IM42o along the movement path PT. As a result of the fourth image IM42o moving along the movement path PT, the images that the user should view are displayed sequentially as the fourth image IM4.

[0129] FIG. 22 shows a second modified example of the third image IM3 of this embodiment. In the third image IM33, the display objects OBJ are arranged along two axes, a time axis t and an importance axis ip. If the third image IM33 is an image of a news article in Internet news, for example, the display object OBJ6a, the display object OBJ6b, and the display object OBJ6c are images of news articles posted in the same time period. These display objects OBJ6 are arranged in the order of the display object OBJ6a, the display object OBJ6b, and the display object OBJ6c as images of news articles with high importance. In the third image IM33, the display objects OBJ6a to OBJ6f are set as images to be viewed by the user. Of these display objects, the display object OBJ6a and the display object OBJ6b are images that have already been viewed by the user. The display object OBJ6c to OBJ6f are images that have not yet been viewed. In the third image IM33 of this modification, a moving path PT is set that sequentially connects the predetermined area ROI6c, the predetermined area ROI6f, the predetermined area ROI6e, and the predetermined area ROI6d. Among the predetermined areas ROI set in the third image IM33, the predetermined area ROI6c is a news article posted at an older time among the news articles that have not been viewed. Moreover, the predetermined area ROI6f is a news article with a relatively high importance among the news articles that have not been viewed. In this modified example, when the user performs a scroll operation on the fourth image IM43o, the display control unit 213 moves the fourth image IM43o along the movement path PT. As a result of the fourth image IM43o moving along the movement path PT, the images to be viewed by the user are displayed in order of posting of the news articles and in order of importance of the news articles.

[0130] The display device D is not limited to being the terminal 20, and may be, for example, a digital signage device having a display surface covering an entire wall, or may be another device. The display device D may also be an ordering terminal used for electronic commerce. In this case, the display device D may be configured so that the display target OBJ of the third image IM3 is a product image, and the display device D sequentially displays the product images each time the user performs a first operation OP1 (for example, a scroll operation). In this case, the position of the product image included in the third image IM3 may be set as a predetermined region ROI. The third image IM3 may also be a timeline image in a messaging service. In this case, for example, the timeline image may have multiple axes (for example, a vertical axis and a horizontal axis), with the vertical axis representing time and the horizontal axis representing the importance of the display contents. In this case, the display object OBJ of the third image IM3 may be the display contents of the timeline, and the display contents of the timeline may or may not be set as a predetermined region ROI. In this case, a movement path PT may or may not be set for the multiple display contents of the timeline.

[0131] Although the embodiments of the present disclosure have been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and corrections based on the present disclosure. Therefore, it should be noted that these modifications and corrections are included in the scope of the present disclosure. By way of example and not of limitation, the functions included in each means, each step, etc. can be rearranged so as not to cause logical inconsistency, and multiple means, steps, etc. can be combined into one or divided. In addition, the configurations shown in each embodiment may be appropriately combined. [Explanation of symbols]

[0132] 1...communication system, 10...server, 20...terminal, 21...control unit, 211...image information acquisition unit, 212...operation determination unit, 213...display control unit, 30 network, D...display device, IM1...first image, IM2...second image, IM3...third image, IM4...fourth image, IM5...fifth image, IMM...main image, IMS...sub-image, OBJ display object, ROI...predetermined area, POSo...reference position

Claims

1. A program executed by an information processing device having a display unit, displaying a second image included in the first image on the display unit; based on a first operation of moving a contact position on the display unit, the first operation being a user operation on the second image displayed on the display unit, a control unit of the information processing device executes a first control for moving the second image displayed on the display unit in a first direction based on the movement of the contact position when the position of a predetermined area in the first image is not set in the first image; When a position of the predetermined area is set in the first image and the predetermined area is not within a predetermined angle range centered on an operation direction of the first operation, the first control is executed by the control unit; and when the position of the specified area is set in the first image and the specified area is within the specified angle range centered on the operation direction of the first operation, executing a second control by the control unit to move the second image displayed on the display unit in a second direction corresponding to the specified area within the specified angle range centered on the operation direction of the first operation.

2. The program according to claim 1, The position of the specified area is set in the first image, and when the specified area is within the specified angle range centered on the operation direction of the first operation, the second control is executed by the control unit based on the operation amount of the first operation being less than a specified operation amount.

3. The program according to claim 2, The position of the specified area is set in the first image, and when the specified area is within the specified angle range centered on the operation direction of the first operation, the control unit executes the first control based on the fact that the operation amount is equal to or greater than the specified operation amount.

4. The program according to any one of claims 1 to 3, The movement in the second direction includes moving the second image by enlarging the second image, which is a three-dimensional image, or by reducing the second image.

5. The program according to any one of claims 1 to 4, The second control includes moving the second image on a movement path determined based on a position of the predetermined area in the first image, based on the movement of the contact position.

6. The program according to any one of claims 1 to 5, The predetermined area includes a first predetermined area and a second predetermined area, displaying a third image including the first predetermined area and the second predetermined area in a superimposed manner on the second image; When a second operation is performed on the first specified area included in the third image, the movement direction of the second image is set to a third direction based on the first specified area, and when the second operation is performed on the second specified area included in the third image, the movement direction of the second image is set to a fourth direction based on the second specified area.

7. An information processing method of an information processing device having a display unit, displaying a second image included in the first image on the display unit; based on a first operation of moving a contact position on the display unit, the first operation being a user operation on the second image displayed on the display unit, a control unit of the information processing device executes a first control for moving the second image displayed on the display unit in a first direction based on the movement of the contact position when the position of a predetermined area in the first image is not set in the first image; When a position of the predetermined area is set in the first image and the predetermined area is not within a predetermined angle range centered on an operation direction of the first operation, the first control is executed by the control unit; an information processing method including: when a position of the specified area is set in the first image and the specified area is within the specified angle range centered on the operation direction of the first operation, executing a second control by the control unit to move the second image displayed on the display unit in a second direction corresponding to the specified area within the specified angle range centered on the operation direction of the first operation.

8. An information processing device including a display unit, The display unit displays a second image included in the first image, based on a first operation of moving a contact position on the display unit, the first operation being a user operation on the second image displayed on the display unit, executes a first control to move the second image displayed on the display unit in a first direction based on the movement of the contact position when the position of a predetermined area in the first image is not set in the first image; a position of the predetermined area is set in the first image, and when the predetermined area is not within a predetermined angle range centered on the operation direction of the first operation, the first control is executed; An information processing device comprising: a control unit that executes a second control to move the second image displayed on the display unit in a second direction corresponding to the specified area within the specified angle range centered on the operation direction of the first operation, when the position of the specified area is set in the first image and the specified area is within the specified angle range centered on the operation direction of the first operation.

Images