Image display program, image display device, image display method, and recording medium

Abstract

To provide an image display program that enables virtual movement while maintaining an immediately previous line-of-sight direction.SOLUTION: An image display program of the present disclosure includes an image display procedure, an operation information acquisition procedure, and a display control procedure. The image display procedure includes displaying an area image cut out from a picked-up image of a target area. The picked-up image of the target area is linked with offset information. The offset information is information in which a reference angle of a display angle in the image and the direction of the target area are associated with each other. The image includes link information for transition to another image. The operation information acquisition procedure includes acquiring information on a user's operation to the area image. The information on the operation includes selection of the link information. The display control procedure includes changing an image to display on the basis of the selection of the link information, and controlling an angle to cut out the area image from the image after the change on the basis of the offset information of the image before and after the change.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an image display program, an image display device, an image display method, and a recording medium. [Background technology]

[0002] There is known a spherical image capturing system that can display an entire celestial sphere (the entire celestial sphere) on a display device such as a monitor by combining images captured by a plurality of wide-angle cameras. For example, Patent Document 1 discloses a spherical image capturing system that includes an imaging means, an image combining unit that creates spherical frame data, an attitude detecting means that detects attitude information of the imaging means, a correction amount calculating unit that creates correction amount data for converting coordinates of the spherical frame data based on the attitude information, and an associating means that associates the spherical frame data with the correction amount data to obtain a spherical image, wherein the correction amount calculating unit creates the correction amount data for correcting tilt of the spherical frame data with respect to the vertical direction in global coordinates and correcting shaking within a horizontal plane in global coordinates by excluding minute shaking components. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-061770 Summary of the Invention [Problem to be solved by the invention]

[0004] The spherical imaging system described in Patent Document 1 captures images of a predetermined space and generates a group of images, making it possible to refer to the captured space in a virtual space. However, in this case, the direction of the captured space and the reference angle indicating the center of each image in the group of captured images are different for each image. Furthermore, when switching between displayed images to simulate movement in the virtual space, there is a problem in that the direction of the displayed space may change each time the image is switched.

[0005] Therefore, an object of the present disclosure is to provide an image display program, an image display device, an image display method, and a recording medium that enable virtual movement while maintaining the previous viewpoint direction. [Means for solving the problem]

[0006] In order to achieve the above object, the image display program of the present disclosure includes: An image display procedure, an operation information acquisition procedure, and a display control procedure are included. the image display step displays an area image cut out from an image captured of the target area; The image of the target area is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition step acquires information about a user's operation on the area image; the operation information includes selection of the link information, the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the image before and after the change. An image display program for causing a computer to execute each of the above procedures.

[0007] The image display device of the present disclosure includes: an image display unit, an operation information acquisition unit, and a display control unit; the image display unit displays an area image cut out from an image of a target area; The image of the target area is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition unit acquires information about a user's operation on the area image; the operation information includes selection of the link information, The display control unit changes the image to be displayed based on the selection of the link information, and controls the angle at which an area image is cut out from the changed image based on the offset information of the images before and after the change.

[0008] The image display method of the present disclosure includes: The method includes an image display step, an operation information acquisition step, and a display control step, The image display step displays an area image cut out from an image of the target area, The image of the target area is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition step acquires information about a user's operation on the area image; the operation information includes selection of the link information, the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the image before and after the change. The image display method is one in which each of the steps is executed by a computer.

[0009] The recording medium of the present disclosure includes: An image display procedure, an operation information acquisition procedure, and a display control procedure are included. the image display step displays an area image cut out from an image captured of the target area; The image of the target area is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition step acquires information about a user's operation on the area image; the operation information includes selection of the link information, the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the image before and after the change. A computer-readable recording medium stores an image display program for causing a computer to execute each of the above procedures. [Effects of the Invention]

[0010] According to the present disclosure, virtual movement is possible while maintaining the previous viewpoint direction. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing a configuration of an example of an image display device according to the present disclosure. [Figure 2] FIG. 2 is a block diagram showing an example of a hardware configuration of the image display device of the present disclosure. [Figure 3] FIG. 3 is a flowchart showing an example of processing in the image display device of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The present disclosure is not limited to the following embodiments. In the following drawings, the same parts are denoted by the same reference numerals. Furthermore, the descriptions of the embodiments can be mutually incorporated unless otherwise specified, and the configurations of the embodiments can be combined unless otherwise specified. It can be obtained.

[0013] [Embodiment 1] The image display program of the present disclosure is a program for causing a computer to execute an image display procedure, an operation information acquisition procedure, and a display control procedure. The image display program of the present disclosure can also be said to be a program for causing a computer to function as the image display procedure, the operation information acquisition procedure, and the display control procedure. Furthermore, the image display program of the present disclosure can also be said to be a program for causing a computer to execute, for example, each step of an image display method described below.

[0014] The image display procedure displays an area image cut out from an image taken of a target area, the image taken of the target area is linked to offset information, the offset information is information that corresponds a reference angle of the display angle in the image to the direction of the target area, the image includes link information for transitioning to other images, the operation information acquisition procedure acquires user operation information for the area image, the operation information includes selection of the link information, and the display control procedure changes the image to be displayed based on the selection of the link information and controls the angle at which the area image is cut out from the changed image based on the offset information of the images before and after the change.

[0015] For example, the "procedure" in each of the steps can be read as "processing." The image display program of the present disclosure may be recorded on a computer-readable recording medium. The recording medium is, for example, a non-transitory computer-readable storage medium. The recording medium is not particularly limited, and examples thereof include random access memory (RAM), read-only memory (ROM), hard disk (HD), flash memory (e.g., solid state drive (SSD), USB flash memory, SD / SDHC card, etc.), optical disk (e.g., CD-R / CD-RW, DVD-R / DVD-RW, BD-R / BD-RE, etc.), magneto-optical disk (MO), and floppy disk (FD). The image display program of the present disclosure (also referred to as a programming product or program product) may be distributed from an external computer. The "distribution" may be, for example, distribution via a communication network or a device connected via a wire. The image display program of the present disclosure may be installed and executed on the device to which it is distributed, or may be executed without being installed. An information processing device capable of executing the image display program of the present disclosure can be referred to as, for example, an image display device of the present disclosure.

[0016] Next, the configuration of an example of an image display device according to the present disclosure will be described with reference to FIG. 1. FIG. 1 is a block diagram showing the configuration of an example of an image display device 10 according to the present embodiment (hereinafter also referred to as "the device"). As shown in FIG. 1, the device 10 includes an image display unit 11, an operation information acquisition unit 12, and a display control unit 13. Although not shown, the device 10 may also include, for example, an input unit, an output unit, a display unit, and / or a storage unit. The image display unit 11, the operation information acquisition unit 12, and the display control unit 13 are each capable of executing, for example, an image display procedure, an operation information acquisition procedure, and a display control procedure in the image display program according to the present disclosure.

[0017] The device 10 may be, for example, a single device including the above-described units, or a device in which the units can be connected via a communication network. The device 10 can also be connected to an external device (described later) via the communication network. The communication network is not particularly limited and any known network can be used, for example, a wired or wireless network. Examples of the communication network include the Internet, the World Wide Web (WWW), a telephone line, a Local Area Network (LAN), a Storage Area Network (SAN), a Delay Tolerant Networking (DTN), a Low Power Wide Area Network (LPWA), and a Local 5G (L5G). Examples of wireless communication include Wi-Fi (registered trademark), Bluetooth (registered trademark), Local 5G, and LPWA. Examples of the wireless communication include direct communication between devices (Ad Hoc communication), infrastructure communication, and indirect communication via an access point. The device 10 may be incorporated into a server as a system. Furthermore, the present device 10 may be, for example, a personal computer (PC, for example, desktop or notebook type) on which the program of the present disclosure is installed, a smartphone, a tablet terminal, etc. The present device 10 may be in the form of cloud computing or edge computing, for example, in which at least one of the above-mentioned units is located on a server and the other units are located on a terminal.

[0018] 2 shows a block diagram of the hardware configuration of the device 10. The device 10 includes, for example, a central processing unit (CPU, GPU, etc.) 101, a memory 102, a bus 103, a storage device 104, an input device 105, an output device 106, and a communication device 107. The components of the device 10 are connected to each other via the bus 103 and their respective interfaces (I / F).

[0019] The central processing unit 101 operates in cooperation with other components via a controller (such as a system controller or an I / O controller) and is responsible for overall control of the device 10. In the device 10, the central processing unit 101 executes, for example, the program of the present disclosure and other programs, and also reads and writes various types of information. Specifically, for example, the central processing unit 101 functions as an image display unit 11, an operation information acquisition unit 12, and a display control unit 13. The device 10 may include, as a computing device, other computing devices such as a CPU, a GPU (Graphics Processing Unit), an APU (Accelerated Processing Unit), or a combination of these.

[0020] The bus 103 can also be connected to, for example, external devices. Examples of the external devices include a user terminal, an external storage device (such as an external database), a printer, an external input device, an external display device, and an external imaging device. The device 10 can be connected to an external network (the communication line network) by, for example, a communication device 107 connected to the bus 103, and can also be connected to other devices via the external network.

[0021] The memory 102 may be, for example, a main memory (primary storage device). When the central processing unit 101 performs processing, the memory 102 reads various operating programs, such as the program of the present disclosure, stored in the storage device 104 (described later), and the central processing unit 101 receives data from the memory 102 and executes the programs. The main memory may be, for example, a RAM (random access memory). The memory 102 may also be, for example, a ROM (read only memory).

[0022] The storage device 104 is also referred to as an auxiliary storage device, for example, in contrast to the main memory (primary storage device). As described above, the storage device 104 stores an operating program including the program of the present disclosure. The storage device 104 may be, for example, a combination of a recording medium and a drive that reads and writes data from and to the recording medium. The recording medium is not particularly limited and may be, for example, an internal or external type, such as a hard disk (HD), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, or memory card. The storage device 104 may be, for example, a hard disk drive (HDD) or a solid state drive (SSD) in which the recording medium and drive are integrated.

[0023] In the present device 10, the memory 102 and the storage device 104 can also store various information such as log information, information acquired from an external database (not shown) or an external device, information generated by the present device 10, and information used by the present device 10 when executing processing. In this case, the memory 102 and the storage device 104 may store, for example, the above-mentioned information on users of the present device. Note that at least a portion of the information may be stored, for example, in an external server other than the memory 102 and the storage device 104, or may be stored in a distributed manner across multiple terminals using blockchain technology or the like. Furthermore, when the present device 10 includes the storage unit, for example, the memory 102 and the storage device 104 function as the storage unit.

[0024] The device 10 further includes, for example, an input device 105 and an output device 106. Examples of the input device 105 include pointing devices such as a touch panel, track pad, and mouse; a keyboard; imaging means such as a camera and scanner; card readers such as an IC card reader and a magnetic card reader; and audio input means such as a microphone. Examples of the output device 106 include display devices such as an LED display and a liquid crystal display; audio output devices such as a speaker; a printer; and the like. In the first embodiment, the input device 105 and the output device 106 are configured separately, but the input device 105 and the output device 106 may be configured as an integrated device, such as a touch panel display.

[0025] An example of processing by the image display program of the present disclosure will be described in more detail with reference to Fig. 3. Fig. 3 is a flowchart showing an example of each procedure of the image display program of the present disclosure. The image display program of the present disclosure is implemented as follows, for example, using the device 10 of Fig. 1 or Fig. 2 in which the image display program of the present disclosure is installed. Note that implementation of the image display program of this embodiment is not limited to use of the device 10 of Fig. 1 or Fig. 2.

[0026] First, prior to processing by the device 10, a target area is captured with a camera to create a group of multiple images of the target area. The target area is not particularly limited as long as it is an area for performing three-dimensional reconstruction, and may be indoors or outdoors. The images are not particularly limited as long as they are images captured within the target area, and may be videos or still images. The images are, for example, wide-angle images. The wide-angle images may be, for example, panoramic images or omnidirectional images. The panoramic images or omnidirectional images can be captured by capturing the target area with, for example, a wide-angle camera equipped with a fisheye lens or a wide-angle lens, or an omnidirectional camera (also called a 360° camera). The captured images may be recorded in the storage unit of the device 10 or in another recording medium. Furthermore, at this time, identification information of the target area may be associated with the group of images of the target area and recorded.

[0027] Next, offset information is acquired for each image. The acquired offset information is, for example, associated with each image and recorded. The offset information is information that associates a reference angle of the display angle in the image with the direction of the target area. The reference angle is, for example, an angle in a spherical coordinate system that indicates the center point of the image. The reference angle is, for example, an angle at which both the pitch angle indicating the vertical direction of the image and the yaw angle indicating the horizontal direction are 0 degrees. The reference angle is, for example, defined by the attitude of the camera when capturing each image. The reference angle means, for example, the front direction of the camera when capturing the image. The direction of the target area may be, for example, a direction (north, south, east, west) or may be expressed as an angle (azimuth angle). In the latter case, for example, the reference angle (azimuth angle: 0 degrees) is not particularly limited, and any direction can be specified. As a specific example, if the north direction of the target area is set as the reference direction of the target area, the direction of the target area can be defined as north being 0 degrees, east being 90 degrees, south being 180 degrees, and west being 270 degrees. Note that the correspondence between each direction and azimuth angle is not limited to this, and any direction can be designated as the reference azimuth angle (0 degrees). Then, for each image, for example, the reference angle and the angle indicating the direction of the target area (azimuth angle) can be obtained, thereby obtaining offset information for each image.

[0028] Next, for each group of images, link information for transitioning to another image is embedded. The link information is information for transitioning to another image, and may be a link to the other image, such as a URL (Uniform Resource Locator). For each image, the link information may be in any format. As a specific example, if an image includes a location where another image was captured, the link information may be embedded in the area of ​​the captured location. Furthermore, an icon indicating the embedding of the link information may be displayed in the pixel area where the link information is embedded. This allows the user to transition to another image specified by the link information, for example, by selecting an icon in the displayed image. Note that the method of displaying the link information is not limited to this; for example, a window displaying an image transition link may be displayed separately from the image currently being displayed.

[0029] The image display unit 11 displays an area image cut out from an image of the target area (S11, image display step). The image display unit 11 can display the area image by, for example, cutting out the image at a predetermined angle of view based on a preset display viewing angle. The image display unit 11 may, for example, display the area image on an output device (display) 106 of the device 10, or may display the area image outside the device 10 (for example, a user terminal). In the latter case, the image display unit 11 can display the area image on the user terminal by, for example, transmitting the area image to the user terminal. The image of the target area is associated with offset information. The offset information is, for example, as described above. The image includes link information for transitioning to another image. The link information is, for example, as described above.

[0030] The operation information acquisition unit 12 acquires operation information of the user on the area image (S12, operation information acquisition step). The operation information includes selection of the link information. The operation information acquisition unit 12 can acquire, for example, information indicating that the user has selected (clicked, tapped, etc.) the link information in the area image as the operation information. The operation information acquisition unit 12 may also acquire operation information including, for example, a viewpoint operation by the user. The viewpoint operation may include, for example, slide information of a pointing device on the area image (for example, a drag operation of a mouse, or a swipe operation of a touch panel). The operation information of the viewpoint operation may include, for example, a selection start position (click or tap start) position in the area image by the user, a movement distance (drag or swipe distance), and a selection end position (click or tap end). The operation information acquisition unit 12 may also acquire, for example, other operation information. The other operation information may include, for example, a double click of a mouse, a double tap on a touch panel, pinch in, pinch out, keyboard input, etc., but is not limited to these.

[0031] The display control unit 13 changes the image to be displayed based on the selection of the link information, and controls the angle at which an area image is cut out from the changed image based on the offset information of the images before and after the change (S13, display control procedure). The display control unit 13 identifies the direction of the target area displayed by the area image, for example, based on the offset information of the image before the change and the cutout angle of the area image in the image before the change. Then, the display control unit 13 controls the cutout angle of the area image in the changed image, for example, based on the direction of the target area and the offset information of the image after the change.

[0032] The processing of the display control unit 13 will be described below using a specific example. For example, assume that in the offset information of the image before the change, the direction of the target area associated with the reference angle of 0 degrees is north (azimuth angle 0 degrees), and in the offset information of the image after the change, the direction of the target area associated with the reference angle of 0 degrees is east (azimuth angle 90 degrees). In this case, the display control unit 13, for example, first calculates the azimuth angle of the displayed area image from the angle of view of the area image displayed in the image before the change and the offset information in the image before the change. Next, the display control unit 13 specifies the cropping angle of the image after the change that corresponds to the calculated azimuth angle, for example, from the calculated azimuth angle and the offset information in the image after the change, and controls the display to crop the image after the change at the specified cropping angle and display it as a new area image.

[0033] Furthermore, the display control unit 13 may extract features from the pre-altered image and the post-altered image, estimate the imaging position and imaging orientation of the camera in the target area for each image based on the features, and estimate the offset information based on the imaging position and imaging orientation of the camera in the target area. When the display control unit 13 estimates the offset information, it can estimate the imaging position and imaging orientation of the camera in the target area using techniques such as SfM (Structure from Motion) and VSLAM (Visual simultaneous localization and mapping).

[0034] The display control unit 13 may change the display angle of the area image by changing the crop angle of the image being displayed based on the viewpoint operation, for example. In this case, the display control unit 13 may change the display angle of the area image in the same manner as known spherical image viewer software, for example. Furthermore, when the display control unit 13 has acquired other operation information in S12, for example, the display control unit 13 may execute corresponding display control (for example, zoom in / out) processing.

[0035] The image display method of the present disclosure is, for example, a method implemented by replacing each "procedure" in the image display program of the present disclosure with a "step." The image display method of the present disclosure can be implemented, for example, using the image display device 10 of the present disclosure shown in FIG. 1 or FIG. 2. Note that the image display method of the present disclosure is not limited to methods that use the image display device 10, for example. For the image display method of the present disclosure, the descriptions of the image display program and image display device of the present disclosure can be cited, for example.

[0036] When an area image for a user to view is cut out from an image, the area image, i.e., the viewpoint direction from which the user is viewing, can be expressed as a difference from a reference angle of the image. However, when a target area is photographed from multiple locations, the correspondence between the reference angle of each image (the center of the image, the front direction of the camera) and the orientation of the target area differs for each image. Therefore, when an image is switched, if an image is cut out using a difference from the same reference angle, an image cut out in a direction different from the orientation of the target area displayed in the image before the switch will be cut out. In response to this, the image display program disclosed herein includes an image display procedure, an operation information acquisition procedure, and a display control procedure. The image display step displays an area image cut out from an image captured of a target area, the image captured of the target area is associated with offset information, the offset information being information correlating a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition step acquires user operation information for the area image, the operation information including selection of the link information, and the display control step changes the image to be displayed based on the selection of the link information and can control an angle at which the area image is cut out from the changed image based on the offset information of the images before and after the change. Thus, according to the image display program of the present disclosure, it is possible to enable virtual movement while maintaining the previous viewpoint direction using multiple images captured with different camera front directions.

[0037] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0038] <Additional Notes> Some or all of the above embodiments can be described as, but not limited to, the following supplementary notes. (Appendix 1) An image display procedure, an operation information acquisition procedure, and a display control procedure are included. the image display step displays an area image cut out from an image captured of the target area; The image of the target area is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition step acquires information about a user's operation on the area image; the operation information includes selection of the link information, the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the image before and after the change. An image display program for causing a computer to execute each of the above procedures. (Appendix 2) The display control procedure includes: specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change; An image display program according to claim 1, which controls the cropping angle of the area image in the changed image based on the direction of the target area and the offset information of the changed image. (Appendix 3) The display control procedure includes: extracting features from the pre-altered image and the post-altered image; For each image, an imaging position and an imaging attitude of the camera in the target area are estimated based on the feature amount; 3. The image display program according to claim 1, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area. (Appendix 4) the operation information acquisition step acquires operation information including a viewpoint operation of a user; The image display program according to any one of appendices 1 to 3, wherein the display control procedure changes the crop angle of the image being displayed based on the viewpoint operation, thereby changing the display angle of the area image. (Appendix 5) an image display unit, an operation information acquisition unit, and a display control unit; the image display unit displays an area image cut out from an image of a target area; The image of the target area is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition unit acquires information about a user's operation on the area image; the operation information includes selection of the link information, The display control unit changes the image to be displayed based on the selection of the link information, and controls the angle at which an area image is cut out from the changed image based on the offset information of the images before and after the change. (Appendix 6) The display control unit specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change; 6. The image display device according to claim 5, wherein the cropping angle of the area image in the changed image is controlled based on the direction of the target area and the offset information of the changed image. (Appendix 7) The display control unit extracting features from the pre-altered image and the post-altered image; For each image, an imaging position and an imaging attitude of the camera in the target area are estimated based on the feature amount; 7. The image display device according to claim 5, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area. (Appendix 8) the operation information acquisition unit acquires operation information including a viewpoint operation by a user; The image display device according to any one of appendices 5 to 7, wherein the display control unit changes the crop angle of the image being displayed based on the viewpoint operation, thereby changing the display angle of the area image. (Appendix 9) The method includes an image display step, an operation information acquisition step, and a display control step, The image display step displays an area image cut out from an image of the target area, The image of the target area is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition step acquires information about a user's operation on the area image; the operation information includes selection of the link information, the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the image before and after the change. An image display method in which each of the steps is executed by a computer. (Appendix 10) The display control step includes: specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change; An image display method according to claim 9, wherein the cropping angle of the area image in the changed image is controlled based on the direction of the target area and the offset information of the changed image. (Appendix 11) The display control step includes: extracting features from the pre-altered image and the post-altered image; For each image, an imaging position and an imaging attitude of the camera in the target area are estimated based on the feature amount; 11. The image display method according to claim 9, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area. (Appendix 12) the operation information acquisition step acquires operation information including a viewpoint operation of a user; 12. The image display method according to any one of claims 9 to 11, wherein the display control step changes the crop angle of the image being displayed based on the viewpoint operation, thereby changing the display angle of the area image. (Appendix 13) An image display procedure, an operation information acquisition procedure, and a display control procedure are included. the image display step displays an area image cut out from an image captured of the target area; The image of the target area is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image, the operation information acquisition step acquires information about a user's operation on the area image; the operation information includes selection of the link information, the display control step changes the image to be displayed based on the selection of the link information, and controls an angle at which an area image is cut out from the image after the change based on the offset information of the image before and after the change. A computer-readable recording medium that records an image display program for causing a computer to execute each of the above procedures. (Appendix 14) The display control procedure includes: specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change; The recording medium according to claim 13, wherein the cropping angle of the area image in the changed image is controlled based on the direction of the target area and the offset information of the changed image. (Appendix 15) The display control procedure includes: extracting features from the pre-altered image and the post-altered image; For each image, an imaging position and an imaging attitude of the camera in the target area are estimated based on the feature amount; 15. The recording medium according to claim 13, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area. (Appendix 16) the operation information acquisition step acquires operation information including a viewpoint operation of a user; 16. The recording medium according to any one of appendices 13 to 15, wherein the display control procedure changes a crop angle of the image being displayed based on the viewpoint operation, thereby changing a display angle of the area image. [Industrial Applicability]

[0039] This disclosure enables virtual movement while maintaining the previous viewpoint direction. Therefore, this disclosure is expected to be used in a variety of fields, such as creating images for building previews and creating promotional images for parks, event venues, etc. [Explanation of symbols]

[0040] 10 Image display device 11 Image display section 12 Operation information acquisition section 13 Display control unit 101 Central Processing Unit 102 memory 103 Bus 104 Storage device 105 Input Device 106 Output Device 107 Communication Devices

Claims

1. An image display procedure, an operation information acquisition procedure, and a display control procedure are included. the image display step displays an area image cut out from an image captured of the target area; the target area is an area from which an image group including a plurality of images captured from at least two imaging positions has been acquired; Each image captured of the target area included in the image group is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image included in the image group; the operation information acquisition step acquires information about a user's operation on the area image; the operation information includes selection of the link information, The display control step changes an image to be displayed based on the selection of the link information from an image included in the image group, and controls an angle at which a new area image is cut out from the changed image based on the offset information of the images before and after the change. An image display program for causing a computer to execute each of the above procedures.

2. The display control procedure includes: specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change; 2. The image display program according to claim 1, further comprising: controlling an angle at which the new area image is cut out in the changed image based on the direction of the target area and the offset information of the changed image.

3. The display control procedure includes: extracting features from the pre-altered image and the post-altered image; For each image included in the image group, an imaging position and an imaging attitude of a camera in the target area are estimated based on the feature amount; 3. The image display program according to claim 1, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area.

4. the operation information acquisition step acquires operation information including a viewpoint operation of a user; 3. The image display program according to claim 1, wherein the display control step changes a display angle of the area image by changing a cutout angle of the image being displayed based on the viewpoint operation.

5. an image display unit, an operation information acquisition unit, and a display control unit; the image display unit displays an area image cut out from an image of a target area; the target area is an area from which an image group including a plurality of images captured from at least two imaging positions has been acquired; Each image captured of the target area included in the image group is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image included in the image group; the operation information acquisition unit acquires information about a user's operation on the area image; the operation information includes selection of the link information, The display control unit changes the image to be displayed based on the selection of the link information from the images included in the image group, and controls the angle at which a new area image is cut out from the changed image based on the offset information of the images before and after the change.

6. The display control unit specifying a direction of the target area displayed by the area image based on the offset information of the image before the change and the cropping angle of the area image in the image before the change; The image display device according to claim 5 , wherein the angle at which the new area image is cut out in the changed image is controlled based on the direction of the target area and the offset information of the changed image.

7. The display control unit extracting features from the pre-altered image and the post-altered image; For each image included in the image group, an imaging position and an imaging attitude of a camera in the target area are estimated based on the feature amount; 7. The image display device according to claim 5, wherein the offset information is estimated based on an imaging position and an imaging attitude of a camera in the target area.

8. the operation information acquisition unit acquires operation information including a viewpoint operation by a user; 7. The image display device according to claim 5, wherein the display control unit changes a display angle of the area image by changing a cutout angle of the image being displayed based on the viewpoint operation.

9. The method includes an image display step, an operation information acquisition step, and a display control step, The image display step displays an area image cut out from an image of the target area, the target area is an area from which an image group including a plurality of images captured from at least two imaging positions has been acquired; Each image captured of the target area included in the image group is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image included in the image group; the operation information acquisition step acquires information about a user's operation on the area image; the operation information includes selection of the link information, the display control step changes an image to be displayed based on the selection of the link information from the images included in the image group, and controls an angle at which a new area image is cut out from the changed image based on the offset information of the images before and after the change. An image display method in which each of the steps is executed by a computer.

10. An image display procedure, an operation information acquisition procedure, and a display control procedure are included. the image display step displays an area image cut out from an image captured of the target area; the target area is an area from which an image group including a plurality of images captured from at least two imaging positions has been acquired; Each image captured of the target area included in the image group is associated with offset information, the offset information is information that associates a reference angle of a display angle in the image with a direction of the target area, the image includes link information for transitioning to another image included in the image group; the operation information acquisition step acquires information about a user's operation on the area image; the operation information includes selection of the link information, The display control step changes an image to be displayed based on the selection of the link information from an image included in the image group, and controls an angle at which a new area image is cut out from the changed image based on the offset information of the images before and after the change. A computer-readable recording medium that records an image display program for causing a computer to execute each of the above procedures.

Images