Configuration device

Abstract

To provide an arrangement apparatus that is free from taking labor and time in arranging an icon indicative of detailed data, etc. on image data such as a 360-degree image.SOLUTION: An arrangement apparatus 200 comprises: an angle calculating section 221 that calculates, based on position information corresponding to 360-degree image data and position information corresponding to an object of calculation, an angle to a predetermined direction with reference to a position indicated by the position information corresponding to the 360-degree image data; and an arranging section 222 that specifies an arrangement position of an icon to be displayed superposed with the 360-degree image data based on the angle calculated by the angle calculating section 221.SELECTED DRAWING: Figure 13

Description

Technical Field

[0001] The present invention relates to an arrangement device, an arrangement method, and a program.

Background Art

[0002] By using a 360-degree camera or the like, a 360-degree image may be acquired.

[0003] As an example of a document describing a 360-degree image, for example, there is Patent Document 1. Patent Document 1 describes an information processing apparatus having an image input unit that receives an input of a captured image such as a 360-degree image of a site, and a captured location specifying unit that displays a site image such as a floor map and receives a specification of the captured location of the captured image on the site image. Further, according to Patent Document 1, in addition to the above configuration, the information processing apparatus includes an object position specifying unit that receives a specification of a position where an object arranged at the site appears in the captured image, a document storage unit that stores information indicating a document related to the site, a document specifying unit that receives a specification of a document related to the specified object from the documents related to the site, a captured location storage unit that stores the captured image, the site image, the captured location, the position, and the document in association with each other, and an output unit that specifies and outputs a document not associated with the captured image among the documents related to the site.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] To provide more detailed explanations of objects and other subjects within image data, such as 360-degree images, icons linking to detailed data are sometimes placed and displayed at locations corresponding to the objects in the image data or at the shooting locations of other image data. However, the placement of such icons is often done manually by the user. As a result, a problem has arisen in that placing the icons is time-consuming.

[0006] Therefore, the object of the present invention is to provide an arrangement device, arrangement method, and program that solve the problem of the time and effort required to place icons indicating detailed data on image data such as 360-degree images. [Means for solving the problem]

[0007] To achieve this objective, one form of the placement apparatus disclosed herein is An angle calculation unit calculates an angle between a predetermined direction based on the position information corresponding to the 360-degree image data and the position information corresponding to the target of calculation, based on the position information corresponding to the 360-degree image data. Based on the angle calculated by the angle calculation unit, the placement unit identifies the placement position of the icon to be displayed superimposed on the 360-degree image data, has This is the structure it takes.

[0008] Furthermore, other forms of the arrangement method of this disclosure are: Information processing device, Based on the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target, the angle between the position indicated by the position information corresponding to the 360-degree image data and a predetermined direction is calculated. Based on the calculated angle, the placement position of the icon to be displayed superimposed on the 360-degree image data is determined. This is the structure it takes.

[0009] Furthermore, other forms of this disclosure, such as program, In an information processing device, Based on the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target, the angle between the position indicated by the position information corresponding to the 360-degree image data and a predetermined direction is calculated. Based on the calculated angle, the placement position of the icon to be displayed superimposed on the 360-degree image data is determined. This is a program for performing the processing. [Effects of the Invention]

[0010] The configurations described above reduce the effort required when placing icons to indicate detailed data on image data such as 360-degree images. [Brief explanation of the drawing]

[0011] [Figure 1] This figure illustrates the layout of the placement apparatus in the first embodiment of this disclosure. [Figure 2] This is a block diagram showing an example configuration of a placement device. [Figure 3] This figure shows an example of 360-degree photo information. [Figure 4] This figure shows an example of detailed data information. [Figure 5] This is an example of how detailed data information is displayed. [Figure 6] This is a diagram illustrating an example of processing by the 2D information generation unit. [Figure 7] This is a diagram illustrating an example of the angle calculation unit's processing. [Figure 8] This diagram illustrates an example of how the icon placement section is handled. [Figure 9] This figure shows an example of an icon that the icon placement section will place. [Figure 10] This is a diagram illustrating an example of a correction made by the correction section. [Figure 11] This flowchart shows an example of the operation of the placement device. [Figure 12] This figure shows an example of the hardware configuration of the placement device in a second embodiment of the present disclosure. [Figure 13] It is a block diagram showing a configuration example of the placement device.

Embodiments for Carrying Out the Invention

[0012] [First Embodiment] The first embodiment of the present disclosure will be described with reference to FIGS. 1 to 11. FIG. 1 is a diagram for explaining the outline of the placement device 100. FIG. 2 is a block diagram showing a configuration example of the placement device 100. FIG. 3 is a diagram showing an example of the 360-degree photographic information 141. FIG. 4 is a diagram showing an example of the detailed data information 142. FIG. 5 is a display example of the detailed data information 142. FIG. 6 is a diagram for explaining a processing example of the two-dimensional information generation unit 152. FIG. 7 is a diagram for explaining a processing example of the angle calculation unit 153. FIG. 8 is a diagram for explaining a processing example of the icon placement unit 154. FIG. 9 is a diagram showing an example of the icon placed by the icon placement unit 154. FIG. 10 is a diagram for explaining an example of the correction by the correction unit 155. FIG. 11 is a flowchart showing an operation example of the placement device 100.

[0013] In the first embodiment of this disclosure, as shown in Figure 1, a placement device 100 is described that places icons linked to detailed data at positions corresponding to objects in image data, such as 360-degree image data, so that 360-degree image data and icons can be displayed superimposed. As will be described later, the placement device 100 in this embodiment calculates an angle based on the shooting position of the 360-degree image data, based on information indicating the shooting position of the image data included in the 360-degree image data and the detailed data. For example, the placement device 100 calculates an angle formed between a straight line extending in a predetermined direction, such as north, from a point corresponding to the shooting position of the 360-degree image data, and a straight line connecting the point corresponding to the shooting position of the 360-degree image data and a point corresponding to the position of the detailed data. Then, the placement device 100 places icons in the 360-degree image data by specifying the placement position of the icons to be displayed superimposed on the 360-degree image data based on the calculated angle. For example, by this method, the placement device 100 can automatically overlay and display 360-degree image data and icons without the user having to specify or modify the display position of icons in the 360-degree image data. In addition to icons linked to detailed data, the placement device 100 may also place and overlay icons linked to other 360-degree image data in the same manner.

[0014] Furthermore, when calculating angles, the placement device 100 can generate 2D information by placing icons indicating each shooting position on a 2D map based on information such as the shooting position of the 360-degree image data and the detailed data. The placement device 100 can also calculate angles based on the shooting positions of the 360-degree image data based on the generated 2D information. The placement device 100 may also output 2D information such as a map on which the icons are placed, along with the 360-degree image data on which the icons are placed. The placement device 100 can also operate and modify the display characteristics such as the size, color, and display angle of the icons superimposed on the 360-degree image data based on the distance between the icons.

[0015] In this embodiment, the "object" refers to an object, area, or range that is deemed to require more detailed explanation by the user who took the 360-degree image data, other users near the shooting location, or users who have viewed the 360-degree image data. For example, the object may be a car, a bicycle, any piece of evidence, or any other object or range.

[0016] As an example, in the embodiment described above, 360-degree image data is captured in advance using a 360-degree camera or the like. Furthermore, at any time, such as when capturing 360-degree image data or when checking 360-degree image data using the screen display unit 120 or the like, detailed data including image data and text information is generated in advance by one of the above users. For example, a user can generate detailed data to describe an object by taking image data of an object that they deem requires more detailed explanation by getting closer to the object, or by inputting text information describing the object along with the object's location information.

[0017] Figure 2 shows an example configuration of the placement device 100. Referring to Figure 2, the placement device 100 has, for example, an operation input unit 110, a screen display unit 120, a communication I / F unit 130, a storage unit 140, and an arithmetic processing unit 150 as its main components.

[0018] Figure 2 illustrates a case where the functionality of the placement device 100 is realized using a single information processing device. However, the placement device 100 may be realized using multiple information processing devices, for example, by being implemented on the cloud. Furthermore, the placement device 100 may not have some of the configurations exemplified above, such as not having an operation input unit 110, and may have configurations other than those exemplified above.

[0019] The operation input unit 110 consists of an operation input device such as a keyboard or mouse. The operation input unit 110 detects the operation of the user operating the placement device 100 and outputs it to the calculation processing unit 150.

[0020] The screen display unit 120 consists of a screen display device such as an LCD (Liquid Crystal Display). The screen display unit 120 can display various information stored in the storage unit 140 on the screen in response to instructions from the arithmetic processing unit 150.

[0021] The communication interface unit 130 consists of a data communication circuit. The communication interface unit 130 performs data communication with external devices connected via a communication line.

[0022] The storage unit 140 is a storage device such as a hard disk or memory. The storage unit 140 stores processing information and programs 145 necessary for various processes in the arithmetic processing unit 150. The programs 145 are read into the arithmetic processing unit 150 and executed to realize various processing functions. The programs 145 are pre-read from external devices or recording media via data input / output functions such as the communication I / F unit 130 and stored in the storage unit 140. The main information stored in the storage unit 140 includes, for example, 360-degree photo information 141, detailed data information 142, 2D information 143, and arrangement information 144.

[0023] The 360-degree photo information 141 includes 360-degree image data taken by the user using a 360-degree camera or the like. For example, the 360-degree photo information 141 is acquired in advance from an external device such as a 360-degree camera via the communication I / F unit 130 and stored in the storage unit 140. Some of the information contained in the 360-degree photo information 141 may be updated in response to operations on the operation input unit 110 or the like.

[0024] Figure 3 shows an example of the information included in the 360-degree photo information 141. Referring to Figure 3, the 360-degree photo information 141 includes, for example, 360-degree image data (e.g., 360° photo data), location information, and direction information. Here, the 360-degree image data is 360-degree image data captured using a 360-degree camera or the like. The location information is information indicating the location where the corresponding 360-degree image data was captured. For example, the location information may be latitude and longitude information. The direction information is information indicating the direction in the 360-degree image data, such as the angle the starting position of the 360-degree image data is facing. For example, the location information and direction information may be the same as the information included in Exif (Exchangeable Image File Forma) information. The location information and the like may be input by the user in response to operations on the operation input unit 110.

[0025] The detailed data information 142 includes detailed data, which is information that describes the object in the 360-degree image data in more detail. For example, the detailed data information 142 is acquired in advance from an external device such as a camera or an external information processing device via the communication I / F unit 130, or is input in advance through an operation on the operation input unit 110, and stored in the storage unit 140. The detailed data included in the detailed data information 142 may be updated at any time in response to an operation on the operation input unit 110, etc.

[0026] Figure 4 shows an example of detailed data included in the detailed data information 142. Referring to Figure 4, the detailed data information 142 includes, for example, image data (e.g., photographic data), location information, and text information. Here, the image data is image data taken using a camera with a general field of view, not a 360-degree camera. For example, the image data captures at least some of the objects included in the 360-degree image data. The location information indicates the location where the corresponding image data was taken. For example, the location information may be latitude and longitude information. The location information may be similar to the information included in Exif (Exchangeable Image File Forma) information. The text information includes textual information that describes the type, situation, location, and range of the object. The information included in the text information may be arbitrary.

[0027] The detailed data information 142 may consist of at least some of the information exemplified above, or it may include information other than that exemplified above. For example, the detailed data information 142 does not necessarily have to include both image data and text information.

[0028] Figure 5 shows an example of how the detailed data included in the detailed data information 142 can be displayed. For example, after icons are placed on the 360-degree image data through a process described later, a user who is viewing the 360-degree image data using the screen display unit 120 or the like can click on an icon that is displayed superimposed on the 360-degree image data using the operation input unit 110 or the like, and the detailed data as exemplified in Figure 5 can be displayed on the screen display unit 120 or the like. The example of how the detailed data included in the detailed data information 142 can be displayed may be other than that exemplified in Figure 5.

[0029] The 2D information 143 represents 2D information including map information showing a map corresponding to the shooting location of the 360-degree image data, and icons placed according to the location information contained in the 360-degree image data and detailed data. For example, the 2D information 143 is updated when the 2D information generation unit 152, described later, generates 2D information by placing icons on a 2D map based on the location information contained in the 360-degree photo information 141 and detailed data information 142.

[0030] The placement information 144 includes information indicating the type and placement position of icons to be displayed superimposed on the 360-degree image data. For example, the placement information 144 is updated in response to the icon placement unit 154 placing icons or the modification unit 155 modifying the display mode of the icons.

[0031] For example, the placement information 144 includes, for each 360-degree image data displaying an icon, information indicating the type of icon, information indicating the placement position of the icon in the 360-degree image data such as angle and coordinates, link information indicating detailed data corresponding to the icon, and information indicating the display mode of the icon. The placement information 144 may also include information other than those exemplified above, such as information for correcting the placement position of the icons.

[0032] The arithmetic processing unit 150 includes an arithmetic device such as a CPU (Central Processing Unit) and its peripheral circuits. The arithmetic processing unit 150 reads and executes a program 145 from the storage unit 140, thereby realizing various processing functions by having the hardware and the program 145 work together. Examples of the main processing functions realized by the arithmetic processing unit 150 include an information receiving unit 151, a two-dimensional information generation unit 152, an angle calculation unit 153, an icon placement unit 154, a modification unit 155, and an output unit 156.

[0033] The information reception unit 151 receives 360-degree image data, detailed data, and other information from external devices.

[0034] For example, the information receiving unit 151 receives 360-degree image data and Exif information from an external device such as a 360-degree camera via the communication I / F unit 130. The information receiving unit 151 then stores the received 360-degree image data and other information as 360-degree photo information 141 in the storage unit 140.

[0035] Furthermore, the information receiving unit 151 receives detailed data by receiving image data, Exif information, and character information from external devices such as cameras and external information processing devices via the communication I / F unit 130, and by receiving input such as character information and location information through operations on the operation input unit 110. The information receiving unit 151 then stores the received detailed data as detailed data information 142 in the storage unit 140.

[0036] The information receiving unit 151 may accept input and updates of location information and other data contained in the 360-degree photo information 141 in response to operations performed by the user or others on the operation input unit 110. Similarly, the information receiving unit 151 may accept updates of location information, text information and other data contained in the detailed data information 142 in response to operations performed on the operation input unit 110.

[0037] The 2D information generation unit 152 generates 2D information on a map that indicates the location corresponding to the 360-degree image data and the location corresponding to the detailed data to be calculated, based on the 360-degree photo information 141 and the detailed data information 142. The 2D information generation unit 152 then stores the generated 2D information as 2D information 143 in the storage unit 140.

[0038] Figure 6 shows an example of processing by the 2D information generation unit 152. For example, as shown in Figure 6, the 2D information generation unit 152 generates 2D information by placing icons on a map by referring to the 360-degree photographic information 141 and the detailed data information 142. For example, the 2D information generation unit 152 places icons on the map at locations corresponding to the location information contained in the 360-degree photographic information 141 and the detailed data information 142. In this case, the 2D information generation unit 152 can place different types of icons based on the location information contained in the 360-degree photographic information 141 and the location information contained in the detailed data information 142.

[0039] The angle calculation unit 153 calculates an angle based on the position information contained in the 360-degree photographic information 141 and the detailed data information 142, with the position corresponding to the 360-degree image data as the reference point. For example, the placement device 100 calculates the angle formed between a straight line extending in a predetermined direction, such as north, from a point corresponding to the shooting position of the reference 360-degree image data, and a straight line connecting the point corresponding to the shooting position of the reference 360-degree image data and a point corresponding to the position of the detailed data to be calculated.

[0040] In this embodiment, the angle calculation unit 153 can calculate an angle using the two-dimensional information generated by the two-dimensional information generation unit 152. Figure 7 shows an example of angle calculation using two-dimensional information by the angle calculation unit 153. Referring to Figure 7, the angle calculation unit 153 identifies an icon corresponding to the position information of the reference 360-degree image data in an arbitrary way. The angle calculation unit 153 then generates a straight line extending in a predetermined direction, such as north, from the icon corresponding to the position information of the reference 360-degree image data, and a straight line connecting the icon corresponding to the position information of the reference 360-degree image data and the icon corresponding to the position information of the detailed data to be calculated. Based on the generated results, the angle calculation unit 153 then calculates the angle at which the generated straight lines intersect (for example, a clockwise angle). For example, in Figure 7, the angle calculation unit 153 calculates 300° as the angle at which the generated straight lines intersect.

[0041] For example, the angle calculation unit 153 calculates the angle for each icon placed on the map using the process described above. In other words, the angle calculation unit 153 uses an icon corresponding to a certain 360-degree image data as a reference to calculate the angle for icons corresponding to the detailed data to be calculated, and also calculates the angle for other icons corresponding to other 360-degree image data that are also subject to calculation. Furthermore, the angle calculation unit 153 performs the same calculation process for each icon corresponding to a 360-degree image data placed on the map, while changing the reference icon corresponding to the 360-degree image data. Note that after identifying the icon corresponding to the location information of the reference 360-degree image data, the angle calculation unit 153 may only calculate the angle for icons that meet predetermined conditions, such as only icons that fall within a predetermined range from the reference icon corresponding to the 360-degree image data among the icons placed on the map.

[0042] The icon placement unit 154 places icons in the 360-degree image data based on the angle calculation result by the angle calculation unit 153. In other words, the icon placement unit 154 identifies the placement position of the icons to be displayed superimposed on the 360-degree image data based on the angle calculation result by the angle calculation unit 153. The icon placement unit 154 then stores information corresponding to the icon placement result as placement information 144 in the storage unit 140.

[0043] Figure 8 is a diagram illustrating an example of placement by the icon placement unit 154. Figure 8 shows an example image where a predetermined direction (for example, north) such as the starting position of the 360-degree image data is set to 0 degrees. As shown in Figure 8, in 360-degree image data, an angle can be assigned from a predetermined reference direction. The icon placement unit 154 then places the icons at positions corresponding to the calculated angle, based on the angle calculated by the angle calculation unit 153 using the corresponding 360-degree image data as a reference. For example, the icon placement unit 154 places the icon corresponding to the calculation target at a position near the center when viewing Figure 8 in the vertical direction, corresponding to the calculated angle. The icon placement unit 154 then generates and updates placement information 144 according to the placement result.

[0044] Here, with reference to Figure 9, an example of an icon to be placed on 360-degree image data will be explained. As shown in Figure 9, the icon can be tailored to the object of angle calculation. In other words, the icon can differ depending on whether the object of calculation is 360-degree image data or detailed data. Note that Figure 9 is just one example of an icon, and the icons to be displayed are not limited to those exemplified in Figure 9. Furthermore, the icon used as 2D information may be the same as or different from the icon placed on 360-degree image data as exemplified in Figure 9.

[0045] The modification unit 155 modifies the display pattern of the icons superimposed on the 360-degree image data. For example, the modification unit 155 modifies the display pattern based on the distance between the position indicated by the position information of the 360-degree image data used as a reference for angle calculation and the position indicated by the position information of the detailed data or 360-degree image data that were used for calculation. Then, the modification unit 155 updates the placement information 144 based on the modified result.

[0046] For example, the modification unit 155 modifies the display characteristics of the icon, such as its size, color, and angle, based on the distance between the above-mentioned criteria and the calculation target. For example, if the distance exceeds a predetermined value, the modification unit 155 modifies the display characteristics by reducing the size by a predetermined value, making the color lighter by a predetermined value, or lowering the angle by a predetermined value. The modification unit 155 may also perform gradual modifications by using multiple thresholds, such as reducing the size of the icon as the distance increases. The modification unit 155 may also be configured to not display the icon when the distance exceeds a predetermined value. Furthermore, as shown in Figure 10, the modification unit 155 can also calculate the standard deviation and modify the display characteristics based on the cumulative distribution function. The modification unit 155 may also modify the display characteristics in ways other than those exemplified above.

[0047] The modification unit 155 may be configured to more precisely identify the position in the 360-degree image data corresponding to the image data included in the detailed data, for example, by performing template matching to the 360-degree image data based on the image data included in the detailed data. In this case, the modification unit 155 can update the placement information 144 to display an icon at the identified position.

[0048] The output unit 156 outputs information based on 360-degree photographic information 141, detailed data information 142, 2D information 143, and arrangement information 144. For example, based on the 360-degree photographic information 141 and the arrangement information 144, the output unit 156 can overlay and display 360-degree image data and icons on the screen display unit 120, or transmit information for overlaying and displaying 360-degree image data and icons to an external device via the communication I / F unit 130. In this case, the output unit 156 can display icons on the screen display unit 120 in a display mode corresponding to the information indicating the display mode of the icons indicated by the arrangement information 144. In addition, along with the above output, the output unit 156 can display 2D information indicated by 2D information 143 on the screen display unit 120, or transmit 2D information to an external device via the communication I / F unit 130.

[0049] The above is an example of the configuration of the placement device 100. Next, an example of the operation of the placement device 100 will be described with reference to Figure 11.

[0050] Figure 11 is a flowchart illustrating an example of the operation of the placement device 100. Referring to Figure 11, the 2D information generation unit 152 generates 2D information based on the 360-degree photographic information 141 and the detailed data information 142 (step S101). For example, 2D information is generated by placing icons on the map at locations corresponding to the location information contained in the 360-degree photographic information 141 and the detailed data information 142. In this case, the 2D information generation unit 152 may place different types of icons for the location information contained in the 360-degree photographic information 141 and the location information contained in the detailed data information 142.

[0051] The angle calculation unit 153 calculates the angle using the two-dimensional information generated by the two-dimensional information generation unit 152 (step S102). For example, the angle calculation unit 153 identifies an icon corresponding to the position information of the reference 360-degree image data in any way. The angle calculation unit 153 then generates a straight line extending in a predetermined direction, such as north, from the icon corresponding to the position information of the reference 360-degree image data, and a straight line connecting the icon corresponding to the position information of the reference 360-degree image data and the icon corresponding to the position information of the detailed data to be calculated. Based on the generated results, the angle calculation unit 153 then calculates the angle at which the generated straight lines intersect (for example, a clockwise angle).

[0052] The icon placement unit 154 places icons in the 360-degree image data based on the angle calculation result by the angle calculation unit 153 (step S103). For example, the icon placement unit 154 places icons at positions corresponding to the angle calculated by the angle calculation unit 153.

[0053] The modification unit 155 modifies the display mode of the icons superimposed on the 360-degree image data (step S104). For example, the modification unit 155 modifies the display mode based on the distance between the position indicated by the position information of the 360-degree image data used as a reference during angle calculation and the position indicated by the position information of the detailed data or 360-degree image data that were the subject of calculation.

[0054] The output unit 156 outputs based on 360-degree photo information 141, detailed data information 142, 2D information 143, arrangement information 144, etc. (step S105). For example, based on the 360-degree photo information 141 and the arrangement information 144, the output unit 156 can display 360-degree image data and icons superimposed on the screen display unit 120, or transmit information for superimposing 360-degree image data and icons to an external device via the communication I / F unit 130. In this case, the output unit 156 can display the icons on the screen display unit 120 in a display mode corresponding to the information indicating the display mode of the icons indicated by the arrangement information 144. In addition, along with the above output, the output unit 156 can display 2D information indicated by 2D information 143 on the screen display unit 120, or transmit 2D information to an external device via the communication I / F unit 130.

[0055] The above is an example of the operation of the placement device 100. Note that Figure 11 shows an example of the operation of the placement device 100, and the operation of the placement device 100 is not limited to the example shown in Figure 11. For example, the placement device 100 may omit the process in step S104.

[0056] Thus, the placement device 100 includes an angle calculation unit 153 and an icon placement unit 154. With this configuration, the icon placement unit 154 can place icons based on the angle calculated by the angle calculation unit 153. As a result, the placement device 100 can automatically place icons in the 360-degree image data without the user having to specify or modify the display position of the icons, and can display the 360-degree image data and icons superimposed on each other. In other words, the above configuration can reduce the effort required when placing icons.

[0057] Furthermore, the placement device 100 includes a two-dimensional information generation unit 152. With this configuration, the placement device 100 can display 360-degree image data and icons superimposed on each other, as well as display two-dimensional information generated by the two-dimensional information generation unit 152. As a result, user visibility and convenience can be further improved.

[0058] Furthermore, the placement device 100 has a modification unit 155. With this configuration, the modification unit 155 can modify the display manner of the icons. In the embodiment described, the icon placement unit 154 places the icons at a position near the center when viewing Figure 8 in the vertical direction, corresponding to the calculated angle. By modifying the display manner of the icons with the modification unit 155, the icons can be displayed in a manner that more accurately reflects the actual situation, corresponding to the distance between the reference and the calculation target.

[0059] [Second Embodiment] Next, a second embodiment of the present disclosure will be described with reference to Figures 12 and 13. In the second embodiment of the present disclosure, an overview of the configuration of the placement device 200, which is an information processing device, will be described.

[0060] Figure 12 shows an example of the hardware configuration of the placement device 200. Referring to Figure 12, the placement device 200 has the following hardware configuration as an example. ·CPU (Central Processing Unit) 201 (computing unit) ROM (Read Only Memory) 202 (Storage Device) • RAM (Random Access Memory) 203 (storage device) • Program group 204 loaded into RAM203 • Storage device 205 for storing the program group 204 • Drive device 206 for reading and writing to the recording medium 210 outside the information processing device. • Communication interface 207 connecting to a communication network 211 outside the information processing device. • Input / output interface 208 for data input and output. • Bus 209 connecting each component

[0061] Furthermore, the placement device 200 can realize the functions of the angle calculation unit 221 and placement unit 222 shown in Figure 12 by having the CPU 201 acquire the program group 204 and execute it. The program group 204 is, for example, stored in advance in a storage device 205 or ROM 202, and the CPU 201 loads it into RAM 203 or the like and executes it as needed. Alternatively, the program group 204 may be supplied to the CPU 201 via a communication network 211, or it may be stored in advance in a recording medium 210, and the drive device 206 may read the program and supply it to the CPU 201.

[0062] Figure 12 shows an example of the hardware configuration of the placement device 200. The hardware configuration of the placement device 200 is not limited to the case described above. For example, the placement device 200 may consist of only a part of the configuration described above, such as not having a drive device 206.

[0063] The angle calculation unit 221 calculates the angle between a predetermined direction, based on the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target.

[0064] The placement unit 222 determines the placement position of the icon to be displayed superimposed on the 360-degree image data, based on the angle calculated by the angle calculation unit 221.

[0065] Thus, the placement device 200 has an angle calculation unit 221 and a placement unit 222. With this configuration, the placement unit 222 can determine the placement position of the icons to be displayed superimposed on the 360-degree image data based on the angle calculated by the angle calculation unit 221. As a result, the placement device 200 can automatically place the icons and display the 360-degree image data and icons superimposed on each other without the user having to specify or modify the display position of the icons in the 360-degree image data. In other words, the above configuration can reduce the effort required when placing icons.

[0066] Furthermore, the information processing device such as the placement device 200 described above can be realized by incorporating a predetermined program into the information processing device. Specifically, another form of the present invention is a program for implementing a process in the information processing device that calculates an angle between a predetermined direction based on the position indicated by the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target, and identifies the placement position of an icon to be displayed superimposed on the 360-degree image data based on the calculated angle.

[0067] Furthermore, the arrangement method performed by the information processing device described above involves the information processing device calculating an angle between the position indicated by the position information corresponding to the 360-degree image data and a predetermined direction based on the position information corresponding to the calculation target, and then determining the placement position of the icon to be displayed superimposed on the 360-degree image data based on the calculated angle.

[0068] Even if the invention is a program (or recording medium) or arrangement method having the above-described configuration, it will have the same operation and effect as the arrangement device 200 described above, and therefore the objectives of the present invention described above can be achieved.

[0069] <Note> Some or all of the above embodiments may also be described as follows. The following outlines the arrangement apparatus and other components of the present invention. However, the present invention is not limited to the following configurations.

[0070] (Note 1) An angle calculation unit calculates an angle between a predetermined direction based on the position information corresponding to the 360-degree image data and the position information corresponding to the target of calculation, based on the position information corresponding to the 360-degree image data. Based on the angle calculated by the angle calculation unit, the placement unit identifies the placement position of the icon to be displayed superimposed on the 360-degree image data, has Placement device. (Note 2) The arrangement device described in Appendix 1, The system includes a two-dimensional information generation unit that generates two-dimensional information on a map indicating the location corresponding to the 360-degree image data and the location corresponding to the calculation target, based on the location information corresponding to the 360-degree image data and the location information corresponding to the calculation target. The angle calculation unit calculates an angle based on the position indicated by the position information corresponding to the 360-degree image data, using the 2D information generated by the 2D information generation unit as a reference. Placement device. (Note 3) The arrangement device described in Appendix 2, The two-dimensional information generation unit generates the two-dimensional information by placing icons on a map at the locations corresponding to the 360-degree image data and the locations corresponding to the calculation target, based on the location information corresponding to the 360-degree image data and the location information corresponding to the calculation target. Placement device. (Note 4) The arrangement device described in Appendix 2 or Appendix 3, The angle calculation unit calculates an angle based on the position indicated by the position information corresponding to the 360-degree image data, based on a straight line extending in a predetermined direction from the position indicated by the position information of the 360-degree image data, and a straight line connecting the position indicated by the position information corresponding to the 360-degree image data and the position indicated by the position information corresponding to the calculation target. Placement device. (Note 5) An arrangement device described in any one of the items from Appendix 2 to Appendix 4, The system has an output unit that displays the 360-degree image data and the icon superimposed on each other, and outputs the 2D information generated by the 2D information generation unit. Placement device. (Note 6) An arrangement device described in any one of the items from Appendix 1 to Appendix 5, The system includes a modification unit that modifies the display mode of the icon based on the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target. Placement device. (Note 7) The arrangement device described in Appendix 6, The modification unit modifies the display mode of the icon based on the distance between the position indicated by the position information corresponding to the 360-degree image data and the position indicated by the position information corresponding to the calculation target. Placement device. (Note 8) An arrangement device described in any one of the items from Appendix 1 to Appendix 7, The location information corresponding to the calculation target indicates the shooting location of the image data included in the detailed data that is the calculation target. Placement device. (Note 9) Information processing device, Based on the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target, the angle between the position indicated by the position information corresponding to the 360-degree image data and a predetermined direction is calculated. Based on the calculated angle, the placement position of the icon to be displayed superimposed on the 360-degree image data is determined. Placement method. (Note 10) In an information processing device, Based on the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target, the angle between the position indicated by the position information corresponding to the 360-degree image data and a predetermined direction is calculated. Based on the calculated angle, the placement position of the icon to be displayed superimposed on the 360-degree image data is determined. A program to perform a process.

[0071] The programs described in each of the above embodiments and appendices are stored in a storage device or recorded on a computer-readable recording medium. For example, the recording medium is a portable medium such as a flexible disk, optical disk, magneto-optical disk, or semiconductor memory.

[0072] Although the present invention has been described above with reference to the embodiments described above, the present invention is not limited to the embodiments described above. Various modifications to the structure and details of the present invention can be made within the scope of the present invention as can be understood by those skilled in the art. [Explanation of Symbols]

[0073] 100 Placement device 110 Operation Input Section 120 Screen display section 130 Communication I / F Section 140 Storage section 141 360-degree photo information 142 Detailed Data Information 143 2D Information 144 Placement information 145 Programs 150 Arithmetic Processing Unit 151 Information Reception Department 152 2D information generation section 153 Angle Calculation Unit 154 Icon placement section 155 Correction section 156 Output section 200 Placement device 201 CPU 202 ROM 203 RAM 204 Program Groups 205 Storage device 206 Drive unit 207 Communication Interface 208 Input / Output Interfaces Bus 209 210 Recording media 211 Communication Network 221 Angle Calculation Unit 222 Placement section

Claims

1. An angle calculation unit calculates an angle between a predetermined direction based on the position information corresponding to the 360-degree image data and the position information corresponding to the target of calculation, based on the position information corresponding to the 360-degree image data. Based on the angle calculated by the angle calculation unit, the placement unit identifies the placement position of the icon to be displayed superimposed on the 360-degree image data, A two-dimensional information generation unit generates two-dimensional information on a map that indicates the location corresponding to the 360-degree image data and the location corresponding to the calculation target, based on the location information corresponding to the 360-degree image data and the location information corresponding to the calculation target. It has, The angle calculation unit calculates an angle based on the position indicated by the position information corresponding to the 360-degree image data, using the 2D information generated by the 2D information generation unit as a reference. Placement device.

2. The arrangement device according to claim 1, The two-dimensional information generation unit generates the two-dimensional information by placing icons on a map at the locations corresponding to the 360-degree image data and the locations corresponding to the calculation target, based on the location information corresponding to the 360-degree image data and the location information corresponding to the calculation target. Placement device.

3. A placement device according to claim 1 or claim 2, The angle calculation unit calculates an angle based on the position indicated by the position information corresponding to the 360-degree image data, based on a straight line extending in a predetermined direction from the position indicated by the position information of the 360-degree image data, and a straight line connecting the position indicated by the position information corresponding to the 360-degree image data and the position indicated by the position information corresponding to the calculation target. Placement device.

4. A placement device according to any one of claims 1 to 3, The system has an output unit that displays the 360-degree image data and the icon superimposed on each other, and outputs the two-dimensional information generated by the two-dimensional information generation unit. Placement device.

5. A placement device according to any one of claims 1 to 4, The system includes a modification unit that modifies the display mode of the icon based on the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target. Placement device.

6. The arrangement device according to claim 5, The modification unit modifies the display mode of the icon based on the distance between the position indicated by the position information corresponding to the 360-degree image data and the position indicated by the position information corresponding to the calculation target. Placement device.

7. A placement device according to any one of claims 1 to 6, The location information corresponding to the calculation target indicates the shooting location of the image data included in the detailed data that is the calculation target. Placement device.

8. Information processing device, Based on location information corresponding to 360-degree image data and location information corresponding to the calculation target, two-dimensional information is generated on a map that shows the location corresponding to the 360-degree image data and the location corresponding to the calculation target. Based on the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target, the angle between the position indicated by the position information corresponding to the 360-degree image data and a predetermined direction is calculated. Based on the calculated angle, the placement position of the icon to be displayed superimposed on the 360-degree image data is determined. When calculating the angle, the angle is calculated based on the position indicated by the position information corresponding to the 360-degree image data, using the generated two-dimensional information as a reference. Placement method.

9. In an information processing device, Based on location information corresponding to 360-degree image data and location information corresponding to the calculation target, two-dimensional information is generated on a map that shows the location corresponding to the 360-degree image data and the location corresponding to the calculation target. Based on the position information corresponding to the 360-degree image data and the position information corresponding to the calculation target, the angle between the position indicated by the position information corresponding to the 360-degree image data and a predetermined direction is calculated. Based on the calculated angle, the placement position of the icon to be displayed superimposed on the 360-degree image data is determined. When calculating the angle, the angle is calculated based on the position indicated by the position information corresponding to the 360-degree image data, using the generated two-dimensional information as a reference. A program to perform a process.

Images