Information processing apparatus, information processing method, and program

Abstract

An information processing apparatus (10) according to one embodiment comprises: a viewpoint image generation unit (17) that uses parameter data which contains the generation number of viewpoint images in an update space and a viewpoint orientation at an arbitrary point in the update space, and update space data which is related to the update space that includes a margin region, to generate a viewpoint image in which a generation point at an arbitrary position in the update space is used as reference; a VPS processing unit (18) that uses the viewpoint image and VPS data to infer the position and the orientation of the generation point in the entire space, and thereby determines a candidate point; and an update candidate position determination unit (19) that determines an update space candidate position on the basis of the candidate point.

Description

Information processing device, information processing method, and program

[0001] The present invention relates to an information processing device, an information processing method, and a program.

[0002] By using 3D point cloud data to build a metaverse space, efforts are underway to apply it to infrastructure, tourism, and other fields. However, the real space used to build the metaverse space changes over time, resulting in differences between the real space and the metaverse space, such as buildings and nature. To prevent this difference from becoming too great and losing the sense of realism, it is necessary to update part of the metaverse space to match the real space.

[0003] Nippon Telegraph and Telephone Corporation et al., "Launch of the 'TENGUN Ogijima Project' to Promote Regional Co-creation - Joint Study Begins Aiming to Create and Expand a Connected Population through a Photorealistic 'Ogijima' Metaverse Realized by IOWN," [online], November 15, 2022, [Retrieved May 14, 2024], Internet <URL: https: / / group.ntt / jp / newsrelease / 2022 / 11 / 15 / 221115b.html>

[0004] A known procedure for updating part of the metaverse space is to create 3D point cloud data in real space using measuring equipment while leaving a margin to make it easier to find overlap with the entire metaverse space, and then place (register) the 3D point cloud data of the space that needs to be updated (hereinafter referred to as the update space) in the metaverse space. In this case, the 3D point cloud data is placed by applying one of the following methods.

[0005] The first method is manual adjustment by hand. However, the cost of identifying which location in the entire metaverse space to update is high. Also, while location information such as GPS can be used for positioning outdoors, indoors GPS may not be available and location information may not be available. The second method is a statistical method. However, when the metaverse space is large, statistical methods require a long search time and may encounter initial value problems.

[0006] The present invention has been made in consideration of the above circumstances, and has an object to provide an information processing device, an information processing method, and a program that are capable of appropriately estimating candidate positions in an update space.

[0007] An information processing device according to a first aspect of the present invention comprises: a viewpoint image generation unit that generates a viewpoint image based on a generation point located at an arbitrary position within the update space using parameter data including the number of viewpoint images to be generated in the update space and the viewpoint direction at an arbitrary point in the update space, and update space data regarding the update space including an overlap area; a VPS processing unit that determines a candidate point by estimating the position and orientation of the generation point in the entire space using the viewpoint image and VPS data; and an update candidate position determination unit that determines an update space candidate position based on the candidate point.

[0008] In an information processing method according to a second aspect of the present invention, a viewpoint image generation means generates a viewpoint image based on a generation point located at an arbitrary position within the update space using parameter data including the number of viewpoint images to be generated in the update space and the viewpoint direction at an arbitrary point in the update space, and update space data regarding the update space including an overlap area, a VPS processing means determines a candidate point by estimating the position and orientation of the generation point in the entire space using the viewpoint image and VPS data, and an update candidate position determination means determines an update space candidate position based on the candidate point.

[0009] A program according to a third aspect of the present invention is a program that causes a computer to function as the information processing device according to the first aspect.

[0010] According to the present invention, it is possible to provide an information processing device, an information processing method, and a program that are capable of appropriately estimating candidate positions in an update space.

[0011] FIG. 1 is a block diagram schematically showing an example of the configuration of an information processing device according to a first embodiment. FIG. 2 is a diagram showing an example of viewpoint image generation processing of the information processing device according to the first embodiment. FIG. 3 is a diagram showing an example of spatial candidate position determination processing of the information processing device according to the first embodiment. FIG. 4 is a flowchart showing an example of processing of the information processing device according to the first embodiment. FIG. 5 is a block diagram schematically showing an example of the configuration of an information processing device according to a second embodiment. FIG. 6 is a diagram showing an example of processing of the information processing device according to the second embodiment. FIG. 7 is a diagram showing an example of processing of the information processing device according to the second embodiment. FIG. 8 is a flowchart showing an example of processing of the information processing device according to the second embodiment. FIG. 9 is a block diagram showing an example of the hardware configuration of an information processing device according to the first and second embodiments.

[0012] Each embodiment will be described below with reference to the drawings. Each embodiment illustrates an apparatus or method for embodying the technical idea of ​​the invention. The drawings are schematic or conceptual. In the following, the same reference numerals are used to designate components having substantially the same functions and configurations. The numbers following the letters that make up the reference numerals are used to distinguish between elements that are referred to by the reference numerals containing the same letters and that have similar configurations. When there is no need to distinguish between elements indicated by reference numerals containing the same letters or numbers, these elements will be referred to by reference numerals containing only letters or numbers.

[0013] [First Embodiment] An information processing device 10 according to the first embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram illustrating a schematic configuration example of an information processing device according to the first embodiment. The information processing device 10 is a device that applies an image of an overlap area seen from inside an update space included in a metaverse space (hereinafter referred to as the entire space) to a VPS (Visual Positioning System) and identifies the position and orientation in the entire space, thereby appropriately setting a candidate position for the update space in the entire space. The overlap area is an excess area of ​​the update space that is provided to make it easier to find overlaps with the entire space.

[0014] The information processing device 10 includes VPS data 11, viewpoint data 12, updated space data 13, a data input unit 14, parameter data 15, an updated space input unit 16, a viewpoint image generation unit 17, a VPS processing unit 18, an updated candidate position determination unit 19, and an updated candidate position output unit 20.

[0015] The information processing device 10 may be an electronic device such as a computer, for example, a television receiver (including Internet television), a PC (Personal Computer), a mobile terminal (for example, a tablet, smartphone, laptop, feature phone, digital music player, e-book reader, smart watch, etc.), a game device (home game console, portable game console), a VR (Virtual Reality) terminal, an AR (Augmented Reality) terminal, etc.

[0016] The information processing device 10 may be communicably connected to an external server or the like via a network, for example. In this case, multiple information processing devices 10 are communicably connected to the external server via the network, enabling functions such as sharing of necessary information. The external server may be a storage device or the like.

[0017] The VPS data 11 is data obtained from a positioning system that uses image information. The VPS processes and analyzes image information of the entire space captured in advance using an imaging device and a 3D map of the entire space to identify the position coordinates and viewpoint direction at a specific viewpoint (capture position). In other words, the VPS data 11 may be a series of data sets at the position coordinates and viewpoint direction identified by the VPS. The data included in the VPS data 11 is not limited to these.

[0018] The viewpoint data 12 is a data group including, for example, the number of viewpoint images generated in the update space and the viewpoint direction at any point in the update space. The number of viewpoint images generated in the update space and the viewpoint direction corresponding to each viewpoint image may be set in advance by a user of the information processing device 10, or may be set by the information processing device 10 according to the update space based on a learning model. The data included in the viewpoint data 12 is not limited to the number of viewpoint images generated in the update space and the viewpoint direction at any point in the update space.

[0019] The update space data 13 is, for example, 3D point cloud data of the update space including the overlap region. The 3D point cloud data of the update space is measured in advance in the space that needs to be updated, and may be stored in the information processing device 10 or configured to be obtainable from an external device.

[0020] The data input unit 14 acquires the VPS data 11 and the viewpoint data 12, inputs the VPS data 11 to a VPS processing unit 18 (described later), and inputs parameter data 15, which is data obtained by converting the viewpoint data 12 into parameters, to a viewpoint image generation unit 17. The updated space input unit 16 acquires the updated space data 13 and inputs it to the viewpoint image generation unit 17. Note that the viewpoint data 12 and the parameter data 15 may have the same data content.

[0021] The viewpoint image generation unit 17 generates a viewpoint image using the parameter data 15 input from the data input unit 14 and the updated space data 13 input from the updated space input unit 16. The processing of the viewpoint image generation unit 17 will be described in detail with reference to Fig. 2. Fig. 2 is a diagram showing an example of the viewpoint image generation processing of the information processing device according to the first embodiment.

[0022] The viewpoint image generation unit 17 places a generation point at any position in the corresponding update space included in the update space data 13 input from the update space input unit 16, based on the number of generated viewpoint images in the update space included in the parameter data 15 input from the data input unit 14.

[0023] For example, as shown in Figure 2, if the number of generated viewpoint images in the update space included in the parameter data 15 is four, the viewpoint image generation unit 17 places the first generation point 130, the second generation point 131, the third generation point 132, and the fourth generation point 133 at the midpoints of the outer space surface of the update space 120 including the overlap area 110, respectively.

[0024] The generation points thus arranged may be determined by the viewpoint image generation unit 17 according to the number of viewpoint images to be generated and the viewpoint direction in the corresponding update space, or may be determined by the user of the information processing device 10.

[0025] Furthermore, the viewpoint image generation unit 17 determines the viewpoint direction corresponding to the arranged generation point using the viewpoint direction at an arbitrary point in the update space. For example, the viewpoint image generation unit 17 determines the viewpoint direction 140 corresponding to the first generation point 130.

[0026] The viewpoint image generation unit 17 generates a viewpoint image in which the overlap region is the edge of the viewpoint by using an arbitrary generation point and a viewpoint direction corresponding to the generation point. For example, when the viewpoint direction at a first generation point 130 arranged at the midpoint of one surface of the update space is viewpoint direction 140, the viewpoint image generation unit 17 generates viewpoint image 150. The viewpoint image generation unit 17 similarly generates viewpoint images for the second generation point, the third generation point, and the fourth generation point.

[0027] The VPS processing unit 18 estimates the position and orientation of the generation point in the entire space using the viewpoint image generated by the viewpoint image generation unit 17 and the VPS data 11. The processing of the VPS processing unit 18 will be described in detail with reference to Fig. 3. Fig. 3 is a diagram showing an example of a spatial candidate position determination process of the information processing device according to the first embodiment.

[0028] The VPS processing unit 18 acquires viewpoint images at the first generation point 130, the second generation point 131, the third generation point 132, and the fourth generation point 133 from the viewpoint image generation unit 17. The VPS processing unit 18 applies the VPS data 11 input from the data input unit 14 to each of the acquired viewpoint images, and estimates the positions and orientations of the first generation point 130, the second generation point 131, the third generation point 132, and the fourth generation point 133 in the entire space 100, respectively.

[0029] 3, the VPS processing unit 18 applies the VPS to each viewpoint image and estimates the position and orientation of each generation point, thereby determining a first candidate point 160, a second candidate point 161, a third candidate point 162, and a fourth candidate point 163. Note that if only one position and orientation are estimated at each generation point, the VPS processing unit 18 may determine that one candidate point, and if multiple positions and orientations are estimated at each generation point, the VPS processing unit 18 may select a combination that is closest to the positional relationship with the corresponding generation point.

[0030] The update candidate position determiner 19 determines an update space candidate position based on the candidate points determined by the VPS processor 18. For example, as shown in Fig. 3 , the update candidate position determiner 19 generates a circumscribing rectangle based on a first candidate point 160, a second candidate point 161, a third candidate point 162, and a fourth candidate point 163 determined by the VPS processor 18, and determines an update space candidate position 170. When there is one candidate point, the update candidate position determiner 19 determines the candidate point as an update space candidate position, and when there are two or more candidate points, the update candidate position determiner 19 may determine the update space candidate position in accordance with the number of candidate points.

[0031] The update candidate position output unit 20 outputs the update space candidate position determined by the update candidate position determination unit 19. For example, the update candidate position output unit 20 draws the update space candidate position 170 in a corresponding region of the entire space 100, and performs processing so that the user of the information processing device 10 can visually recognize it.

[0032] Next, an example of the processing operation of the information processing device according to this embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing an example of the processing of the information processing device according to the first embodiment. In this embodiment, the processing operation is started when, for example, the information processing device 10 is started or when a user presses a button or the like to start processing.

[0033] The data input unit 14 acquires viewpoint data 12 and converts the viewpoint data 12 into parameters to input parameter data 15 to the viewpoint image generation unit 17 (step S10). The data input unit 14 acquires VPS data 11 and inputs the VPS data 11 to the VPS processing unit 18 (step S11). Next, the updated space input unit 16 acquires updated space data 13 and inputs it to the viewpoint image generation unit 17 (step S12). Note that the order of steps S10, S11, and S12 is not particularly determined, and they may be input simultaneously.

[0034] The viewpoint image generation unit 17 generates viewpoint images using the parameter data 15 input from the data input unit 14 and the update space data 13 input from the update space input unit 16 (step S13). That is, based on the number of viewpoint images to be generated in the update space, the viewpoint image generation unit 17 places a generation point at an arbitrary position in the corresponding update space included in the update space data 13 input from the update space input unit 16, and determines the viewpoint direction corresponding to the placed generation point using the viewpoint direction at the arbitrary point in the update space, thereby generating a viewpoint image in which the overlap region is the edge of the viewpoint.

[0035] The VPS processing unit 18 estimates the position and orientation of the generation point in the entire space (step S14) using the viewpoint image generated by the viewpoint image generation unit 17 and the VPS data 11. Furthermore, the VPS processing unit 18 applies the VPS to the viewpoint image, thereby estimating the position and orientation of the generation point and determining the candidate point.

[0036] The update candidate position determination unit 19 determines an update space candidate position based on the candidate point determined by the VPS processing unit 18 (step S15). Then, the update candidate position output unit 20 outputs the update space candidate position determined by the update candidate position determination unit 19, and the process ends.

[0037] According to the information processing device 10 of the embodiment, the viewpoint image generation unit 17 generates a viewpoint image using viewpoint data and updated space data, the VPS processing unit 18 determines candidate points by applying VPS to the viewpoint image, and the updated candidate position determination unit 19 determines candidate positions for the updated space from the candidate points, making it possible to automatically determine appropriate candidate positions for the updated space from a huge amount of overall space data, and furthermore, because VPS is used, it can be applied even when there is no data such as position information indoors or outdoors.

[0038] [Second embodiment] In the first embodiment, it is assumed that there is one update space in the entire space, but in the second embodiment, it is assumed that there are at least two or more update spaces in the entire space, and further, the appearance times of the objects in the multiple update spaces are different.

[0039] An information processing device 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram schematically illustrating an example configuration of the information processing device according to the second embodiment. The information processing device 10 includes VPS data 11, viewpoint data 12, a plurality of pieces of updated space data 13, a data input unit 14, parameter data 15, an updated space input unit 16, a viewpoint image generation unit 17, a VPS processing unit 18, an updated candidate position determination unit 19, an updated candidate position output unit 20, a sorting processing unit 21, updated candidate position data 22, a registration processing unit 23, entire space data 24, and a VPS data regeneration unit 25.

[0040] The sorting processing unit 21 sorts the plurality of pieces of update space data 13 according to the appearance time of an object existing in the update space included in each of the plurality of pieces of update space data 13. That is, the sorting processing unit 21 sorts the update spaces in chronological order from a reference time.

[0041] The updated candidate position data 22 is a data group including the updated space candidate positions output by the updated candidate position output unit 20 .

[0042] The registration processing unit 23 registers the updated space at an appropriate position in the overall space using the update candidate position data 22 and executes a process of applying the updated space. The registration processing unit 23 replaces the space after application of the updated space as the overall space. Overall space data 24 is a data group including the replaced overall space.

[0043] The VPS data regeneration unit 25 regenerates the VPS data 11 based on the entire space data 24. For example, the VPS data regeneration unit 25 may be configured to regenerate the VPS data 11 when the range of the updated space in the entire space exceeds a predetermined threshold.

[0044] 6 and 7 are diagrams illustrating an example of processing by the information processing apparatus according to the second embodiment. Fig. 6 illustrates a first update space 121 including a first marginal region 111, an object 180 existing in the first update space 121, a second update space 122 including a second marginal region 112, and an object 181 existing in the second update space 122.

[0045] For example, if an object 181 present in the second update space 122 is included in the first extension area 111, the sorting processing unit 21 sorts the first update space 121 and the second update space 122 in chronological order and starts processing in the order of earliest to latest. As shown in Fig. 7 , by starting processing for the first update space 121 first, a partial object 182 of the object 180 that is the common part of the second extension area 112 is correctly displayed, and the second update space 122 can be processed normally.

[0046] Next, an example of the processing operation of the information processing device according to this embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the processing of the information processing device according to the second embodiment. In this embodiment, the processing operation is started when, for example, the information processing device 10 is started or when the user presses a button or the like to start processing. Furthermore, the processing from step S10 to step S15 described below is the same as that in the first embodiment.

[0047] The sorting processing unit 21 sorts the update spaces according to the appearance times of objects present in the update spaces contained in each of the plurality of update space data 13 (step S20). The data input unit 14 acquires viewpoint data 12 and converts the viewpoint data 12 into parameters to input parameter data 15 to the viewpoint image generation unit 17 (step S10). The data input unit 14 acquires VPS data 11 and inputs the VPS data 11 to the VPS processing unit 18 (step S11). Next, the update space input unit 16 acquires update space data 13 and inputs it to the viewpoint image generation unit 17 (step S12). Note that the order of steps S10, S11, and S12 is not particularly determined, and they may be input simultaneously.

[0048] The viewpoint image generation unit 17 generates viewpoint images using the parameter data 15 input from the data input unit 14 and the update space data 13 input from the update space input unit 16 (step S13). That is, based on the number of viewpoint images to be generated in the update space, the viewpoint image generation unit 17 places a generation point at an arbitrary position in the corresponding update space included in the update space data 13 input from the update space input unit 16, and determines the viewpoint direction corresponding to the placed generation point using the viewpoint direction at the arbitrary point in the update space, thereby generating a viewpoint image in which the overlap region is the edge of the viewpoint.

[0049] The VPS processing unit 18 estimates the position and orientation of the generation point in the entire space (step S14) using the viewpoint image generated by the viewpoint image generation unit 17 and the VPS data 11. Furthermore, the VPS processing unit 18 applies the VPS to the viewpoint image, thereby estimating the position and orientation of the generation point and determining the candidate point.

[0050] The update candidate position determination unit 19 determines an update space candidate position based on the candidate point determined by the VPS processing unit 18 (step S15). Then, the update candidate position output unit 20 outputs the update space candidate position determined by the update candidate position determination unit 19.

[0051] The registration processing unit 23 registers the updated space at an appropriate position in the overall space using the update candidate position data 22 (step S21). The registration processing unit 23 also replaces the space after the update space is applied as the overall space and updates the overall space (step S22). The VPS data regeneration unit 25 regenerates the VPS data 11 based on the overall space data 24 (step S22). The information processing device 10 determines whether the above process has been performed on all of the rearranged updated spaces (step S23).

[0052] If the information processing device 10 determines that the above process has not been performed on all of the rearranged update spaces (step S23, NO), it transitions to the process of step S10. Through this process, the processes of steps S10 to S15 and steps S21 to S22 are repeatedly performed on all of the update spaces. On the other hand, if the information processing device 10 determines that the above process has been performed on all of the rearranged update spaces (step S23, YES), it ends the process.

[0053] According to the information processing device 10 of the embodiment, when there are multiple update spaces and part of the overlap area included in a specific update space is part of another update space, if the order of updates is incorrect, it becomes difficult to estimate the position in the overall space. However, by rearranging the update spaces in chronological order based on the appearance time of the object existing in the update space and performing processing in order of earliest appearance, it becomes possible to prevent mismatches between the overlap area and the overall space.

[0054] Next, an example of the hardware configuration of the information processing device 10 according to the first and second embodiments will be described with reference to Fig. 9. Fig. 9 is a block diagram showing an example of the hardware configuration of the information processing device according to the first and second embodiments.

[0055] 9 , the information processing device 10 includes, for example, a processor 1001, a data memory 1002, a program memory 1003, a communication interface 1004, and an input / output interface 1005. The processor 1001, the data memory 1002, the program memory 1003, the communication interface 1004, and the input / output interface 1005 are connected to each other via a bus communication line, and can transmit and receive data between them. Note that the processor 1001, the data memory 1002, the program memory 1003, the communication interface 1004, and the input / output interface 1005 may also be configured to transmit and receive data between them via wireless communication or the like.

[0056] The processor 1001 includes at least one processor such as a CPU (Central Process Unit), MPU (micro processing unit), GPU (Graphics Processing Unit), or FPGA (field-programmable gate array), and can realize various functions of the information processing device 10 by executing programs such as system software, application software, or firmware stored in the data memory 1002 or the program memory 1003.

[0057] The data memory 1002 may include, for example, a read-only memory (ROM) and a random-access memory (RAM). The ROM is a non-volatile memory used exclusively for reading data, and can store data and various setting values ​​used by the processor 1001 when performing various processes. The RAM can be used as a so-called work area for temporarily storing data when the processor 1001 performs various processes.

[0058] The program memory 1003 is a non-transitory computer-readable storage medium of a computer centered around the processor 1001. The auxiliary storage unit is, for example, an EEPROM (registered trademark) (electric erasable programmable read-only memory), a hard disk drive (HDD), or a solid state drive (SSD). The program memory 1003 can store data used by the processor 1001 (described later) when performing various processes, data generated by the processes in the processor 1001, various setting values, and the like.

[0059] The communication interface 1004 can transmit information received from the outside to components within the information processing device 10, and can also transmit information received from components within the information processing device 10 to the outside.

[0060] The input / output interface 1005 is installed in the information processing device 10 and is connected to input devices and output devices used by the user of the information processing device 10. The input devices may include, for example, user interfaces such as a mouse and keyboard that are operated by the user of the information processing device 10 and are used to input various information (e.g., information to change the numerical values ​​of various settings of the information processing device 10), as well as various sensors such as a microphone and a touch panel. The output devices may include, for example, a monitor that visually presents information to the user of the information processing device 10. The output devices may also include audio output means such as a speaker that audibly supplies information to the user of the information processing device 10.

[0061] The program according to the embodiment may be transferred in a state where it is stored in an electronic device, or may be transferred in a state where it is not stored in an electronic device. In the latter case, the program may be transferred via a network, or may be transferred in a state where it is stored in a storage medium. The storage medium is a non-transitory tangible medium. The storage medium is a computer-readable medium. The storage medium may be in any form, such as a CD-ROM or a memory card, as long as it is capable of storing the program and is computer-readable.

[0062] The present invention is not limited to the above-described embodiments, and various modifications can be made in the implementation stage without departing from the spirit of the invention. Furthermore, the embodiments may be implemented in appropriate combinations, in which case the combined effects can be obtained. Furthermore, the above-described embodiments include various inventions, and various inventions can be extracted by combining selected elements from the disclosed elements. For example, if the problem can be solved and the desired effect can be obtained even if some elements are deleted from all elements shown in the embodiments, the configuration from which these elements are deleted can be extracted as an invention.

[0063] 10... Information processing device 11... VPS data 12... Viewpoint data 13... Updated space data 14... Data input unit 15... Parameter data 16... Updated space input unit 17... Viewpoint image generation unit 18... VPS processing unit 19... Updated candidate position determination unit 20... Updated candidate position output unit 21... Sorting processing unit 22... Updated candidate position data 23... Registration processing unit 24... Whole space data 25... VPS data regeneration unit 1001... Processor 1002... Data memory 1003... Program memory 1004... Communication interface 1005... Input / output interface

Claims

1. An information processing device comprising: a viewpoint image generation unit that generates a viewpoint image based on a generation point located at an arbitrary position within an update space using parameter data including the number of viewpoint images to be generated in the update space and the viewpoint direction at an arbitrary point in the update space, and update space data regarding the update space including an overlap area; a VPS processing unit that determines a candidate point by estimating the position and orientation of the generation point in the entire space using the viewpoint image and VPS data; and an update candidate position determination unit that determines a candidate position in the update space based on the candidate point.

2. An information processing apparatus according to claim 1, further comprising a data input section that inputs said parameter data to said viewpoint image generating section and inputs said VPS data to said VPS processing section.

3. The information processing device described in claim 1, wherein the viewpoint image generation unit places the generation point at an arbitrary position in the corresponding update space included in the update space data based on the number of viewpoint images generated in the update space, and generates the viewpoint image with the overlap area as the edge of the viewpoint by using the viewpoint direction corresponding to the generation point.

4. The information processing device according to claim 1, further comprising a sorting processing unit that sorts the plurality of pieces of updated space data according to the appearance time of an object that exists in the updated space and is included in each piece of updated space data.

5. An information processing device as described in claim 4, further comprising: a registration processing unit that uses the update space candidate position to register the update space at an appropriate position in the overall space and executes an application process to replace the space after application of the update space as the overall space; and a VPS data regeneration unit that regenerates the VPS data based on the overall space replaced by the registration processing unit.

6. The information processing device according to claim 5, wherein when the range of the updated space in the entire space exceeds a predetermined threshold, a process of regenerating the VPS data is executed.

7. An information processing method in which a viewpoint image generation means generates a viewpoint image based on a generation point located at an arbitrary position within the update space, using parameter data including the number of viewpoint images to be generated in the update space and the viewpoint direction at an arbitrary point in the update space, and update space data regarding the update space including an overlap area; a VPS processing means determines a candidate point by estimating the position and orientation of the generation point in the entire space using the viewpoint image and VPS data; and an update candidate position determination means determines an update space candidate position based on the candidate point.

8. A program that causes a computer to function as the information processing device according to any one of claims 1 to 6.

Images