Information processing device and method

Abstract

An acquisition unit 11 acquires a plurality of captured image data items indicating images of a subject captured from a plurality of different viewpoints by an imaging device. A high-quality image data generation unit 12 generates high-quality image data in which the quality of the captured image data acquired by the acquisition unit 11 has been improved. On the basis of the high-quality image data generated by the high-quality image data generation unit 12, a three-dimensional reproduction model generation unit 13 generates a three-dimensional reproduction model using Gaussian plotting. A rendering unit 14 uses the three-dimensional reproduction model to generate rendering image data in which an image viewed from an arbitrary viewpoint in a three-dimensional space is rendered. A low-quality reproduction model generation unit 15 lowers the quality of the image rendered by the three-dimensional reproduction model, and generates a low-quality reproduction model for rendering an image approximating an image indicated by the captured image data actually acquired by the acquisition unit 11. A difference calculation unit 16 calculates a difference between the rendering image data generated by the rendering unit 14 and the high-quality image data generated by the high-quality image data generation unit 12, and a difference calculation unit 17 calculates a difference between the captured image data acquired by the acquisition unit 11 and the low-quality image data rendered by using the low-quality reproduction model generated by the low-quality reproduction model generation unit 15. An adding unit 18 adds the difference calculated by the difference calculation unit 16 and the difference calculated by the difference calculation unit 17. Then, the three-dimensional reproduction model generation unit 13 and the low-quality reproduction model generation unit 15 update the models generated by the respective units so that the addition result supplied from the addition unit 18 con

Claims

1. An information processing device comprising: an acquisition unit that acquires image data showing images captured from multiple different viewpoints; a high-quality image data generation unit that generates high-quality image data by improving the quality of the acquired image data; a three-dimensional reproduction model generation unit that generates a three-dimensional reproduction model for rendering an image in three-dimensional space based on the generated high-quality image data; and a low-quality reproduction model generation unit that generates a low-quality reproduction model for rendering an image that approximates the image shown by the acquired image data by lowering the quality of the image rendered by the three-dimensional reproduction model, wherein the three-dimensional reproduction model generation unit and the low-quality reproduction model generation unit perform the generation in such a way that the difference between the high-quality image data showing the image rendered by the three-dimensional reproduction model and the image data showing the image rendered by the three-dimensional reproduction model, and the difference between the acquired image data and the image data showing the image rendered by the low-quality reproduction model, are minimized.

2. The information processing apparatus according to claim 1, characterized in that the low-quality reproduction model generation unit generates the low-quality reproduction model that includes parameters such as reducing the difference in a filtering process using an n × n patch kernel as parameters.

3. The information processing apparatus according to claim 1, characterized in that the low-quality reproduction model generation unit generates the low-quality reproduction model that includes the parameter such that the difference becomes small in a two-dimensional Gaussian filter processing with variance as a parameter.

4. The information processing apparatus according to claim 1, characterized in that the three-dimensional reproduction model generation unit generates the three-dimensional reproduction model using Gaussian splatting.

5. The information processing apparatus according to claim 1, characterized in that the three-dimensional reproduction model generation unit and the low-quality reproduction model generation unit perform the generation such that the sum of the difference between the high-quality image data obtained by improving the quality of the acquired imaging image data and the image data showing the image rendered by the three-dimensional reproduction model, and the difference between the acquired imaging image data and the image data showing the image rendered by the low-quality reproduction model, is small.

6. The information processing apparatus according to claim 1, characterized in that the three-dimensional reproduction model generation unit and the low-quality reproduction model generation unit perform the generation such that the difference between the high-quality image data obtained by improving the quality of the acquired imaging image data and the image data showing the image rendered by the three-dimensional reproduction model, and the difference between the acquired imaging image data and the image data showing the image rendered by the low-quality reproduction model, are reduced.

7. An information processing method comprising: an acquisition step of acquiring image data showing images captured from multiple different viewpoints; a high-quality image data generation step of generating high-quality image data by improving the quality of the acquired image data; a three-dimensional reproduction model generation step of generating a three-dimensional reproduction model for rendering an image in three-dimensional space based on the generated high-quality image data; and a low-quality reproduction model generation step of generating a low-quality reproduction model for rendering an image that approximates the image shown by the acquired image data by lowering the quality of the image rendered by the three-dimensional reproduction model, wherein in the three-dimensional reproduction model generation step and the low-quality reproduction model generation step, the generation is performed such that the difference between the high-quality image data showing the image rendered by the three-dimensional reproduction model and the image data showing the image rendered by the three-dimensional reproduction model, and the difference between the acquired image data and the image data showing the image rendered by the low-quality reproduction model are reduced.

Images