Information processing method

Abstract

To perform, in a virtual space, information processing beneficial both for the use of an imaging device by a user and for the provision of an imaging device by a provider.SOLUTION: An information processing method includes: step S402 of recording, on a block chain, data related to a characteristic unique to an imaging device prepared in the virtual space, as data having uniqueness; step S406 of acquiring information related to an operation history from a time when imaging was performed by the imaging device; and step S408 of generating first information to be presented to a first user who is to carry out imaging by using the imaging device, on the basis of the information related to the operation history.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an information processing method for acquiring an image using an imaging device in a virtual space. [Background technology]

[0002] In real space, users may practice taking pictures using various imaging devices. In this case, the users must actually purchase or rent the imaging devices. Providers of imaging devices must also build systems for manufacturing, prototyping, and renting various imaging devices.

[0003] In response to this, a method has been proposed in which an imaging device is prepared in a three-dimensional virtual space constructed within a computer, and the user uses the device to capture images in the virtual space. Patent Document 1 discloses a method for capturing images by automatically setting exposure and the like without relying on instructions from the player, in order to capture images that represent the progress of a video game in the virtual space.

[0004] Furthermore, since all information in the virtual space is electronic data, various information in the virtual space can be easily obtained, and it is possible to present useful content to users based on that information.Patent Document 2 discloses a method for collecting participants' reaction data to a travel experience in a virtual space, estimating the participants' interest in real travel, and generating advertising information. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2022-067581 [Patent Document 2] Japanese Patent Application Publication No. 2022-151679 Summary of the Invention [Problem to be solved by the invention]

[0006] It is desirable that users can use an imaging device in a virtual space with a sense of reality, and that the burden on providers of the imaging device can be reduced. [Means for solving the problem]

[0007] An information processing method according to one aspect of the present invention includes the steps of: recording data relating to the specific characteristics of an imaging device prepared in a virtual space as unique data on a blockchain; acquiring information relating to an operation history when imaging is performed with the imaging device; and generating first information to be presented to a first user who captures an image with the imaging device based on the information relating to the operation history. Note that a program for causing a computer to execute processing according to the information processing method also constitutes another aspect of the present invention.

[0008] Another aspect of the present invention is an information processing device that includes a means for recording data relating to the specific characteristics of an imaging device prepared in a virtual space on a blockchain as unique data, a means for acquiring information relating to the operation history when imaging is performed with the imaging device, and a means for generating first information to be presented to a first user who takes an image with the imaging device based on the information relating to the operation history. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide an information processing method that is advantageous for both the use of an imaging device by a user and the provision of an imaging device by a provider in a virtual space. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. [Figure 2] FIG. 1 is a block diagram showing the configuration of a virtual space service system. [Figure 3] FIG. 1 is a block diagram showing the configuration of an information processing device included in the virtual space service system of the first embodiment. [Figure 4] 4 is a flowchart showing information processing in the first embodiment. [Figure 5] FIG. 1 is a diagram showing an image processing system in a real space according to a first embodiment. [Figure 6] 6 is a diagram showing the object plane and the image plane in FIG. 5 in the first embodiment. [Figure 7] 1 is a diagram showing an image processing system in a first embodiment, which is likened to a real space including a three-dimensional subject. [Figure 8] 1 is a diagram showing a specific example of an image processing system in a real space including a three-dimensional subject in the first embodiment. [Figure 9] 9 is a diagram showing the object plane and the image plane in FIG. 8 in the first embodiment. [Figure 10] 5A to 5C are diagrams illustrating occlusion processing in the first embodiment. [Figure 11] FIG. 3 is a diagram showing a database for managing data of operation history in the first embodiment. [Figure 12] 4 is a flowchart showing a process of presenting imaging reference information in the first embodiment. [Figure 13] 1 is a histogram of operation frequencies in Example 1. [Figure 14] FIG. 10 is a diagram showing reference information displayed on a user device according to the first embodiment. [Figure 15] 10A and 10B are diagrams showing a situation in which flare and ghosts occur in an image processing system illustrated as a real space, as a modification of the first embodiment. [Figure 16] FIG. 10 is a diagram showing a database for managing data of operation history in the second embodiment. [Figure 17] 10 is a flowchart showing information processing in the second embodiment. [Figure 18] 10 is a flowchart showing a process of presenting imaging reference information in the second embodiment. [Figure 19] 10 is a histogram showing the frequency of imaging conditions in Example 2. [Figure 20] FIG. 10 is a diagram showing reference information displayed on a user device according to the second embodiment. [Figure 21] FIG. 11 is a block diagram showing the configuration of an information processing device included in a virtual space service system according to a third embodiment. [Figure 22] 10 is a flowchart showing information processing in the third embodiment. [Figure 23] FIG. 11 is a diagram showing reference information and a display prompting a user to rate displayed on a user device according to a third embodiment. [Figure 24] FIG. 11 is a diagram showing a database for managing data of operation history in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] FIG. 1 shows a virtual space 101. The virtual space 101 displays information stored in a virtual space server (described later) for a user, and is, for example, a space developed within a computer. A specific example is computer graphics (CG). Within the virtual space 101, a subject 102 and an imaging device 103 are placed.

[0013] The subject 102 is an object to be imaged, such as a person or a building, placed in the virtual space 101. The subject 102 may be two-dimensional or three-dimensional.

[0014] The imaging device 103 is a device that converts the subject 102 into an image, and corresponds to a camera in real space. The imaging device 103 may be considered as a concept, or may be a camera that does not exist in real space. The imaging device 103 is equipped with a converter 104 that has the function of converting the subject into an image. The converter 104 corresponds to, for example, a camera lens in real space. The functional characteristics of the imaging device 103 are called the characteristics of the imaging device. The imaging device 103 acquires image data including the subject 102 by taking into account the characteristics of the imaging device. Specifically, the image data including the subject 102 is generated on a computer by taking into account information equivalent to the characteristics of the imaging device. The image data also depends on the relative positional relationship between the subject 102 and the imaging device 103. Therefore, when acquiring image data, it is necessary to also consider spatial information about the subject 102 and the imaging device 103.

[0015] The characteristics of an imaging device are unique to each imaging device 103. In the real world, it is difficult to replicate an imaging device, including its unique characteristics. However, in virtual space, imaging devices exist essentially as electronic data, so it is possible to easily replicate the characteristics of the imaging device. However, the imaging device 103 corresponds to a camera in the real world, and the ease with which the imaging device 103 can be replicated is problematic. To prevent unauthorized replication in virtual space, it is necessary to manage the unique characteristics of the imaging device as an asset.

[0016] Therefore, in this embodiment, data related to the characteristics unique to each imaging device 103 prepared in the virtual space 101 is recorded and managed on a blockchain using an NFT (Non-Fungible Token), that is, as unique data. The unique data is not limited to an NFT, but may be other data. This makes it possible to maintain (guarantee) the uniqueness of the characteristics unique to the imaging device 103. Furthermore, by using an NFT to record data related to the characteristics unique to the imaging device on a blockchain, the imaging device 103 is prevented from being freely duplicated. For example, it is possible to prevent a highly valuable vintage camera that is the only one in the world, or a camera that is highly customized with various options, from being easily duplicated and losing its value as a unique or rare item.

[0017] FIG. 2 is a block diagram of a virtual space service system as an information processing system. A virtual space server 210 executes information processing for providing a virtual space 101. The virtual space server 210 transmits and receives data to and from a device (user device) 231 used by a user in real space via a communication network 220 such as the Internet. It is preferable that the data transmission and reception can also be viewed through a user device 232 used by another user. The user devices 231 and 232 are, for example, personal computers, tablet terminals, and smartphones. The user devices 231 and 232 can display the virtual space 101 created by computer graphics as if it were real space through a monitor that displays images. The imaging device 103 in the virtual space 101 can be operated using a keyboard and mouse. Alternatively, a head-mounted display or the like can be used instead of the monitor of the user devices 231 and 232. Operation can also be performed by recognizing user gestures through a camera mounted on the head-mounted display or the like, rather than using a keyboard or mouse.

[0018] The virtual space server 210 transmits and receives data to and from the NFT management system (management means) 240 via the communication network 220. The NFT management system 240 is a data processing system for managing NFTs. NFTs managed by the NFT management system 240 are recorded and stored on the blockchain 250, thereby managing and verifying the owner. This procedure makes it possible to prevent the characteristics of the imaging device from being freely copied. The information processing device 260 is configured from a personal computer and performs various information processing related to the virtual space server 210, the network 220, the NFT management system 240, the blockchain 250, and the user devices 231 and 232. Details will be described in each of the following embodiments. [Example]

[0019] In the first embodiment, a captured image including a subject is acquired by capturing an image using an imaging device with unique characteristics in a virtual space, and information about a user's operation history for the imaging device when capturing the image is acquired and the operation history is analyzed. Then, reference information (first information) according to the operation history is presented to a user (first user) who subsequently captures an image.

[0020] 3 shows the configuration of an information processing apparatus 260 according to Example 1. The information processing apparatus 260 includes an imaging characteristic generation device 301, a development device 302, an operation history acquisition device 303, and an analysis / information presentation device 304.

[0021] The imaging characteristic generation device 301 generates characteristics of an imaging device and assigns the generated characteristics to the imaging device, thereby setting the imaging device as an imaging device with unique characteristics. An example of the unique characteristics of an imaging device is the characteristics of the optical system of the imaging device. Specifically, the imaging characteristic generation device 301 causes the imaging device 103 in the virtual space 101 to capture an image of the subject 102, thereby acquiring a captured image including an image of the subject 102. In this case, the imaging characteristic generation device 301 acquires the characteristics of the optical system of the imaging device 103 and spatial information of the imaging device 103 and the subject 102, and acquires (generates) the captured image using these optical system characteristics and spatial information.

[0022] The development device 302 develops the captured image generated by capturing an image in the virtual space. The developed captured image is displayed on the user devices 231 and 232.

[0023] The operation history acquisition device 303 acquires information about the operation history of the imaging device 103 when the imaging device 103 captures an image in a virtual space using the user device 231 (or 232), and records the information in a database. The information about the operation history may be the operation history itself, or may be information that can be converted into an operation history, and will hereinafter be simply referred to as the operation history. In addition to the operation history, the environment in the virtual space recorded at the time of capturing the image may also be acquired. The acquired operation history is managed by being recorded in a database.

[0024] The analysis and information presentation device 304 analyzes the operation history acquired by the operation history acquisition device 303. It also acquires the imaging conditions set by the user when capturing images, and presents reference information to the user (first user) who is capturing images as a reference for capturing images. For example, it presents to the user, as reference information, captured images captured under similar imaging conditions previously acquired with respect to the acquired imaging conditions, or captured images captured under the imaging conditions. The captured images at this time are acquired using the imaging conditions, the characteristics of the optical system, and the spatial information described above.

[0025] The flowchart in Figure 4 shows the information processing performed in this embodiment. Figure 4 shows the processes performed by the user devices 231 and 232, the information processing device 260, the virtual space server 210, and the NFT management system 240 separately. The user devices 231 and 232, the information processing device 260, the virtual space server 210, and the NFT management system 240 each perform processing according to a program.

[0026] In step S401, the information processing device 260 (imaging characteristic generation device 301) prepares unique characteristics and prepares an imaging device to which the unique characteristics have been assigned.

[0027] In step S402, the information processing device 260 uses an NFT to record the imaging device to which the characteristics were assigned in step S401 on the blockchain in the NFT management system 240 via the virtual space server 210 and the communication network 220. The record of the imaging device to which the stored characteristics were assigned is managed by the NFT management system 240.

[0028] In step S403, the user devices 231 and 232 prompt the user to specify the imaging device they wish to use. At this time, a plurality of imaging devices each having unique characteristics may be presented so that the user can select the imaging device they wish to use. For example, various imaging devices may be presented, such as an imaging device with high optical resolution, i.e., an imaging device with a narrow point spread function (PSF), or an imaging device with low resolution that produces a blurred, impressive captured image.

[0029] In step S404, the information processing device 260 provides the user with the imaging device designated by the user. Note that, in steps S403 and S404, the information processing device 260 may unilaterally assign an imaging device to the user without the user selecting the imaging device they wish to use.

[0030] In step S405, the user devices 231 and 232 allow the user to use the provided imaging device in the virtual space.

[0031] At the same time, in step S406, the information processing device 260 (operation history acquisition device 303) acquires the operation history of the imaging device.

[0032] In step S407, the information processing device 260 (developing device 302) develops the captured image. Then, the information processing device 260 manages the captured image in association with the operation history acquired in step S406. At this time, the captured image may be displayed to the user.

[0033] In step S408, the information processing device 260 (analysis and information presentation device 304) analyzes the operation history to generate and present reference information. For example, the reference information may be generated based on the frequency of a specific operation. Specifically, the operation history of the imaging device when an image is captured by the imaging device in the virtual space is first obtained. At this time, the operation history includes the settings of the imaging device at the time of capturing the image, the location of the image capture, the time of the image capture, information related to movement such as the speed and acceleration of the imaging device, and the weather. Details of the reference information generated based on this operation history will be described later. Note that the reference information may be presented only when a predetermined condition is satisfied.

[0034] In step S409, the user devices 231 and 232 acquire reference information. At this time, the user devices 231 and 232 may display information that explicitly notifies the user of the location on the imaging device that should be operated. For example, the user devices 231 and 232 may highlight a specific operation location on the imaging device in the virtual space, or display the operation location on the monitor of the user device.

[0035] Here, the imaging device 103 and the imaging characteristic generation device 301 will be described in more detail. The characteristics of the imaging device in this embodiment are those in a virtual space, but the characteristics of an imaging device existing in real space may be reflected in the characteristics of the imaging device. In this case, it is possible to obtain a captured image in the virtual space that corresponds to a captured image obtained by imaging using an imaging device existing in real space. Here, the characteristics in the virtual space and the characteristics in real space will be compared for explanation. Also, here, as an example, the characteristics of the imaging device are taken to be the characteristics of an optical system (hereinafter referred to as a lens).

[0036] 5(a) and (b) show an example of the configuration of an image processing system in real space. FIG. 5(a) shows a bird's-eye view of the image processing system. The optical axis direction of the lens 502 is the z direction, and two directions that are perpendicular to the z direction and perpendicular to each other are the x direction and y direction. The object plane 501 corresponds to the object 102 in FIG. 1. The lens 502 corresponds to the converter 104 in FIG. 1. The lens 502 and image plane 503 are arranged within the imaging device 103, and the image formed on the image plane 503 is obtained by calculation, which will be described later. The lens 502 is arranged between the object plane 501 and the image plane 503.

[0037] Figure 5(b) shows a cross section of the image processing system of Figure 5(a) as viewed from the +z direction. Light rays 511 emitted from each point on the object plane 501 pass through the lens 502 and enter the image plane 503, forming an optical image at each point on the image plane 503. In this case, the optical image on the image plane 503 is generally not a point but has a certain degree of spread. The characteristics of an imaging device can be expressed, for example, using a point spread function (PSF), which indicates the spread of a point on the object plane on the image plane. The PSF is calculated by the product of the distribution obtained by performing a discrete Fourier transform on the pupil function, which uses the wavefront aberration of the optical system as a phase function, and the complex conjugate of the distribution. Because the PSF is suitable for representing lens characteristics, it is preferable to express the characteristics of an imaging device using a PSF. Note that if the specific shape of the lens is unknown but only information such as the PSF is available, it may be used. If the specific shape of the lens is known, the PSF can be calculated and used.

[0038] Furthermore, the characteristics of the imaging device in this embodiment are not limited to the PSF, and characteristics related to spot diagrams, aberration coefficients, and the shape of aberrations in aberration diagrams can also be used. A spot diagram is obtained by plotting the positions on the image plane of light rays that are emitted in multiple directions from a point on the object plane and pass through a lens. It is difficult to use a spot diagram, which is a collection of points, directly in image calculations, but by calculating a two-dimensional histogram, the spot diagram can be converted into a distribution equivalent to the PSF.

[0039] Aberration coefficients are coefficients that can evaluate the amount of aberration that occurs in an optical system based on the paraxial ray tracing values ​​of the optical system. The amount of aberration can be calculated from information on the aberration coefficient, the optical system's aperture, and the angle of view. By treating the calculated aberration amount as a spot diagram and performing the same processing as above, a distribution equivalent to the PSF can be obtained. Furthermore, by reading the aberration values ​​from the aberration shape in the aberration diagram, treating the aberration amount as a spot diagram, and performing the same processing as above, a distribution equivalent to the PSF can be obtained. In this way, by using the aberration shape and aberration coefficients in the aberration diagram, it is possible to confirm the final image from the early stages of design, when the target optical performance during design is expressed using aberration diagrams and aberration coefficients.

[0040] Next, an image processing method for calculating a captured image in a virtual space will be described. The captured image is preferably obtained by convolution of the characteristics of the subject 102 and the imaging device with the characteristics obtained from spatial information (for example, the relative positional relationship between the imaging device and the subject). Here, the case where the subject 102 is planar and the case where it is three-dimensional will be described in order.

[0041] First, we will explain the case where the subject 102 is flat. Generally, the PSF differs depending on the position on the image plane. The position on the image plane depends on the relative positional relationship between the subject 102 and the image capture device 103. Therefore, in addition to the characteristics of the image capture device, characteristics obtained from spatial information are also required.

[0042] 6(a) and 6(b) show the object plane 501 and the image plane 503 in FIG. 5 as viewed from the +x direction. FIG. 6(a) shows an example of the object 601, and FIG. 6(b) shows an example of the PSF 602. In these figures, the object region is divided into 3x3 regions because the PSF 602 differs depending on the position on the image plane. An image of each region can be obtained by performing a convolution calculation on the object 601 and the PSF 602 for each region.

[0043] Figure 6(c) shows an image 603 obtained by integrating all the images obtained by the convolution calculation. Comparing the central region with the region below it, the PSF 602 in the former region is sharper and less diffuse, and the image 603 is also sharper and less blurred. In other words, an image 603 corresponding to the PSF 602 is obtained for each region. Generally, an image of a subject is inverted vertically and horizontally. However, this inversion process is omitted here to explain only the convolution process. Therefore, the image actually obtained on the image plane 503 is inverted vertically and horizontally from the image 603. Note that while the subject is described here as being monochrome, the subject may also be color. A color subject is generally expressed using three colors: RGB. Therefore, as an example of a calculation method, a color image is obtained by performing the same process for each of the three colors, RGB, and integrating all the images. Although the captured image is described here as being a still image, the captured image may also be a video. A similar calculation is performed for each frame of the video and then combined in chronological order to obtain a video image.

[0044] Next, we will explain the case where the subject 102 is three-dimensional. Generally, the PSF varies depending on the object distance, which is the distance between the subject and the lens. Therefore, the characteristics of the imaging device vary depending on the object distance. Figures 7(a) and (b) show an example of an image processing system likened to a real space containing a three-dimensional subject. Figure 7(a) shows an overhead view of the image processing system, and Figure 7(b) shows a cross section of the image processing system viewed from the +z direction.

[0045] As shown in Figure 7(b), the object has a spread in the x direction, so it can be considered a three-dimensional object. The object consists of two stars, with the lower star having a longer object distance than the central star (located on a different object plane 701). Generally, the larger the change in object distance relative to the PSF when the lens 702 and image plane 703 are in focus, the larger the PSF distribution. The blurring of the image obtained by convolution with a significantly changed PSF is what is known as blur. In the case of a three-dimensional object, it is possible to calculate the image using the same convolution calculation as for a planar object.

[0046] Basically, it is possible to calculate the image of a three-dimensional object with multiple object distances in a similar manner. However, if the object distances in adjacent areas of the object are significantly different, it is necessary to consider the effect of the image intruding into the adjacent area. In such cases, it is preferable to classify the spatial information into groups by distance and calculate the image. Furthermore, it is preferable to use occlusion processing, which will be described later, as a method for integrating multiple images.

[0047] 8 shows a specific example of an image processing system that is likened to a real space containing a three-dimensional object. The three-dimensional object 800 is composed of a brick-patterned background 801 and a foreground object (person) 802. A lens 810 is disposed between the three-dimensional object 800 and an image plane 820.

[0048] 9(a) to 9(g) show the three-dimensional object 800 and image plane 820 of FIG. 8 as viewed from the +x direction. FIGS. 9(a) and 9(b) show a background 801 and a foreground 802, respectively. FIG. 9(c) shows a mask 903 corresponding to the foreground 802. In the mask 903, the areas where the foreground 802 exists are represented as white, and the areas where it does not exist are represented as black. In numerical processing, white areas are recognized as 1 and black areas as 0. By multiplying the foreground 902 and the mask 903, the masked foreground 904 shown in FIG. 9(d) is calculated.

[0049] Image calculations are performed by convolution on the background 901, the masked foreground 904, and the mask 903. As a result of the image calculations, a background image 911, a foreground image 912, and a mask image 913, shown in Figures 9(e), (f), and (g), respectively, are obtained. The background image 911, the foreground image 912, and the mask image 913 are examples of images calculated assuming that the imaging device is focused on the foreground 904. The foreground image 912 and the mask image 913 take into account the characteristics of the imaging device, including blurring caused by the lens itself. The background image 911 also takes into account the characteristics of the imaging device, which also take into account blurring caused by defocus.

[0050] Here, using Figure 10, we will explain the occlusion processing for integrating the foreground image and the background image. In the occlusion processing, first, a distribution 1002 is calculated by inverting the mask image. Inversion means a distribution obtained by subtracting the distribution of the mask image from 1.0. White is 1.0, black is 0.0, and gray means anything in between. Next, in the occlusion processing, the background image 1001 is multiplied by the distribution 1002 by inverting the mask image. The result of this multiplication is the masked foreground image 1003. Then, in the occlusion processing, the masked foreground image 1003 is added to the foreground image 1011 to obtain the final image 1021.

[0051] In Figure 10, the number of images to be integrated is two, one for the foreground and one for the background, but in reality, three or more images can be used. In that case, these processes can be repeated. Also, in Figure 10, the foreground and background are flat, but they can also be three-dimensional objects. In the case of a three-dimensional object, for example, if you focus on the eyes near the center of the foreground (subject), the peripheral parts of the foreground, such as the ears and shoulders, will be greatly blurred. In this case, occlusion processing can be used to achieve a greater effect.

[0052] Other basic settings of an imaging device include focal length, aperture value, shutter speed, ISO sensitivity, exposure, white balance, etc. By specifying these imaging settings, it is possible to perform image processing that matches those settings.

[0053] By following the procedure described above, it is possible to acquire an image taking into account the characteristics of the optical system included in the imaging device in virtual space, such as the shape of the lens and the characteristics of the glass that is the material of the lens.

[0054] Next, we will explain in more detail how to acquire and analyze a user's operation history regarding an imaging device, and how to present reference information to the user. Figure 11 shows a database that manages the acquired operation history data. Using this diagram, we will explain an example of a user's operation history recorded in the database.

[0055] The database is provided in the operation history acquisition device in the information processing device 260. The database records the image capture time and sorts it in chronological order. The database also records user IDs for distinguishing users. The user ID may be the ID acquired when participating in the virtual space. The database also records image capture device IDs. The image capture device ID may be the ID assigned to the image capture device in the virtual space. The database also records various parameters of the image capture device set at the time of image capture. Specifically, these are focal length, F-number, exposure, etc. Other parameters such as ISO sensitivity and white balance may also be recorded.

[0056] The database also records the image capture location. For example, the image capture location may be a three-dimensional position coordinate in the virtual space. In addition to the image capture time and image capture location, information on the speed and acceleration of the image capture device obtained by acquiring time-series data may also be recorded. For example, information on the movement of the image capture device when panning a subject moving in the virtual space or when intentionally capturing an image in which the subject is blurred may be recorded.

[0057] In addition, the database records the weather at the time of image capture. The weather set in the virtual space is acquired as the weather. The weather may be a general description such as sunny, cloudy, or rainy, or may be expressed as snow, thunder, or a numerical representation of the weather.

[0058] The database also records the subject and its location. To record the subject, when the virtual space is created, a label is attached to the subject prepared there, and the label is recorded. Note that although one subject is shown in Figure 11, there may be multiple subjects, in which case multiple subjects may be recorded. The location of the subject may be recorded as the three-dimensional position coordinates in the virtual space. If the label of the subject in the virtual space itself cannot be obtained, the subject may be recorded using various image recognition technologies. The presence of a subject in a captured image can be ascertained (determined) from the positional relationship between the subject in the virtual space and the imaging device and the angle of view setting of the imaging device.

[0059] The database records the captured images. Fig. 11 shows the storage folder and file name of the captured image data, and these may be those recorded by the developing device 302 in Fig. 3.

[0060] FIG. 12 is a flowchart showing the process executed by the analysis and information presentation device 304 to analyze the operation history and present reference information, and shows in detail the process performed in step S408 of FIG.

[0061] In step S1201, the analysis and information presentation device 304 acquires pre-prepared determination conditions (predetermined conditions) for presenting reference information. "Prepared in advance" means that the provider of the imaging device sets the determination conditions, for example. Specific examples of the determination conditions will be described later.

[0062] In step S1202, the analysis and information presentation device 304 accumulates the operation history up to a specific number of times (predetermined number of times). For example, the history of capturing an image of the same subject, "person," is accumulated up to a specific number of times, i.e., five times.

[0063] In step S1203, the analysis and information presentation device 304 determines whether the operation history matches the determination condition acquired in step S1201 (satisfies the determination condition). If the determination condition is met, the process proceeds to step S1204, where reference information for imaging is presented to the user until the number of times the operation history has been accumulated reaches the next specific number. This allows the same reference information to be presented until, for example, the number of times the operation history has been accumulated reaches 10. The process then proceeds to step S1206. On the other hand, if the operation history does not match the determination condition, the analysis and information presentation device 304 proceeds to step S1205, where no reference information is presented to the user. The process then proceeds to step S1206.

[0064] In step S1206, the analysis and information presentation device 304 re-determines whether the operation history meets the determination condition in step S1201 when the operation history reaches a specific number of times, for example, 10 times, and then ends this process.

[0065] 13(a) and 13(b) show histograms indicating operation frequencies created based on operation histories stored in a database. FIG. 13(a) shows the operation frequencies when operation histories have been accumulated up to five times, and FIG. 13(b) shows the operation frequencies when operation histories have been accumulated up to ten times. These figures show histograms of the "exposure" value when the subject corresponding to a specific user ID in the database shown in FIG. 11 is a "person." These histograms illustrate, as an example, a case in which the determination condition in step S1201 is that the frequency of capturing images of the subject "person" at an exposure of 2 / 3 or more is 20% or less, and the reference information recommends that the user set the exposure to 2 / 3 or more. The examples also illustrate a case in which the specified number of times in step S1202 is 5, and the next specified number of times in steps S1204 and S1206 is 10.

[0066] In FIG. 13(a), all the exposures are 1 / 3 or less, but in FIG. 13(b), the user has taken images based on the reference information, resulting in an increase in data with exposures of 2 / 3 or more.

[0067] Alternatively, the determination criterion for the operation history prepared in advance in step S1201 may be whether or not there are infrequently used or frequently used functions in the imaging device, and these functions may be presented to the user as reference information. For example, the determination criterion may be whether or not the focal lengths of a zoom lens in the virtual space are biased toward only a specific range, and the reference information may be a recommendation to use a different range of focal lengths. Furthermore, the determination criterion may be whether or not a specific subject is frequently photographed, and the reference information may be a recommendation to adjust the F-stop or exposure settings, or a recommendation to use a lens in the virtual space with specific optical imaging characteristics.

[0068] It is also possible to allow the user to set the reference information to be hidden when it is determined that the reference information has been useful to the user to some extent.

[0069] Figures 14(a) and (b) show how reference information is displayed on a user device. The user device acquires and displays reference information according to the operation history described in Figures 4, 12, and 13(a) and (b) based on the database shown in Figure 11.

[0070] FIG. 14(a) shows the rear display of the imaging device displayed on the monitor or head-mounted display of the user device. A1401 shows a virtual space displayed on the monitor or head-mounted display of the user device. A1402 shows a subject in the virtual space. In this figure, the subject is a person and the weather is cloudy. A1403 shows the rear display of the imaging device in the virtual space. A1404 shows an image within the imageable field of view displayed on the rear display. A1405 shows a screen for setting the imaging parameters "focal length," "F-number," and "exposure" displayed on the rear display. A1406 shows a highlighting of "exposure" to draw the user's attention. A1407 is a mark indicating an exposure of 2 / 3, which is recommended to the user when the subject is a person.

[0071] 14(b) shows how reference information is displayed in an area outside the rear display of the imaging device on the monitor of the user device or on the head-mounted display. B1401 to B1405 are the same as A1401 to A1405, respectively. B1406 shows the reference information, "It is recommended to set the exposure to +2 / 3 or more for this subject."

[0072] In this way, reference information for imaging according to the user's operation history can be presented to the user.

[0073] According to this embodiment, it is possible for a user to realistically try out an imaging device in a virtual space, and it is also possible to reduce the burden on the provider of the imaging device.

[0074] [Modification of Example 1] In the first embodiment, an example of an image processing system likened to a real space is shown in Figures 5(a) and 5(b). Specifically, it shows how light rays 511 emitted from each point on an object plane 501 are imaged at each point on an image plane 503 via a lens 502. As a modification of the first embodiment, a case will be described in which the characteristics of the imaging device are the shape, transmittance, thin film characteristics, and characteristics related to the occurrence of flare and ghosting of a lens.

[0075] 15(a) and (b) show examples of flare and ghosting occurring in an image processing system likened to a real space. FIG. 15(a) shows an overhead view of the image processing system. Light source plane 1501 indicates a surface on which a light source that emits strong light is present. Lens 1502 corresponds to converter 104 in FIG. 1. Lens 1502 and image plane 1503 are disposed within imaging device 103, and the image formed on image plane 1503 is obtained by calculation based on lens 1502. Lens 1502 is disposed between light source plane 1501 and image plane 1503.

[0076] Figure 15(b) shows Figure 15(a) viewed from the +z direction. Flare and ghosting occur when light rays 1511 emitted from a light source position within light source plane 1501 are reflected or transmitted through lens 1502 along a ray trajectory different from that of normal imaging rays and then enter image plane 1503. Flare and ghosting can occur when a light source emits high-intensity light different from that of a normal subject and the light travels a different optical path within the optical system. Furthermore, flare and ghosting are particularly likely to occur when the surface of a lens within the optical system is not coated, or only has a relatively simple coating such as a single-layer coating, or when the transmittance is lower than 100% by a certain amount due to thin-film characteristics. If the specific lens shape is known, the occurrence of flare and ghosting can be determined by calculating the ray trajectory different from that of normal imaging rays within the optical system.

[0077] Such an image processing system makes it possible to perform imaging in which flare or ghosting occurs depending on the relationship between the imaging device and a subject that can be a light source in virtual space. Note that, even if the specific lens shape is unknown, if there is information that flare or ghosting occurs when the imaging device and a subject that can be a light source have a specific relationship, that information can be used.

[0078] Furthermore, reference information for capturing images may be presented to the user based on the user's operation history. For example, in the database of FIG. 11, if a certain number of images have been captured that include a "light source" as a subject, reference information for effectively generating flare and ghosting may be presented. In this case, reference information such as "Point the lens at a specific angle relative to the light source to generate flare and ghosting" may be displayed on the monitor of the user device or on the rear display or in an area outside the rear display of the imaging device in the virtual space of the head-mounted display.

[0079] This modification also allows the user to realistically try out an imaging device in a virtual space, and reduces the burden on the provider of the imaging device. [Example]

[0080] In addition to the basic configuration of Example 1, Example 2 will explain a case where multiple users use their own imaging devices in a virtual space. Images including a subject are acquired by the imaging devices used by multiple users. The operation history at the time of capturing the images is acquired, the imaging conditions are analyzed, and reference information according to the imaging conditions set by the user is presented to the user. The following will mainly explain the differences from Example 1.

[0081] Fig. 16 shows a database for managing operation history data in this embodiment. User IDs 0001, 0002, and 0003 corresponding to multiple users (three in this example) are recorded in the database. Note that the number of users may be even greater. One imaging device ID is assigned to each user ID. However, the same user may use multiple imaging devices, in which case multiple imaging device IDs are assigned to the same user ID.

[0082] Next, the reference information in this embodiment will be described. Even if there are multiple users, the processes shown in FIGS. 4 and 12 of the first embodiment are performed until the operation histories of these users are accumulated. For example, the provider of the imaging device sets judgment conditions in advance, and when the operation histories of multiple users are accumulated and meet the judgment conditions, similar imaging conditions or captured images acquired in the past are presented to the user as reference information according to the imaging conditions set by the user. This process will be described using the flowcharts in FIGS. 17 and 18.

[0083] The flowchart in Figure 17 shows the information processing performed in this embodiment. Figure 17 shows the processes performed by the user devices 231 and 232, the information processing device 260, the virtual space server 210, and the NFT management system 240 separately. Steps S1701 to S1704 are the same as steps S401 to S404 in Figure 4.

[0084] In step S1705, the user device 231 sets the imaging conditions for capturing an image in the virtual space in response to an operation of the user capturing the image. The imaging conditions here may be parameters such as focal length, which are conditions of the imaging device itself, or may be parameters related to the imaging environment, such as the type of subject to be captured or the imaging location in the virtual space. The imaging conditions may be set before capturing an image, or may be the imaging conditions used when capturing an image once.

[0085] In step S1706, the information processing device 260 (analysis and information presentation device 304) acquires the imaging conditions set by the user in step S1705.

[0086] In step S1707, the information processing device 260 (analysis and information presentation device 304) analyzes the imaging conditions and presents reference information for imaging based on the operation history of all users stored in the database.

[0087] In step S1708, the user devices 231 and 232 acquire the reference information.

[0088] In step S1709, the user devices 231 and 232 refer to the reference information and acquire the captured image captured by the imaging device in the virtual space.

[0089] In step S1710, the information processing device 260 (developing device 302) develops the captured image.

[0090] FIG. 18 is a flowchart showing the process executed by the analysis and information presentation device 304 to analyze the imaging conditions and present reference information, and shows in detail the process performed in step S1707 in FIG.

[0091] In step S1801, the analysis and information presentation device 304 acquires information from a database in which the operation history of all users is recorded.

[0092] In step S1802, the analysis and information presentation device 304 searches for database information that matches the imaging conditions based on the user-set imaging conditions acquired in step S1706. It then determines whether there is database information that matches the user-set imaging conditions. Note that the database information includes captured images acquired under past imaging conditions. If there is database information that matches the imaging conditions, the process proceeds to step S1803. On the other hand, if there is no database information that matches the imaging conditions, the process proceeds to step S1804, and no reference information is presented to the user.

[0093] In step S1803, the analysis and information presentation device 304 presents to the user taking the image a captured image acquired by any of all users in the past, as well as reference information indicating the settings of the imaging device used in the capture and other imaging conditions. For example, if the user taking the image sets the subject as a "person" or "building" as an imaging condition, the subject distance, focal length, and F-number used when another user captured the subject are displayed as reference information indicating recommended settings. When presenting the subject distance, a marker may be displayed in the virtual space indicating the recommended imaging location for the user relative to the subject. Note that the subject may be automatically acquired or recognized in the captured image by pointing the imaging device in the direction of the subject in the virtual space.

[0094] Furthermore, as reference information, sample images captured by other users using recommended settings may be displayed. Additionally, if the imaging conditions are weather or a virtual imaging location, other users' imaging device settings and sample images that match those conditions may be displayed. Then, the process proceeds to step S1805.

[0095] In step S1804, the analysis information presentation device 304 does not present reference information to the user, and then ends this process.

[0096] In step S1805, if there is other similar reference information, the analysis and information presentation device 304 prepares it so that it can be presented to the user as a candidate. For example, similar reference information is displayed in order of most recent image capture time. Then, this process ends.

[0097] Next, we will explain the reference information that is presented to the user when similar imaging conditions or captured images acquired in the past are presented to the user according to the imaging conditions set by the user. Fig. 19 is a histogram showing the frequency of imaging conditions created based on the operation history in the database. Here, the histogram is shown when the subject is "person" and the focal length is "50 mm." In other words, when the subject is "person," the histogram shows the distance between the user (imaging device) and the subject as the imaging conditions when other users captured images.

[0098] As can be seen from Figure 19, images were often taken from a distance of 1.0 to 1.5 m from the subject. In this case, reference information (recommended settings) such as "We recommend taking images from a distance of 1.0 to 1.5 m from the subject" may be displayed to the user. Alternatively, a marker may be displayed in the virtual space at a location approximately 1.5 m from the subject. By imitating commonly used settings in this way, even beginners may be able to take good images. Conversely, by deliberately trying different settings (e.g., taking images from a distance of 0.5 m or 3.0 m) from the settings recommended in the reference information, unique images may be obtained.

[0099] It should be noted that the recommended settings may change as more operation histories of other users are accumulated. In this case, the acquisition of operation histories of other users to be used when analyzing the recommended settings may be stopped at a certain number of accumulated times. Furthermore, the recommended settings may be updated as needed depending on the accumulated operation histories.

[0100] In general, the characteristics of an optical system due to differences in lens shape are also reflected in differences in the resolution and blur at the focal plane. When the distance to the subject, focal length, or F-number is changed, these differences are likely to appear in the captured image. Therefore, this information may be presented to the user as reference information regarding captured images that take into account the characteristics of the optical system in virtual space.

[0101] 20(a) and (b) show how reference information is displayed on a user device. The user device acquires and displays reference information according to the imaging conditions described in FIGS. 18 and 19 based on the database shown in FIG. 17. Here, the case is shown where the user capturing the image has set the subject as an imaging condition to "person."

[0102] FIG. 20(a) shows the rear display of the imaging device displayed on the monitor or head-mounted display of the user device, with reference information displayed on the rear display and in other areas. A2001 represents the virtual space displayed on the monitor or head-mounted display of the user device. A2002 represents the subject in the virtual space. In this figure, the subject is a person, with multiple small lights in the background. A2003 represents the rear display of the imaging device in the virtual space. A2004 represents an image within the captureable angle of view displayed on the rear display. A2005 represents the screen displayed on the rear display for setting the imaging parameters "focal length," "F-number," and "subject." In this figure, the focal length is set to 50 mm, and the subject is set to "person." A2006 represents a sample image captured by another user using recommended settings, displayed in an area outside the rear display. A2007 is reference information displayed in an area outside the rear display as recommended settings for obtaining an image similar to the sample image, specifically the information that "a distance of about 1.5 m from the subject is recommended."

[0103] FIG. 20(b) shows reference information displayed on the monitor or head-mounted display of the user device. In this figure, an overhead view of the imaging device is displayed. B2001 and 2002 are the same as A2001 and 2002, respectively. B2003 is the imaging device in the virtual space. B2004 shows the rear display of the imaging device in the virtual space. B2004 is a landmark indicating the recommended imaging location for the user relative to the subject in the virtual space. The distance between this landmark and the subject is also displayed. B2005 indicates the recommended imaging location for the user relative to the subject, displayed together with the information "Try standing here."

[0104] In this embodiment as well, it is possible to allow the user to realistically try out an imaging device in a virtual space, and it is also possible to reduce the burden on the provider of the imaging device. [Example]

[0105] In the third embodiment, in addition to the basic configuration of the first and second embodiments, multiple users rate evaluation targets such as captured images captured by their respective imaging devices, and the results are utilized. By acquiring and analyzing such ratings together with the operation history during image capture in the virtual space, it is possible to present information corresponding to the operation history to the user. The following mainly describes the differences from the first and second embodiments.

[0106] Fig. 21 shows the configuration of an information processing device 260' in the virtual space service system of this embodiment. The components labeled 2101 to 2103 are the same as the components labeled 301 to 303 in Fig. 3. The rating acquisition device 2104 acquires information (which will be described later; hereinafter, also simply referred to as rating) regarding user ratings of captured images acquired by imaging using an imaging device in the virtual space via the user devices 231 and 232.

[0107] The acquired evaluations are associated with the captured images that are the subject of the evaluations, and are recorded and managed in a database. The history / evaluation analysis / information presentation device 2105 analyzes the operation history and evaluations acquired by the operation history acquisition device 2103 and the evaluation acquisition device 2104, and presents reference information to the user.

[0108] The flowcharts in Figures 22(a) and 22(b) show the information processing performed in this embodiment. In Figure 22, the processes performed by the user devices 231 and 232, the information processing device 260', the virtual space server 210, and the NFT management system 240 are shown separately.

[0109] 22(a) shows a case where a user gives a self-evaluation to a captured image acquired by capturing an image himself / herself. The basic processing flow is the same as in FIG.

[0110] Steps SA2201 to SA2206 are the same as steps S401 to S406 in FIG.

[0111] In step SA2207, the information processing device 260' (developing device 302) develops the captured image acquired by imaging in step SA2205 and presents it to the user.

[0112] In step SA2208, the user device prompts the user to give a self-evaluation to the presented captured image. At this time, the information regarding the evaluation may be a numerical value such as a five-point scale for each captured image, or a free comment. Also, one evaluation may be given for each captured image, or evaluations may be given collectively to multiple captured images after a series of multiple captures is completed.

[0113] In step SA2209, the information processing device 260′ (history / evaluation analysis / information presentation device 2105) acquires an evaluation of the captured image. As for the subsequent processing, as described in the first embodiment (FIG. 4), the information processing device 260′ may analyze the user's operation history and present reference information, which the user may acquire.

[0114] 22(b) shows a case where an evaluation is given to an example (captured image) as reference information presented to the user. The basic processing flow is the same as in FIG.

[0115] Steps SB2201 to SB2206 are the same as steps S1701 to S1706 in FIG.

[0116] In step SB2207, the information processing device 260′ (developing device 302) analyzes the imaging conditions acquired in step SB2206 and presents reference information for imaging. At this time, captured images that match the specific imaging conditions acquired by other users are presented as example images. One or more example images may be presented. Furthermore, if there are multiple example images acquired under imaging conditions similar to the imaging conditions acquired in step SB2206, they may be presented somewhat randomly to prevent bias in evaluation of a specific example image.

[0117] In step SB2208, the user device obtains the reference information presented in step SB2207.

[0118] In step SB2209, the user device prompts the user to rate other users' examples included in the presented reference information. At this time, if an example that was previously presented is presented again, rating may be skipped. If the user does not have time to rate during image capture, the user may be allowed to rate later. To encourage users to rate, a system may be adopted in which a reward is provided to users who have given many ratings. Furthermore, rating may be skipped according to user settings. Note that a rating may be given for reference information (such as the distance from the subject) presented by the information processing device 260′ in addition to the example.

[0119] In step SB2210, the information processing device 260′ obtains an evaluation of the presented example work. As for the subsequent processing, as described in the second embodiment (FIG. 17), the user may capture an image based on the reference information, and the information processing device 260′ may develop the captured image.

[0120] FIG. 23 shows a display on the monitor or head-mounted display of the user device that prompts the user to rate along with reference information, and shows the display at step SB2209 in FIG. 22(b).

[0121] 2301 to 2305 are the same as A2001 to 2005 in FIG. 20(a). 2306 indicates a captured image as a sample image captured by another user using the recommended settings. Note that an image with a larger angle of view than the corresponding sample image may be displayed as the image (subject) 2302 captured by the user and displayed on the monitor or head-mounted display of the user device. For the portion of the image with a larger angle of view than the sample image, the CG in the virtual space may be displayed as is without taking into account the characteristics of the optical system. The image thus acquired may be displayed so that it extends beyond the periphery of the sample image. This allows users to see what was captured around the sample image when it was captured and how the photographer framed the image, which may be useful as a reference for users who are planning to take photos in the future.

[0122] Like A2007, 2307 is the recommended setting for capturing the sample images. 2308 is the field for entering a rating for the sample images. In this figure, the more stars you give (ranging from 0 to 5), the higher the rating.

[0123] When presenting examples, the examples that meet the imaging conditions may be presented in descending order of evaluation. Alternatively, only the top few highly rated examples may be displayed. In this case, the average value of the evaluations given to the top few examples may also be presented, or the average value of the evaluations given to the examples may not be presented until a certain number of evaluations have been accumulated. Note that the display configuration is similar even when the user assigns evaluations to captured images that they have captured themselves, as shown in FIG. 22(a).

[0124] 24 shows a database for managing operation history data in this embodiment. The database in this embodiment includes ratings given by users to their own captured images. Specifically, to the left of "Captured Image," ratings given by the user or other users in terms of the number of stars are shown for each captured image, categorized by the number of stars.

[0125] For example, for the captured image "folder0001￥0001.jpg" on the first line, 0 users gave it 5 stars, 1 user gave it 4 stars, 3 users gave it 3 stars, 6 users gave it 2 stars, 5 users gave it 1 star, and 1 user did not give it any stars. In this case, the total score is calculated by converting the number of stars into a score, for example, 5 points for 5 stars and 4 points for 4 stars. For example, the total score for the captured image on the same first line is 5×0+4×1+3×5+2×6+1×5+0×1=36 The items other than the above evaluation are the same as in Figure 16.

[0126] In this embodiment, the case where sample images that match the imaging conditions set by the user are evaluated has been described, but imaging conditions similar to the imaging conditions set by the user may also be evaluated, or an imaging device with unique characteristics may also be evaluated.

[0127] In this embodiment as well, it is possible to allow the user to realistically try out an imaging device in a virtual space, and it is also possible to reduce the burden on the provider of the imaging device.

[0128] The above embodiments include the following methods.

[0129] (Method 1) A step of recording data relating to the specific characteristics of the imaging device prepared in the virtual space on the blockchain as unique data; acquiring information about an operation history when an image is captured by the imaging device; and generating first information to be presented to a first user who captures an image with the imaging device based on the information related to the operation history. (Method 2) The information processing method according to Method 1, wherein the first information is information that serves as a reference for the first user when capturing an image using the imaging device. (Method 3) 3. The information processing method according to Method 1 or 2, wherein the first information is information according to the frequency of a specific operation on the imaging device. (Method 4) The information processing method described in Method 1 or 2, characterized in that the first information is past imaging conditions similar to the imaging conditions set by the first user or an image acquired under the past imaging conditions. (Method 5) 3. The information processing method according to Method 1 or 2, wherein the first information is information that notifies the first user of a location in the imaging device that the first user should operate. (Method 6) 6. The information processing method according to any one of methods 1 to 5, further comprising the step of presenting the imaging device provided in the virtual space to the first user. (Method 7) 7. The information processing device according to any one of methods 1 to 6, wherein the inherent characteristics of the imaging device are characteristics of an optical system possessed by the imaging device. (Method 8) The information processing method described in Method 7, further comprising a step of acquiring an image based on the characteristics of the optical system and spatial information of the imaging device and the subject imaged by the imaging device in the virtual space. (Method 9) The information processing method according to Method 7 or 8, wherein the image is generated by convolution of the subject, the characteristics of the optical system, and the characteristics obtained based on the spatial information. (Method 10) The information processing method described in any one of Methods 7 to 9, characterized in that the image is generated by classifying the spatial information into groups based on the distance between the subject and the imaging device and performing occlusion processing. (Method 11) 11. The information processing method according to any one of Methods 7 to 10, wherein the characteristics of the optical system are characteristics relating to at least one of a point spread function, a spot diagram, an aberration coefficient, and an aberration shape. (Method 12) 12. The information processing method according to any one of Methods 7 to 11, wherein the optical system characteristics are characteristics relating to at least one of transmittance, thin film characteristics, flare, and ghosting. (Method 13) An information processing method described in any one of methods 1 to 12, characterized in that the information regarding the operation history is information regarding at least one of the settings of the imaging device, the location where the image was taken, the time when the image was taken, and the movement of the imaging device. (Method 14) 14. The information processing method according to any one of Methods 1 to 13, wherein the information relating to operation history is information relating to operation history of a plurality of users. (Method 15) The method further includes a step of acquiring information regarding an evaluation given by at least one of the first user and a second user different from the first user to at least one evaluation target of an image acquired by imaging using the imaging device, imaging conditions for the imaging, and the imaging device, An information processing method described in any one of methods 1 to 14, characterized in that in the step of generating the first information, the first information is obtained based on information regarding the evaluation. (Method 16) An information processing method described in method 15, characterized in that in the step of generating the first information, if there are multiple evaluation targets, the first information is obtained based on the highest evaluation in the information regarding the evaluation. (Method 17) 17. The information processing method according to Method 15 or 16, further comprising the step of recording the information relating to the operation history and the information relating to the evaluation in association with each other. (Method 18) 18. An information processing method according to any one of methods 1 to 17, comprising a step of presenting the first information through a device used by the first user in real space. (Method 19) An information processing method described in any one of methods 1 to 18, characterized in that in the step of generating the first information, the first information is generated when the number of times the operation history has been accumulated reaches a predetermined number or when the conditions for past imaging by the imaging device satisfy the conditions set by the first user.

[0130] (Other Examples) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0131] The embodiments described above are merely representative examples, and various modifications and changes can be made to each embodiment when implementing the present invention. [Explanation of symbols]

[0132] 101 Virtual Space 103 Imaging device 260,260′ Information processing device

Claims

1. A step of recording data relating to the specific characteristics of the imaging device prepared in the virtual space on the blockchain as unique data; acquiring information about an operation history when an image is captured by the imaging device; and generating first information to be presented to a first user who captures an image with the imaging device based on the information related to the operation history.

2. 2. The information processing method according to claim 1, wherein the first information is information that serves as a reference when the first user takes an image using the imaging device.

3. 2. The information processing method according to claim 1, wherein the first information is information according to a frequency of a specific operation on the imaging device.

4. 2. The information processing method according to claim 1, wherein the first information is a previous image capturing condition similar to the image capturing condition set by the first user or an image captured under the previous image capturing condition.

5. 2. The information processing method according to claim 1, wherein the first information is information that notifies the first user of a location in the imaging device that the first user should operate.

6. 2. The information processing method according to claim 1, further comprising the step of presenting the imaging device prepared in the virtual space to the first user.

7. 2. The information processing apparatus according to claim 1, wherein the inherent characteristics of the imaging device are characteristics of an optical system of the imaging device.

8. 8. The information processing method according to claim 7, further comprising the step of acquiring an image based on the characteristics of the optical system and spatial information of the imaging device in the virtual space and the subject imaged by the imaging device.

9. 8. The information processing method according to claim 7, wherein the image is generated by convolution of the subject, characteristics of the optical system, and characteristics obtained based on the spatial information.

10. The information processing method according to claim 7 , wherein the image is generated by classifying the spatial information into groups according to the distance between the subject and the imaging device and performing occlusion processing.

11. 8. The information processing method according to claim 7, wherein the characteristics of the optical system are characteristics relating to at least one of a point spread function, a spot diagram, an aberration coefficient, and an aberration shape.

12. 8. The information processing method according to claim 7, wherein the optical system characteristic is a characteristic relating to at least one of transmittance, thin film characteristics, flare, and ghost.

13. 2. The information processing method according to claim 1, wherein the information regarding the operation history is information regarding at least one of the settings of the imaging device, the location where the imaging was performed, the time when the imaging was performed, and the movement of the imaging device.

14. 2. The information processing method according to claim 1, wherein the information regarding the operation history is information regarding operation histories of a plurality of users.

15. The method further includes a step of acquiring information regarding an evaluation given by at least one of the first user and a second user different from the first user to at least one evaluation target among an image acquired by imaging using the imaging device, imaging conditions for the imaging, and the imaging device, 2. The information processing method according to claim 1, wherein in the step of generating the first information, the first information is acquired based on information relating to the evaluation.

16. The information processing method according to claim 15, characterized in that in the step of generating the first information, if there are multiple evaluation targets, the first information is obtained based on the highest evaluation in the information regarding the evaluation.

17. 16. The information processing method according to claim 15, further comprising the step of recording the information relating to the operation history and the information relating to the evaluation in association with each other.

18. 2. The information processing method according to claim 1, further comprising the step of presenting the first information through a device used by the first user in real space.

19. The information processing method according to claim 1, characterized in that, in the step of generating the first information, the first information is generated when the number of times the operation history has been accumulated reaches a predetermined number or when the conditions for past imaging by the imaging device satisfy the conditions set by the first user.

20. 20. A program causing a computer to execute a process according to the information processing method of claim 1.

21. A means for recording data relating to the specific characteristics of an imaging device prepared in the virtual space on a blockchain as unique data; means for acquiring information regarding an operation history when an image is captured by the imaging device; and generating, based on the information relating to the operation history, first information to be presented to a first user who captures an image with the imaging device.

22. The information processing device according to claim 20; A management means for managing the unique data on the blockchain; and a device that presents the first information to the first user in real space.

Images