Information processing device, information processing method, and program

Abstract

To provide technology that enables users to properly view 3D content. [Solution] An information processing device having a display surface for displaying 3D content, comprising: a first acquisition unit for acquiring 2D content; a second acquisition unit for acquiring depth information of 2D content based on the 2D content; an adjustment unit that performs an adjustment process based on the arrangement of the display surface and a predetermined film when a predetermined film necessary for a user to view 3D content is placed on the display surface; and a generation unit that generates 3D content based on the 2D content and depth information according to the execution status of the adjustment process.

Description

Technical Field

[0004] , , , , , , ,

[0006] , , , ,

[0005] , , , , ,

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Conventionally, a stereoscopic display technology that can freely switch between a 2D image display mode and a 3D image display mode is widely known.

[0003] Regarding this, Patent Document 1 describes a stereoscopic display device including a main buffer for writing an input image, a capture for acquiring the image written in this image buffer, an image conversion unit for converting the format of the image acquired by this capture from a 2D image to a 3D image, an overlay buffer for writing the image-converted image, a display for displaying the image written in the main buffer or the overlay buffer, and a switching unit for switching the display of the image written in the main buffer and the overlay buffer depending on whether the input image is a 2D image or a 3D image.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, since the conventional stereoscopic display device as described above does not have a calibration function for enabling a user to appropriately view 3D content, there is a risk that the user may not be able to appropriately view 3D content.

[0006] Therefore, the present invention has been made in view of the above, and an object thereof is to provide a technology that enables a user to appropriately view 3D content. [Means for solving the problem]

[0007] An information processing apparatus according to one aspect of the present invention is an information processing apparatus having a display surface for displaying 3D content, comprising: a first acquisition unit for acquiring 2D content; a second acquisition unit for acquiring depth information of 2D content based on the 2D content; an adjustment unit that performs an adjustment process based on the arrangement of the display surface and a predetermined film when a predetermined film necessary for a user to view 3D content is arranged on the display surface; and a generation unit that generates 3D content based on the 2D content and depth information according to the execution status of the adjustment process.

[0008] An information processing method according to one aspect of the present invention is an information processing method performed by an information processing device having a display surface for displaying 3D content, and includes the steps of: acquiring 2D content; acquiring depth information of 2D content based on the 2D content; performing an adjustment process based on the arrangement of a predetermined film necessary for a user to view 3D content when the film is placed on the display surface; and generating 3D content based on the 2D content and depth information according to the status of the adjustment process.

[0009] A program according to one aspect of the present invention is a program for causing an information processing device having a display surface for displaying 3D content to function as: a first acquisition unit for acquiring 2D content; a second acquisition unit for acquiring depth information of 2D content based on the 2D content; an adjustment unit that performs an adjustment process based on the arrangement of a predetermined film between the display surface and the predetermined film when a predetermined film necessary for a user to view 3D content is placed on the display surface; and a generation unit that generates 3D content based on the 2D content and depth information according to the execution status of the adjustment process. [Effects of the Invention]

[0010] According to an aspect of the present invention, users can properly view 3D content. [Brief explanation of the drawing]

[0011] [Figure 1] This figure shows an overview of the services related to a 3D content generation device according to one embodiment. [Figure 2] This figure shows the overall configuration of a 3D content generation device according to one embodiment. [Figure 3] This figure shows an example of the adjustment process according to one embodiment. [Figure 4] This figure shows an example of a viewing settings screen according to one embodiment. [Figure 5] This figure shows an example of an eye-tracking confirmation screen according to one embodiment. [Figure 6] This figure shows an example of a screen for executing the first adjustment process according to one embodiment. [Figure 7] This is a diagram illustrating the first adjustment process according to one embodiment. [Figure 8] This figure shows an example of a screen for executing the second adjustment process (manual) according to one embodiment. [Figure 9] This is a diagram illustrating the second adjustment process (manual) according to one embodiment. [Figure 10] This figure shows an example of a setting completion screen according to one embodiment. [Figure 11] This figure illustrates the problems that arise when the second adjustment process according to one embodiment is performed manually. [Figure 12] This figure shows an example of a second adjustment process (automatic) according to one embodiment. [Figure 13] This figure illustrates the effects of automatically executing the second adjustment process according to one embodiment. [Figure 14] This flowchart shows an example of a 3D content generation process according to one embodiment. [Figure 15] This figure shows an example of a computer hardware configuration according to one embodiment.

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are merely examples, and there is no intention to exclude various modifications and applications of technologies not explicitly described below. That is, the present invention can be implemented with various modifications (such as combining each embodiment) without departing from its gist. Also, in the description of the following drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0013] In the embodiments of the present invention, "part", "device", and "system" do not merely mean physical means, but also include cases where the functions of the "part", "device", and "system" are realized by software. Also, even if the functions of one "part", "device", and "system" are realized by two or more physical means or devices, or the functions of two or more "parts", "devices", and "systems" are realized by one physical means or device, it is also acceptable.

[0014] FIG. 1 is a diagram showing an overview of a service related to a 3D content generation device (information processing device) according to an embodiment. The 3D content generation device has, for example, a display surface for displaying 3D content. The "display surface" is, for example, the input / output interface 204 (such as a touch panel display) shown in FIG. 15. The 3D content generation device acquires 2D content and generates 3D content based on the acquired 2D image and the depth information of the 2D content.

[0015] Here, an overview of the 3D content viewing service related to the 3D content generation device according to an embodiment will be described. As shown in FIG. 1, the 3D content viewing service includes, for example, items (1) to (4).

[0016] (1) For example, a user operating a 3D content generation device purchases a 3D film (a predetermined film) to be placed on the display surface of the 3D content generation device, which is necessary for the user to view 3D content, from a predetermined website or store. For example, the surface of the 3D film is equipped with a lenticular lens sheet, but is not limited to this, and may be equipped with a lens sheet of other shapes.

[0017] 3D content is data that includes one or more 3D images and at least one of the audio associated with one or more 3D images. 2D content is data that includes one or more 2D images and at least one of the audio associated with one or more 2D images. 2D and 3D content may include data relating to content such as movies, television programs, music, video games, stage plays, books, or comics. Furthermore, 2D and 3D content may include images and videos obtained by a user capturing images with a camera equipped on a 3D content generation device. 2D images may be images generated using AI.

[0018] (2) The user downloads a dedicated application for viewing 3D content to the 3D content generation device, for example. The download method is optional, but for example, the user can download it by using the camera provided by the 3D content generation device to read the QR code attached to the package of the purchased 3D film.

[0019] (3) The user attaches (places) the 3D film purchased in item (1) above onto the display surface of the 3D content generation device. After the 3D film is attached to the display surface of the 3D content generation device, the user performs an initial setup (e.g., calibration) on the 3D content generation device, which is an example of an "adjustment process".

[0020] (4) Users can view 3D content with the naked eye via a dedicated application for viewing 3D content, which is run on the 3D content generation device. The operation of the dedicated application for viewing 3D content can be summarized as follows: 1. The dedicated application for viewing 3D content is installed on the 3D content generation device. 2. The 3D content generation device performs a calibration determination (for example, whether or not the calibration process has been performed). If the calibration process has not been performed on the 3D content generation device in which the 3D film is placed, the calibration process is performed. 3. 2D content is selected from the storage area of ​​the 3D content generation device (for example, the area for storing 2D content such as images and videos within the 3D content generation device) (specifically, the dedicated application accesses the storage area and displays a list of content in the storage area by referring to it via the dedicated application. The dedicated application accepts user input to select 2D content from the list of content in the storage area). 4. The dedicated application converts the selected 2D content into 3D content and plays it back.

[0021] Thus, users can view 3D content via a dedicated application for 3D video viewing after performing a calibration process on a 3D content generation device to which they operate a 3D film. Furthermore, as described in section 3 above, the dedicated application for 3D content viewing allows users to enjoy a realistic sense of presence by displaying photos and videos they have taken in the past on their smartphone or other device in 3D, leading to the re-experiencing of memories. In other words, by using this 3D video viewing service, users can "re-experiencing memories."

[0022] As mentioned above, conventional stereoscopic display devices lack calibration functions necessary to enable users to properly view 3D content, which may prevent users from viewing 3D content correctly.

[0023] Therefore, a 3D content generation device having a display surface for displaying 3D content, according to one embodiment of the present invention, acquires 2D content and acquires depth information of the 2D content based on the acquired 2D content. When a predetermined film necessary for a user to view 3D content is placed on the display surface, the 3D content generation device performs an adjustment process based on the arrangement of the display surface and the predetermined film. The 3D content generation device generates 3D content based on the 2D content and depth information according to the execution status of the adjustment process (for example, whether or not the adjustment process is performed). In this way, the 3D content generation device according to one embodiment of the present invention performs the above adjustment process and generates 3D content based on the 2D content and depth information according to the execution status of the adjustment process. Therefore, the user can view the 3D content appropriately.

[0024] Figure 2 is a diagram showing the overall configuration of a 3D content generation device according to one embodiment of one invention. As shown in Figure 2, the 3D content generation device 1 includes a communication unit 11 that sends and receives information to and from an external device (not shown) that stores various information including 2D images and related audio information, an information processing unit 12 that performs various processes for 3D content generation, and a recording unit 13 that records information for performing various processes for 3D content generation and the results of performing such processes.

[0025] The 3D content generation device 1 and the external device are connected to each other via a predetermined communication network. The predetermined communication network may be a wired communication network or a wireless communication network.

[0026] The 3D content generation device 1 is, for example, a general-purpose smartphone, but is not limited to that. The 3D content generation device 1 may also be a personal computer or a tablet terminal. The 3D content generation device 1 is implemented by a software program. This program may be provided, for example, by downloading it from outside the 3D content generation device 1 via a predetermined network, or it may be provided on various computer-readable information recording media such as CD-ROMs or DVD-ROMs.

[0027] Furthermore, the external device capable of communicating with the 3D content generation device 1 may be, for example, a server device composed of a computer system, or a cloud server, or it may be a device such as a smartphone, personal computer, or tablet terminal.

[0028] The information processing unit 12 functionally comprises a 2D image acquisition unit 21 (first acquisition unit), a depth information acquisition unit 23 (second acquisition unit), an input reception unit 25, an adjustment unit 27, a 3D content generation unit 29 (generation unit), a display control unit 31, and a depth information modification unit 33 (modification unit).

[0029] The 2D image acquisition unit 21 acquires one or more 2D contents (2D images) from, for example, an external device. The 2D image acquisition unit 21 stores the acquired 2D contents as 2D content information TCI in the recording unit 13. The 2D image acquisition unit 21 may also acquire image information obtained by capturing images with the camera of the 3D content generation device 1 as 2D content.

[0030] The depth information acquisition unit 23 acquires depth information of the 2D content based on the 2D content acquired by the 2D image acquisition unit 21. The depth information acquisition unit 23 stores the acquired depth information DI in the recording unit 13, associating it with the 2D content information TCI. Depth information includes, for example, depth information for each pixel of a planar image.

[0031] The method for obtaining depth information for each image included in the 2D content is arbitrary. The depth information acquisition unit 23 may generate depth information by, for example, estimating the depth from each image using machine learning. The depth information acquisition unit 23 may also generate and update a learning model by preparing, for example, the correct labels for each image and their corresponding depths as training data.

[0032] Learning models include, for example, large-scale language models (LLMs). LLMs are learning models that learn from large amounts of text data and perform natural language processing tasks. Examples of LLMs include GPT-4, BERT, LaMDA, and PaLM.

[0033] When using such labeled images, the depth information acquisition unit 23 can train the model by, for example, having the learning model perform inference, comparing the results with the labeled images, and repeatedly making fine adjustments. The depth information acquisition unit 23 may also perform machine learning using images without labeled images.

[0034] The input receiving unit 25 receives operation input from the user to the 3D content generation device 1. The input receiving unit 25 receives operation input from the user, including touch operations on the display surface (e.g., touch panel display) of the 3D content generation device 1.

[0035] The adjustment unit 27 performs an adjustment process (e.g., calibration process) based on the arrangement of the 3D film between the display surface and the 3D film when the 3D film necessary for the user to view 3D content is placed on the display surface. The adjustment unit 27 performs an adjustment determination (e.g., determination of whether or not the adjustment process has already been performed) as a prerequisite for the adjustment process. If the adjustment process has not been performed in the 3D content generation device in which the 3D film is placed, the adjustment process is performed. The adjustment process includes at least two adjustment processes, "Calibration A" and "Calibration B," as described below. The adjustment unit 27 determines that the adjustment process has been performed if both adjustment processes have been performed, and determines that the adjustment process has not been performed if at least one of the two adjustment processes has not been performed. Furthermore, if the adjustment process has been completed once, the adjustment unit 27 may skip the adjustment process from the second time onward. It is preferable to perform the adjustment process according to the arrangement of the newly placed 3D film each time the 3D film is replaced in the same 3D content generation device 1. The adjustment unit 27 stores the adjustment information CI related to the adjustment process in the recording unit 13. The adjustment information CI includes at least one of the following: information regarding the progress of the adjustment process (adjustment status) and information regarding the results of the adjustment process.

[0036] Referring to Figures 3 to 13, the adjustment process according to one embodiment will be specifically described. Figure 3 is a diagram showing an example of the adjustment process according to one embodiment. As shown in Figure 3, the adjustment process includes a plurality of adjustment processes, which include, for example, "Calibration A" ("diagonal adjustment") (first adjustment process) for adjusting the alignment (angle) misalignment between the display surface and the 3D film based on the lens shape of the 3D film. The plurality of adjustment processes also include "Calibration B" ("bias adjustment") (second adjustment process) for adjusting the parallax when the user views 3D content. Details of each adjustment process will be described later.

[0037] In the adjustment process shown in Figure 3, an "eye-tracking" process is performed as a prerequisite for "Calibration A" and "Calibration B". The "eye-tracking" process allows verification of whether the camera provided by the 3D content generation device 1 shown in Figure 2 is functioning correctly. The "eye-tracking" process also allows detection, tracking, and analysis of the eye and gaze movements of the user operating the 3D content generation device 1. "Calibration A" and "Calibration B" may be performed based on the results of the "eye-tracking" process.

[0038] "Calibration B" (second adjustment process) is performed after "Calibration A" (first adjustment process). Since adjusting the misalignment between the display surface and the 3D film is more important for users to properly view 3D content, "Calibration A" is performed first to adjust the misalignment, and then "Calibration B" is performed. More specifically, if angle adjustment is not performed by "Calibration A" to adjust the misalignment (angle) between the display surface and the 3D film (if the angle remains misaligned), then the optimization of 3D content viewing by "Calibration B" to adjust the parallax when the user views 3D content cannot be performed.

[0039] Referring to Figures 4 to 10, the adjustment process according to one embodiment will be explained using an example screen on the display surface of the 3D content generation device 1 shown in Figure 2. Figure 4 is a diagram showing an example of a viewing settings screen according to one embodiment. As shown in Figure 4, first, as STEP 1, the viewing settings screen G1 is displayed on the display surface of the 3D content generation device 1 shown in Figure 2. After the user confirms the points to note written on the viewing settings screen G1 and then makes an operation input to select the "Next" button, the system transitions from the viewing settings screen G1 to the eye tracking confirmation screen G3 shown in Figure 5.

[0040] In STEP 2, the 3D content generation device 1 performs eye-tracking processing. When the user completes the "confirmation items" listed on the eye-tracking confirmation screen G3 and then selects the "Next" button, the device transitions from the eye-tracking confirmation screen G3 to screen G5, shown in Figure 6, which is used to perform the "diagonal direction adjustment" process (first adjustment process).

[0041] In STEP 3, the 3D content generation device 1 performs a first adjustment process related to "diagonal direction adjustment". The 3D content generation device 1 performs an adjustment process to correct the misalignment between the display surface and the 3D film, for example, based on the shape of the lenticular lens on the 3D film. The lenticular lens sheet is a sheet with a series of semi-cylindrical shapes arranged on its surface. The misalignment between the display surface and the 3D film includes, for example, the misalignment between the direction of the semi-cylindrical shapes and the positional relationship between the arrangement of multiple display pixels on the display surface. To allow the user to recognize this misalignment, the state of the misalignment is schematically displayed on screen G5, shown in Figure 6, before the adjustment process is performed.

[0042] Figure 7 is a diagram illustrating the first adjustment process according to one embodiment. As shown in Figures 6 and 7, the user performs an operation input by moving the knob P on the slider bar B left or right while viewing the screen G5 via the display surface of the 3D content generation device 1. In accordance with the movement of the knob P on the slider bar B left or right, the inclination of the striped pattern SP changes. It changes. When the inclination of the striped pattern SP becomes parallel to the inclination of line L, it is determined that the misalignment between the display surface and the 3D film has been resolved (adjustment is complete).

[0043] As shown in Figure 6, when the user performs an operation to select the "Next" button on screen G5 after the first adjustment process is completed, the screen transitions from screen G5 to screen G7, which is used to execute the second adjustment process (manual), as shown in Figure 8.

[0044] In STEP 4, the 3D content generation device 1 performs a second adjustment process related to the "bias adjustment" process. For example, the 3D content generation device 1 performs an adjustment process to adjust the parallax when a user views 3D content.

[0045] Figure 9 is a diagram illustrating a second adjustment process (manual) according to one embodiment. As shown in Figures 8 and 9, the user performs an operation input by moving the knob P on the slider bar B left or right while viewing the screen G7 through the display surface of the 3D content generation device 1. As the knob P is moved left or right on the slider bar B, the sharpness of, for example, the outline of the image changes. When the image sharpness increases and the image becomes clearly visible to the user, it is determined that the parallax adjustment for viewing the 3D content is complete.

[0046] As shown in Figures 8 and 9, when the user performs an operation to select the "Next" button on screen G7 after the second adjustment process is complete, the system transitions from screen G7 to the setting completion screen G9 shown in Figure 10.

[0047] In STEP 5, as shown in Figure 10, the setting completion screen G9 is displayed on the display surface of the 3D content generation device 1, and the adjustment process is completed.

[0048] As explained with reference to Figures 4 to 10, the 3D content generation device 1 (display control unit 31) displays at least one of the first adjustment status of the first adjustment process and the second adjustment status of the second adjustment process on the display surface, and at least one of the first adjustment status and the second adjustment status is updated in accordance with the user's operation input. With this configuration, the user can manually fine-tune the settings while checking the progress of at least one of the first adjustment status and the second adjustment status, thereby enabling proper calibration.

[0049] In the examples shown in Figures 4 to 10, the first and second adjustment processes are performed manually by the user, but the second adjustment process may be performed automatically.

[0050] Referring to Figures 11 to 13, the second adjustment process (automatic) according to one embodiment will be described. Figure 11 is a diagram illustrating the problems when the second adjustment process according to one embodiment is performed manually. Figure 12 is a diagram illustrating an example of the second adjustment process (automatic) according to one embodiment. Figure 13 is a diagram illustrating the effects when the second adjustment process according to one embodiment is performed automatically.

[0051] First, with reference to Figure 11, the challenges of manually performing the second adjustment process according to one embodiment will be explained. As shown in Figure 11, when the second adjustment process is performed manually, the content creator faces the challenge of having to manually perform the optimal parallax adjustment for each piece of content, and the user faces the challenge that, due to manual adjustment, there is a risk of incorrect settings occurring by the user or that viewing may begin without optimal parallax adjustment.

[0052] Therefore, as shown in Figure 12, the adjustment unit 27 of the 3D content generation device 1 performs a second adjustment process based on focal length information obtained by detecting the user's pupils using eye-tracking processing. For example, the adjustment unit 27 inputs the acquired focal length information into a pre-trained learning model to set the optimal parameters for parallax adjustment, thereby obtaining the optimal parameters as output information of the learning model. The adjustment unit 27 can then perform the second adjustment process using these output optimal parameters (automatically) without any user input.

[0053] With this configuration, as shown in Figure 13, content creators no longer need to manually adjust the parallax for each piece of content, and users are less likely to make incorrect settings.

[0054] Returning to Figure 2, the 3D content generation unit 29 generates 3D content based on 2D content and depth information according to the execution status of the adjustment process of the adjustment unit 27. The 3D content generation unit 29 stores the generated 3D content as 3D content information SCI in the recording unit 13.

[0055] The 3D content generation unit 29 may delete the 3D content after it has been displayed on the display surface. With this configuration, it is no longer necessary to constantly record the generated and displayed 3D content as 3D content information SCI, thus reducing the amount of data recorded in the 3D content generation device 1 and ensuring sufficient recording capacity.

[0056] The display control unit 31 displays at least one of 2D content and 3D content on the display surface. The display control unit 31 may switch from 3D content to 2D content when it receives user input while displaying 3D content created in, for example, a half-side-by-side format on the display surface. With this configuration, it is possible to easily switch from 3D display to 2D display for content created in a specific display format in response to user input.

[0057] The display control unit 31 can stream 3D content, for example. For example, if the 3D content generation unit 29 receives user input to select a specific 2D content from one or more 2D contents, it converts the specific 2D content into 3D content as multiple different segment data. The display control unit 31 may display the converted multiple different segment data as 3D content in a predetermined order. The display order of the segment data is arbitrary, but for example, the segment data may be displayed sequentially in the order in which the 2D content was divided and generated, that is, in the order in which the segment data was generated.

[0058] The depth information modification unit 33 modifies the depth information associated with the 3D content. For example, when 3D content is displayed on the display surface, if there is user input to change the depth information, the depth information modification unit 33 modifies the depth information associated with the 3D content in accordance with the user input. For example, as shown in Figures 6 to 9, which were referenced in the explanation of the adjustment process, the depth information associated with the 3D content is changed by the user appropriately operating the knob P on the slider bar B while viewing the 3D content. The user can easily adjust how the 3D content looks to their liking in accordance with the user's input to the display surface.

[0059] <3D Image Generation Processing> Referring to Figure 14, an example of a 3D content generation process according to one embodiment will be described. Figure 14 is a flowchart of an example of a 3D content generation process according to one embodiment. As shown in Figure 14, the 3D content generation device 1 shown in Figure 1 acquires one or more 2D content (step S1). The 3D content generation device 1 acquires depth information of one or more 2D content (step S3).

[0060] The 3D content generation device 1 performs an adjustment process (step S5). Based on the user's input, the 3D content generation device 1 selects one or more specific 2D content from the acquired 2D content (step S7). The 3D content generation device 1 generates 3D content corresponding to the selected specific 2D content (step S9).

[0061] According to the 3D content generation process described above, the 3D content generation device acquires 2D content and, based on the acquired 2D content, acquires depth information for the 2D content. When a predetermined film necessary for a user to view 3D content is placed on the display surface, the 3D content generation device performs an adjustment process based on the arrangement of the display surface and the predetermined film. The 3D content generation device generates 3D content based on the 2D content and depth information according to the status of the adjustment process.

[0062] Thus, the 3D content generation device according to one embodiment of the present invention performs the above adjustment process and generates 3D content based on 2D content and depth information according to the execution status of the adjustment process. Therefore, the user can properly view the 3D content. In addition, 2D content, including past photographs and videos, that are previously recorded in the 3D content generation device can be converted into 3D content in a smooth flow, and the 3D content can be viewed.

[0063] Figure 15 is a diagram showing an example of a computer hardware configuration according to an embodiment of the present invention. Referring to Figure 15, an example of a computer hardware configuration that can be used to configure the 3D content generation device 1 shown in Figure 1 will be described.

[0064] As shown in Figure 15, the computer 200 mainly comprises a processor 201, a main storage device 202, an auxiliary storage device 203, an input / output interface 204, and a communication interface 205 as hardware resources, which are interconnected via a bus line 206 that includes an address bus, a data bus, a control bus, etc. Interface circuits (not shown) may be interposed between the bus line 206 and each hardware resource as appropriate.

[0065] The processor 201 controls the entire computer. The processor 201 corresponds, for example, to the information processing unit 12 shown in Figure 2. The main storage device 202 provides a workspace to the processor 201, and the SRAM (S tatic R andom A Ccess M (emory) and DRAM ( D ynamic R andom A Ccess M The main storage device 202 is a volatile memory such as an emory. The auxiliary storage device 203 is a non-volatile memory such as an HDD, SSD, or flash memory that stores software programs and data. The programs and data are loaded from the auxiliary storage device 203 to the main storage device 202 via the bus line 206 at any given time.

[0066] The input / output interface 204 performs either or both of the following functions: presenting information and / or receiving information input. Examples include cameras, keyboards, mice, displays, touch panel displays, microphones, and speakers. The communication interface 205 is connected to the predetermined communication network described above and transmits and receives data via the said communication network. The communication interface 205 may also acquire network-related information, such as information related to Wi-Fi access points.

[0067] It will be apparent to those skilled in the art that, through the cooperation of the hardware resources and software exemplified above, the computer 200 can function as a desired means, perform the desired steps, and realize the desired functions.

[0068] The above embodiments are provided to facilitate understanding of the present invention and are not intended to limit its scope. The present invention can be modified or improved without departing from its spirit, and equivalents thereof are also included. Furthermore, the present invention can form various disclosures by appropriately combining the multiple components disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiments. Moreover, components may be appropriately combined in different embodiments.

[0069] For example, one user can share the generated 3D content with one or more other users. Content can be transmitted from a 3D content generation device operated by one user to a 3D content generation device operated by another user, for example, via a Social Networking Service (SNS).

[0070] The user fee for the 3D content viewing service according to one embodiment may be free or paid. If it is paid, the fee may be charged each time the 3D content is viewed, or it may be charged at predetermined intervals. [Explanation of Symbols]

[0071] 1...3D content generation device, 11...Communication unit, 12...Information processing unit, 13...Recording unit, 21...2D image acquisition unit, 23...Depth information acquisition unit, 25...Input reception unit, 27...Adjustment unit, 29...3D content generation unit, 31...Display control unit, 33...Depth information modification unit, 200...Computer, 201...Processor, 202...Main recording device, 203...Auxiliary recording device, 204...Input / output interface, 205...Communication interface, 206...Bus line.

Claims

1. An information processing device having a display surface for displaying 3D content, A first acquisition unit for acquiring 2D content, A second acquisition unit acquires depth information of the 2D content based on the aforementioned 2D content, When a predetermined film necessary for a user to view the 3D content is placed on the display surface, an adjustment unit performs an adjustment process based on the arrangement of the display surface and the predetermined film, The system includes a generation unit that generates the 3D content based on the 2D content and depth information according to the execution status of the adjustment process, Information processing device.

2. The adjustment process includes multiple adjustment processes, The aforementioned multiple adjustment processes are: The process includes a first adjustment process for adjusting the misalignment between the display surface and the predetermined film based on the lens shape of the predetermined film, and a second adjustment process for adjusting the parallax when the user views the 3D content. The generation unit generates the 3D content when the first adjustment process and the second adjustment process are performed. The information processing apparatus according to claim 1.

3. The adjustment unit performs the second adjustment process based on the focal length information obtained by detecting the user's pupil. The information processing apparatus according to claim 2.

4. The system further comprises a display control unit that displays the 3D content on the display surface, The generation unit deletes the 3D content after it has been displayed on the display surface. The information processing apparatus according to claim 1.

5. The system further includes a display control unit that displays the 2D content and the 3D content on the display surface. The display control unit switches from the 3D content to the 2D content when the user inputs an operation while the 3D content is being displayed on the display surface. The information processing apparatus according to claim 1.

6. A display control unit that displays the 3D content on the display surface, The system further includes a modification unit that, when the 3D content is displayed on the display surface and the user provides input, modifies the depth information associated with the 3D content in response to the user's input. The information processing apparatus according to claim 1.

7. When the generation unit receives input for selecting a specific 2D content from one or more of the 2D content, it converts the specific 2D content into 3D content as multiple different segment data. The display control unit displays the converted plurality of different segment data as 3D content in a predetermined order. The information processing apparatus according to claim 1.

8. An information processing method performed by an information processing device having a display surface for displaying 3D content, Steps to acquire 2D content, The steps include: obtaining depth information of the 2D content based on the 2D content; When a predetermined film necessary for a user to view the 3D content is placed on the display surface, the step of performing an adjustment process based on the arrangement of the display surface and the predetermined film, The process includes the step of generating the 3D content based on the 2D content and the depth information, depending on the execution status of the adjustment process. Information processing methods.

9. An information processing device having a display surface for displaying 3D content, A first acquisition unit for acquiring 2D content, A second acquisition unit acquires depth information of the 2D content based on the aforementioned 2D content, When a predetermined film necessary for a user to view the 3D content is placed on the display surface, an adjustment unit performs an adjustment process based on the arrangement of the display surface and the predetermined film, A generation unit generates the 3D content based on the 2D content and the depth information according to the execution status of the adjustment process, A program designed to function as such.

Images