Information processing apparatus, information processing method, and program

Abstract

To provide a technology that enables a user to appropriately view 3D content. 【Solution means】 An information processing apparatus having a display surface for displaying 3D content, comprising: a first acquisition unit that acquires 2D content; a second acquisition unit that acquires depth information of the 2D content based on the 2D content; an adjustment unit that executes an adjustment process based on the arrangement status of the display surface and a predetermined film when the predetermined film necessary for the user to view 3D content is arranged on the display surface; and a generation unit that generates 3D content based on the 2D content and the depth information according to the execution status of the adjustment process.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Conventionally, a stereoscopic display technology capable of freely switching between a 2D image display mode and a 3D image display mode has been widely known.

[0003] Regarding this, Patent Document 1 describes a stereoscopic display device including a main buffer for writing an input image, a capture for acquiring the image written in this image buffer, an image conversion unit for converting the format of the image acquired by this capture from a 2D image to a 3D image, an overlay buffer for writing the image converted by the image conversion, a display for displaying the image written in the main buffer or the overlay buffer, and a switching unit for switching the display of the image written in the main buffer and the overlay buffer depending on whether the input image is a 2D image or a 3D image.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, since the conventional stereoscopic display device as described above does not have a calibration function for enabling a user to appropriately view 3D content, there is a possibility that the user may not be able to appropriately view 3D content.

[0006] Therefore, the present invention has been made in view of the above, and an object thereof is to provide a technology that enables a user to appropriately view 3D content.

Means for Solving the Problem

[0007] An information processing apparatus according to an aspect of the present invention is an information processing apparatus having a display surface for displaying 3D content, including a first acquisition unit that acquires 2D content, a second acquisition unit that acquires depth information of the 2D content based on the 2D content, an adjustment unit that executes adjustment processing based on the arrangement state of the display surface and a predetermined film when the predetermined film necessary for the user to view 3D content is arranged on the display surface, and a generation unit that generates 3D content based on the 2D content and the depth information according to the execution state of the adjustment processing.

[0008] An information processing method according to an aspect of the present invention is an information processing method executed by an information processing apparatus having a display surface for displaying 3D content, including steps of acquiring 2D content, acquiring depth information of the 2D content based on the 2D content, executing adjustment processing based on the arrangement state of the display surface and a predetermined film when the predetermined film necessary for the user to view 3D content is arranged on the display surface, and generating 3D content based on the 2D content and the depth information according to the execution state of the adjustment processing.

[0009] A program according to an aspect of the present invention is a program for causing an information processing apparatus having a display surface for displaying 3D content to function as a first acquisition unit that acquires 2D content, a second acquisition unit that acquires depth information of the 2D content based on the 2D content, an adjustment unit that executes adjustment processing based on the arrangement state of the display surface and a predetermined film when the predetermined film necessary for the user to view 3D content is arranged on the display surface, and a generation unit that generates 3D content based on the 2D content and the depth information according to the execution state of the adjustment processing.

Advantages of the Invention

[0010] According to an aspect of the present invention, a user can appropriately view 3D content.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are merely examples, and there is no intention to exclude various modifications and applications of technologies not explicitly described below. That is, the present invention can be implemented with various modifications (such as combining each embodiment) without departing from its gist. Also, in the description of the following drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0013] In the embodiments of the present invention, the "part", "device", and "system" do not merely mean physical means, but also include cases where the functions of the "part", "device", and "system" are realized by software. Also, even if the functions of one "part", "device", and "system" are realized by two or more physical means or devices, or the functions of two or more "parts", "devices", and "systems" are realized by one physical means or device, it is also acceptable.

[0014] FIG. 1 is a diagram showing an overview of a service related to a 3D content generation device (information processing device) according to an embodiment. The 3D content generation device has, for example, a display surface for displaying 3D content. The "display surface" is, for example, the input / output interface 204 (e.g., touch panel display) shown in FIG. 15. The 3D content generation device acquires 2D content and generates 3D content based on the acquired 2D image and the depth information of the 2D content.

[0015] Here, an overview of the 3D content viewing service related to the 3D content generation device according to an embodiment will be described. As shown in FIG. 1, the 3D content viewing service includes, for example, items (1) to (4).

[0016] (1) For example, a user who operates a 3D content generation device purchases a 3D film (predetermined film) for placement on the display surface of the 3D content generation device, which is a 3D film necessary for the user to view 3D content, from a predetermined website or store. For example, the surface of the 3D film is provided with a lenticular lens sheet, but it is not limited to this, and may be provided with a lens sheet having other shapes.

[0017] 3D content is data including at least one of one or more 3D images and audio associated with one or more 3D images. 2D content is data including at least one of one or more 2D images and audio associated with one or more 2D images. 2D content and 3D content may include data related to content such as movies, TV programs, music, video games, stage plays, books, or comics. In addition, 2D content and 3D content include images and videos obtained by the user capturing images with a camera provided in the 3D content generation device. The 2D image may be an image generated using AI.

[0018] (2) For example, the user causes the 3D content generation device to download a dedicated application for viewing 3D content. The download method is arbitrary. For example, the user can download it by using the camera provided in the 3D content generation device to read the QR code attached to the package of the purchased 3D film.

[0019] (3) The user attaches (places) the 3D film purchased in the above item (1) on the display surface of the 3D content generation device. After the 3D film is attached to the display surface of the 3D content generation device, the user executes an initial setting (for example, a calibration process), which is an example of an "adjustment process", on the 3D content generation device.

[0020] (4) The user can view 3D content with the naked eye through a dedicated application for viewing 3D content, which is executed on the 3D content generation device. Here, the operation of the dedicated application for viewing 3D content is summarized as follows. 1. A dedicated application for viewing 3D content is installed on the 3D content generation device. 2. Calibration determination (for example, determination of whether the calibration process has been executed) is performed on the 3D content generation device. If the calibration process has not been executed on the 3D content generation device where the 3D film is placed, the calibration process is executed. 3. 2D content is selected from the storage area of the 3D content generation device (for example, an area for storing 2D content such as images and videos in the 3D content generation device) (specifically, the dedicated application accesses the storage area and displays the content list of the storage area through the dedicated application. The dedicated application receives the user's selection input for selecting 2D content from the content list of the storage area). 4. The dedicated application converts the selected 2D content into 3D content and plays it back.

[0021] In this way, the user can view 3D content through a dedicated application for viewing 3D videos after executing the calibration process in the 3D content generation device with the 3D film attached that the user operates. Also, in the dedicated application for viewing 3D content, as described in 3. above, the user can enjoy a real sense of presence by displaying photos and videos taken in the past on a smartphone or the like that the user operates in 3D, leading to reliving memories. That is, the user can "relive memories" by using this 3D video viewing service.

[0022] As described above, since the conventional stereoscopic display device does not have a calibration function for enabling the user to appropriately view 3D content, there is a possibility that the user may not be able to appropriately view 3D content.

[0023] Therefore, a 3D content generation device having a display surface for displaying 3D content according to an embodiment of the present invention acquires 2D content and acquires depth information of the 2D content based on the acquired 2D content. When a predetermined film necessary for a user to view 3D content is arranged on the display surface, the 3D content generation device executes an adjustment process based on the arrangement situation of the display surface and the predetermined film. The 3D content generation device generates 3D content based on the 2D content and the depth information according to the execution situation of the adjustment process (for example, whether the adjustment process is executed or not). Thus, the 3D content generation device according to an embodiment of the present invention executes the above adjustment process and generates 3D content based on the 2D content and the depth information according to the execution situation of the adjustment process. Therefore, the user can appropriately view 3D content.

[0024] FIG. 2 is a diagram showing the overall configuration of a 3D content generation device according to an embodiment of the present invention. As shown in FIG. 2, the 3D content generation device 1 includes, for example, a communication unit 11 that transmits and receives information to and from an external device (not shown) that stores various information including 2D images and related audio information, an information processing unit 12 that executes various processes for 3D content generation, and a recording unit 13 that records information for executing various processes for 3D content generation and the execution results of the various processes.

[0025] The 3D content generation device 1 and the external device are connected to each other via a predetermined communication network. The predetermined communication network may be a wired communication network or a wireless communication network.

[0026] Note that the 3D content generation device 1 is, for example, a general-purpose smartphone, but is not limited thereto. The 3D content generation device 1 may be a device such as a personal computer or a tablet terminal. The 3D content generation device 1 is implemented by a software program. The program may be downloaded and provided from outside the 3D content generation device 1 via a predetermined network, or may be provided by various computer-readable information recording media such as a CD-ROM or a DVD-ROM.

[0027] In addition, the external device capable of communicating with the 3D content generation device 1 may be configured by, for example, a server device configured by a computer system, or a cloud server or the like, or may be a device such as a smartphone, a personal computer, or a tablet terminal.

[0028] Functionally, the information processing unit 12 includes a 2D image acquisition unit 21 (first acquisition unit), a depth information acquisition unit 23 (second acquisition unit), an input reception unit 25, an adjustment unit 27, a 3D content generation unit 29 (generation unit), a display control unit 31, and a depth information change unit 33 (change unit).

[0029] The 2D image acquisition unit 21 acquires one or more 2D contents (2D images) from, for example, an external device or the like. The 2D image acquisition unit 21 stores the acquired 2D content in the recording unit 13 as 2D content information TCI. The 2D image acquisition unit 21 may acquire image information obtained by imaging with the camera of the 3D content generation device 1 as a 2D content.

[0030] The depth information acquisition unit 23 acquires the depth information of the 2D content based on the 2D content acquired by the 2D image acquisition unit 21. The depth information acquisition unit 23 stores the acquired depth information DI in the recording unit 13 in association with the 2D content information TCI. The depth information includes, for example, information on the depth of each pixel of a planar image.

[0031] The method for obtaining the depth information of each image included in the 2D content is arbitrary. The depth information acquisition unit 23 may generate depth information, for example, by estimating the depth from each image using machine learning. The depth information acquisition unit 23 may, for example, prepare each image and the corresponding correct label of the depth as learning data to generate and update a learning model.

[0032] The learning model includes, for example, a large language model (LLM). The LLM is a learning model that learns from a large amount of text data and executes natural language processing tasks. The LLM is, for example, GPT-4, BERT, LaMDA, PaLM, etc.

[0033] When using such images with correct labels, the depth information acquisition unit 23 can execute model learning, for example, by causing the learning model to perform inference, comparing the result with the correct label, and repeating fine-tuning. Note that the depth information acquisition unit 23 may execute machine learning using images without correct labels.

[0034] The input reception unit 25 receives an operation input from the user to the 3D content generation device 1. The input reception unit 25 receives, for example, an operation input including a touch operation by the user on the display surface (e.g., a touch panel display) of the 3D content generation device 1.

[0035] When the 3D film necessary for the user to view 3D content is arranged on the display surface, the adjustment unit 27 executes adjustment processing (for example, calibration processing) based on the arrangement situation between the display surface and the 3D film. The adjustment unit 27, for example, performs an adjustment determination (for example, determination as to whether the adjustment processing has been executed) as a prerequisite for the adjustment processing. When the adjustment processing has not been executed in the 3D content generation device in which the 3D film is arranged, the adjustment processing is executed. Further, the adjustment processing includes at least two adjustment processes of "calibration A" and "calibration B" as follows. The adjustment unit 27 determines that the adjustment processing has been executed when the two adjustment processes have been executed, and determines that the adjustment processing has not been executed when at least one of the two adjustment processes has not been executed. Furthermore, the adjustment unit 27 may skip the adjustment processing after the second time if the adjustment processing has been completed once. Note that each time the 3D film is replaced in the same 3D content generation device 1, it is preferable to execute the adjustment processing according to the arrangement situation of the newly arranged 3D film. The adjustment unit 27 stores adjustment information CI related to the adjustment processing in the recording unit 13. The adjustment information CI includes at least one of information regarding the progress status (adjustment status) of the adjustment processing and information regarding the result of the adjustment processing.

[0036] Referring to FIGS. 3 to 13, the adjustment processing according to an embodiment will be specifically described. FIG. 3 is a diagram showing an example of the adjustment processing according to an embodiment. As shown in FIG. 3, the adjustment processing includes a plurality of adjustment processes, and the plurality of adjustment processes include, for example, "calibration A" ("diagonal direction adjustment") (first adjustment process) for adjusting the arrangement (angle) deviation between the display surface and the 3D film based on the lens shape of the 3D film. The plurality of adjustment processes include "calibration B" ("bias adjustment") (second adjustment process) for adjusting the parallax when the user views 3D content. Details of each adjustment process will be described later.

[0037] In the adjustment process shown in FIG. 3, as a prerequisite for "Calibration A" and "Calibration B", the "Eye Tracking" process is executed. In the "Eye Tracking" process, it is possible to check whether the camera provided in the 3D content generation device 1 shown in FIG. 2 is functioning properly. Also, in the "Eye Tracking" process, it is possible to detect, track, and analyze the pupil and the movement of the line of sight of the user operating the 3D content generation device 1. "Calibration A" and "Calibration B" may be executed based on the results of the "Eye Tracking" process.

[0038] "Calibration B" (the second adjustment process) is executed after "Calibration A" (the first adjustment process). For the user to properly view 3D content, it is more important to adjust the misalignment between the display surface and the 3D film. Therefore, "Calibration A" is executed first to adjust the misalignment, and then "Calibration B" is executed. More specifically, if the angle adjustment is not performed by "Calibration A" for adjusting the misalignment (angle) between the display surface and the 3D film (if the angle remains misaligned), the optimization of 3D content viewing by "Calibration B" for adjusting the parallax when the user views the 3D content cannot be executed.

[0039] Referring to FIGS. 4 to 10, the adjustment process according to an embodiment will be described while using a screen example on the display surface of the 3D content generation device 1 shown in FIG. 2. FIG. 4 is a diagram showing an example of a viewing setting screen according to an embodiment. As shown in FIG. 4, first, as STEP1, a viewing setting screen G1 is displayed on the display surface of the 3D content generation device 1 shown in FIG. 2. After the user checks the precautions described on the viewing setting screen G1 and performs an operation input for selecting the "Next" button, the screen transitions from the viewing setting screen G1 to the eye tracking confirmation screen G3 shown in FIG. 5.

[0040] In STEP2, the 3D content generation device 1 executes eye tracking processing. When the user makes an operation input to select the "Next" button after completing the "Verification Items" described on the eye tracking confirmation screen G3, the screen transitions from the eye tracking confirmation screen G3 to the screen G5 shown in FIG. 6 for executing the "Diagonal Direction Adjustment" process (first adjustment process).

[0041] In STEP3, the 3D content generation device 1 executes the first adjustment process related to "Diagonal Direction Adjustment". The 3D content generation device 1 executes an adjustment process for adjusting the misalignment between the display surface and the 3D film based on, for example, the shape of the lenticular lens of the 3D film. The lenticular lens sheet is a sheet in which semicylindrical shapes like kamaboko are arranged on the surface. The misalignment between the display surface and the 3D film includes, for example, the misalignment of the position relationship between the direction of the fine semi-cylinders and the arrangement of a plurality of display pixels on the display surface. The situation of the misalignment is schematically displayed on the screen G5 shown in FIG. 6 before the adjustment process is executed so that the user can recognize the misalignment.

[0042] FIG. 7 is a diagram for explaining the first adjustment process according to an embodiment. As shown in FIGS. 6 and 7, the user executes an operation input to move the knob P left and right on the slider bar B while checking the screen G5 through the display surface in the 3D content generation device 1. In response to moving the knob P left and right on the slider bar B, the inclination of the stripe pattern SP changes. If the inclination of the stripe pattern SP and the inclination of the line L become parallel, it is determined that the misalignment between the display surface and the 3D film has been eliminated (the adjustment is completed).

[0043] As shown in FIG. 6, when the user makes an operation input to select the "Next" button on the screen G5 when the first adjustment process is completed, the screen transitions from the screen G5 to the screen G7 shown in FIG. 8 for executing the second adjustment process (manual).

[0044] In STEP4, the 3D content generation device 1 executes a second adjustment process related to the "bias adjustment" process. The 3D content generation device 1 executes an adjustment process for adjusting the parallax when, for example, the user views 3D content.

[0045] FIG. 9 is a diagram for explaining the second adjustment process (manual) according to an embodiment. As shown in FIGS. 8 and 9, the user executes an operation input to move the knob P left and right on the slider bar B while checking the screen G7 through the display surface in the 3D content generation device 1. In response to moving the knob P left and right on the slider bar B, for example, the sharpness of the outline of the image or the like changes. When the sharpness of the image increases and the image becomes clear for the user, it is determined that the adjustment of the parallax when the user views 3D content is completed.

[0046] As shown in FIGS. 8 and 9, when the user performs an operation input for selecting the "Next" button on the screen G7 when the second adjustment process is completed, the screen transitions from the screen G7 to the setting completion screen G9 shown in FIG. 10.

[0047] In STEP5, as shown in FIG. 10, the setting completion screen G9 is displayed on the display surface of the 3D content generation device 1, and the adjustment process ends.

[0048] As described with reference to FIGS. 4 to 10, the 3D content generation device 1 (display control unit 31) displays at least one of the first adjustment status of the first adjustment process and the second adjustment status of the second adjustment process on the display surface, and at least one of the first adjustment status and the second adjustment status is updated according to the user's operation input. According to this configuration, since the user can manually perform fine adjustment while checking the progress of at least one of the first adjustment status and the second adjustment status, appropriate calibration can be executed.

[0049] In the example of FIGS. 4 to 10, the first adjustment process and the second adjustment process are manually executed by the user, but the second adjustment process may be automatically executed.

[0050] Referring to FIGS. 11 to 13, a second adjustment process (automatic) according to an embodiment will be described. FIG. 11 is a diagram for explaining problems in the case of manually executing the second adjustment process according to an embodiment. FIG. 12 is a diagram showing an example of the second adjustment process (automatic) according to an embodiment. FIG. 13 is a diagram for explaining the effects in the case of automatically executing the second adjustment process according to an embodiment.

[0051] First, referring to FIG. 11, problems in the case of manually executing the second adjustment process according to an embodiment will be described. As shown in FIG. 11, when the second adjustment process is manually executed, there is a problem that the content production side needs to manually perform optimal parallax adjustment for each content, and on the user side, there is a problem that there is a possibility that the user may start viewing in a state where incorrect settings occur or optimal parallax adjustment cannot be performed due to manual adjustment.

[0052] Therefore, as shown in FIG. 12, the adjustment unit 27 of the 3D content generation device 1 executes the second adjustment process based on the focal length information obtained by detecting the user's pupil using the eye tracking process. For example, the adjustment unit 27 inputs the acquired focal length information into a learning model that has been previously learned to set optimal parameters for parallax adjustment, and acquires the optimal parameters as the output information of the learning model. The adjustment unit 27 can execute the second adjustment process automatically without user operation input using the optimal parameters thus output.

[0053] According to this configuration, as shown in FIG. 13, on the content production side, it is no longer necessary to manually perform optimal parallax adjustment for each content, and on the user side, the possibility of incorrect settings by the user and the like is reduced.

[0054] Returning to FIG. 2, the 3D content generation unit 29 generates 3D content based on 2D content and depth information according to the execution status of the adjustment process of the adjustment unit 27. The 3D content generation unit 29 stores the generated 3D content in the recording unit 13 as 3D content information SCI.

[0055] The 3D content generation unit 29 may delete the 3D content after the 3D content is displayed on the display surface. According to this configuration, it is not necessary to always record the generated and once-displayed 3D content as 3D content information SCI, so the amount of data recorded in the 3D content generation device 1 can be reduced, and it is possible to secure the recording capacity.

[0056] The display control unit 31 causes at least one of the 2D content and the 3D content to be displayed on the display surface. For example, when the display control unit 31 is displaying 3D content created in a half-side-by-side format on the display surface and there is a user operation input, it may switch from the 3D content to 2D content. According to this configuration, it is possible to easily switch from 3D display to 2D display for content created in a specific display format in response to a user operation input.

[0057] The display control unit 31 can, for example, stream and play 3D content. For example, first, when the 3D content generation unit 29 receives a user input for selecting a specific 2D content from one or more 2D contents, it converts the specific 2D content into 3D content as a plurality of different segment data. The display control unit 31 may display the plurality of different segment data converted as 3D content in a predetermined order. The display order of the segment data is arbitrary, but for example, the segment data may be sequentially displayed in the order in which the 2D content is divided and generated, that is, the generation order of the segment data.

[0058] The depth information changing unit 33 changes the depth information associated with the 3D content. For example, when the 3D content is being displayed on the display surface, if there is a user operation input for changing the depth information, the depth information changing unit 33 changes the depth information associated with the 3D content according to the user operation input. For example, as shown in FIGS. 6 to 9 referred to in the description of the adjustment process, while the user is viewing the 3D content, by appropriately operating the knob P on the slider B, the depth information associated with the 3D content is changed. The user can easily adjust the appearance of the 3D content according to his / her preference according to the user operation input to the display surface.

[0059] <3D Image Generation Process> Referring to FIG. 14, an example of the 3D content generation process according to an embodiment will be described. FIG. 14 is a flowchart showing an example of the 3D content generation process according to an embodiment. As shown in FIG. 14, the 3D content generation device 1 shown in FIG. 1 acquires one or more 2D contents (step S1). The 3D content generation device 1 acquires the depth information of the one or more 2D contents (step S3).

[0060] The 3D content generation device 1 executes an adjustment process (step S5). The 3D content generation device 1 selects one or more specific 2D contents from the acquired one or more 2D contents based on the user operation input (step S7). The 3D content generation device 1 generates 3D content corresponding to the selected specific 2D content (step S9).

[0061] According to the above 3D content generation process, the 3D content generation device acquires 2D content and obtains the depth information of the 2D content based on the acquired 2D content. When a predetermined film necessary for the user to view 3D content is arranged on the display surface, the 3D content generation device executes an adjustment process based on the arrangement situation between the display surface and the predetermined film. The 3D content generation device generates 3D content based on the 2D content and the depth information according to the execution situation of the adjustment process.

[0062] In this way, the 3D content generation device according to an embodiment of the present invention executes the above adjustment process and generates 3D content based on the 2D content and the depth information according to the execution situation of the adjustment process. Therefore, the user can appropriately view the 3D content. Also, regarding 2D content including past photos, videos, etc. recorded in the 3D content generation device in advance, it is possible to convert the 2D content into 3D content with a smooth flow and view the 3D content.

[0063] FIG. 15 is a diagram showing an example of the hardware configuration of a computer according to an embodiment of the present invention. With reference to FIG. 15, an example of the hardware configuration of a computer that can be used to configure the 3D content generation device 1 shown in FIG. 1 will be described.

[0064] As shown in FIG. 15, the computer 200 mainly includes, as hardware resources, a processor 201, a main recording device 202, an auxiliary recording device 203, an input / output interface 204, and a communication interface 205, and these are interconnected via a bus line 206 including an address bus, a data bus, a control bus, etc. Note that an interface circuit (not shown) may be appropriately interposed between the bus line 206 and each hardware resource.

[0065] The processor 201 controls the entire computer. The processor 201 corresponds to, for example, the information processing unit 12 shown in FIG. 2. The main recording device 202 provides a working area for the processor 201 and SRAM (S static R random A access M memory), such as DRAM D dynamic R random A access M memory), etc. are volatile memories. The auxiliary recording device 203 is a non-volatile memory such as an HDD, SSD, flash memory, etc. that stores programs and data, etc., which are software. The programs and data, etc. are loaded from the auxiliary recording device 203 to the main recording device 202 via the bus line 206 at any time.

[0066] The input / output interface 204 performs one or both of presenting information and receiving input of information, and includes a camera, keyboard, mouse, display, touch panel display, microphone, speaker, etc. The communication interface 205 is connected to the above-described predetermined communication network and transmits and receives data via the predetermined communication network. The communication interface 205 may also acquire information related to the network, for example, information related to a Wi-Fi access point, etc.

[0067] It is obvious to those skilled in the art that by the cooperation of the hardware resources and software exemplified above, the computer 200 can function as a desired means, execute desired steps, and realize desired functions.

[0068] Note that the above embodiments are for facilitating the understanding of the present invention and are not intended to limit the interpretation of the present invention. The present invention can be changed / improved without departing from its gist, and equivalents thereof are also included in the present invention. Further, the present invention can form various disclosures by appropriate combinations of a plurality of components disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiments. Furthermore, components may be appropriately combined from different embodiments.

[0069] For example, a user can share the generated 3D content with one or more other users. It can be transmitted, for example, via SNS (Social Networking Service) from a 3D content generation device operated by one user to a 3D content generation device operated by another user.

[0070] The user usage fee for the 3D content viewing service according to one embodiment may be free or charged. When it is charged, it may be in a fee form where a charge is imposed each time 3D content is viewed, or it may be in a fee form where a charge is imposed at regular intervals.

Explanation of Reference Numerals

[0071] 1…3D content generation device, 11…communication unit, 12…information processing unit, 13…recording unit, 21…2D image acquisition unit, 23…depth information acquisition unit, 25…input reception unit, 27…adjustment unit, 29…3D content generation unit, 31…display control unit, 33…depth information change unit, 200…computer, 201…processor, 202…main recording device, 203…auxiliary recording device, 204…input / output interface, 205…communication interface, 206…bus line.

Claims

1. An information processing device having a display surface for displaying 3D content, A first acquisition unit that acquires 2D content; A second acquisition unit that acquires depth information of the 2D content based on the 2D content; an adjustment unit that, when a predetermined film necessary for a user to watch the 3D content is arranged on the display surface, executes an adjustment process based on an arrangement state of the display surface and the predetermined film; a generating unit that generates the 3D content based on the 2D content and the depth information according to an execution status of the adjustment process, The adjustment process includes a plurality of adjustment processes, The plurality of adjustment processes include: a first adjustment process for adjusting a positional misalignment between the display surface and the predetermined film based on a lens shape of the predetermined film, and a second adjustment process for adjusting a parallax when the user views the 3D content, the generation unit generates the 3D content when the second adjustment process is executed after the first adjustment process. Information processing device.

2. The adjustment unit executes the second adjustment process based on focal length information obtained by detecting the pupil of the user. The information processing device according to claim 1 .

3. A display control unit that displays the 3D content on the display surface, The generation unit deletes the 3D content after the 3D content is displayed on the display surface. The information processing device according to claim 1 .

4. a display control unit that displays the 2D content and the 3D content on the display surface, the display control unit switches the 3D content to the 2D content when the user inputs an operation while the 3D content is being displayed on the display surface, The information processing device according to claim 1 .

5. a display control unit that displays the 3D content on the display surface; and a change unit that changes depth information associated with the 3D content in response to an operation input by the user when the 3D content is displayed on the display surface. The information processing device according to claim 1 .

6. Further comprising a display control unit for displaying the 3D content on the display surface, When the generation unit receives an input for selecting a specific 2D content from one or more of the 2D content, the generation unit converts the specific 2D content into 3D content as a plurality of different segment data; The display control unit displays the converted plurality of different segment data as the 3D content in a predetermined order. The information processing device according to claim 1 .

7. An information processing method executed by an information processing device having a display surface for displaying 3D content, comprising: obtaining 2D content; obtaining depth information of the 2D content based on the 2D content; When a predetermined film necessary for a user to view the 3D content is arranged on the display surface, executing an adjustment process based on an arrangement state of the display surface and the predetermined film; generating the 3D content based on the 2D content and the depth information according to an execution status of the adjustment process; The adjustment process includes a plurality of adjustment processes, The plurality of adjustment processes include: a first adjustment process for adjusting a positional misalignment between the display surface and the predetermined film based on a lens shape of the predetermined film, and a second adjustment process for adjusting a parallax when the user views the 3D content, the generating step generates the 3D content when the second adjustment process is executed after the first adjustment process. Information processing methods.

8. An information processing device having a display surface for displaying 3D content, A first acquisition unit that acquires 2D content; A second acquisition unit that acquires depth information of the 2D content based on the 2D content; an adjustment unit that, when a predetermined film necessary for a user to watch the 3D content is arranged on the display surface, executes an adjustment process based on an arrangement state of the display surface and the predetermined film; a generating unit that generates the 3D content based on the 2D content and the depth information according to an execution status of the adjustment process; Function as a The adjustment process includes a plurality of adjustment processes, The plurality of adjustment processes include: a first adjustment process for adjusting a positional misalignment between the display surface and the predetermined film based on a lens shape of the predetermined film, and a second adjustment process for adjusting a parallax when the user views the 3D content, The generation unit generates the 3D content when the second adjustment process is executed after the first adjustment process.

Images