An information processing method, apparatus and electronic device

Abstract

The application discloses an information processing method, device and electronic equipment. The information processing method comprises the following steps: acquiring scene content information of a 3D scene to be displayed; determining spatial information corresponding to a user's eyes in a current space to obtain the user's eye spatial information, wherein the user's eye spatial information at least comprises visual angles of the user's eyes relative to a plurality of naked-eye 3D display screens arranged in the current space; and then generating, according to the scene content information of the 3D scene to be displayed and the user's eye spatial information, a to-be-displayed image of a naked-eye 3D effect at least matching a visual angle of each naked-eye 3D display screen corresponding to a user for each naked-eye 3D display screen, and finally outputting each to-be-displayed image to the corresponding naked-eye 3D display screen for display.

Description

Technical Field

[0001] This application belongs to the field of human-computer interaction technology, and in particular relates to an information processing method, apparatus and electronic device. Background Technology

[0002] Currently, when constructing immersive spaces that do not require glasses or head-mounted devices, multiple 2D screens are typically used, such as Microsoft's Virtual Cube. However, 2D screens lack the ability to perceive depth through binocular parallax, resulting in insufficient sense of presence. Summary of the Invention

[0003] Therefore, this application discloses the following technical solution:

[0004] An information processing method, the method comprising:

[0005] Obtain scene content information of the 3D scene to be displayed;

[0006] Determine the spatial information corresponding to the user's eyes in the current space to obtain the user's eye spatial information; the eye spatial information includes at least the viewing angle of the user's eyes relative to multiple naked-eye 3D displays arranged in the current space;

[0007] Based on the scene content information of the 3D scene and the eye space information, generate an image to be displayed for each naked-eye 3D display screen that matches at least the user's viewing angle; the image to be displayed is an image with naked-eye 3D effect;

[0008] Each image to be displayed is output to its corresponding glasses-free 3D display screen.

[0009] Optionally, generating an image to be displayed for each glasses-free 3D display screen that matches at least the corresponding user's viewing angle includes:

[0010] Generate at least a left parallax image and a right parallax image that match the user's viewpoint for each naked-eye 3D display screen;

[0011] The left and right parallax images corresponding to each naked-eye 3D display screen are interleaved to obtain interleaved images of the naked-eye 3D effect corresponding to each naked-eye 3D display screen, which are used as the images to be displayed.

[0012] Optionally, determining the spatial information corresponding to the user's eye in the current space to obtain the user's eye spatial information includes:

[0013] Obtain the screen position information of the multiple glasses-free 3D displays in the current space;

[0014] Obtain the position information of both eyes obtained by tracking the user's eyes;

[0015] Based on the screen position information and the eye position information, determine the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, as the eye space information; or, determine the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, and the first and second distances of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, as the eye space information.

[0016] Optionally, generating an image to be displayed for each naked-eye 3D display screen, based on the scene content information of the 3D scene and the eye space information, at least matching the corresponding user's viewing angle, includes:

[0017] Based on the user's left eye's first viewing angle relative to each naked-eye 3D display screen, or based on the user's left eye's first viewing angle and first distance relative to each naked-eye 3D display screen, the scene content information of the 3D scene is subjected to 2D projection processing to obtain the left parallax image corresponding to each naked-eye 3D display screen.

[0018] Based on the user's right eye's second viewing angle relative to each naked-eye 3D display, or based on the user's right eye's second viewing angle and second distance relative to each naked-eye 3D display, the scene content information of the 3D scene is subjected to 2D projection processing to obtain the right parallax image corresponding to each naked-eye 3D display.

[0019] The left and right parallax images corresponding to each naked-eye 3D display screen are interleaved to obtain interleaved images of the naked-eye 3D effect corresponding to each naked-eye 3D display screen, which are used as the images to be displayed.

[0020] Optionally, obtaining the screen position information corresponding to the plurality of naked-eye 3D displays in the current space includes:

[0021] The position information of each screen is obtained by mapping each naked-eye 3D display to a calibrated spatial coordinate system; wherein, each naked-eye 3D display is arranged according to a preset positional relationship in the current space.

[0022] Optionally, generating an image to be displayed for each glasses-free 3D display screen that matches at least the corresponding user's viewing angle includes:

[0023] In the multi-screen unified scene mode, a complete area image of the 3D scene that matches at least the corresponding user's viewpoint is generated for each naked-eye 3D display screen, as the image to be displayed;

[0024] In the multi-screen independent scene mode, images of different local areas of the 3D scene that match at least the user's perspective are generated for each naked-eye 3D display screen as the images to be displayed.

[0025] Optionally, generating images of different local regions of the 3D scene for each naked-eye 3D display screen, at least matching the corresponding user's viewpoint, includes:

[0026] The scene content information of the 3D scene is segmented based on a preset segmentation strategy to obtain the sub-scene content information of multiple sub-scenes, the number of which is the number of naked-eye 3D displays.

[0027] Based on the sub-scene content information of the multiple sub-scenes, sub-scene region images that at least match the different sub-scenes of their respective user perspectives are generated for each naked-eye 3D display screen.

[0028] Optionally, the sub-scene content information of each sub-scene does not overlap with each other, or the sub-scene content information of adjacent sub-scenes partially overlaps.

[0029] An information processing apparatus, the apparatus comprising:

[0030] The acquisition unit is used to acquire scene content information of the 3D scene to be displayed;

[0031] A determining unit is used to determine the spatial information corresponding to the user's eyes in the current space, thereby obtaining the user's eye spatial information; the eye spatial information includes at least the viewing angle of the user's eyes relative to multiple naked-eye 3D displays arranged in the current space; a generating unit is used to generate, based on the scene content information of the 3D scene and the eye spatial information, an image to be displayed for each naked-eye 3D display that at least matches the user's corresponding viewing angle; the image to be displayed is an image with a naked-eye 3D effect;

[0032] The output unit is used to output each image to be displayed to the corresponding naked-eye 3D display screen.

[0033] An electronic device, comprising:

[0034] Memory, used to store at least one set of computer instructions;

[0035] A processor is configured to implement the information processing method described in any of the preceding descriptions by invoking and executing the instruction set stored in the memory.

[0036] As can be seen from the above solutions, the information processing method, apparatus, and electronic device disclosed in this application obtain scene content information of the 3D scene to be displayed, determine the spatial information corresponding to the user's eyes in the current space, and obtain the user's eye spatial information. The user's eye spatial information includes at least the viewing angle of the user's eyes relative to multiple naked-eye 3D displays arranged in the current space. Then, based on the scene content information of the 3D scene to be displayed and the user's eye spatial information, an image to be displayed that matches at least the naked-eye 3D effect corresponding to the user's viewing angle is generated for each naked-eye 3D display. Finally, each image to be displayed is output to the corresponding naked-eye 3D display for display.

[0037] For the 3D scene to be displayed, this application uses multiple glasses-free 3D displays to display information, and specifically generates a display image for each glasses-free 3D display that matches at least the corresponding user's viewing angle. This achieves the construction of an immersive space based on multiple glasses-free 3D displays, and the display of glasses-free 3D effects across multiple screens and viewing angles based on this immersive space. The sense of depth brought by the binocular parallax of the glasses-free 3D displays gives users a strong sense of presence, and the construction of an immersive space using multiple glasses-free 3D displays provides users with a wider field of view, resulting in a more intense overall immersive experience. Attached Figure Description

[0038] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0039] Figure 1 This is a flowchart illustrating the information processing method provided in this application;

[0040] Figure 2 This is a flowchart illustrating the process of determining the eye space information corresponding to the user's eye in the current space, as provided in this application.

[0041] Figure 3 This is an example diagram of the layout of three glasses-free 3D displays according to a preset positional relationship provided in this application;

[0042] Figure 4 This is a flowchart illustrating the process of generating images to be displayed for each naked-eye 3D display screen, as provided in this application.

[0043] Figure 5 This application provides for the purpose of... Figure 3The example is a processing logic diagram for generating an image to be displayed for each glasses-free 3D display;

[0044] Figure 6 This is a processing logic diagram for generating an image to be displayed for each naked-eye 3D display screen under the multi-screen unified scene mode provided in this application;

[0045] Figure 7 This is a processing logic diagram for generating images to be displayed for each naked-eye 3D display screen in the multi-screen independent scene mode provided in this application;

[0046] Figure 8 This is a structural diagram of the information processing device provided in this application;

[0047] Figure 9 This is a structural diagram of the electronic device provided in this application. Detailed Implementation

[0048] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0049] This application discloses an information processing method, apparatus, and electronic device for constructing an immersive space based on multiple glasses-free 3D displays, eliminating the need for glasses and head-mounted devices, and for displaying glasses-free 3D effects across multiple screens and viewing angles of the 3D scene to be displayed based on the constructed immersive space. The disclosed information processing method can be applied to, but is not limited to, electronic devices in numerous general-purpose or dedicated computing environments or configurations, such as personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor devices, etc.

[0050] See Figure 1 The provided information processing method flowchart, the information processing method disclosed in the embodiments of this application, may include the following processing steps:

[0051] Step 101: Obtain the scene content information of the 3D scene to be displayed.

[0052] The scene content information of the 3D scene to be displayed may include, but is not limited to, the three-dimensional scene content information of 3D games, 3D modeling (such as 3D room models in VR house viewing), etc., depending on the user's current actual application situation.

[0053] Taking a 3D game scene as an example, the scene content information of the acquired 3D scene can include the 3D models of various scene objects such as characters, equipment, and background objects in the 3D game scene to be displayed, as well as the textures, colors, and other information of each displayable structural surface contained in the 3D models of various scene objects. All of this information can be regarded as the 3D stereoscopic scene content information of the 3D game scene.

[0054] Step 102: Determine the spatial information corresponding to the user's eyes in the current space to obtain the user's eye spatial information.

[0055] The user's eye spatial information includes at least the user's eye viewing angles relative to multiple glasses-free 3D displays arranged in the current space. Optionally, the user's eye viewing angles relative to the glasses-free 3D displays can be divided into a first viewing angle of the user's left eye relative to the glasses-free 3D displays, and a second viewing angle of the user's right eye relative to the glasses-free 3D displays.

[0056] Optionally, the user's eye viewing angle relative to the naked-eye 3D display screen, such as the first viewpoint and the second viewpoint, can further include the viewing direction and angle of the user's eye (left or right eye) relative to the naked-eye 3D display screen. The viewing direction can be one of the following: looking straight ahead, looking to the side, or looking down from a standing position. Among them, looking to the side is further divided into looking to the left and looking to the right. The viewing angle is the actual viewing angle of the human eye (left or right eye) relative to the naked-eye 3D display screen under the corresponding viewing direction. For example, the left eye / right eye has a 90° viewing angle relative to a certain naked-eye 3D display screen, and a 30° viewing angle relative to another naked-eye 3D display screen, etc.

[0057] In addition to including the user's eye views relative to multiple glasses-free 3D displays, such as a first view and a second view, in other embodiments, the user's eye spatial information may also include a first distance and a second distance between the user's left and right eyes and each glasses-free 3D display.

[0058] See Figure 2 As shown, step 102 specifically determines the spatial information corresponding to the user's eye in the current space through the following processing procedure:

[0059] Step 201: Obtain the screen position information of multiple naked-eye 3D displays in the current space.

[0060] This application embodiment employs multiple glasses-free 3D displays to construct an immersive space that eliminates the need for glasses or head-mounted devices. The multiple glasses-free 3D displays are arranged in a preset positional relationship within the current space. For example, each pair of adjacent screens can be arranged sequentially with a set angle (e.g., 120° or 135°) and a set distance. Taking three glasses-free 3D displays as an example... Figure 3 The image shows a layout rendering of three glasses-free 3D displays arranged sequentially with each pair of adjacent screens at a 135° angle and a certain distance between them.

[0061] Each naked-eye 3D display is driven and processed by the same electronic device (such as a PC host) with processing capabilities.

[0062] In one embodiment, the user can configure the positional layout information, such as the angle and distance between adjacent screens, as needed, and place each naked-eye 3D display screen in the corresponding position according to the configured information. Based on this, an electronic device, such as a PC host, maps each naked-eye 3D display screen to the constructed calibration spatial coordinate system according to the configured positional layout information of each screen, thereby obtaining the spatial position information of each naked-eye 3D display screen in the calibration spatial coordinate system.

[0063] For example, calibrating a spatial coordinate system can, but is not limited to, using a display screen located in the center (such as...). Figure 3 The three-dimensional coordinate system is defined with the center of the screen (geometric center of the screen) of the display screen 2) as the origin, the width and height of the display screen at the center position as the x and y axes respectively, and the direction perpendicular to the plane of the display screen as the z axis.

[0064] In other implementations, users can directly place each naked-eye 3D display screen at the required angle and distance according to their needs, without configuring position information. The electronic device uses RGB cameras, infrared cameras, and / or distance sensors to collect image information and / or distance information of each naked-eye 3D display screen, and detects the relative position information of each naked-eye 3D display screen based on the collected information, such as the angle and distance between adjacent screens. Then, based on the detected relative position information between each display screen, each display screen is mapped to the constructed calibration space coordinate system.

[0065] In step 201, the spatial position information of each screen obtained by mapping each naked-eye 3D display screen to the calibration spatial coordinate system through any of the above embodiments can be obtained, and the position information of each naked-eye 3D display screen in the calibration spatial coordinate system can be used as the screen position information corresponding to each screen in the current space.

[0066] The screen position information of the naked-eye 3D display in the current space can be represented by, but is not limited to, the three-dimensional position coordinates of each vertex of the display.

[0067] Step 202: Obtain the position information of both eyes obtained by tracking the user's eyes.

[0068] Optionally, this application may pre-set one or more eye-tracking components in the current space. Specifically, the eye-tracking components may be set inside the naked-eye 3D display screen (i.e., the eye-tracking components are a component of the naked-eye 3D display screen), such as setting eye-tracking components in the corresponding area of ​​the upper edge of the screen of each naked-eye 3D display screen, but it is not limited to this. The eye-tracking components may also be set outside the naked-eye 3D display screen, making them independent of the naked-eye 3D display screen. There is no limitation on this.

[0069] Based on this, eye tracking components can be used to track the user's eyes and obtain the position information of the user's eyes.

[0070] It is easy to understand that the user's binocular position information can include the spatial position information of the user's left and right eyes in the constructed calibration coordinate system, specifically, but not limited to, the three-dimensional position coordinates of the geometric center of the human eye (left eye and right eye).

[0071] The eye-tracking component can be, but is not limited to, a camera, such as an infrared camera and / or an RGB camera, and can be a monocular or binocular camera. Preferably, the eye-tracking component is a binocular infrared camera. By using multiple binocular infrared cameras to collect infrared image information of the human eye, and analyzing the human eye position based on the collected infrared image information, eye tracking is achieved to obtain the user's binocular position information.

[0072] Step 203: Based on the obtained screen position information and the user's eye position information, determine the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, as the user's eye space information; or, determine the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, and the first and second distances of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, as the user's eye space information.

[0073] Subsequently, based on the screen position information of each glasses-free 3D display and the position information of the user's left and right eyes, the first viewing angle of the user's left eye relative to each glasses-free 3D display and the second viewing angle of the user's right eye relative to each glasses-free 3D display can be determined. Taking the left eye as an example, the viewing direction of the user's left eye relative to each glasses-free 3D display can be determined, such as looking straight ahead, looking to the side (left side, right side), or looking down, as well as the specific viewing angle under the corresponding viewing direction. The determined viewing direction and viewing angle constitute the first viewing angle of the user's left eye relative to each glasses-free 3D display. The process of determining the second viewing angle of the right eye is similar. The determined first and second viewing angles of the user's left and right eyes relative to each glasses-free 3D display are used as the user's ocular spatial information.

[0074] In other embodiments, in addition to determining the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, the first distance of the user's left eye relative to each naked-eye 3D display screen and the second distance of the user's right eye relative to each naked-eye 3D display screen can be calculated based on the obtained screen position information of each naked-eye 3D display screen and the position information of the user's left and right eyes. The determined first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, as well as the first and second distances, are used as the user's eye space information.

[0075] Step 103: Based on the scene content information of the 3D scene and the user's eye space information, generate an image to be displayed for each naked-eye 3D display screen that matches at least the user's viewpoint; the generated image to be displayed is an image with naked-eye 3D effect.

[0076] After acquiring the scene content information of the 3D scene to be displayed and determining the eye space information corresponding to the user's eyes in the current space, the electronic device, such as a PC host, can generate at least a left parallax image and a right parallax image matching the user's viewpoint for each naked-eye 3D display screen based on the acquired scene content information of the 3D scene to be displayed and the eye space information corresponding to the user's eyes in the current space. The left parallax image and the right parallax image corresponding to each naked-eye 3D display screen are interleaved to obtain an interleaved image of the naked-eye 3D effect corresponding to each naked-eye 3D display screen, which is used as the image to be displayed for each screen.

[0077] Regarding the user's eye-space information, including the aforementioned first and second perspectives, or a combination of the aforementioned first and second perspectives and a first and second distance, see [link to relevant documentation]. Figure 4 The process of generating images to be displayed for each naked-eye 3D display screen that at least match the user's viewing angle can be further implemented as follows:

[0078] Step 401: Based on the user's left eye's first viewing angle relative to each naked-eye 3D display screen, or based on the user's left eye's first viewing angle and first distance relative to each naked-eye 3D display screen, perform 2D projection processing on the scene content information of the 3D scene to be displayed to obtain the left parallax image corresponding to each naked-eye 3D display screen.

[0079] The user's eye spatial information includes the user's left and right eye spatial information, such as the first viewing angle of the left eye relative to each naked-eye 3D display screen, or the first viewing angle and first distance of the left eye relative to each naked-eye 3D display screen, and the second viewing angle of the right eye relative to each naked-eye 3D display screen, or the second viewing angle and second distance of the right eye relative to each naked-eye 3D display screen. The scene content information of the 3D scene to be displayed includes stereoscopic scene content information from all angles of the 3D scene, such as the 3D models of various scene objects in a 3D game scene, including characters, equipment, and background objects, as well as the textures, colors, and other information of all displayable structural surfaces of each scene object. In this embodiment, the 3D scene to be displayed is subjected to two-dimensional projection processing that matches the user's left eye's left eye spatial information relative to each naked-eye 3D display screen, resulting in a left parallax image for each naked-eye 3D display screen that matches the user's left eye. Furthermore, by performing two-dimensional projection processing on the 3D scene to be displayed, matching the user's right eye spatial information relative to each naked-eye 3D display screen, a right parallax image matching the user's right eye is obtained for each naked-eye 3D display screen.

[0080] Specifically, the user's left-eye spatial information only includes the user's left eye's first-view perspective relative to each naked-eye 3D display screen. Specifically, based on the user's left eye's first-view perspective relative to each naked-eye 3D display screen, including the viewing direction (frontal view, side view, top view, etc.) and the viewing angle in the corresponding viewing direction, the 3D scene to be displayed is projected in two dimensions onto the first-view perspective. For example, the 3D model of each scene object in the 3D scene, the texture, color, and other information of each structural surface on the model are projected in two dimensions onto the first-view perspective to obtain the left parallax image corresponding to each naked-eye 3D display screen and matching the user's left eye's first-view perspective.

[0081] For the user's left eye spatial information, including the user's left eye's first viewing angle and first distance relative to each naked-eye 3D display screen, when projecting the 3D scene to be displayed, in addition to using the viewing direction and angle information contained in the first viewing angle as the basis for projection, the first distance of the user's left eye relative to each naked-eye 3D display screen is also taken into consideration. Specifically, the scene depth when projecting the left eye's viewing angle is controlled according to the first distance. The smaller the first distance, the smaller the scene depth; the larger the first distance, the larger the scene depth. This is to enable the user to have different depth perceptions of the 3D scene under the current viewing angle when at different distances from the naked-eye 3D display screen.

[0082] Step 402: Based on the user's right eye's second viewing angle relative to each naked-eye 3D display screen, or based on the user's right eye's second viewing angle and second distance relative to each naked-eye 3D display screen, perform 2D projection processing on the scene content information of the 3D scene to be displayed to obtain the right parallax image corresponding to each naked-eye 3D display screen.

[0083] Similarly, for the user's right eye spatial information, only the second perspective of the user's right eye relative to each naked-eye 3D display screen is included. Specifically, based on the viewing direction (frontal view, side view, top view, etc.) and viewing angle of the user's right eye relative to each naked-eye 3D display screen, the 3D scene to be displayed is projected into the second perspective in two dimensions. For example, the 3D model of each scene object in the 3D scene, the texture, color and other information of each structural surface on the model are projected into the second perspective in two dimensions, so as to obtain the right parallax image of each naked-eye 3D display screen that matches the user's right eye second perspective.

[0084] For the user's right eye spatial information, including the user's right eye's second perspective and second distance relative to each naked-eye 3D display screen, when projecting the 3D scene to be displayed, in addition to using the perspective direction and angle information contained in the second perspective as the basis for projection, the second distance of the user's right eye relative to each naked-eye 3D display screen is also taken into consideration. Specifically, the scene depth when projecting the right eye perspective is controlled according to the second distance, similar to the depth control when projecting the left eye. The smaller the second distance, the smaller the scene depth, and the larger the second distance, the larger the scene depth. This allows the user to have different depth perceptions of the 3D scene under the current perspective when at different distances from the naked-eye 3D display screen.

[0085] Step 403: Interweave the left parallax image and right parallax image corresponding to each naked-eye 3D display screen to obtain the interwoven image of the naked-eye 3D effect corresponding to each naked-eye 3D display screen, which is used as the image to be displayed.

[0086] After obtaining the left and right parallax images corresponding to each naked-eye 3D display, the left and right parallax images corresponding to each naked-eye 3D display are further interleaved to generate an interleaved image corresponding to each naked-eye 3D display.

[0087] Among them, the interwoven image is a naked-eye 3D image, which can present a naked-eye 3D effect when displayed.

[0088] This application embodiment specifically utilizes a preset interlacing algorithm to generate an interlaced image that can present a naked-eye 3D effect for each naked-eye 3D display screen based on the left and right parallax images corresponding to each naked-eye 3D display screen, as well as the naked-eye 3D feature parameter data of each naked-eye 3D display screen and the relative position information between the human eye and the naked-eye 3D display screen.

[0089] Optionally, in this embodiment, the surface of the glasses-free 3D display screen is provided with multiple optical components for achieving a glasses-free 3D effect. These optical components may be, but are not limited to, a series of columnar liquid crystal lenses for achieving a glasses-free 3D effect. The glasses-free 3D characteristic parameters of the glasses-free 3D display screen can be related parameters of the optical components provided on the surface of the display screen, specifically including but not limited to the number of pixels covered by a single liquid crystal lens on the display screen, and information such as the optical parameters of the liquid crystal lens. The optical parameters of the liquid crystal lens can be parameters such as the lens's focal length and thickness.

[0090] Step 104: Output each image to be displayed to its corresponding glasses-free 3D display screen.

[0091] The interlaced images generated for each naked-eye 3D display screen serve as the images to be displayed on each naked-eye 3D display screen. Accordingly, each generated interlaced image can be output one-to-one to the corresponding naked-eye 3D display screen to display the image information of the naked-eye 3D effect.

[0092] See Figure 5 Provided for Figure 3 The example provides a processing logic diagram for generating a glasses-free 3D effect image for each glasses-free 3D display, wherein the image is generated through projection processing of the 3D scene to be displayed. Figure 3 The naked-eye 3D displays 1, 2, and 3 generate matching left and right parallax images. By interlacing the left and right parallax images of each naked-eye 3D display, interlaced images of the naked-eye 3D effect corresponding to each display are obtained. Finally, each interlaced image is output to the corresponding display, realizing the display of naked-eye 3D image information on each display.

[0093] The naked-eye 3D images displayed on each naked-eye 3D display can synchronize with changes in the user's viewing angle based on eye-tracking technology. In addition, optionally, when the distance between the user's eyes and the naked-eye 3D display changes, the depth of the displayed image will also change synchronously with the distance, and the naked-eye 3D image will be magnified / shrunk as the depth changes. This will enable the construction of an immersive space that does not require wearing glasses or head-mounted devices, and simulate the viewing effect of the human eye on a 3D scene from different angles and distances in real-world scenarios.

[0094] In summary, the information processing method of this application, for a 3D scene to be displayed, uses multiple glasses-free 3D displays to display information, and specifically generates an image for each glasses-free 3D display that matches at least the corresponding user's viewing angle for the glasses-free 3D effect. This achieves the construction of an immersive space based on multiple glasses-free 3D displays, and the display of glasses-free 3D effects across multiple screens and viewing angles of the 3D scene to be displayed based on the immersive space. The sense of depth brought by the binocular parallax of the glasses-free 3D displays gives users a strong sense of presence, and the construction of an immersive space using multiple glasses-free 3D displays provides users with a wider field of view, resulting in a more intense overall sense of immersion.

[0095] In one embodiment, optionally, when displaying the multi-screen, multi-view naked-eye 3D effect of a 3D scene based on multiple naked-eye 3D displays, there can be different application modes, mainly including a multi-screen unified scene mode and a multi-screen independent scene mode.

[0096] In the multi-screen unified scene mode, each naked-eye 3D display screen displays a complete area image of the 3D scene to be displayed that matches at least the user's viewing angle. In other words, in this mode, the scene areas displayed by each naked-eye 3D display screen are the same, which are all complete areas of the 3D scene to be displayed. The difference is that the viewing angles of the complete area of ​​the 3D scene to be displayed by each naked-eye 3D display screen are different.

[0097] In the multi-screen independent scene mode, each naked-eye 3D display screen displays different local areas of the 3D scene to be displayed, which are at least matched with the user's viewing angle. In this mode, in addition to the different viewing angles, the scene areas displayed by each naked-eye 3D display screen are also different. The displayed scene areas are different local areas of the 3D scene to be displayed, and the displayed local area images are matched with the user's viewing angle (or viewing angle and distance) relative to the naked-eye 3D display screen.

[0098] In practical applications, users can configure modes as needed. Based on the configured mode, each glasses-free 3D display generates an image to be displayed that matches at least the user's viewing angle. This can be further implemented as follows:

[0099] 11) In the multi-screen unified scene mode, generate a complete area image of the 3D scene that matches at least the user's viewpoint for each naked-eye 3D display screen, as the image to be displayed for each screen.

[0100] In this mode, there is no need to segment the 3D scene to be displayed, combined with [see also...] Figure 6By directly matching the user's viewing angle (e.g., the first viewing angle for the left eye and the second viewing angle for the right eye) or the user's viewing angle and distance (e.g., the first viewing angle and first distance for the left eye and the second viewing angle and second distance for the right eye) of each naked-eye 3D display screen with the corresponding user's viewing angle or the corresponding user's viewing angle and distance, the system can generate a naked-eye 3D effect image for each naked-eye 3D display screen that matches at least its corresponding user's viewing angle.

[0101] 12) In the multi-screen independent scene mode, generate images of different local areas of the 3D scene that match the user's perspective for each naked-eye 3D display screen, as their respective images to be displayed.

[0102] Unlike the previous mode, in the multi-screen independent scene mode, the scene content information of the 3D scene to be displayed can first be segmented based on a preset segmentation strategy to obtain the sub-scene content information of multiple sub-scenes, which is the same as the number of naked-eye 3D displays. Then, based on the sub-scene content information of multiple sub-scenes, sub-scene area images that match at least the user's perspective of each sub-scene are generated for each naked-eye 3D display.

[0103] For example, the above-mentioned preset segmentation strategy may include, but is not limited to, dividing the scene content information of the 3D scene to be displayed into multiple sub-scenes based on the number of naked-eye 3D displays, in a certain order (e.g., according to the layout position of scene objects from left to right or from right to left), and ensuring that the sub-scene content information of each sub-scene does not overlap with each other, or that the sub-scene content information of adjacent sub-scenes partially overlaps.

[0104] Each glasses-free 3D display corresponds one-to-one with each sub-scene. Based on the segmentation of scene content information of the 3D scene to be displayed according to a preset segmentation strategy, such as... Figure 7 As shown, for each naked-eye 3D display screen, the scene content information of its corresponding sub-scene can be obtained, and the sub-scene can be projected to match its corresponding user viewpoint (or viewpoint and distance) to obtain the left and right parallax images of each naked-eye 3D display screen corresponding to its sub-scene. Then, by interlacing the left and right parallax images, the interlaced image of each naked-eye 3D display screen corresponding to its sub-scene can be obtained, and the naked-eye 3D effect image can be displayed on each naked-eye 3D display screen on the interlaced image generated for it.

[0105] Optionally, multi-screen synchronous rendering technology can be used to synchronously display the corresponding interlaced images on multiple naked-eye 3D displays to achieve naked-eye 3D effects.

[0106] This embodiment provides different multi-screen glasses-free 3D application modes, allowing users to select the corresponding mode as needed to construct an immersive space without wearing glasses or head-mounted devices. It also enables multi-screen glasses-free 3D display of the 3D scene to be displayed, allowing multiple glasses-free 3D screens to present multi-angle glasses-free 3D images of the same global scene area, or corresponding angle glasses-free 3D images of different sub-scene areas within the global scene. This satisfies users' diverse needs for constructing immersive 3D spaces. Furthermore, by adopting the solution of this application, the glasses-free 3D display screen provides a strong sense of presence through the depth effect brought by binocular parallax. The multi-screen synchronous rendering technology also provides users with a wider field of view, resulting in a more intense overall immersive experience.

[0107] Corresponding to the information processing method described above, this application also provides an information processing apparatus, the structure of which is as follows: Figure 8 As shown, it includes:

[0108] Acquisition unit 801 is used to acquire scene content information of the 3D scene to be displayed;

[0109] The determining unit 802 is used to determine the spatial information corresponding to the user's eyes in the current space, and obtain the user's eye spatial information; the eye spatial information includes at least the viewing angle of the user's eyes relative to multiple naked-eye 3D displays arranged in the current space;

[0110] The generation unit 803 is used to generate, based on the scene content information of the 3D scene and the eye space information, an image to be displayed that is at least matched to the user's viewing angle for each naked-eye 3D display screen; the image to be displayed is an image of naked-eye 3D effect;

[0111] The output unit 804 is used to output each image to be displayed to the corresponding naked-eye 3D display screen.

[0112] In one embodiment, the generation unit 803 is specifically configured to: generate at least a left parallax image and a right parallax image that match the user's viewpoint for each naked-eye 3D display screen; and perform interleaving processing on the left parallax image and the right parallax image corresponding to each naked-eye 3D display screen to obtain an interleaved image of the naked-eye 3D effect corresponding to each naked-eye 3D display screen, which is used as the image to be displayed.

[0113] In one embodiment, the determining unit 802 is specifically used for:

[0114] Obtain the screen position information of the multiple glasses-free 3D displays in the current space;

[0115] Obtain the position information of both eyes obtained by tracking the user's eyes;

[0116] Based on the screen position information and the eye position information, determine the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, as the eye space information; or, determine the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, and the first and second distances of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, as the eye space information.

[0117] In one embodiment, the generation unit 803 is specifically used for:

[0118] Based on the user's left eye's first viewing angle relative to each naked-eye 3D display screen, or based on the user's left eye's first viewing angle and first distance relative to each naked-eye 3D display screen, the scene content information of the 3D scene is subjected to 2D projection processing to obtain the left parallax image corresponding to each naked-eye 3D display screen.

[0119] Based on the user's right eye's second viewing angle relative to each naked-eye 3D display, or based on the user's right eye's second viewing angle and second distance relative to each naked-eye 3D display, the scene content information of the 3D scene is subjected to 2D projection processing to obtain the right parallax image corresponding to each naked-eye 3D display.

[0120] The left and right parallax images corresponding to each naked-eye 3D display screen are interleaved to obtain interleaved images of the naked-eye 3D effect corresponding to each naked-eye 3D display screen, which are used as the images to be displayed.

[0121] In one embodiment, the determining unit 802, when acquiring the screen position information corresponding to the multiple glasses-free 3D displays in the current space, is specifically used for:

[0122] The position information of each screen is obtained by mapping each naked-eye 3D display to a calibrated spatial coordinate system; wherein, each naked-eye 3D display is arranged according to a preset positional relationship in the current space.

[0123] In one embodiment, the generation unit 803 is specifically used for:

[0124] In the multi-screen unified scene mode, a complete area image of the 3D scene that matches at least the corresponding user's viewpoint is generated for each naked-eye 3D display screen, as the image to be displayed;

[0125] In the multi-screen independent scene mode, images of different local areas of the 3D scene that match at least the user's perspective are generated for each naked-eye 3D display screen as the images to be displayed.

[0126] In one embodiment, the generation unit 803, when generating images of different local regions of the 3D scene that at least match the corresponding user's viewpoint for each naked-eye 3D display screen, is specifically used for:

[0127] The scene content information of the 3D scene is segmented based on a preset segmentation strategy to obtain the sub-scene content information of multiple sub-scenes, the number of which is the number of naked-eye 3D displays.

[0128] Based on the sub-scene content information of the multiple sub-scenes, sub-scene region images that at least match the different sub-scenes of their respective user perspectives are generated for each naked-eye 3D display screen.

[0129] In one embodiment, the sub-scene content information of each sub-scene does not overlap with each other, or the sub-scene content information of adjacent sub-scenes partially overlaps.

[0130] The information processing apparatus disclosed in this application is relatively simple to describe because it corresponds to the information processing method disclosed in the above method embodiments. For any similarities, please refer to the description of the above method embodiments, which will not be detailed here.

[0131] This application also discloses an electronic device, which may be, but is not limited to, a device in a variety of general or special computing device environments or configurations, such as: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor devices, etc.

[0132] The composition and structure of electronic devices, such as Figure 9 As shown, it includes at least:

[0133] Memory 10 is used to store the computer instruction set.

[0134] Computer instruction sets can be implemented in the form of computer programs.

[0135] The processor 20 is configured to implement the information processing method disclosed in any of the above method embodiments by executing a computer instruction set.

[0136] The processor 20 can be a central processing unit (CPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices.

[0137] Electronic devices have a display device and / or have a display interface and can connect to an external display device.

[0138] Optionally, the electronic device may also include a camera assembly, and / or be connected to an external camera assembly.

[0139] In addition to these components, electronic devices may also include communication interfaces, communication buses, and other parts. Memory, processor, and communication interface communicate with each other through the communication bus.

[0140] Communication interfaces are used for communication between electronic devices and other devices. Communication buses can be Peripheral Component Interconnect (PCI) buses or Extended Industry Standard Architecture (EISA) buses, and can be categorized into address buses, data buses, control buses, etc.

[0141] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0142] For ease of description, the above systems or devices are described separately as various modules or units based on their functions. Of course, in implementing this application, the functions of each unit can be implemented in one or more software and / or hardware components.

[0143] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of this application.

[0144] Finally, it should be noted that in this document, relational terms such as first, second, third, and fourth are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0145] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. An information processing method, the method comprising: Obtain scene content information of the 3D scene to be displayed; Determine the spatial information corresponding to the user's eyes in the current space to obtain the user's eye spatial information; The eye space information includes at least: the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen arranged in the current space, or the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen arranged in the current space, and the first and second distances of the user's left and right eyes relative to each naked-eye 3D display screen arranged in the current space. Based on the scene content information of the 3D scene and the eye space information, generate an image to be displayed for each naked-eye 3D display screen that matches at least the user's viewing angle; the image to be displayed is an image with naked-eye 3D effect; Each image to be displayed is output to its corresponding glasses-free 3D display screen; Generate images to be displayed for each glasses-free 3D display screen that are at least matched to the user's viewing angle, including: Based on the user's left eye's first viewing angle relative to each naked-eye 3D display screen, or based on the user's left eye's first viewing angle and first distance relative to each naked-eye 3D display screen, the scene content information of the 3D scene is subjected to 2D projection processing to obtain the left parallax image corresponding to each naked-eye 3D display screen. Based on the user's right eye's second viewing angle relative to each naked-eye 3D display, or based on the user's right eye's second viewing angle and second distance relative to each naked-eye 3D display, the scene content information of the 3D scene is subjected to 2D projection processing to obtain the right parallax image corresponding to each naked-eye 3D display. The left and right parallax images corresponding to each naked-eye 3D display screen are interleaved to obtain interleaved images of the naked-eye 3D effect corresponding to each naked-eye 3D display screen, which are used as the images to be displayed.

2. The method according to claim 1, wherein generating an image to be displayed for each naked-eye 3D display screen that at least matches the corresponding user's viewing angle includes: Generate at least a left parallax image and a right parallax image that match the user's viewpoint for each naked-eye 3D display screen; The left and right parallax images corresponding to each naked-eye 3D display screen are interleaved to obtain interleaved images of the naked-eye 3D effect corresponding to each naked-eye 3D display screen, which are used as the images to be displayed.

3. The method according to claim 1, wherein determining the spatial information corresponding to the user's eye in the current space to obtain the user's eye spatial information includes: Obtain the screen position information of the multiple glasses-free 3D displays in the current space; Obtain the position information of both eyes obtained by tracking the user's eyes; Based on the screen position information and the eye position information, determine the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, as the eye space information; or, determine the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, and the first and second distances of the user's left and right eyes relative to each naked-eye 3D display screen, respectively, as the eye space information.

4. The method according to claim 3, wherein obtaining the screen position information corresponding to the plurality of naked-eye 3D displays in the current space includes: The position information of each screen is obtained by mapping each naked-eye 3D display to a calibrated spatial coordinate system; wherein, each naked-eye 3D display is arranged according to a preset positional relationship in the current space.

5. The method according to claim 1, wherein generating an image to be displayed for each naked-eye 3D display screen that is at least matched to the corresponding user's viewing angle comprises: In the multi-screen unified scene mode, a complete area image of the 3D scene that matches at least the corresponding user's viewpoint is generated for each naked-eye 3D display screen, as the image to be displayed; In the multi-screen independent scene mode, images of different local areas of the 3D scene that match at least the user's perspective are generated for each naked-eye 3D display screen as the images to be displayed.

6. The method according to claim 5, wherein generating images of different local regions of the 3D scene for each naked-eye 3D display screen, at least matching the corresponding user's viewpoint, comprises: The scene content information of the 3D scene is segmented based on a preset segmentation strategy to obtain the sub-scene content information of multiple sub-scenes, the number of which is the number of naked-eye 3D displays. Based on the sub-scene content information of the multiple sub-scenes, sub-scene region images that at least match the different sub-scenes of their respective user perspectives are generated for each naked-eye 3D display screen.

7. The method according to claim 6, wherein, The content information of each sub-scene does not overlap with each other, or the content information of adjacent sub-scenes partially overlaps.

8. An information processing apparatus, the apparatus comprising: The acquisition unit is used to acquire scene content information of the 3D scene to be displayed; The determining unit is used to determine the spatial information corresponding to the user's eye in the current space, thereby obtaining the user's eye spatial information; The eye space information includes at least: the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen arranged in the current space, or the first and second viewing angles of the user's left and right eyes relative to each naked-eye 3D display screen arranged in the current space, and the first and second distances of the user's left and right eyes relative to each naked-eye 3D display screen arranged in the current space. The generation unit is configured to generate, based on the scene content information of the 3D scene and the eye space information, an image to be displayed that is at least matched to the user's viewpoint for each naked-eye 3D display screen; the image to be displayed is an image of naked-eye 3D effect; The output unit is used to output each image to be displayed to the corresponding glasses-free 3D display screen; The generation unit generates images for each glasses-free 3D display screen that are at least matched to the user's viewing angle, including: Based on the user's left eye's first viewing angle relative to each naked-eye 3D display screen, or based on the user's left eye's first viewing angle and first distance relative to each naked-eye 3D display screen, the scene content information of the 3D scene is subjected to 2D projection processing to obtain the left parallax image corresponding to each naked-eye 3D display screen. Based on the user's right eye's second viewing angle relative to each naked-eye 3D display, or based on the user's right eye's second viewing angle and second distance relative to each naked-eye 3D display, the scene content information of the 3D scene is subjected to 2D projection processing to obtain the right parallax image corresponding to each naked-eye 3D display. The left and right parallax images corresponding to each naked-eye 3D display screen are interleaved to obtain interleaved images of the naked-eye 3D effect corresponding to each naked-eye 3D display screen, which are used as the images to be displayed.

9. An electronic device, comprising: Memory, used to store at least one set of computer instructions; A processor is configured to implement the information processing method as described in any one of claims 1-7 by invoking and executing the instruction set stored in the memory.

Images