Stereo naked-eye 3D image playback method, device, equipment and medium

Abstract

The embodiments of the present application disclose a stereo naked-eye 3D picture playback method, device, equipment, and medium. The method includes: determining a target 3D virtual object interacting in a naked-eye 3D picture, and obtaining the current virtual position and virtual motion information of the target 3D virtual object in the naked-eye 3D space corresponding to the naked-eye 3D picture; obtaining the relative position information between the object's eyes and the target 3D virtual object; determining the sound playback parameters of the target 3D virtual object based on the relative position information, the current virtual position, and the virtual motion information; and playing the stereo sound corresponding to the target 3D virtual object in the naked-eye 3D picture based on the sound playback parameters. In this way, the sound playback parameters of the target 3D virtual object are accurately calculated through the relative position information, the current virtual position, and the virtual motion information, and stereo sound with greater spatial realism that is synchronized with the naked-eye 3D picture of the target 3D virtual object is played through the sound playback parameters.

Description

Technical Field

[0001] The present application relates to the field of naked-eye 3D technology, and in particular to a method, device, equipment and medium for playing stereo naked-eye 3D images. Background Art

[0002] With the continuous development of multimedia technology, it has been achieved that when playing naked-eye 3D images, the sound is also played accordingly, thus forming a stereo naked-eye 3D image.

[0003] Related technologies use preset sound parameters for different naked-eye 3D images. When a certain naked-eye 3D image is played, the corresponding sound is played using these sound parameters, thereby achieving a certain degree of stereo playback effect. However, images are often changing, and using preset sound parameters to achieve stereo playback results in a relatively artificial and rigid stereo playback effect, which does not conform to the real-world audio and video synchronization effect. Ultimately, the naked-eye 3D image and stereo sound are out of sync, and the stereo naked-eye 3D image playback effect is unrealistic. Summary of the Invention

[0004] The embodiments of the present application provide a stereo naked-eye three-dimensional image playback method, device, equipment and medium, which can calculate in real time the sound playback parameters corresponding to the position of the target three-dimensional virtual object in the naked-eye three-dimensional image, so as to achieve a real stereo playback effect through the sound playback parameters.

[0005] To achieve the above objectives, an embodiment of the present application provides a method for playing stereoscopic naked-eye 3D images, comprising:

[0006] Determining a target three-dimensional virtual object for interaction in a naked-eye three-dimensional image, and obtaining current virtual position and virtual motion information of the target three-dimensional virtual object in a naked-eye three-dimensional space corresponding to the naked-eye three-dimensional image;

[0007] Acquiring relative position information between the subject's eyes and the target three-dimensional virtual object;

[0008] determining a sound playback parameter of the target three-dimensional virtual object according to the relative position information, the current virtual position, and the virtual motion information;

[0009] The stereo sound corresponding to the target three-dimensional virtual object is played in the naked-eye three-dimensional picture according to the sound playing parameters.

[0010] To achieve the above objectives, an embodiment of the present application provides a stereoscopic naked-eye 3D image playback device, comprising:

[0011] a determination module, configured to determine a target three-dimensional virtual object to be interacted with in a naked-eye three-dimensional picture, and obtain current virtual position and virtual motion information of the target three-dimensional virtual object in a naked-eye three-dimensional space corresponding to the naked-eye three-dimensional picture;

[0012] an acquisition module, configured to acquire relative position information between the eyes of the subject and the target three-dimensional virtual object;

[0013] a generating module, configured to determine sound playback parameters of the target three-dimensional virtual object according to the relative position information, the current virtual position, and the virtual motion information;

[0014] The playing module is configured to play the stereo sound corresponding to the target three-dimensional virtual object in the naked-eye three-dimensional picture according to the sound playing parameters.

[0015] In some embodiments, the relative position information includes the relative distance and orientation angle between the subject's eyes and the target three-dimensional virtual object; the acquisition module is configured to:

[0016] Obtaining the eye positions of the subject's eyes in the naked eye three-dimensional space;

[0017] determining a relative distance between the subject's eyes and the target three-dimensional virtual object based on the eye position and the current virtual position;

[0018] The vertical distance between the eye and the naked-eye three-dimensional display screen is determined, and the azimuth angle between the eye and the target three-dimensional virtual object is determined according to the vertical distance and the relative distance.

[0019] In some embodiments, a generating module is configured to:

[0020] determining a volume parameter corresponding to the target three-dimensional virtual object according to the relative distance;

[0021] Determining volume sub-parameters of different sound channels corresponding to the target three-dimensional virtual object according to the azimuth angle;

[0022] Determining a sound position parameter corresponding to the target three-dimensional virtual object according to the current virtual position;

[0023] determining a volume adjustment parameter corresponding to the target three-dimensional virtual object according to the virtual motion information;

[0024] The sound playback parameter of the target three-dimensional virtual object is generated according to the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter and the volume adjustment parameter.

[0025] In some embodiments, the virtual motion information includes a virtual motion direction and a virtual motion speed; the generating module is configured to:

[0026] determining a first adjustment weight value corresponding to the volume parameter according to the virtual movement direction;

[0027] determining a second adjustment weight value corresponding to the volume parameter according to the virtual movement speed;

[0028] The first adjustment weight value is multiplied by the second adjustment weight value to obtain a volume adjustment parameter corresponding to the target three-dimensional virtual object.

[0029] In some embodiments, a generating module is configured to:

[0030] Determining an environment type of an environment in which the target three-dimensional virtual object is located;

[0031] When the environment type is a closed environment, obtaining sound reflection parameters corresponding to the reflection surface in the closed environment;

[0032] The sound playback parameter of the target three-dimensional virtual object is generated according to the sound reflection parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter and the volume adjustment parameter.

[0033] In some embodiments, the virtual motion information includes a virtual motion trajectory, and the generating module is configured to:

[0034] Determining an environmental virtual object with which the target three-dimensional virtual object interacts in the virtual motion trajectory;

[0035] Determining a sound absorption parameter corresponding to the environmental virtual object;

[0036] The sound playback parameter of the target three-dimensional virtual object is generated according to the sound absorption parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter and the volume adjustment parameter.

[0037] In some embodiments, a generating module is configured to:

[0038] Determining a first material type corresponding to the environmental virtual object and a second material type corresponding to the target three-dimensional virtual object;

[0039] determining, according to the first material type and the second material type, a touch sound parameter corresponding to a touch between the target three-dimensional virtual object and the environment virtual object;

[0040] The sound playback parameter of the target three-dimensional virtual object is generated according to the touch sound parameter, the sound absorption parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter, and the volume adjustment parameter.

[0041] In some embodiments, a generating module is configured to:

[0042] Determining the sound filtering parameters corresponding to the azimuth angle according to a mapping relationship between the preset azimuth angle and the preset head-related transfer function filtering parameters;

[0043] The sound playback parameter of the target three-dimensional virtual object is generated according to the sound filtering parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter and the volume adjustment parameter.

[0044] In some embodiments, a generating module is configured to:

[0045] determining a field of view angle of an eye of a subject and an angle bisector of the field of view angle;

[0046] determining an angle between the relative distance and the angle bisector;

[0047] When the included angle is smaller than a preset angle, generating a sound gain parameter corresponding to the target three-dimensional virtual object;

[0048] The sound playback parameter of the target three-dimensional virtual object is generated according to the sound gain parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter and the volume adjustment parameter.

[0049] In order to achieve the above-mentioned objectives, an embodiment of the present application provides a computer-readable storage medium on the one hand, which stores multiple instructions, and the instructions are suitable for a processor to load to execute the stereo naked-eye three-dimensional image playback method provided by the embodiment of the present application.

[0050] In order to achieve the above-mentioned objectives, an embodiment of the present application provides a computer device on the one hand, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor. When the processor executes the computer program, the stereo naked-eye three-dimensional image playback method provided in the embodiment of the present application is implemented.

[0051] In an embodiment of the present application, a target three-dimensional virtual object interacting in a naked-eye three-dimensional image is determined, and the current virtual position and virtual motion information of the target three-dimensional virtual object in the naked-eye three-dimensional space corresponding to the naked-eye three-dimensional image is obtained; the relative position information between the object's eyes and the target three-dimensional virtual object is obtained; the sound playback parameters of the target three-dimensional virtual object are determined based on the relative position information, the current virtual position, and the virtual motion information; and the stereo sound corresponding to the target three-dimensional virtual object is played in the naked-eye three-dimensional image based on the sound playback parameters. In this way, the current virtual position and virtual motion information of the target three-dimensional virtual object interacting in the naked-eye three-dimensional image is determined in the naked-eye three-dimensional space, and then the relative position information between the object's eyes and the target three-dimensional virtual object is obtained. The sound playback parameters of the target three-dimensional virtual object are determined based on the relative position information, the current virtual position, and the virtual motion information, and then the stereo sound corresponding to the target three-dimensional virtual object is played in the naked-eye three-dimensional image based on the sound playback parameters. That is to say, the sound playback parameters of the target three-dimensional virtual object are accurately calculated through relative position information, current virtual position and virtual motion information, and stereo sound with greater spatial realism is played through the sound playback parameters, which is synchronized with the naked-eye three-dimensional picture of the target three-dimensional virtual object. Compared with the related art that uses preset sound parameters to achieve stereo playback, which will result in a relatively false and rigid stereo playback effect, this application can ensure that the object can hear a stereo playback effect that is more in line with the real world when watching the target three-dimensional virtual object.

[0052] Other features and advantages of the present application will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present application. The purposes and other advantages of the present application can be achieved and obtained through the structures particularly pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0054] Figure 1 2 is a schematic diagram of a system framework corresponding to the stereo naked-eye 3D image playback method provided in an embodiment of the present application;

[0055] Figure 2 1 is a schematic diagram of a scene of a method for playing stereo naked-eye 3D images provided in an embodiment of the present application;

[0056] Figure 31 is a flow chart of a method for playing stereoscopic naked-eye 3D images provided in an embodiment of the present application;

[0057] Figure 4 is a schematic diagram of the field of view provided in an embodiment of the present application;

[0058] Figure 5 This is another flowchart of the method for playing stereoscopic naked-eye 3D images provided by an embodiment of the present application;

[0059] Figure 6 2 is a schematic structural diagram of a stereo naked-eye 3D image playback device provided in an embodiment of the present application;

[0060] Figure 7 It is a structural diagram of the computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] In order to enable those skilled in the art to better understand the solutions of this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making any creative efforts shall fall within the scope of protection of this application.

[0062] It should be noted that in each specific embodiment of the present application, when it comes to the need to perform relevant processing based on the user's head data, eye data, and other data, the user's permission or consent will be obtained first, and the collection, use, and processing of such data will comply with relevant laws, regulations, and standards. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the embodiment of the present application will be obtained.

[0063] Some processes described in the specification, claims, and figures include multiple steps that appear in a specific order. However, it should be understood that these steps may be performed in a different order or in parallel. Step numbers are used solely to distinguish between different steps and do not inherently indicate any order of execution. Furthermore, terms such as "first," "second," or "target" are used to distinguish similar objects and are not necessarily intended to describe a specific order or precedence.

[0064] The embodiments of the present application provide a method, device, computer equipment and storage medium for playing stereo naked-eye three-dimensional images. Specifically, the embodiments of the present application will be described from the perspective of a stereo naked-eye three-dimensional image playback device. The stereo naked-eye three-dimensional image playback device can be specifically integrated into a computer device, which can be a server or a terminal or other device. Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Among them, the terminal can be a smart phone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, smart home appliance, car terminal, intelligent voice interaction device, aircraft, etc., but is not limited to this. The embodiments of the present application can be applied to various scenarios, including but not limited to games, naked-eye three-dimensional image playback and other scenarios.

[0065] Before further explaining the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations:

[0066] Glasses-free 3D refers to the ability to view 3D images with the naked eye, without the aid of special glasses or other auxiliary equipment. Glasses-free 3D technology primarily utilizes the human eye's parallax principle. Due to the different positions of the two eyes, the images seen by each eye differ slightly. Glasses-free 3D technology uses a special screen design or optical device to project images from different perspectives into the left and right eyes, creating a sense of three-dimensionality in the brain. Common glasses-free 3D technologies include parallax barrier technology and lenticular lens technology. The parallax principle of the human eye states that due to the different positions of the two eyes, when viewing the same object, different perspectives are generated, resulting in different images on the retina. The brain processes and fuses these two slightly different images to create a sense of three-dimensionality and depth.

[0067] Positive parallax: Parallax when the left view of an object on the display screen is on the left and the right view is on the right. When viewing an object with positive parallax, the perceived object is behind the display screen.

[0068] Negative parallax: This occurs when the left view of an object on a display screen is on the right, and the right view is on the left. When viewing an object with negative parallax, the object appears to be in front of the display screen. Stereoscopic vision, which provides images with parallax to each eye, is synthesized by the brain to produce a three-dimensional perception. This is recognized as one of the primary mechanisms for stereoscopic vision. For example, computer equipment reproduces image signals containing parallax information as images with parallax, thus creating stereoscopic vision.

[0069] The above is an introduction to the relevant terms of naked-eye 3D technology. If other terms are involved later in the text, they will be explained later.

[0070] First, let’s explain the technical problems existing in related technologies:

[0071] With the continuous development of multimedia technology, it has been achieved that when playing naked-eye 3D images, the sound is also played accordingly, thus forming a stereo naked-eye 3D image.

[0072] Related technologies use preset sound parameters for different naked-eye 3D images. When a certain naked-eye 3D image is played, the corresponding sound is played using these sound parameters, thereby achieving a certain degree of stereo playback effect. However, images are often changing, and using preset sound parameters to achieve stereo playback results in a relatively artificial and rigid stereo playback effect, which does not conform to the real-world audio and video synchronization effect. Ultimately, the naked-eye 3D image and stereo sound are out of sync, and the stereo naked-eye 3D image playback effect is unrealistic.

[0073] To address this technical problem, embodiments of the present application provide a method, apparatus, device, and medium for playing stereo naked-eye 3D images. By determining the current virtual position and virtual motion information of a target 3D virtual object interacting in the naked-eye 3D image in naked-eye 3D space, the relative position information between the subject's eyes and the target 3D virtual object is then obtained. Sound playback parameters for the target 3D virtual object are determined based on the relative position information, current virtual position, and virtual motion information. The stereo sound corresponding to the target 3D virtual object is then played in the naked-eye 3D image based on the sound playback parameters. In other words, the sound playback parameters for the target 3D virtual object are accurately calculated based on the relative position information, current virtual position, and virtual motion information. The sound playback parameters are then used to play stereo sound that is synchronized with the naked-eye 3D image of the target 3D virtual object and has a more spatially realistic feel. Compared to related art solutions that achieve stereo playback by presetting sound parameters, which can result in a more artificial and rigid stereo playback effect, the present application ensures that the subject can hear a more realistic stereo sound playback effect when viewing the target 3D virtual object.

[0074] The following text will describe in detail the stereo naked-eye 3D image playback method, device, equipment and medium provided by the embodiments of the present application.

[0075] See also Figure 1 , Figure 1 1 is a schematic diagram of a system framework corresponding to the stereoscopic naked-eye 3D image playback method provided in an embodiment of the present application. The stereoscopic naked-eye 3D image playback method provided in an embodiment of the present application can be applied to this system framework.

[0076] It includes a terminal 140, the Internet 130, a gateway 120, a server 110, and the like.

[0077] The terminal 140 or the server 110 may be a device that executes a stereoscopic naked-eye 3D picture playback method.

[0078] Terminal 140 includes, but is not limited to, mobile phones, computers, intelligent voice interaction devices, smart home appliances, in-vehicle terminals, aircraft, and the like. Embodiments of the present application can be applied to various scenarios, including, but not limited to, gaming and naked-eye 3D video playback. Furthermore, it can be a single device or a combination of multiple devices. For example, multiple desktop computers connected via a local area network, sharing a common display, and working collaboratively, collectively constitute terminal 140. Terminal 140 can communicate with Internet 130 via wired or wireless means to exchange data.

[0079] Server 110 refers to a computer system that provides certain services to terminal 140. Compared to ordinary terminal 140, server 110 has higher requirements in terms of stability, security, and performance. Server 110 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0080] Gateway 120, also known as a gateway or protocol converter, implements network interconnection at the transport layer and is a computer system or device that performs a conversion function. It acts as a translator between two systems using different communication protocols, data formats, languages, or even completely different architectures. Gateways can also provide filtering and security functions. Messages sent from terminal 140 to server 110 are sent through gateway 120 to the corresponding server 110. Messages sent from server 110 to terminal 140 are also sent through gateway 120 to the corresponding terminal 140.

[0081] The stereo naked-eye 3D image playback method in the embodiment of the present application can be applied to a variety of scenarios, such as gaming, multimedia playback, etc. The scenarios to which the stereo naked-eye 3D image playback method in the present application is applied are not limited here.

[0082] See also Figure 2 , Figure 2 This is a scene diagram of the stereo naked-eye 3D image playback method provided in an embodiment of the present application.

[0083] Glasses-free 3D technology allows users to see stereoscopic images without the aid of 3D glasses or other auxiliary equipment. This technology, based on left-view and right-view imaging, primarily utilizes the parallax principle of the human eye.

[0084] When the human eye observes an object, the distance between the two eyes (approximately 6-6.5 cm) causes subtle differences in the images seen by the left and right eyes. This difference is called parallax. The brain uses this parallax to perceive the depth and distance of the object, thus forming stereoscopic vision.

[0085] Therefore, by setting up left and right views, and viewing them with the human eye, parallax is created. This allows the brain to perceive naked-eye 3D images based on the principle of parallax. Parallax can be positive or negative. When viewing a 3D virtual object with negative parallax, the object appears to be in front of the display screen. When viewing a 3D virtual object with positive parallax, the object appears to be behind the display screen.

[0086] Based on the above principles, the naked-eye 3D display screen can display 3D virtual objects with a sense of spatial stereo. Users can view the 3D virtual objects through the naked-eye 3D display screen and then interact with the target 3D virtual object among multiple 3D virtual objects.

[0087] In this process, the target three-dimensional virtual object interacting in the naked-eye three-dimensional picture is determined, and the current virtual position and virtual motion information of the target three-dimensional virtual object in the naked-eye three-dimensional space corresponding to the naked-eye three-dimensional picture are obtained; the relative position information between the object's eyes and the target three-dimensional virtual object is obtained; the sound playback parameters of the target three-dimensional virtual object are determined based on the relative position information, the current virtual position and the virtual motion information; and the stereo sound corresponding to the target three-dimensional virtual object is played in the naked-eye three-dimensional picture based on the sound playback parameters.

[0088] In this way, during the movement of the target three-dimensional virtual object in the naked-eye three-dimensional space, the sound playback parameters of the target three-dimensional virtual object are accurately calculated, so that stereo sound with a real sense of space is generated according to the sound playback parameters, thereby achieving the synchronization of the naked-eye three-dimensional picture and stereo sound, thereby increasing the interactive experience between the object and the target three-dimensional virtual object.

[0089] It should be noted that, since the target three-dimensional virtual object is displayed in motion in the naked-eye three-dimensional picture, the subject's human eyes can see the target three-dimensional virtual object by watching the naked-eye three-dimensional picture. When the depth of field of the target three-dimensional virtual object changes, the stereo sound corresponding to the target three-dimensional virtual object can also change with the virtual position of the target three-dimensional virtual object. Based on the human instinct of binaural sound source positioning, this can help the subject concentrate on watching the target three-dimensional virtual object, so that the visual distance of the human eye will also change accordingly. In this way, the visual distance of the human eye can be adjusted, the shape of the human eye lens can be changed, and the effect of alleviating visual fatigue of the human eye can be achieved.

[0090] The stereo naked-eye 3D image playback method, device, equipment and medium in this application will be described in detail later.

[0091] See also Figure 3 , Figure 3 1 is a flow chart of a method for playing stereoscopic naked-eye 3D images provided in an embodiment of the present application. The method for playing stereoscopic naked-eye 3D images may include the following steps:

[0092] Step 210: Determine a target 3D virtual object to be interacted with in the naked-eye 3D image, and obtain current virtual position and virtual motion information of the target 3D virtual object in the naked-eye 3D space corresponding to the naked-eye 3D image;

[0093] Step 220: Obtain relative position information between the subject's eyes and the target three-dimensional virtual object;

[0094] Step 230: Determine the sound playback parameters of the target three-dimensional virtual object based on the relative position information, the current virtual position, and the virtual motion information;

[0095] Step 240: Play the stereo sound corresponding to the target three-dimensional virtual object in the naked-eye three-dimensional image according to the sound playback parameters.

[0096] Steps 210 to 240 will be described in detail below.

[0097] In step 210, a target 3D virtual object for interaction in the naked-eye 3D picture is determined, and the current virtual position and virtual motion information of the target 3D virtual object in the naked-eye 3D space corresponding to the naked-eye 3D picture are obtained.

[0098] Among them, the target three-dimensional virtual object for object interaction can be determined among multiple three-dimensional virtual objects in the naked-eye three-dimensional picture, and then the current virtual position and virtual motion information of the target three-dimensional virtual object in the naked-eye three-dimensional space corresponding to the naked-eye three-dimensional picture can be obtained.

[0099] It should be noted that the naked-eye three-dimensional space and the space of the real physical world can correspond to the same three-dimensional coordinate system. The target three-dimensional virtual object can move in the naked-eye three-dimensional space. During its movement, the current virtual position, that is, the three-dimensional coordinate position in the three-dimensional coordinate system, can be obtained. The virtual motion information can also be obtained. The virtual motion information includes virtual motion trajectory, virtual motion direction, virtual motion direction and virtual motion acceleration, etc.

[0100] In step 220 , relative position information between the subject's eyes and the target three-dimensional virtual object is obtained.

[0101] The object's eye position can be obtained using a three-dimensional coordinate system as a reference. Then, the relative position information between the object's eye and the target three-dimensional virtual object is determined based on the eye position and the current virtual position of the target three-dimensional virtual object. The relative position information includes the relative distance between the object's eye and the target three-dimensional virtual object, i.e., the straight-line distance between the two. The relative position information also includes the azimuth angle between the object's eye and the target three-dimensional virtual object. The azimuth angle includes the vertical and horizontal azimuth angles between the object's eye and the target three-dimensional virtual object.

[0102] In some embodiments, obtaining relative position information between the subject's eyes and the target three-dimensional virtual object includes:

[0103] (1.1) Obtaining the eye positions of the subject in naked eye three-dimensional space;

[0104] (1.2) Determine the relative distance between the subject's eyes and the target three-dimensional virtual object based on the eye position and the current virtual position;

[0105] (1.3) Determine the vertical distance between the eye and the naked-eye 3D display screen, and determine the azimuth angle between the eye and the target 3D virtual object based on the vertical distance and the relative distance.

[0106] In the naked-eye 3D space, there is a corresponding 3D coordinate system. This 3D coordinate system can be used to determine the position of any spatial point in the naked-eye 3D space. This 3D coordinate system can be the same as the 3D coordinate system of the 3D space in the real physical world. The 3D coordinate system can be set as the reference origin or fixed reference point to ensure that the eye and the virtual object's position coordinates are in the same coordinate system, facilitating subsequent orientation calculations. For example, the x-axis is set to the horizontal direction, the y-axis is set to the vertical direction, and the z-axis is set to the depth direction.

[0107] The eye position of the object's eyes can be determined through the three-dimensional coordinate system in the naked eye three-dimensional space. The eye position can be represented by three-dimensional coordinates. For example, the eye position can be represented as (x0, y0, z0), and the current virtual position corresponding to the target three-dimensional virtual object can be represented as (x1, y1, z1).

[0108] Based on the eye position and the current virtual position, the relative distance between the object's eye and the target three-dimensional virtual object is determined. For example, the coordinate value (x0, y0, z0) and the coordinate value (x1, y1, z1) can be calculated to obtain the relative distance between the eye and the target three-dimensional virtual object. The relative distance can be a straight-line distance.

[0109] The vertical distance between the eye and the naked-eye 3D display is then determined, and the azimuth angle between the eye and the target 3D virtual object is determined based on the vertical distance and the relative distance. For example, based on triangle calculation rules, given the relative distance and the vertical distance, the angle between the two sides can be calculated. This angle is the azimuth angle between the eye and the target 3D virtual object.

[0110] In the present application, by calculating the relative position information between the eyes of the object and the target three-dimensional virtual object, the relative position information can help to accurately calculate the sound playback parameters of the target three-dimensional virtual object in the subsequent step.

[0111] In step 230 , the sound playback parameters of the target three-dimensional virtual object are determined according to the relative position information, the current virtual position and the virtual motion information.

[0112] The sound playback parameters of the target three-dimensional virtual object can be determined based on the relative position information, the current virtual position, and the virtual motion information. For example, the sound playback parameters include parameters such as sound position parameters and volume parameters. The sound playback parameters calculated in this way are determined by the actual motion of the target three-dimensional virtual object. Therefore, the sound playback parameters are consistent with the actual motion of the target three-dimensional virtual object. In this way, when the stereo sound of the target three-dimensional virtual object is subsequently played using the sound playback parameters, the stereo sound has a more realistic sound playback effect.

[0113] In some embodiments, determining the sound playback parameters of the target three-dimensional virtual object based on the relative position information, the current virtual position, and the virtual motion information includes:

[0114] (1.1) Determining a volume parameter corresponding to the target three-dimensional virtual object based on the relative distance;

[0115] (1.2) Determining the volume sub-parameters of different sound channels corresponding to the target three-dimensional virtual object based on the azimuth angle;

[0116] (1.3) Determining the sound position parameters corresponding to the target three-dimensional virtual object based on the current virtual position;

[0117] (1.4) determining a volume adjustment parameter corresponding to the target three-dimensional virtual object based on the virtual motion information;

[0118] (1.5) Generate sound playback parameters of the target three-dimensional virtual object according to the volume parameter, the volume sub-parameters of different sound channels, the sound position parameter, and the volume adjustment parameter.

[0119] It can be understood that when the target three-dimensional virtual object is farther away from the object, the volume of the stereo sound corresponding to the target three-dimensional virtual object is smaller, and when the target three-dimensional virtual object is closer to the object, the volume of the stereo sound corresponding to the target three-dimensional virtual object is larger.

[0120] Therefore, the volume parameter corresponding to the target three-dimensional virtual object can be determined based on the relative distance. For example, a first mapping relationship between a preset distance range and a preset volume parameter can be set. After the relative distance is obtained, the volume parameter corresponding to the relative distance can be determined based on the relative distance and the first mapping relationship.

[0121] It is understandable that the stereo sound corresponding to the target three-dimensional virtual object can be generated by playing sound through two or more channels, and the volume of sounds of different channels will affect the playback effect of the stereo sound in space. Therefore, it is necessary to determine the volume sub-parameters of different channels to achieve volume control of different channels.

[0122] Specifically, the volume sub-parameters for different channels corresponding to the target 3D virtual object can be determined based on the azimuth angle. For example, the azimuth angle can be decomposed to obtain the vertical azimuth angle and the horizontal azimuth angle, where the vertical azimuth angle is the azimuth angle of the target 3D virtual object relative to the eye on the vertical plane, and the horizontal azimuth angle is the azimuth angle of the target 3D virtual object relative to the eye on the horizontal plane. The sub-volume parameters for different channels are then set based on the vertical and horizontal azimuth angles.

[0123] Taking dual channels as an example, the calculated horizontal and vertical azimuth angles are mapped to a range that is convenient for channel allocation. For example, the horizontal azimuth angle is converted to an intuitive angle representation of [0, 360°] or [-180°, 180°], and the vertical azimuth angle is converted to [-90°, 90°]. This facilitates the subsequent association of the volume sub-parameter settings of different channels.

[0124] The calculation of the binaural volume sub-parameters leverages the human ear's binaural effect, controlling the volume proportions of the left and right channels based on the azimuth angle to simulate the auditory perception of sounds arriving from different directions. For example, when the horizontal azimuth angle is 0° (the target virtual object is directly in front of the eye), the left and right channel volumes are set equal. When the horizontal azimuth angle is greater than 0° (the target virtual object is to the right of the eye), as the angle increases (e.g., towards 90° to the right), the right channel volume proportion gradually increases, while the left channel proportion decreases.

[0125] The vertical azimuth angle can affect the frequency response of the sound channels or add virtual height channels (if a multi-channel layout is supported). In a two-channel scenario, when the vertical azimuth angle is greater than 0° (the target virtual object is above the eyes), the proportion of high-frequency components in the left and right channels can be appropriately increased to simulate the bright listening experience of "sound sources above." When the vertical azimuth angle is less than 0° (the virtual object is below), the proportion of low-frequency components can be increased to simulate the heaviness of "sound sources below." For example, filtering algorithms can be used to adjust the frequency equalization parameters (EQ) of the sound channels to make sounds from different vertical directions audible and distinguishable.

[0126] Therefore, the volume sub-parameters for the different channels corresponding to the target 3D virtual object can be determined using the azimuth angle. For multi-channel audio, other methods can be used to calculate the volume sub-parameters corresponding to the different channels. This ensures that when multiple channels play sound simultaneously, the position of the combined stereo sound corresponds to the position of the target 3D virtual object in naked-eye 3D space.

[0127] It is understandable that the sound position of the stereo sound in space should be the same as the current virtual position of the target three-dimensional virtual object, so that stereo sound with synchronized sound and picture can be formed.

[0128] Therefore, the sound position parameters corresponding to the target three-dimensional virtual object can be determined based on the current virtual position. The sound position parameters can be used as a standard sound source position. In the subsequent process of generating sound playback parameters, the sound source position can be locked by using the sound position parameters to help further optimize other parameters. For example, the volume sub-parameters of the above-mentioned different channels can be optimized so that when different channels play sounds at the same time, the stereo position matches the sound source position, thereby ensuring the spatial realism of the stereo sound.

[0129] It is understandable that in the real physical world, when an object is in motion, the sound corresponding to the object changes with the object's position.

[0130] Therefore, the volume adjustment parameters corresponding to the target three-dimensional virtual object can be determined based on the virtual motion information. For example, the virtual motion speed and virtual motion direction can be determined based on the virtual motion information. When the virtual motion speed is greater, the volume adjustment amplitude is greater, and when the virtual motion speed is smaller, the volume adjustment amplitude is smaller. When the virtual motion direction is close to the person's head, the volume increases accordingly, and when the virtual motion direction is away from the person's head, the volume decreases accordingly. Therefore, the volume adjustment parameters can truly reflect the volume changes of the target three-dimensional virtual object during movement.

[0131] In some embodiments, the virtual motion information includes a virtual motion direction and a virtual motion speed; and determining a volume adjustment parameter corresponding to the target three-dimensional virtual object based on the virtual motion information includes:

[0132] (1.4.1) Determining a first adjustment weight value corresponding to the volume parameter according to the virtual motion direction;

[0133] (1.4.2) Determining a second adjustment weight value corresponding to the volume parameter according to the virtual motion speed;

[0134] (1.4.3) Multiply the first adjustment weight value by the second adjustment weight value to obtain a volume adjustment parameter corresponding to the target three-dimensional virtual object.

[0135] Among them, the first adjustment weight value corresponding to the volume parameter can be determined according to the virtual movement direction. For example, when the virtual movement direction is close to the user's head as a whole, the first adjustment weight value is a positive weight. When the virtual movement direction is away from the user's head as a whole, the first adjustment weight value is a negative weight.

[0136] The second adjustment weight value corresponding to the volume parameter can be determined based on the virtual movement speed. For example, when the virtual movement speed is greater, the amplitude of the volume adjustment is greater, and the value of the second adjustment weight value is greater. When the virtual movement speed is smaller, the amplitude of the volume adjustment is smaller, and the value of the second adjustment weight value is smaller.

[0137] Finally, the first adjustment weight value can be multiplied by the second adjustment weight value to obtain the volume adjustment parameter corresponding to the target three-dimensional virtual object. The volume adjustment parameter can be used to adjust the volume.

[0138] From the above, it can be seen that the volume parameters, volume sub-parameters of different channels, sound position parameters and volume adjustment parameters are all generated by real-time calculation through relevant information when the object interacts with the target three-dimensional virtual object. Finally, the sound playback parameters of the target three-dimensional virtual object are generated according to the volume parameters, volume sub-parameters of different channels, sound position parameters and volume adjustment parameters. The sound playback parameters obtained in this way are more accurate, and the stereo sound played by the sound playback parameters can be synchronized with the target three-dimensional virtual object in the naked-eye three-dimensional picture, thereby achieving a real stereo naked-eye three-dimensional picture playback effect.

[0139] In some embodiments, generating a sound playback parameter of a target three-dimensional virtual object based on a volume parameter, volume sub-parameters of different sound channels, a sound position parameter, and a volume adjustment parameter includes:

[0140] (2.1) Determining the environment type of the target three-dimensional virtual object;

[0141] (2.2) When the environment type is a closed environment, obtain the sound reflection parameters corresponding to the reflection surface in the closed environment;

[0142] (2.3) Generate sound playback parameters of the target three-dimensional virtual object based on the sound reflection parameter, the volume parameter, the volume sub-parameters of different sound channels, the sound position parameter, and the volume adjustment parameter.

[0143] Among them, the environment type of the target three-dimensional virtual object can be determined. For example, virtual scenes such as "enclosed indoor space" and "open grassland" all correspond to corresponding environment types. For example, the environment type corresponding to the "enclosed indoor space" scene is a enclosed environment, and the environment type corresponding to the "open grassland" scene is an open environment.

[0144] When the environment type is a closed environment, obtain the sound reflection parameters corresponding to the reflective surfaces within the closed environment. For example, the reflective surfaces within the closed environment can be indoor walls or floors. You can obtain the sound reflection parameters corresponding to the indoor walls and floors respectively. When sound is reflected by the reflective surfaces, these sound reflection parameters can be used to calculate the reverberation time, reverberation intensity, and other parameters of the sound.

[0145] Finally, the sound playback parameters for the target 3D virtual object are generated based on the sound reflection parameters, volume parameters, volume sub-parameters for different sound channels, sound position parameters, and volume adjustment parameters. These parameters are calculated in real time and are dynamic parameters. The sound reflection parameters, on the other hand, are inherent to the reflective surface and are static parameters. By combining static and dynamic parameters, we can fully account for environmental factors, the inherent characteristics of the target 3D virtual object, and the human factors between the target 3D virtual object and the subject's eyes, thereby achieving more accurate calculation of the sound playback parameters for the target 3D virtual object.

[0146] In some embodiments, the virtual motion information includes a virtual motion trajectory, and generating sound playback parameters of a target three-dimensional virtual object based on a volume parameter, volume sub-parameters of different sound channels, a sound position parameter, and a volume adjustment parameter includes:

[0147] (3.1) Determine the environment virtual objects that the target three-dimensional virtual object interacts with in the virtual motion trajectory;

[0148] (3.2) Determine the sound absorption parameters corresponding to the virtual objects in the environment;

[0149] (3.3) Generate sound playback parameters of the target three-dimensional virtual object based on the sound absorption parameter, the volume parameter, the volume sub-parameters of different sound channels, the sound position parameter, and the volume adjustment parameter.

[0150] The system identifies virtual objects in the environment that interact with the target 3D virtual object in the virtual motion trajectory, such as floating virtual "clouds," virtual "grass," or virtual "goose down" in naked-eye 3D space. Sound absorption parameters corresponding to these virtual objects are then determined. These sound absorption parameters are sound attribute parameters corresponding to these virtual objects. When sound from the target 3D virtual object propagates to these virtual objects, the virtual objects absorb a portion of the sound based on the sound absorption parameters.

[0151] Finally, the sound playback parameters for the target 3D virtual object are generated based on the sound absorption parameters, volume parameters, volume sub-parameters for different sound channels, sound position parameters, and volume adjustment parameters. These parameters are calculated in real time and are dynamic parameters. The sound absorption parameters, on the other hand, are inherent to the environmental virtual object and are static parameters. By combining static and dynamic parameters, we can fully account for environmental factors, the inherent factors of the target 3D virtual object, and the human factors between the target 3D virtual object and the subject's eyes, thereby achieving more accurate calculation of the sound playback parameters for the target 3D virtual object.

[0152] In some embodiments, generating a sound playback parameter of a target three-dimensional virtual object based on a sound absorption parameter, a volume parameter, volume sub-parameters of different sound channels, a sound position parameter, and a volume adjustment parameter includes:

[0153] (3.3.1) Determining a first material type corresponding to the environment virtual object and a second material type corresponding to the target three-dimensional virtual object;

[0154] (3.3.2) Determining, based on the first material type and the second material type, touch sound parameters corresponding to the contact between the target three-dimensional virtual object and the environment virtual object;

[0155] (3.3.3) Generate sound playback parameters for the target 3D virtual object based on the touch sound parameters, sound absorption parameters, volume parameters, volume sub-parameters of different sound channels, sound position parameters, and volume adjustment parameters.

[0156] It is understandable that when a target three-dimensional virtual object collides with an environment virtual object, the collision sound generated by the collision will also be different due to the different materials corresponding to the target three-dimensional virtual object and the environment virtual object.

[0157] Therefore, the first material type corresponding to the virtual environment object and the second material type of the target 3D virtual object can be determined. For example, material types include metal, wood, stone, plastic, etc., and a material label can be pre-assigned to each material to form a material type database corresponding to different materials. The first material type corresponding to the virtual environment object and the second material type of the target 3D virtual object can then be determined from this material type database.

[0158] When materials of different material types collide, corresponding collision sounds are produced. For example, when wood collides with wood, the collision sound is relatively dull, while when metal collides with metal, the collision sound is relatively crisp. The corresponding touch sound parameters when the target 3D virtual object touches the environment virtual object can be determined based on the first material type and the second material type.

[0159] Finally, the sound playback parameters of the target 3D virtual object are generated based on the touch sound parameters, sound absorption parameters, volume parameters, volume sub-parameters of different sound channels, sound position parameters, and volume adjustment parameters. The volume parameters, volume sub-parameters of different sound channels, sound position parameters, and volume adjustment parameters are all parameters calculated in real time and are dynamic parameters. The touch sound parameters and sound absorption parameters are inherent to the environmental virtual objects and are static parameters. By combining static and dynamic parameters, environmental factors, the inherent factors of the target 3D virtual object, and the human factors of the target 3D virtual object and the object's eyes can be fully considered, thereby achieving more accurate calculation of the sound playback parameters of the target 3D virtual object.

[0160] In some embodiments, generating a sound playback parameter of a target three-dimensional virtual object based on a volume parameter, volume sub-parameters of different sound channels, a sound position parameter, and a volume adjustment parameter includes:

[0161] (4.1) determining a sound filtering parameter corresponding to the azimuth angle based on a mapping relationship between a preset azimuth angle and a preset head-related transfer function filtering parameter;

[0162] (4.2) Generate sound playback parameters of the target three-dimensional virtual object based on the sound filter parameters, volume parameters, volume sub-parameters of different sound channels, sound position parameters, and volume adjustment parameters.

[0163] Among them, since the sound playback parameters are sound-related parameters calculated by a computer, the sound playback parameters need to be filtered to enhance the sounds of some frequency bands, such as enhancing the low frequencies to achieve low-frequency sounds with more obvious sound effects.

[0164] The sound filter parameters corresponding to the azimuth angle can be determined based on the mapping relationship between the preset azimuth angle and the preset head-related transfer function filter parameters. For example, by introducing a personalized or universal HRTF (Head-Related Transfer Function) database, which contains the mapping relationship between the preset azimuth angle and the preset head-related transfer function filter parameters, the corresponding sound filter parameters, i.e., the HRTF filter parameters, are matched according to the azimuth angle (horizontal azimuth angle, vertical azimuth angle) between the user's eyes (associated head) and the target three-dimensional virtual object.

[0165] Finally, the sound playback parameters of the target 3D virtual object are generated based on the sound filtering parameters, volume parameters, volume sub-parameters of different sound channels, sound position parameters, and volume adjustment parameters. Initial sound playback parameters can be generated by combining the volume parameters, volume sub-parameters of different sound channels, sound position parameters, and volume adjustment parameters. Finally, these initial sound playback parameters are filtered using the sound filtering parameters to obtain the sound playback parameters of the target 3D virtual object. The resulting sound playback parameters can enhance certain audio bands of the target 3D virtual object, thereby obtaining sound playback parameters with a better stereo effect.

[0166] In some embodiments, generating a sound playback parameter of a target three-dimensional virtual object based on a volume parameter, volume sub-parameters of different sound channels, a sound position parameter, and a volume adjustment parameter includes:

[0167] (5.1) Determine the subject's eye's field of view and the angle bisector of the field of view;

[0168] (5.2) Determine the angle between the relative distance and the angle bisector;

[0169] (5.3) When the included angle is less than a preset angle, generating a sound gain parameter corresponding to the target three-dimensional virtual object;

[0170] (5.4) Generate sound playback parameters of the target three-dimensional virtual object based on the sound gain parameter, the volume parameter, the volume sub-parameters of different sound channels, the sound position parameter, and the volume adjustment parameter.

[0171] Please combine Figure 4 , Figure 4 Schematic diagram of the field of view provided by an embodiment of the present application. The field of view of the subject's eyes and the angle bisector of the field of view can be determined. For example, when viewing an image, both eyes have a leftmost and a rightmost viewing angle. The leftmost and rightmost viewing angles combine to form the field of view angle, and only objects within this field of view angle can be seen by the subject. After determining the field of view angle, the angle bisector corresponding to the field of view angle can be determined, such as angle bisector L1.

[0172] Then determine the angle between the relative distance and the angle bisector. The relative distance is the straight-line distance between the subject's eye and the target three-dimensional virtual object. The relative distance can be regarded as a line, such as Figure 4 Then determine the angle between L2 and the angle bisector, as Figure 4 As shown, the angle is A1.

[0173] Then, it is determined whether it is less than a preset angle. When the human eye views the scene within the preset angle, the human eye can concentrate more on viewing the scene. Therefore, when the angle is less than the preset angle, the sound gain parameter corresponding to the target three-dimensional virtual object is generated to achieve sound enhancement of the target three-dimensional virtual object, so that the human eye can concentrate more on viewing the target three-dimensional virtual object.

[0174] Finally, the sound playback parameters for the target 3D virtual object are generated based on the sound gain parameters, volume parameters, volume sub-parameters for different sound channels, sound position parameters, and volume adjustment parameters. These parameters are calculated in real time, so the sound playback parameters calculated from these parameters are also actual, not preset.

[0175] In this way, the stereo sound played by the sound playback parameters has a more realistic stereo effect, so that the subject can concentrate more on viewing the target three-dimensional virtual object. As a result, when the human eye views the target three-dimensional virtual object, the visual distance of the eye changes due to the movement of the target three-dimensional virtual object, thereby better alleviating eye fatigue.

[0176] It should be noted that, in this application, the methods for determining sound playback parameters in the above-mentioned embodiments can be combined. For example, the sound playback parameters of the target three-dimensional virtual object can be generated based on sound reflection parameters, sound absorption parameters, sound filtering parameters, sound gain parameters, touch sound parameters, volume parameters, volume sub-parameters of different sound channels, sound position parameters, and volume adjustment parameters. In other words, the above-mentioned embodiments can be arbitrarily combined to generate sound playback parameters.

[0177] In addition, when the sound playback parameters are calculated, the sound playback parameters can be the sound playback parameters of the target three-dimensional virtual object for a period of time in the future, such as the sound playback parameters in the next 2 seconds. The advantage of this is that the number of calculations for the sound playback parameters can be reduced, which reduces the computing pressure of the computer equipment.

[0178] In step 240 , a stereo sound corresponding to the target 3D virtual object is played in the naked-eye 3D image according to the sound playing parameters.

[0179] From the above, it can be seen that after the sound playback parameters are determined, the playback time corresponding to the sound playback parameters can be determined, and stereo sound can be played according to the sound playback parameters within the playback time, thereby achieving synchronization between the stereo sound and the target three-dimensional virtual picture to enhance the realism of the object viewing the target three-dimensional virtual object.

[0180] It should be noted that, since the target three-dimensional virtual object is displayed in motion in the naked-eye three-dimensional picture, the subject's human eyes can see the target three-dimensional virtual object by watching the naked-eye three-dimensional picture. When the depth of field of the target three-dimensional virtual object changes, the stereo sound corresponding to the target three-dimensional virtual object can also change with the virtual position of the target three-dimensional virtual object. Based on the human instinct of binaural sound source positioning, this can help the subject concentrate on watching the target three-dimensional virtual object, so that the visual distance of the human eye will also change accordingly. In this way, the visual distance of the human eye can be adjusted, the shape of the human eye lens can be changed, and the effect of alleviating visual fatigue of the human eye can be achieved.

[0181] In an embodiment of the present application, a target three-dimensional virtual object interacting in a naked-eye three-dimensional image is determined, and the current virtual position and virtual motion information of the target three-dimensional virtual object in the naked-eye three-dimensional space corresponding to the naked-eye three-dimensional image is obtained; the relative position information between the object's eyes and the target three-dimensional virtual object is obtained; the sound playback parameters of the target three-dimensional virtual object are determined based on the relative position information, the current virtual position, and the virtual motion information; and the stereo sound corresponding to the target three-dimensional virtual object is played in the naked-eye three-dimensional image based on the sound playback parameters. In this way, the current virtual position and virtual motion information of the target three-dimensional virtual object interacting in the naked-eye three-dimensional image is determined in the naked-eye three-dimensional space, and then the relative position information between the object's eyes and the target three-dimensional virtual object is obtained. The sound playback parameters of the target three-dimensional virtual object are determined based on the relative position information, the current virtual position, and the virtual motion information, and then the stereo sound corresponding to the target three-dimensional virtual object is played in the naked-eye three-dimensional image based on the sound playback parameters. That is to say, the sound playback parameters of the target three-dimensional virtual object are accurately calculated through relative position information, current virtual position and virtual motion information, and stereo sound with greater spatial realism is played through the sound playback parameters, which is synchronized with the naked-eye three-dimensional picture of the target three-dimensional virtual object. Compared with the related art that uses preset sound parameters to achieve stereo playback, which will result in a relatively false and rigid stereo playback effect, this application can ensure that the object can hear a stereo playback effect that is more in line with the real world when watching the target three-dimensional virtual object.

[0182] See also Figure 5 , Figure 5 1 is another flow chart of the method for playing stereoscopic naked-eye 3D images provided in an embodiment of the present application. The method for playing stereoscopic naked-eye 3D images may include the following steps:

[0183] Step 301: Determine a target 3D virtual object to be interacted with in a naked-eye 3D image, and obtain current virtual position and virtual motion information of the target 3D virtual object in a naked-eye 3D space corresponding to the naked-eye 3D image;

[0184] Step 302: Obtain the eye positions of the subject in the naked eye three-dimensional space.

[0185] Step 303: Determine the relative distance between the subject's eyes and the target three-dimensional virtual object based on the eye position and the current virtual position;

[0186] Step 304: Determine the vertical distance between the eye and the naked-eye 3D display screen, and determine the orientation angle between the eye and the target 3D virtual object based on the vertical distance and the relative distance;

[0187] Step 305: Determine the volume parameter corresponding to the target three-dimensional virtual object according to the relative distance;

[0188] Step 306: Determine volume sub-parameters of different sound channels corresponding to the target three-dimensional virtual object according to the azimuth angle;

[0189] Step 307: Determine the sound position parameters corresponding to the target three-dimensional virtual object according to the current virtual position;

[0190] Step 308: determining a first adjustment weight value corresponding to the volume parameter according to the virtual motion direction;

[0191] Step 309: determining a second adjustment weight value corresponding to the volume parameter according to the virtual motion speed;

[0192] Step 310: Multiply the first adjustment weight value by the second adjustment weight value to obtain a volume adjustment parameter corresponding to the target three-dimensional virtual object;

[0193] Step 311: Determine the field of view angle of the subject's eye and the angle bisector of the field of view angle, and determine the angle between the relative distance and the angle bisector;

[0194] Step 312: When the included angle is less than the preset angle, generate a sound gain parameter corresponding to the target three-dimensional virtual object;

[0195] Step 313: Generate sound playback parameters of the target three-dimensional virtual object according to the sound gain parameter, the volume parameter, the volume sub-parameters of different sound channels, the sound position parameter, and the volume adjustment parameter;

[0196] Step 314: Play the stereo sound corresponding to the target 3D virtual object in the naked-eye 3D image according to the sound playback parameters.

[0197] In the above embodiments, the description of each embodiment has its own focus. For the parts not described in detail in a certain embodiment, please refer to the detailed description of the above-mentioned stereo naked-eye 3D image playback method, which will not be repeated here.

[0198] See also Figure 6 , Figure 6 1 is a schematic diagram of the structure of a stereo naked-eye 3D picture playback device provided in an embodiment of the present application. The stereo naked-eye 3D picture playback device is used to execute the above-mentioned stereo naked-eye 3D picture playback method.

[0199] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or portion of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal. It can be implemented in whole or in part using software, hardware (such as processing circuits or memory), or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the functionality of the module or unit.

[0200] The stereo naked-eye 3D image playback device 400 includes:

[0201] The determination module 410 is configured to determine a target 3D virtual object to be interacted with in the naked-eye 3D image, and obtain the current virtual position and virtual motion information of the target 3D virtual object in the naked-eye 3D space corresponding to the naked-eye 3D image;

[0202] an acquisition module 420 for acquiring relative position information between the subject's eyes and the target three-dimensional virtual object;

[0203] A generating module 430 is configured to determine sound playback parameters of a target three-dimensional virtual object based on the relative position information, the current virtual position, and the virtual motion information;

[0204] The playing module 440 is configured to play the stereo sound corresponding to the target 3D virtual object in the naked-eye 3D image according to the sound playing parameters.

[0205] In some embodiments, the relative position information includes the relative distance and orientation angle between the subject's eyes and the target three-dimensional virtual object; the acquisition module 420 is configured to:

[0206] Obtaining the eye positions of the subject in naked eye three-dimensional space;

[0207] Determining the relative distance between the subject's eyes and the target three-dimensional virtual object based on the eye position and the current virtual position;

[0208] The vertical distance between the eye and the naked-eye 3D display screen is determined, and the azimuth angle between the eye and the target 3D virtual object is determined based on the vertical distance and the relative distance.

[0209] In some embodiments, the generating module 430 is configured to:

[0210] Determine a volume parameter corresponding to the target three-dimensional virtual object according to the relative distance;

[0211] Determining volume sub-parameters of different sound channels corresponding to the target three-dimensional virtual object according to the azimuth angle;

[0212] Determine the sound position parameters corresponding to the target three-dimensional virtual object according to the current virtual position;

[0213] determining a volume adjustment parameter corresponding to the target three-dimensional virtual object according to the virtual motion information;

[0214] The sound playback parameters of the target three-dimensional virtual object are generated according to the volume parameter, the volume sub-parameters of different sound channels, the sound position parameter and the volume adjustment parameter.

[0215] In some embodiments, the virtual motion information includes a virtual motion direction and a virtual motion speed; the generating module 430 is configured to:

[0216] determining a first adjustment weight value corresponding to the volume parameter according to the virtual movement direction;

[0217] determining a second adjustment weight value corresponding to the volume parameter according to the virtual movement speed;

[0218] The first adjustment weight value is multiplied by the second adjustment weight value to obtain a volume adjustment parameter corresponding to the target three-dimensional virtual object.

[0219] In some embodiments, the generating module 430 is configured to:

[0220] determining an environment type of an environment in which a target three-dimensional virtual object is located;

[0221] When the environment type is a closed environment, obtain the sound reflection parameters corresponding to the reflection surface in the closed environment;

[0222] The sound playback parameters of the target three-dimensional virtual object are generated according to the sound reflection parameters, the volume parameters, the volume sub-parameters of different sound channels, the sound position parameters and the volume adjustment parameters.

[0223] In some embodiments, the virtual motion information includes a virtual motion trajectory, and the generating module 430 is configured to:

[0224] Determine an environmental virtual object for interaction with a target three-dimensional virtual object in a virtual motion trajectory;

[0225] Determine the sound absorption parameters corresponding to the virtual objects in the environment;

[0226] The sound playback parameters of the target three-dimensional virtual object are generated according to the sound absorption parameter, the volume parameter, the volume sub-parameters of different sound channels, the sound position parameter and the volume adjustment parameter.

[0227] In some embodiments, the generating module 430 is configured to:

[0228] Determine a first material type corresponding to the environment virtual object and a second material type corresponding to the target three-dimensional virtual object;

[0229] Determining, based on the first material type and the second material type, touch sound parameters corresponding to the touch between the target three-dimensional virtual object and the environment virtual object;

[0230] The sound playback parameters of the target three-dimensional virtual object are generated according to the touch sound parameters, the sound absorption parameters, the volume parameters, the volume sub-parameters of different sound channels, the sound position parameters and the volume adjustment parameters.

[0231] In some embodiments, the generating module 430 is configured to:

[0232] Determining the sound filtering parameters corresponding to the azimuth angle according to the mapping relationship between the preset azimuth angle and the preset head-related transfer function filtering parameters;

[0233] The sound playback parameters of the target three-dimensional virtual object are generated according to the sound filtering parameters, the volume parameters, the volume sub-parameters of different sound channels, the sound position parameters and the volume adjustment parameters.

[0234] In some embodiments, the generating module 430 is configured to:

[0235] Determine the subject's eye's field of view angle and the angle bisector of the field of view angle;

[0236] Determine the angle between the relative distance and the angle bisector;

[0237] When the included angle is less than a preset angle, a sound gain parameter corresponding to the target three-dimensional virtual object is generated;

[0238] The sound playback parameters of the target three-dimensional virtual object are generated according to the sound gain parameter, the volume parameter, the volume sub-parameters of different channels, the sound position parameter and the volume adjustment parameter.

[0239] In the above embodiments, the description of each embodiment has its own focus. For the parts not described in detail in a certain embodiment, please refer to the detailed description of the above-mentioned stereo naked-eye 3D image playback method, which will not be repeated here.

[0240] In an embodiment of the present application, the determination module 410 determines the target three-dimensional virtual object interacting in the naked-eye three-dimensional picture, and obtains the current virtual position and virtual motion information of the target three-dimensional virtual object in the naked-eye three-dimensional space corresponding to the naked-eye three-dimensional picture; the acquisition module 420 obtains the relative position information between the object's eyes and the target three-dimensional virtual object; the generation module 430 determines the sound playback parameters of the target three-dimensional virtual object based on the relative position information, the current virtual position and the virtual motion information; the playback module 440 plays the stereo sound corresponding to the target three-dimensional virtual object in the naked-eye three-dimensional picture according to the sound playback parameters.

[0241] In this way, by determining the current virtual position and virtual motion information of the target three-dimensional virtual object interacting in the naked-eye three-dimensional image in naked-eye three-dimensional space, the relative position information between the subject's eyes and the target three-dimensional virtual object is obtained. The sound playback parameters of the target three-dimensional virtual object are determined based on the relative position information, current virtual position, and virtual motion information. Then, the stereo sound corresponding to the target three-dimensional virtual object is played in the naked-eye three-dimensional image based on the sound playback parameters. In other words, the sound playback parameters of the target three-dimensional virtual object are accurately calculated based on the relative position information, current virtual position, and virtual motion information. The sound playback parameters are used to play stereo sound that is synchronized with the naked-eye three-dimensional image of the target three-dimensional virtual object and has a more spatially realistic feel. Compared to the related art scheme of achieving stereo playback by presetting sound parameters, which results in a relatively artificial and rigid stereo playback effect, the present application can ensure that the subject can hear a stereo playback effect that is more consistent with the real world when viewing the target three-dimensional virtual object.

[0242] The present application also provides a computer device comprising a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the above-described stereoscopic naked-eye 3D image playback method. The computer device can be any intelligent terminal, including a tablet computer and an in-vehicle computer.

[0243] See also Figure 7 , Figure 7 The hardware structure of a computer device according to another embodiment is shown. The computer device includes:

[0244] The processor 501 may be implemented as a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application.

[0245] The memory 502 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 502 can store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program codes are stored in the memory 502 and are called by the processor 501 to execute the stereo naked-eye 3D image playback method of the embodiments of this application.

[0246] Input / output interface 503, used to implement information input and output;

[0247] Communication interface 504, used to implement communication interaction between this device and other devices, which can be achieved through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WiFi, Bluetooth, etc.);

[0248] Bus 505 , which transmits information between various components of the device (e.g., processor 501 , memory 502 , input / output interface 503 , and communication interface 504 );

[0249] The processor 501 , the memory 502 , the input / output interface 503 and the communication interface 504 are connected to each other in communication within the device via a bus 505 .

[0250] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the above-mentioned stereo naked-eye three-dimensional image playback method.

[0251] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0252] The embodiments of the present application provide a stereo naked-eye 3D image playback method, a stereo naked-eye 3D image playback device, a computer device, and a storage medium. The method determines the target 3D virtual object interacting in the naked-eye 3D image and obtains the current virtual position and virtual motion information of the target 3D virtual object in the naked-eye 3D space corresponding to the naked-eye 3D image; obtains the relative position information between the object's eyes and the target 3D virtual object; determines the sound playback parameters of the target 3D virtual object based on the relative position information, the current virtual position, and the virtual motion information; and plays the stereo sound corresponding to the target 3D virtual object in the naked-eye 3D image based on the sound playback parameters. In this way, by determining the current virtual position and virtual motion information of the target 3D virtual object interacting in the naked-eye 3D image in the naked-eye 3D space, and then obtaining the relative position information between the object's eyes and the target 3D virtual object. The sound playback parameters of the target 3D virtual object are determined based on the relative position information, the current virtual position, and the virtual motion information, and then the stereo sound corresponding to the target 3D virtual object is played in the naked-eye 3D image based on the sound playback parameters. That is to say, the sound playback parameters of the target three-dimensional virtual object are accurately calculated through relative position information, current virtual position and virtual motion information, and stereo sound with greater spatial realism is played through the sound playback parameters, which is synchronized with the naked-eye three-dimensional picture of the target three-dimensional virtual object. Compared with the related art that uses preset sound parameters to achieve stereo playback, which will result in a relatively false and rigid stereo playback effect, this application can ensure that the object can hear a stereo playback effect that is more in line with the real world when watching the target three-dimensional virtual object.

[0253] The embodiments described in the embodiments of this application are intended to more clearly illustrate the technical solutions of the embodiments of this application and do not constitute a limitation on the technical solutions provided by the embodiments of this application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0254] Those skilled in the art will understand that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0255] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, i.e., they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of this embodiment.

[0256] Those skilled in the art will appreciate that all or some of the steps in the methods, systems, and functional modules / units in the devices disclosed above may be implemented as software, firmware, hardware, or appropriate combinations thereof.

[0257] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0258] It should be understood that in this application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0259] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the above-mentioned units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0260] The units described above as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0261] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0262] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes multiple instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: various media that can store programs, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0263] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but are not intended to limit the scope of the present invention. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and essence of the present invention should be within the scope of the present invention.

Claims

1. A method for playing stereoscopic naked-eye 3D images, characterized in that: include: Determining a target three-dimensional virtual object for interaction in a naked-eye three-dimensional image, and obtaining current virtual position and virtual motion information of the target three-dimensional virtual object in a naked-eye three-dimensional space corresponding to the naked-eye three-dimensional image; Obtaining the eye positions of the subject's eyes in the naked eye three-dimensional space; determining a relative distance between the subject's eyes and the target three-dimensional virtual object based on the eye position and the current virtual position; Determining a vertical distance between the eye and the naked-eye 3D display screen, and determining an azimuth angle between the eye and the target 3D virtual object based on the vertical distance and the relative distance; determining a volume parameter corresponding to the target three-dimensional virtual object according to the relative distance; Determining volume sub-parameters of different sound channels corresponding to the target three-dimensional virtual object according to the azimuth angle; Determining a sound position parameter corresponding to the target three-dimensional virtual object according to the current virtual position; determining a volume adjustment parameter corresponding to the target three-dimensional virtual object according to the virtual motion information; generating a sound playback parameter of the target three-dimensional virtual object according to the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter, and the volume adjustment parameter; The stereo sound corresponding to the target three-dimensional virtual object is played in the naked-eye three-dimensional picture according to the sound playing parameters.

2. The method for playing stereoscopic naked-eye 3D images according to claim 1, wherein: The virtual motion information includes a virtual motion direction and a virtual motion speed; and determining a volume adjustment parameter corresponding to the target three-dimensional virtual object according to the virtual motion information includes: determining a first adjustment weight value corresponding to the volume parameter according to the virtual movement direction; determining a second adjustment weight value corresponding to the volume parameter according to the virtual movement speed; The first adjustment weight value is multiplied by the second adjustment weight value to obtain a volume adjustment parameter corresponding to the target three-dimensional virtual object.

3. The method for playing stereoscopic naked-eye 3D images according to claim 1, wherein: Generating the sound playback parameter of the target three-dimensional virtual object according to the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter, and the volume adjustment parameter includes: Determining an environment type of an environment in which the target three-dimensional virtual object is located; When the environment type is a closed environment, obtaining sound reflection parameters corresponding to the reflection surface in the closed environment; The sound playback parameter of the target three-dimensional virtual object is generated according to the sound reflection parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter and the volume adjustment parameter.

4. The method for playing stereoscopic naked-eye 3D images according to claim 1, wherein: The virtual motion information includes a virtual motion trajectory, and generating the sound playback parameter of the target three-dimensional virtual object according to the volume parameter, the volume sub-parameters of different sound channels, the sound position parameter, and the volume adjustment parameter includes: Determining an environmental virtual object with which the target three-dimensional virtual object interacts in the virtual motion trajectory; Determining a sound absorption parameter corresponding to the environmental virtual object; The sound playback parameter of the target three-dimensional virtual object is generated according to the sound absorption parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter and the volume adjustment parameter.

5. The method for playing stereoscopic naked-eye 3D images according to claim 4, wherein: Generating the sound playback parameter of the target three-dimensional virtual object according to the sound absorption parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter, and the volume adjustment parameter includes: Determining a first material type corresponding to the environmental virtual object and a second material type corresponding to the target three-dimensional virtual object; determining, according to the first material type and the second material type, a touch sound parameter corresponding to a touch between the target three-dimensional virtual object and the environment virtual object; The sound playback parameter of the target three-dimensional virtual object is generated according to the touch sound parameter, the sound absorption parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter, and the volume adjustment parameter.

6. The method for playing stereoscopic naked-eye 3D images according to claim 1, wherein: Generating the sound playback parameter of the target three-dimensional virtual object according to the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter, and the volume adjustment parameter includes: Determining the sound filtering parameters corresponding to the azimuth angle according to a mapping relationship between the preset azimuth angle and the preset head-related transfer function filtering parameters; The sound playback parameter of the target three-dimensional virtual object is generated according to the sound filtering parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter and the volume adjustment parameter.

7. The method for playing stereoscopic naked-eye 3D images according to claim 1, wherein: Generating the sound playback parameter of the target three-dimensional virtual object according to the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter, and the volume adjustment parameter includes: determining a field of view angle of an eye of a subject and an angle bisector of the field of view angle; determining an angle between the relative distance and the angle bisector; When the included angle is smaller than a preset angle, generating a sound gain parameter corresponding to the target three-dimensional virtual object; The sound playback parameter of the target three-dimensional virtual object is generated according to the sound gain parameter, the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter and the volume adjustment parameter.

8. A stereo naked-eye 3D image playback device, characterized in that: include: a determination module, configured to determine a target three-dimensional virtual object to be interacted with in a naked-eye three-dimensional picture, and obtain current virtual position and virtual motion information of the target three-dimensional virtual object in a naked-eye three-dimensional space corresponding to the naked-eye three-dimensional picture; An acquisition module, configured to acquire the eye positions of the subject's eyes in the naked eye three-dimensional space; determining a relative distance between the subject's eyes and the target three-dimensional virtual object based on the eye position and the current virtual position; Determining a vertical distance between the eye and the naked-eye 3D display screen, and determining an azimuth angle between the eye and the target 3D virtual object based on the vertical distance and the relative distance; a generating module, configured to determine a volume parameter corresponding to the target three-dimensional virtual object according to the relative distance; Determining volume sub-parameters of different sound channels corresponding to the target three-dimensional virtual object according to the azimuth angle; Determining a sound position parameter corresponding to the target three-dimensional virtual object according to the current virtual position; determining a volume adjustment parameter corresponding to the target three-dimensional virtual object according to the virtual motion information; generating a sound playback parameter of the target three-dimensional virtual object according to the volume parameter, the volume sub-parameters of the different sound channels, the sound position parameter, and the volume adjustment parameter; The playing module is configured to play the stereo sound corresponding to the target three-dimensional virtual object in the naked-eye three-dimensional picture according to the sound playing parameters.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a plurality of instructions, which are suitable for being loaded by a processor to execute the stereoscopic naked-eye 3D picture playback method according to any one of claims 1 to 7.

10. A computer device comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, characterized in that: When the processor executes the computer program, the stereo naked-eye three-dimensional image playback method according to any one of claims 1 to 7 is implemented.

Images