Three-dimensional image data processing method, device, equipment and medium

Abstract

The present disclosure provides a method, apparatus, device, and medium for processing three-dimensional image data, belonging to the field of display technology. The method comprises: receiving indication information, the indication information being used to indicate the number of target sub-regions, the target sub-regions being sub-regions within the viewing area where viewers are present; determining target views based on the indication information, wherein the number of target views determined when the number of target sub-regions is equal to 1 is smaller than the number of target views determined when the number of target sub-regions is greater than 1; and transmitting image data of the target views to the three-dimensional display terminal.

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to a method, apparatus, device, and medium for processing three-dimensional image data. Background Art

[0002] Currently, 3D display technology based on integrated imaging principles (also known as light field display technology) has entered the commercial application stage. A 3D display terminal based on integrated imaging principles consists of an optical lens array and a display panel. The optical lens array is located on the light-emitting surface of the display panel. Each lens in the optical lens array corresponds to multiple sub-pixels. Its main function is to project light from different sub-pixels in different directions, thereby generating multiple viewpoints. Summary of the Invention

[0003] The present disclosure provides a method, apparatus, device, and medium for processing three-dimensional image data. The technical solution is as follows:

[0004] In a first aspect, a method for processing three-dimensional image data is provided, for providing three-dimensional image data for a three-dimensional display terminal, wherein the three-dimensional display terminal has a plurality of viewpoints arranged in sequence, a viewing area of ​​the three-dimensional display terminal including a plurality of sub-areas, the arrangement direction of the plurality of sub-areas being the same as the arrangement direction of the plurality of viewpoints, and different sub-areas corresponding to at least partially different viewpoints, the method comprising:

[0005] Receive indication information, where the indication information is used to indicate the number of target sub-areas, where the target sub-areas are sub-areas in the viewing area where viewers exist; determine a target view based on the indication information, wherein the number of target views determined when the number of target sub-areas is equal to 1 is less than the number of target views determined when the number of target sub-areas is greater than 1; and send image data of the target view to the three-dimensional display terminal.

[0006] Optionally, the multiple viewpoints respectively correspond to a view, the number of the target sub-areas is greater than 1, and determining the target view based on the indication information includes: taking all views corresponding to the multiple viewpoints as the target view.

[0007] Optionally, the multiple viewpoints correspond to a view respectively, the number of the target sub-areas is equal to 1, and determining the target view based on the indication information includes: determining the viewpoint used by the viewer of the three-dimensional display terminal; and taking the view corresponding to the viewpoint used by the viewer among the views corresponding to the multiple viewpoints as the target view.

[0008] Optionally, the indication information includes the viewing position of the viewer of the three-dimensional display terminal, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; determining the viewpoint used by the viewer of the three-dimensional display terminal includes: determining the first viewpoint corresponding to the target sub-area based on the correspondence between the preset viewpoint and the viewing position; using the first viewpoint and N second viewpoints as the viewpoints used by the viewer, the N second viewpoints being the N viewpoints closest to the first viewpoint among the multiple viewpoints; wherein N is an even number, and N≥0.

[0009] Optionally, the indication information includes an identifier of a target viewpoint, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; the determination module is used to determine the viewpoint used by the viewer of the three-dimensional display terminal based on the identifier of the target viewpoint, wherein the target viewpoint includes a first viewpoint, or the target viewpoint includes a first viewpoint and N second viewpoints, the first viewpoint is a viewpoint corresponding to the target sub-area, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints, wherein N is an even number and N≥0; the viewpoint used by the viewer includes the first viewpoint and the N second viewpoints.

[0010] Optionally, sending the image data of the target view to the three-dimensional display terminal includes: in response to determining that the viewer is in motion, sending the image data of the target view with a first resolution to the three-dimensional display terminal; in response to determining that the viewer is in a stationary state, sending the image data of the target view with a second resolution to the three-dimensional display terminal; wherein the first resolution is lower than the second resolution.

[0011] Optionally, when the number of the target sub-regions is equal to 1, the resolution of the target view determined is greater than the resolution of the target view determined when the number of the target sub-regions is greater than 1.

[0012] In a second aspect, a method for processing three-dimensional image data is provided, which is used to provide three-dimensional image data for multiple three-dimensional display terminals, wherein the multiple three-dimensional display terminals include a first display terminal and at least one second display terminal. The method includes: receiving first viewing angle indication information, wherein the first viewing angle indication information is used to indicate a first viewing angle of the first display terminal for a target object; determining a first target view corresponding to the first viewing angle based on the first viewing angle indication information, wherein the number of the first target views is less than the number of viewpoints of the first display terminal; and sending image data of the first target view to the first display terminal and the at least one second display terminal.

[0013] Optionally, the first viewing angle indication information includes the viewing position of the viewer of the first display terminal; determining the first target view corresponding to the first viewing angle based on the first viewing angle indication information includes: determining the first viewpoint corresponding to the viewing position indicated by the first viewing angle indication information based on a preset correspondence between the viewpoint and the viewing position; taking the view corresponding to the first viewpoint and N second viewpoints as the first target view, the N second viewpoints being the N viewpoints closest to the first viewpoint among the multiple viewpoints; wherein N is an even number, and N≥0.

[0014] Optionally, the first viewpoint information includes an identifier of the target viewpoint, the target viewpoint includes a first viewpoint, or the target viewpoint includes a first viewpoint and N second viewpoints, the first viewpoint is a viewpoint corresponding to a viewing position of a viewer of the first display terminal, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints, where N is an even number and N≥0; determining the first target view corresponding to the first viewpoint according to the first viewpoint indication information includes: according to the identifier of the target viewpoint, taking the view corresponding to the first viewpoint and the N second viewpoints as the first target view.

[0015] Optionally, the method also includes: receiving second viewing angle indication information sent by a third display terminal, the third display terminal being one of the at least one second display terminal, the second viewing angle indication information being used to indicate a second viewing angle of the third display terminal for the target object; determining a second target view corresponding to the second viewing angle; and sending image data of the second target view to the third display terminal.

[0016] According to a third aspect, a device for processing image data is provided for providing three-dimensional image data for a three-dimensional display terminal, wherein the three-dimensional display terminal has a plurality of viewpoints arranged in sequence, and a viewing area of ​​the three-dimensional display terminal includes a plurality of sub-areas, and an arrangement direction of the plurality of sub-areas is the same as an arrangement direction of the plurality of viewpoints, and the viewpoints corresponding to different sub-areas are at least partially different. The device comprises: a receiving module for receiving indication information, wherein the indication information is used to indicate the number of target sub-areas, and the target sub-areas are sub-areas in the viewing area where there are viewers; a determining module for determining a target view based on the indication information, wherein the number of target views determined when the number of target sub-areas is equal to 1 is less than the number of target views determined when the number of target sub-areas is greater than 1; and a sending module for sending image data of the target view to the three-dimensional display terminal.

[0017] Optionally, the multiple viewpoints respectively correspond to a view, the number of the target sub-regions is greater than 1, and the determination module is configured to use all views corresponding to the multiple viewpoints as the target views.

[0018] Optionally, the multiple viewpoints correspond to a view respectively, the number of the target sub-areas is equal to 1, and the determination module is used to determine the viewpoint used by the viewer of the three-dimensional display terminal; and the view corresponding to the viewpoint used by the viewer among the views corresponding to the multiple viewpoints is used as the target view.

[0019] Optionally, the indication information includes the viewing position of the viewer of the three-dimensional display terminal, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; the determination module is used to determine the first viewpoint corresponding to the target sub-area based on the correspondence between the preset viewpoint and the viewing position; the first viewpoint and N second viewpoints are used as the viewpoints used by the viewer, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints; wherein N is an even number, and N≥0.

[0020] Optionally, the indication information includes an identifier of a target viewpoint, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; determining the viewpoint used by the viewer of the three-dimensional display terminal includes: determining the viewpoint used by the viewer of the three-dimensional display terminal based on the identifier of the target viewpoint, wherein the target viewpoint includes a first viewpoint, or the target viewpoint includes a first viewpoint and N second viewpoints, the first viewpoint is a viewpoint corresponding to the target sub-area, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints, wherein N is an even number and N≥0; the viewpoint used by the viewer includes the first viewpoint and the N second viewpoints.

[0021] Optionally, the sending module is used to, in response to determining that the viewer is in motion, send image data of the target view with a first resolution to the three-dimensional display terminal; in response to determining that the viewer is in a stationary state, send image data of the target view with a second resolution to the three-dimensional display terminal; wherein the first resolution is lower than the second resolution.

[0022] Optionally, when the number of the target sub-regions is equal to 1, the resolution of the target view determined is greater than the resolution of the target view determined when the number of the target sub-regions is greater than 1.

[0023] In a fourth aspect, a three-dimensional image data processing device is provided, which is used to provide three-dimensional image data for multiple three-dimensional display terminals, wherein the multiple three-dimensional display terminals include a first display terminal and at least one second display terminal, and the device includes: a receiving module, which is used to receive first viewing angle indication information, and the first viewing angle indication information is used to indicate the first viewing angle of the first display terminal for the target object; a determination module, which is used to determine the first target view corresponding to the first viewing angle according to the first viewing angle indication information, and the number of the first target views is less than the number of viewpoints of the first display terminal; and a sending module, which is used to send the image data of the first target view to the first display terminal and the at least one second display terminal.

[0024] Optionally, the first viewing angle indication information includes the viewing position of the viewer of the first display terminal; the determination module is used to determine the first viewpoint corresponding to the viewing position of the viewer of the first display terminal according to a preset correspondence between the viewpoint and the viewing position; and take the view corresponding to the first viewpoint and N second viewpoints as the first target view, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints; wherein N is an even number, and N≥0.

[0025] Optionally, the first viewing angle indication information includes an identifier of the target viewpoint, the target viewpoint includes a first viewpoint, or the target viewpoint includes a first viewpoint and N second viewpoints, the first viewpoint is a viewpoint corresponding to the viewing position of the viewer of the first display terminal, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints, where N is an even number and N≥0; the determination module is used to, based on the identifier of the target viewpoint, take the view corresponding to the first viewpoint and the N second viewpoints as the first target view.

[0026] Optionally, the receiving module is also used to receive second viewing angle indication information sent by a third display terminal, where the third display terminal is one of the at least one second display terminal, and the second viewing angle indication information is used to indicate the second viewing angle of the third display terminal for the target object; the determination module is also used to determine the second target view corresponding to the second viewing angle based on the second viewing angle indication information; and the sending module is also used to send image data of the second target view to the third display terminal.

[0027] In a fifth aspect, a computer device is provided, the computer device comprising a processor and a memory;

[0028] Wherein, the memory is used to store computer programs;

[0029] The processor is configured to execute the computer program stored in the memory to implement any of the three-dimensional image data processing methods described in the first aspect, or the three-dimensional image data processing method described in the second aspect.

[0030] In a sixth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and when the stored computer instructions are executed by a processor, the three-dimensional image data processing method described in any one of the first aspects, or the three-dimensional image data processing method described in the second aspect can be implemented.

[0031] In a seventh aspect, a computer program product is provided, wherein instructions are stored in the computer program product, which, when executed on a computer, enables the computer to execute any of the three-dimensional image data processing methods described in the first aspect, or the three-dimensional image data processing method described in the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0033] Figure 1 This is a schematic diagram of the structure and working principle of a three-dimensional display terminal provided by an embodiment of the present disclosure;

[0034] Figure 2 is a structural diagram of a display system provided by an embodiment of the present disclosure;

[0035] Figure 3 is a flowchart of a method for processing three-dimensional image data provided by an embodiment of the present disclosure;

[0036] Figure 4 is a flowchart of another method for processing three-dimensional image data provided by an embodiment of the present disclosure;

[0037] Figure 5 is a schematic diagram of the relationship between the viewing position and the viewpoint provided by an embodiment of the present disclosure;

[0038] Figure 6 is a flowchart of another method for processing three-dimensional image data provided by an embodiment of the present disclosure;

[0039] Figure 7 is a flowchart of another method for processing three-dimensional image data provided by an embodiment of the present disclosure;

[0040] Figure 8is a schematic diagram of an application scenario of an embodiment of the present disclosure;

[0041] Figure 9 is a schematic diagram of another application scenario of an embodiment of the present disclosure;

[0042] Figure 10 is a block diagram of a three-dimensional image data processing device provided by an embodiment of the present disclosure;

[0043] Figure 11 is a block diagram of another three-dimensional image data processing device provided by an embodiment of the present disclosure;

[0044] Figure 12 It is a structural diagram of a computer device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0045] In order to make the objectives, technical solutions and advantages of the present disclosure more clear, the embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings.

[0046] To facilitate understanding of the embodiments of the present disclosure, a three-dimensional display terminal based on the integrated imaging principle is first introduced below.

[0047] Figure 1 This is a schematic diagram of the structure and working principle of a three-dimensional display terminal provided by an embodiment of the present disclosure. Figure 1 As shown, the three-dimensional display terminal 10 includes a display panel 11 and a lens array 12. The lens array 12 is located on the light-emitting surface of the display panel 11. Light emitted by the display panel 11 passes through the lens array 12 and then exits.

[0048] The display panel 11 includes a plurality of pixels arranged in an array, each pixel including a plurality of sub-pixels. For example, each pixel includes three sub-pixels, namely a red sub-pixel, a blue sub-pixel, and a green sub-pixel. It should be noted that the embodiment of the present disclosure does not limit the number and color of the sub-pixels contained in each pixel, and can be set according to actual needs.

[0049] The lens array 12 includes a plurality of cylindrical lenses arranged in parallel, and each arrow in the figure represents a cylindrical lens. Figure 1 In the left-right direction (in the left and right directions), each cylindrical lens 121 corresponds to multiple sub-pixels. The number of sub-pixels corresponding to each cylindrical lens 121 can be the same, thereby dividing the sub-pixels on the display panel into multiple groups. Each group of sub-pixels corresponds to a viewpoint, and the multiple viewpoints are spaced apart along the arrangement direction a of the multiple cylindrical lenses 121.

[0050] For example, Figure 1In the 3D display, the lens array includes eight cylindrical lenses, each corresponding to six pixels. The pixels of the display panel are divided into six groups. Pixels numbered 1 form a group, pixels numbered 2 form a group, and so on. The 3D display terminal has six viewpoints.

[0051] It should be noted that Figure 1 In the example shown, each cylindrical lens corresponds to an integer number of sub-pixels. In other examples, the number of sub-pixels corresponding to each cylindrical lens may not be an integer, but rather multiple cylindrical lenses (for example, three cylindrical lenses) may correspond to an integer number of sub-pixels. In the disclosed embodiment, the smallest cylindrical lens corresponding to an integer number of sub-pixels is combined as a period, and the number of viewpoints is equal to the number of sub-pixels corresponding to each period. The disclosed embodiment does not limit the number of viewpoints of the 3D display terminal.

[0052] Each viewpoint corresponds to a view. Figure 1 For example, six viewpoints correspond to six views. A 3D display terminal synthesizes these six views into a single image. Based on this synthesized image, each pixel is controlled to emit light. The lens array modulates the light emitted by each pixel to achieve viewpoint separation and convergent imaging. Information from the same viewpoint converges into an area, which is referred to as the viewing area for that viewpoint. Each viewpoint's viewing area is discrete, but to human visual perception, the image appears continuous.

[0053] When a user is watching, the viewpoints corresponding to the left and right eyes are at least partially different, and the views corresponding to different viewpoints are different. Therefore, the images seen by the viewer's left and right eyes are different. Based on the principle of binocular parallax, the viewer sees a three-dimensional image.

[0054] Exemplarily, the display panel includes but is not limited to a liquid crystal display panel, an OLED (Organic Light-Emitting Diode) display panel, a QLED (Quantum Dot Light Emitting Diodes) display panel, and the like.

[0055] In the embodiment of the present disclosure, the three-dimensional display terminal further includes a communication component for communicating with a server and / or other terminals.

[0056] Optionally, the 3D display terminal may further include an interactive component for interacting with the user and receiving user input of an operation instruction. The interactive component includes but is not limited to a pointing device such as a mouse, a control ball, and a touch pad.

[0057] In the embodiment of the present disclosure, the three-dimensional display terminal may be a naked-eye three-dimensional display terminal or VR (Virtual Reality) glasses, etc.

[0058] In the embodiment of the present disclosure, the viewing area of ​​the 3D display terminal is divided into multiple sub-areas, and the arrangement direction of the multiple sub-areas is the same as the arrangement direction of the multiple viewpoints. The viewpoints corresponding to different sub-areas are at least partially different, that is, when the viewer is in different sub-areas, the viewpoints used are at least partially different. For example, Figure 1 As shown, for the naked-eye 3D display terminal, when the viewer is located in the first sub-area, the viewpoint corresponding to the left eye is viewpoint 2, and the viewpoint corresponding to the right eye is viewpoint 5; when the viewer is located in the second sub-area, the viewpoint corresponding to the left eye is viewpoint 3, and the viewpoint corresponding to the right eye is viewpoint 6.

[0059] Figure 2 Schematic diagram of a display system provided by an embodiment of the present disclosure. Figure 2 As shown, the display system includes a server 21 and multiple 3D display terminals 22, each of which is connected to the server 21 via a network. The server 21 can be a single server or a server cluster. Figure 1 The three-dimensional display terminal shown will not be described in detail here.

[0060] The server stores image data for a 3D image. A 3D display terminal can send a request to the server, requesting the server to send the image data for the 3D image. The server sends the image data to the 3D display terminal in response to the request. The 3D display terminal displays the received image data, allowing a user to view the corresponding 3D image.

[0061] In some examples, the request may include viewing angle information, which indicates a target viewing angle. The image data sent by the server to the 3D display terminal is image data corresponding to all viewpoints within the target viewing angle. This allows users to view the 3D image from different viewpoints, each with a slightly different perspective of the target object.

[0062] In the embodiment of the present disclosure, the server first renders the view and then sends the rendered image data to the three-dimensional display terminal.

[0063] Since the image data sent by the server to the 3D display terminal includes image data of views corresponding to all viewpoints, the data volume is large, resulting in high data processing pressure and network transmission pressure on the server.

[0064] Figure 3This is a flowchart of a method for processing three-dimensional image data provided by an embodiment of the present disclosure. The method can be executed by a server. The method is used to provide three-dimensional image data for a three-dimensional display terminal. The three-dimensional display terminal has multiple viewpoints arranged in sequence. The viewing area of ​​the three-dimensional display terminal includes multiple sub-areas. The arrangement direction of the multiple sub-areas is the same as the arrangement direction of the multiple viewpoints. The viewpoints corresponding to different sub-areas are at least partially different. Figure 3 As shown, the method includes:

[0065] In step 301, indication information is received, where the indication information is used to indicate the number of target sub-areas, where the target sub-areas are sub-areas in the viewing area where viewers exist.

[0066] Among them, the three-dimensional display terminal can be Figure 2 The server may receive indication information sent by the 3D display terminal. The indication information is generated by the 3D display terminal based on the number and viewing positions of the detected viewers. The disclosed embodiments do not limit how the 3D display terminal determines the number and viewing positions of viewers. The 3D display terminal may use technologies such as image recognition or infrared sensing to determine the number of viewers.

[0067] In some examples, the indication information includes a numerical value equal to the number of target sub-areas, such as 1, 2, or 3. In other examples, the indication information includes an identifier corresponding to the number of target sub-areas, with different values ​​of the identifier corresponding to different number intervals. For example, when the number of target sub-areas is equal to 1, the identifier has a first value, such as "0"; when the number of target sub-areas is greater than 1, the identifier has a second value, such as "1."

[0068] In the aforementioned examples, the indication information directly or explicitly indicates the number of target sub-areas, while in other embodiments, the indication information may also indirectly or implicitly indicate the number of target sub-areas. For example, in some examples, the indication information includes the viewer's viewing position, and the indication information is generated by the 3D display terminal when the number of target sub-areas is 1. For another example, in other examples, the indication information includes the identifier of the target viewpoint, and the indication information is generated by the 3D display terminal when the number of target sub-areas is 1. Therefore, when the server receives the indication information including the viewing position or the identifier of the target viewpoint, it can determine that the number of target sub-areas of the 3D display terminal is equal to 1 based on the indication information.

[0069] In step 302, a target view is determined based on the indication information.

[0070] The number of target views determined when the number of target sub-regions is equal to 1 is smaller than the number of target views determined when the number of target sub-regions is greater than 1.

[0071] In step 303, the image data of the target view is sent to the 3D display terminal.

[0072] In the disclosed embodiment, the server first renders the target view and then sends the rendered image data to the 3D display terminal. After receiving the image data, the 3D display terminal controls the display panel to emit light based on the image data, thereby displaying the corresponding 3D image.

[0073] As mentioned above, a 3D display terminal has multiple viewpoints, each corresponding to a view. Different viewpoints correspond to different views. Different views are used to present the 3D image. When there are many viewers, they typically view from different viewing positions, i.e., from different sub-areas. The viewpoints corresponding to different sub-areas differ at least in part, resulting in a greater number of viewpoints being used. When there are fewer viewers, fewer viewpoints are used.

[0074] In an embodiment of the present disclosure, the target view is determined according to the number of target sub-areas of the display terminal, and the number of target views determined when the number of target sub-areas is equal to 1 is less than the number of target views determined when the number of target sub-areas is greater than 1. In this way, when there are multiple viewers and they are located in multiple sub-areas, image data of more views can be sent to the display terminal, so that different viewers can watch from different viewpoints to ensure the viewing effect of multiple viewers; and when the number of viewers is 1 or the number of viewers is greater than 1 but they are located in the same sub-area, image data of fewer views are sent to the display terminal. On the one hand, the viewer can ensure the display effect by watching at the viewpoint corresponding to the received view. On the other hand, since the amount of data corresponding to the view is smaller, the data processing pressure of the server and the network transmission pressure can be reduced.

[0075] Figure 4 This is a flow chart of a method for processing three-dimensional image data provided by an embodiment of the present disclosure. This method can be performed jointly by a three-dimensional display terminal and a server. Figure 4 As shown, the method includes:

[0076] In step 401, the 3D display terminal determines the number of viewers.

[0077] In some examples, the 3D display terminal includes an image acquisition device, such as a camera. Optionally, the camera includes one or a combination of an RGB (Red, Green, Blue) camera, a depth camera (such as a Time of Flight (TOF) camera), a wide-angle camera, and a fisheye camera. The type, number, and installation location of the camera can be set according to actual needs and are not limited in this disclosure.

[0078] The image acquisition device can be used to acquire images in the viewing area of ​​the three-dimensional display terminal. Image recognition technology, such as face detection technology, can be used to determine the number of users in the image, thereby determining the number of viewers.

[0079] In some examples, the number of viewers is determined in the following manner: first, faces in the image are identified using face detection technology; then, incomplete faces in the identified faces are removed; and finally, the number of remaining faces is used as the number of viewers.

[0080] In some scenarios, there may be users who pass through the viewing area of ​​the 3D display terminal but do not view the display content of the 3D display terminal. If the view corresponding to the user's position is used as the target view and its image data is sent to the 3D display terminal, it will waste the server's computing resources and network resources. Therefore, it is necessary to identify such users and exclude them from being viewers of the display terminal. Normally, only users whose faces are facing the 3D display terminal can see the display content of the 3D display terminal. If the recognized face is incomplete, it means that the user's face is not facing the 3D display terminal, that is, they are not viewing the display content of the 3D display terminal. Therefore, such users can be removed by removing the incomplete face.

[0081] In other examples, incomplete faces may not be removed, and the number of faces in the image may be used as the number of viewers.

[0082] The embodiments of the present disclosure do not limit how the 3D display terminal determines the number of viewers, as long as the number of viewers can be determined. For example, in other examples, the 3D display device can receive a number input by the user and determine the received number as the number of viewers.

[0083] In step 402, the 3D display terminal determines the viewing position of the viewer.

[0084] Optionally, the three-dimensional display terminal uses head tracking technology or eye tracking technology to determine the viewing position of the viewer.

[0085] In some examples, the 3D display terminal is a naked-eye 3D display terminal, and the viewer's viewing position is the position of a reference point of a target part of the viewer, which may be the head or the eyes. Alternatively, the viewer's viewing position is the position of the center point of both eyes, or the viewer's viewing position includes the position of the left eyeball and the position of the right eyeball, etc.

[0086] In other examples, the three-dimensional display terminal is a near-eye display terminal, such as VR glasses, and the viewer's viewing position includes the position of the left eye and the position of the right eye, etc.

[0087] Alternatively, the position can be expressed using spatial coordinates, which are determined based on image recognition technology. The coordinate system of the spatial coordinates is based on the light-emitting surface of the display panel as the XY plane, i.e., the Z-axis 0 plane, with the direction perpendicular to the light-emitting surface as the Z-axis direction, and the Z-axis passing through the center of the display panel. For example, the X direction can be the row direction of the pixels arranged in the display panel, and the Y direction can be the column direction of the pixels arranged in the display panel. When the display panel is placed vertically, the X direction is the horizontal direction, and the Y direction is the vertical direction.

[0088] Alternatively, the position can be expressed as an angle relative to the center plane of the 3D display terminal, where the center plane is perpendicular to the arrangement direction of the cylindrical lenses and perpendicular to the light-emitting surface of the display panel of the 3D display terminal. In other words, the center plane is the vertical center plane of the 3D display terminal when it is normally positioned, i.e., the YZ plane in the aforementioned coordinate system. The angle is the angle between the center plane and a perpendicular line from the viewing position to the vertical center line of the 3D display terminal (i.e., the Y axis), and can be calculated based on the spatial coordinates of the reference point.

[0089] In step 403, the three-dimensional display terminal generates instruction information.

[0090] If the number of viewers of the 3D display terminal is greater than 1 and the viewers of the 3D display terminal are located in at least two sub-areas, the 3D display terminal generates first indication information, where the first indication information is used to indicate that the number of target sub-areas is greater than 1.

[0091] Exemplarily, the first indication information is used to indicate a numerical value of the number of target sub-regions, or includes an indicator used to indicate that the number of target sub-regions is greater than 1, etc.

[0092] If the number of viewers of the 3D display terminal is 1, or the number of viewers of the 3D display terminal is greater than 1 and all viewers of the 3D display terminal are located in the same sub-area (which can be considered to be located in the same viewing position), the 3D display terminal generates second indication information, which includes the viewing position of the viewer. In this case, the second indication information is used to indicate that the number of target sub-areas is 1.

[0093] Here, the target sub-area is a sub-area in the viewing area where a viewer exists.

[0094] In an embodiment of the present disclosure, when the number of viewers is greater than 1, the number of target sub-regions is determined according to the viewing positions of the viewers.

[0095] The 3D display terminal has multiple viewpoints arranged in sequence. The viewing area of ​​the 3D display terminal includes multiple subareas. The arrangement direction of the multiple subareas is the same as that of the multiple viewpoints. Different subareas correspond to at least partially different viewpoints.

[0096] In the disclosed embodiment, each subregion is a spatial region that can be represented by spatial coordinates or by an angular interval relative to a reference plane, which can be the center plane of the aforementioned 3D display terminal. The 3D display terminal determines the spatial region where each viewer is located and then uses the number of determined spatial regions as the number of target subregions.

[0097] In step 404, the 3D display terminal sends instruction information to the server.

[0098] Correspondingly, the server receives the indication information.

[0099] In step 405, the server determines the target view based on the indication information.

[0100] For the first indication information, step 405 includes: the server uses all views corresponding to the viewpoints of the 3D display terminal as target views. That is, the target views include views corresponding to all viewpoints of the 3D display terminal.

[0101] Regarding the second indication information, step 405 includes: first, determining the viewpoint used by the viewer of the 3D display terminal; second, selecting the view corresponding to the viewpoint used by the viewer among the multiple views corresponding to the viewpoints as the target view. In other words, the target view includes views corresponding to some viewpoints of the 3D display terminal.

[0102] It can be seen that, in this embodiment, when the number of target sub-regions is equal to 1, the number of target views is smaller than the number of target views when the number of target sub-regions is greater than 1.

[0103] In some examples, determining the viewpoint used by a viewer of a 3D display terminal includes: determining a first viewpoint corresponding to a target sub-region based on a predetermined correspondence between viewpoints and viewing positions; and using the first viewpoint and N second viewpoints as the viewpoints used by the viewer, where the N second viewpoints are the N viewpoints closest to the first viewpoint among the plurality of viewpoints, where N is an even number and N ≥ 0.

[0104] Exemplarily, the corresponding relationship may be stored in the form of a list.

[0105] In the embodiment of the present disclosure, the first viewpoint may also be referred to as a central viewpoint. In this correspondence, one viewing position corresponds to one or more first viewpoints.

[0106] For example, when the 3D display terminal is a naked-eye 3D display terminal, if the viewing position is the center of both eyes, then the viewing position corresponds to a pair of first viewpoints, with the two first viewpoints in each pair corresponding to the viewer's left and right eyes, respectively. For another example, when the 3D display terminal is a naked-eye 3D display terminal, if the viewing position includes the position of the left eye and the position of the right eye, then each viewing position corresponds to a first viewpoint.

[0107] When the 3D display terminal is a near-eye display terminal, and the viewer's viewing position includes the position of the left eye and the position of the right eye, each viewing position corresponds to multiple first viewpoints, for example, each viewing position corresponds to 2 or 3 first viewpoints.

[0108] In some examples, the correspondence is a viewpoint-angle correspondence. In the viewpoint-angle correspondence, each viewpoint corresponds to an angle. If the viewing position indicated by the indication information is expressed as an angle relative to the aforementioned central plane of the 3D display terminal, the server may first determine, from the viewpoint-angle correspondence, a target angle that is closest to the angle corresponding to the viewing position, and then use the viewpoint corresponding to the target angle in the correspondence as the first viewpoint.

[0109] The following combination Figure 5 How to determine the first viewpoint is exemplified. Figure 5 As shown, the angle corresponding to viewpoint 2 is a2, and the angle corresponding to viewpoint 3 is a3. The correspondence between viewpoints and angles includes... (viewpoint 2, a2), (viewpoint 3, a3), ..., and the angle corresponding to the left eye is A. In this correspondence, the angle closest to A is a2, so viewpoint 2 corresponding to a2 is used as the first viewpoint corresponding to the left eye.

[0110] In other examples, the correspondence is between viewpoints and angle intervals, and the viewing position indicated by the indication information is expressed as an angle relative to the aforementioned central plane of the 3D display terminal. The server can first determine the target angle interval within which the angle corresponding to the indication information falls, and then use the viewpoint corresponding to the target angle interval in the correspondence as the first viewpoint. For example, the sub-regions and angle intervals can correspond one-to-one.

[0111] In other examples, the correspondence is a correspondence between a viewpoint and an angle interval, or a correspondence between a viewpoint and an angle. If the viewing position indicated by the indication information is expressed in spatial coordinates, the server may first convert the spatial coordinates into angles relative to the center plane of the 3D display terminal, and then determine the first viewpoint based on the angle corresponding to the indication information and the correspondence.

[0112] In the disclosed embodiment, the 3D display terminal must pre-store the correspondence between viewpoints and angle intervals in the server before executing the method. For example, the server may pre-store a mapping between the model of the 3D display terminal and the correspondence, so that the server can obtain the corresponding correspondence based on the model of the 3D display terminal.

[0113] The value of N can be determined based on the parameters of the 3D display terminal's optical system. For example, if the 3D display terminal experiences severe light crosstalk, the value of N can be larger, such as 4. If the 3D display terminal experiences mild light crosstalk, the value of N can be smaller, such as 2. In the disclosed embodiment, the N second viewpoints are symmetrically distributed on either side of the corresponding first viewpoint.

[0114] It should be noted that the N second viewpoints and the corresponding first viewpoint can be viewpoints in the same viewing area, or some of the N second viewpoints can be viewpoints in a viewing area adjacent to the viewing area where the first viewpoint is located. Here, the area where all sub-pixels of the display panel are imaged through the facing lenses can be called the main lobe area, and the area where all sub-pixels of the display panel are imaged through non-facing lenses can be called the side lobe area. The main lobe area and the side lobe area are each a viewing area. When the first viewpoint is the viewpoint on both sides of the main lobe area, some of the second viewpoints corresponding to the first viewpoint are viewpoints in the side lobe area adjacent to the main lobe area.

[0115] Alternatively, in other embodiments, the second indication information may not include the viewer's viewing position, but may include an identifier of a target viewpoint. The target viewpoint includes a first viewpoint, or includes a first viewpoint and N second viewpoints, where the first viewpoint is the viewpoint corresponding to the target sub-region, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints, where N is an even number and N ≥ 0.

[0116] In this case, the viewpoint used by the viewer of the 3D display terminal can be determined by replacing it with the following method: determining the viewpoint used by the viewer of the 3D display terminal according to the identifier of the target viewpoint. The viewpoint used by the viewer includes a first viewpoint and N second viewpoints.

[0117] It should be noted that this embodiment distinguishes between two situations: when the number of target sub-regions is equal to 1 and when the number of target sub-regions is greater than 1. When the number of target sub-regions is greater than 1, the view corresponding to the viewpoint of the 3D display terminal is directly used as the target view, which can simplify the implementation process. In other embodiments, when the number of target sub-regions is greater than 1, the number of target views can also be determined based on the actual number. For example, the number of target views is positively correlated with the number of target sub-regions, that is, the greater the number of target sub-regions, the greater the number of target views. When the number of target sub-regions reaches a set upper limit, all views corresponding to the viewpoints of the 3D display terminal are used as target views.

[0118] In step 406 , the server sends the image data of the target view to the 3D display terminal.

[0119] Optionally, the server stores image data of the target view of at least one resolution, or renders the target view based on at least one resolution to obtain image data of the target view of the corresponding resolution.

[0120] In some examples, the server sends image data of the target view at a default resolution or a specified resolution to the 3D display terminal.

[0121] In other examples, the second indication information is also used to indicate that the number of viewers is 1. In this case, the server selects and transmits image data of the target view at a corresponding resolution based on the viewing state of the viewer on the 3D display terminal. For example, when the viewer is in motion, image data of the target view at a first resolution is transmitted to the 3D display terminal. For another example, when the viewer is stationary, image data of the target view at a second resolution is transmitted to the 3D display terminal. The first resolution is lower than the second resolution.

[0122] This allows viewers in a static state to see higher-resolution images, enhancing the clarity of the 3D image. Furthermore, for viewers in motion, even with higher-resolution images, the images they see are still blurry. Therefore, lower-resolution image data for the target view can be sent to reduce network transmission pressure.

[0123] In some examples, if the indication information includes the viewer's viewing position, the server can determine the viewer's viewing state based on the most recently received X viewing positions, where X is an integer and X ≥ 2. If the X viewing positions are all different, or the deviation between any two of the X viewing positions is greater than a threshold, the viewer is determined to be in motion. If the X viewing positions are all the same, or the deviation between any two of the X viewing positions is not greater than a threshold, the viewer is determined to be stationary. Exemplarily, X is 2 or 3.

[0124] In other examples, if the indication information includes the identifier of the target viewpoint, the server can determine the viewer's viewing state based on the identifiers of the target viewpoints in the most recently received Y indication information, where Y is an integer and Y ≥ 2. If the identifiers of the target viewpoints in the Y indication information are all different, or if the identifiers of the target viewpoints in the Y indication information are at least partially different, then the viewer is determined to be in motion. If the identifiers of the target viewpoints in the Y indication information are all the same, then the viewer is determined to be stationary. Exemplarily, Y is equal to 2 or 3.

[0125] In some other embodiments, if the network quality is poor, for example, the transmission rate corresponding to the three-dimensional display terminal is less than a threshold and / or the transmission bandwidth of the three-dimensional display terminal is less than a threshold, the server may select the resolution of the target view according to the number of determined target views, so that the resolution of the target view determined when the number of target sub-areas is equal to 1 is greater than the resolution of the target view determined when the number of target sub-areas is greater than 1.

[0126] For example, when all views corresponding to multiple viewpoints are used as target views, the resolution of the target views is the third resolution. However, when the view corresponding to the viewpoint used by the viewer among the multiple viewpoints is used as the target view, the resolution of the target view is the second resolution, and the third resolution is lower than the second resolution. Since the image data volume of a view with a lower resolution is smaller, when there are a large number of target views, by reducing the resolution of the target views, the overall data volume of the image data of the target views can be reduced, thereby reducing network transmission pressure.

[0127] Of course, the network quality may also be ignored, and the resolution of the target view determined when the number of target sub-regions is equal to 1 is equal to the resolution of the target view determined when the number of target sub-regions is greater than 1.

[0128] In step 407, the 3D display terminal displays the received image data.

[0129] When the viewer is in motion, the 3D display terminal displays the target view at a first resolution at a first refresh rate. When the viewer is stationary, the 3D display terminal displays the target view at a second resolution at a second refresh rate. Here, the first refresh rate is greater than the second refresh rate. This improves the smoothness of the image for viewers in motion.

[0130] In an embodiment of the present disclosure, the target view is determined according to the number of target sub-areas of the display terminal, and the number of target views determined when the number of target sub-areas is equal to 1 is less than the number of target views determined when the number of target sub-areas is greater than 1. In this way, when there are multiple viewers and they are located in multiple sub-areas, image data of more views can be sent to the display terminal, so that different viewers can watch from different viewpoints to ensure the viewing effect of multiple viewers; and when the number of viewers is 1 or the number of viewers is greater than 1 but they are located in the same sub-area, image data of fewer views are sent to the display terminal. On the one hand, the viewer can ensure the display effect by watching at the viewpoint corresponding to the received view. On the other hand, since the amount of data corresponding to the view is smaller, the data processing pressure of the server and the network transmission pressure can be reduced.

[0131] In addition, by indirectly indicating the number of target sub-areas by including indication information of the viewer's viewing position, the server can determine both the number of target sub-areas and the viewing status of the viewer based on the indication information. In this way, the information interaction between the server and the three-dimensional display terminal can be reduced, further reducing the network transmission pressure.

[0132] Figure 6 3D image data processing method provided by an embodiment of the present disclosure. The method can be executed by a server. The method is used to provide 3D image data to multiple 3D display terminals, wherein the multiple 3D display terminals include a first display terminal and at least one second display terminal, such as Figure 6 As shown, the method includes:

[0133] In step 501, first viewing angle indication information is received.

[0134] The first viewing angle indication information is used to indicate a first viewing angle of the first display terminal with respect to the target object.

[0135] In step 502, a first target view corresponding to the first viewing angle is determined according to the first viewing angle indication information.

[0136] In some examples, the number of first target views is smaller than the number of viewpoints of the first display terminal. By sending image data corresponding to some viewpoints to the first display terminal and the second display terminal for display, the amount of image data is reduced compared to sending image data corresponding to all viewpoints, thereby reducing image processing pressure on the server and network transmission pressure.

[0137] In step 503 , the image data of the first target view is sent to the first display terminal and at least one second display terminal.

[0138] By simultaneously sending image data of the first target view to a first display terminal and at least one second display terminal, that is, sending image data of the same view to both the first and second display terminals, synchronized display can be achieved on the first and second display terminals. Furthermore, the first target view is determined based on the first viewing angle indication information corresponding to the first display terminal. This ensures that the content displayed on the second display terminal follows the content displayed on the first display terminal, making it suitable for teaching scenarios, conference scenarios, and live broadcast scenarios.

[0139] Figure 7 This is a flow chart of a method for processing three-dimensional image data provided by an embodiment of the present disclosure. Figure 7 As shown, the method is performed by the first display terminal, the server and the second display terminal. The first display terminal and the second display terminal are both Figure 2 The three-dimensional display terminal shown. The method includes:

[0140] In step 601, a first display terminal sends first viewing angle indication information.

[0141] Correspondingly, the server receives the first viewing angle indication information.

[0142] The first viewing angle indication information is used to indicate a first viewing angle of the first display terminal with respect to the target object.

[0143] In some examples, the first viewing angle indication information may directly indicate the first viewing angle, for example, the first viewing angle indication information includes the viewing angle of the viewer of the first display terminal. Alternatively, the first viewing angle indication information may indirectly indicate the first viewing angle, for example, the first viewing angle indication information includes the viewing position of the viewer of the first display terminal, or includes the viewpoint corresponding to the viewing position of the viewer of the first display terminal.

[0144] In some examples, the first viewing angle indication information is generated based on the viewing position of a viewer of the first display terminal.

[0145] In other examples, the first viewing angle indication information is generated by the first display terminal based on an operation instruction input by the user. The operation instruction is used to indicate the first viewing angle selected by the user. The embodiments of the present disclosure do not limit the method by which the user inputs the operation instruction, including but not limited to voice input, gesture input, and input via a touch screen.

[0146] For the relevant content of the first viewing angle indication information, reference may be made to the relevant content of the second indication information in the aforementioned step 403, and a detailed description thereof will be omitted here.

[0147] In step 602, the server determines a first target view corresponding to the first viewing angle according to the first viewing angle indication information.

[0148] In some examples, the number of first target views is smaller than the number of viewpoints of the first display terminal. By sending image data corresponding to some viewpoints to the first display terminal and the second display terminal for display, the amount of image data is reduced compared to sending image data corresponding to all viewpoints, thereby reducing image processing pressure on the server and network transmission pressure.

[0149] In some examples, the first viewing angle indication information includes a viewing position of a viewer of the first display terminal. Step 602 includes: determining a first viewpoint corresponding to the viewing position of the viewer of the first display terminal based on a preset correspondence between viewpoints and viewing positions; and using views corresponding to the first viewpoint and N second viewpoints as first target views, where the N second viewpoints are the N viewpoints closest to the first viewpoint among the plurality of viewpoints; wherein N is an even number and N ≥ 0.

[0150] In other examples, the first viewpoint information includes an identifier of a target viewpoint, the target viewpoint includes the first viewpoint, or the target viewpoint includes the first viewpoint and N second viewpoints, the first viewpoint is a viewpoint corresponding to the viewer's viewing position, and the N second viewpoints are the N viewpoints closest to the first viewpoint among multiple viewpoints, where N is an even number and N≥0; step 602 includes: taking the view corresponding to the first viewpoint and the N second viewpoints as the first target view.

[0151] For related content, please refer to the aforementioned step 405 and will not be described in detail here.

[0152] In step 603 , the server sends image data of the first target view to the first display terminal and at least one second display terminal.

[0153] In step 604 , the first display terminal and the second display terminal display the received image data.

[0154] By simultaneously sending the image data of the first target view to the first display terminal and at least one second display terminal, that is, sending image data of the same view to the first display terminal and the second display terminal, synchronized display can be achieved on the first display terminal and the second display terminal. Furthermore, the first target view is determined based on the first viewing angle indication information corresponding to the first display terminal. This ensures that the content displayed on the second display terminal follows the content displayed on the first display terminal.

[0155] Furthermore, since the angles (or images) of the three-dimensional images seen by viewers at different viewpoints may be different, when the first display terminal has only one viewer and the first target view corresponds to the viewing position of the viewer of the first display terminal, by sending the image data of the first target view to the first display terminal, the viewer of the second display terminal must be at the corresponding position to be able to see a clear image. In this way, it can be ensured that the content seen by the viewer of the second display terminal is highly consistent with that of the viewer of the first display terminal.

[0156] In some scenarios, there may be at least one second display terminal that needs to view a 3D image from a different viewing angle without affecting other second display terminals and the first display terminal. In this case, the method may further include:

[0157] In step 605, the third display terminal generates second viewing angle indication information according to the operation instruction input by the user.

[0158] The third display terminal is one of the at least one second display terminal, and the second viewing angle indication information is used to indicate a second viewing angle of the third display terminal for the target object.

[0159] The input method of the operation instruction is shown in step 601, and the detailed description is omitted here.

[0160] In step 606, the third display terminal sends second viewing angle indication information to the server.

[0161] Correspondingly, the server receives the second viewing angle indication information sent by the third display terminal.

[0162] In step 607, the server determines a second target view corresponding to the second viewing angle according to the second viewing angle indication information.

[0163] The implementation of this step refers to the aforementioned step 602, and the detailed description is omitted here.

[0164] In step 608, the server sends the image data of the second target view to the third display terminal. The third display terminal receives the image data of the second target view. After receiving the image data of the second target view, the third display terminal controls the display panel to emit light based on the received image data, thereby displaying the corresponding three-dimensional image. The first display terminal and the other display terminals continue to display the image data of the first target view. In this way, the third display terminal can display a different three-dimensional image from the first display terminal and the other second display terminals, achieving asynchronous display.

[0165] Optionally, the first viewing angle indication information is further used to indicate whether synchronization is established. When the first viewing angle indication information indicates synchronization, steps 603 and 604 are performed. When the first viewing angle indication information indicates asynchrony, steps 603 and 604 are replaced by the server sending the image data of the first target view to the first display terminal, and the first display terminal displays the received image data.

[0166] It should be noted that the method may further include: before step 601, the server establishing an association relationship between multiple display terminals; and determining a first display terminal and a second display terminal from the multiple display terminals.

[0167] In the embodiment of the present disclosure, the manner of establishing the association relationship includes but is not limited to: adding multiple display terminals to the same group, or adding multiple display terminals to the same conference, etc.

[0168] Optionally, the first display terminal can be fixed. For example, the same 3D display terminal is always used as the first display terminal until the group is disbanded or the meeting ends. In some examples, the server can determine the first display terminal as the 3D display terminal corresponding to the group creator or the meeting initiator. In other examples, the server can determine the first display terminal based on the identity information of the user of the 3D display terminal.

[0169] Alternatively, the first display terminal may also be changeable. For example, before the group is disbanded or before the conference is received, the server may determine the first display terminal from multiple three-dimensional display terminals that are associated with each other according to predetermined rules, such as using the three-dimensional display terminal used by the user currently speaking as the first display terminal.

[0170] Among the multiple three-dimensional display terminals that are associated, the other three-dimensional display terminals except the first display terminal are second display terminals. The embodiment of the present disclosure does not limit the number of second display terminals.

[0171] The following combination Figure 8 and Figure 9 right Figure 7The application scenario of the method shown is illustrated with an example.

[0172] like Figure 8 As shown, in a teaching scenario, the first display terminal A is used by the lecturer, and the second display terminals B, C, and D are used by the audience. The server (not shown) determines the lecturer's designated viewing angle and the lecturer's viewpoint through the first display terminal A. It then pushes the current teaching content, such as chemical molecular structures, to the first display terminal A and the second display terminals B, C, and D, ensuring that the audience and the lecturer see the 3D model from the same angle.

[0173] In a conference scenario, the first display terminal is the 3D display terminal used by the current speaker, and the other 3D display terminals are the second display terminals. Each 3D display terminal can perform voice detection separately. When a voice input is detected, it sends a request to the server. The server will use the 3D display terminal corresponding to the received request as the first display terminal.

[0174] Taking a meeting to discuss a design plan as an example, during the plan presentation phase, 3D display terminal A is the 3D display terminal used by the speaker, that is, the first display terminal, and the other 3D display terminals B, C, and D are the second display terminals. 3D display terminal A displays the front, side, top view, and cross-section of the object one by one according to the current sharing progress of the speaker. The server synchronously pushes the content displayed by 3D display terminal A to 3D display terminals B, C, and D to achieve synchronous display. During this process, if the user of 3D display terminal C (the third display terminal) wants to observe and understand a certain angle in detail, he sends a second perspective indication information to the server, and does not share the perspective he uses. The server sends the image data of the view corresponding to the second perspective indication information to 3D display terminal C, and 3D display terminal C achieves asynchronous display.

[0175] During the discussion phase, the speaker's 3D display terminal becomes the primary display terminal, and the primary display terminal changes as the speaker changes. When the user of 3D display terminal D speaks, 3D display terminal D becomes the primary display terminal. The server sends image data corresponding to the view angle selected by 3D display terminal D to the 3D display terminal and synchronizes this image data with 3D display terminals A, B, and C.

[0176] In a live broadcast scenario, the terminal used by the host is the first display terminal, and the terminal used by the audience is the second display terminal. When the user corresponding to the second display terminal enters the live broadcast room for the first time, the server can send image data with the same viewing angle as the first display terminal to the second display terminal, thus achieving synchronous sharing. The user of the second display terminal can select the viewing angle they want to watch and send viewing angle indication information to the server. The server adjusts the viewing angle corresponding to the image data of the second display terminal based on the received viewing angle indication information, so that the second display terminal can display the image of the viewing angle the user wants to watch without affecting other second display terminals, thereby achieving asynchronous display.

[0177] Figure 10 FIG. 1 is a block diagram of a three-dimensional image data processing device provided by an embodiment of the present disclosure. Figure 10 As shown, the apparatus 900 is used to provide 3D image data to a 3D display terminal. The 3D display terminal has multiple viewpoints arranged in sequence. The viewing area of ​​the 3D display terminal includes multiple sub-areas. The sub-areas are arranged in the same direction as the viewpoints, and different sub-areas correspond to at least partially different viewpoints. The apparatus 900 includes a receiving module 901, a determining module 902, and a sending module 903.

[0178] The receiving module 901 is used to receive indication information, where the indication information is used to indicate the number of target sub-areas, where the target sub-areas are sub-areas in the viewing area where viewers exist; the determining module 902 is used to determine the target view based on the indication information, wherein the number of target views determined when the number of target sub-areas is equal to 1 is less than the number of target views determined when the number of target sub-areas is greater than 1; the sending module 903 is used to send image data of the target view to the three-dimensional display terminal.

[0179] Optionally, the multiple viewpoints respectively correspond to a view, the number of the target sub-regions is greater than 1, and the determining module 902 is configured to use all views corresponding to the multiple viewpoints as the target views.

[0180] Optionally, the multiple viewpoints correspond to a view respectively, the number of the target sub-areas is equal to 1, and the determination module 902 is used to determine the viewpoint used by the viewer of the three-dimensional display terminal; and the view corresponding to the viewpoint used by the viewer among the views corresponding to the multiple viewpoints is used as the target view.

[0181] Optionally, the indication information includes the viewing position of the viewer of the three-dimensional display terminal, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; the determination module 902 is used to determine the first viewpoint corresponding to the target sub-area based on the correspondence between the preset viewpoint and the viewing position; the first viewpoint and N second viewpoints are used as the viewpoints used by the viewer, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints; wherein N is an even number, and N≥0.

[0182] Optionally, the indication information includes an identifier of a target viewpoint, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; the determination module 902 is used to determine the viewpoint used by the viewer of the three-dimensional display terminal based on the identifier of the target viewpoint, wherein the target viewpoint includes a first viewpoint, or the target viewpoint includes a first viewpoint and N second viewpoints, the first viewpoint is a viewpoint corresponding to the target sub-area, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints, wherein N is an even number and N≥0; the viewpoint used by the viewer includes the first viewpoint and the N second viewpoints.

[0183] Optionally, the sending module 903 is used to, in response to determining that the viewer is in motion, send image data of the target view with a first resolution to the three-dimensional display terminal; in response to determining that the viewer is in a stationary state, send image data of the target view with a second resolution to the three-dimensional display terminal; wherein the first resolution is lower than the second resolution.

[0184] Optionally, when the number of the target sub-regions is equal to 1, the resolution of the target view determined is greater than the resolution of the target view determined when the number of the target sub-regions is greater than 1.

[0185] Figure 11 This is a block diagram of a three-dimensional image data processing device provided by an embodiment of the present disclosure. Figure 11As shown, the apparatus 1000 is used to provide 3D image data to multiple 3D display terminals, the multiple 3D display terminals including a first display terminal and at least one second display terminal. The apparatus 1000 includes: a receiving module 1001, a determining module 1002, and a sending module 1003. The receiving module 1001 is used to receive first viewing angle indication information, the first viewing angle indication information being used to indicate a first viewing angle of a target object of the first display terminal; the determining module 1002 is used to determine, based on the first viewing angle indication information, first target views corresponding to the first viewing angle, where the number of the first target views is less than the number of viewpoints of the first display terminal; and the sending module 1003 is used to send image data of the first target views to the first display terminal and the at least one second display terminal.

[0186] Optionally, the first viewing angle indication information includes the viewing position of the viewer of the first display terminal; the determination module 1002 is used to determine the first viewpoint corresponding to the viewing position of the viewer of the first display terminal according to the preset correspondence between the viewpoint and the viewing position; the view corresponding to the first viewpoint and N second viewpoints is used as the first target view, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints; wherein N is an even number, and N≥0.

[0187] Optionally, the first viewing angle indication information includes an identifier of the target viewpoint, the target viewpoint includes a first viewpoint, or the target viewpoint includes a first viewpoint and N second viewpoints, the first viewpoint is a viewpoint corresponding to the viewing position of the viewer of the first display terminal, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints, where N is an even number and N≥0; the determination module 1002 is used to, based on the identifier of the target viewpoint, take the view corresponding to the first viewpoint and the N second viewpoints as the first target view.

[0188] Optionally, the receiving module 1001 is also used to receive second viewing angle indication information sent by a third display terminal, where the third display terminal is one of the at least one second display terminal, and the second viewing angle indication information is used to indicate the second viewing angle of the third display terminal for the target object; the determining module 1002 is also used to determine the second target view corresponding to the second viewing angle based on the second viewing angle indication information; and the sending module 1003 is also used to send image data of the second target view to the third display terminal.

[0189] It should be noted that the 3D image data processing device provided in the above embodiments is merely illustrated by the division of the aforementioned functional modules when processing 3D image data. In actual applications, the aforementioned functions can be assigned to different functional modules as needed, i.e., the internal structure of the device can be divided into different functional modules to perform all or part of the functions described above. Furthermore, the 3D image data processing device provided in the above embodiments and the 3D image data processing method embodiment are based on the same concept. The implementation process is detailed in the method embodiment and will not be further described here.

[0190] like Figure 12 As shown, the embodiment of the present disclosure further provides a computer device 1100, which can be a 3D image data processing device, such as the aforementioned server. The computer device 1100 can be used to execute the 3D image data processing method provided in each of the above embodiments. Figure 12 The computer device 1100 includes: a memory 1101, a processor 1102 and a communication component 1103. The memory 1101 and the communication component 1103 can be connected to the processor 1102 via a bus. It can be understood by those skilled in the art that Figure 12 The structure of the computer device 1100 shown in the figure does not constitute a limitation of the computer device 1100. In actual applications, the computer device 1100 may include more or fewer components than shown in the figure, or some components may be combined, or the components may be arranged differently.

[0191] Memory 1101 can be used to store computer programs and modules. Memory 1101 may primarily include a program storage area and a data storage area. The program storage area may store an operating system, at least one application required for a function, and the like. Memory 1101 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state memory device. Accordingly, memory 1101 may also include a memory controller to provide processor 1102 with access to memory 1101.

[0192] The processor 1102 executes various functional applications and data processing by running software programs and modules stored in the memory 1101 .

[0193] The communication component 1103 is used to communicate with the 3D display terminal, for example, to receive instruction information and first-view instruction information sent by the 3D display terminal, and to send image data to the 3D display terminal.

[0194] The embodiment of the present disclosure also provides a display system, including a server and a three-dimensional display terminal. The three-dimensional display terminal has a plurality of viewpoints arranged in sequence, and the viewing area of ​​the three-dimensional display terminal includes a plurality of sub-areas, the arrangement direction of the plurality of sub-areas is the same as the arrangement direction of the plurality of viewpoints, and the viewpoints corresponding to different sub-areas are at least partially different. The three-dimensional display terminal is used to send indication information, the indication information is used to indicate the number of target sub-areas, and the target sub-areas are sub-areas in the viewing area where viewers exist; the server is used to determine the target view based on the received indication information, wherein the number of target views determined when the number of target sub-areas is equal to 1 is less than the number of target views determined when the number of target sub-areas is greater than 1; and send the image data of the target view to the three-dimensional display terminal. The three-dimensional display terminal is also used to display a three-dimensional image based on the received image data.

[0195] For more information about the server and 3D display terminal, please refer to Figure 3 and Figure 4 The method embodiments shown are not described in detail here.

[0196] The present disclosure also provides a display system including a server, a first display terminal, and a second display terminal. The first display terminal is configured to send first viewing angle indication information, the first viewing angle indication information being configured to indicate a first viewing angle of the first display terminal with respect to a target object. The server is configured to determine, based on the first viewing angle indication information, a first target view corresponding to the first viewing angle, the number of the first target views being less than the number of viewpoints possessed by the first display terminal; and to send image data of the first target view to the first display terminal and at least one second display terminal. The first display terminal and the second display terminal are further configured to display a three-dimensional image based on the received image data.

[0197] For more information about the server, the first display terminal, and the second display terminal, see Figure 6 and Figure 7 The method embodiments shown are not described in detail here.

[0198] In an exemplary embodiment, a computer-readable storage medium is also provided. The computer-readable storage medium is a non-volatile storage medium. A computer program is stored in the computer-readable storage medium. When the computer program in the computer-readable storage medium is executed by a processor, the three-dimensional image data processing method provided in the embodiment of the present disclosure can be executed.

[0199] In an exemplary embodiment, a computer program product is further provided. The computer program product stores instructions, which, when executed on a computer, enable the computer to execute the method for processing three-dimensional image data provided by the embodiment of the present disclosure.

[0200] In an exemplary embodiment, a chip is further provided. The chip includes a programmable logic circuit and / or program instructions. When the chip is running, it can execute the three-dimensional image data processing method provided by the embodiment of the present disclosure.

[0201] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0202] The above description is merely an optional embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the scope of protection of the present disclosure.

Claims

1. A method for processing three-dimensional image data, characterized in that: A method for providing three-dimensional image data for a three-dimensional display terminal, wherein the three-dimensional display terminal has a plurality of viewpoints arranged in sequence, a viewing area of ​​the three-dimensional display terminal includes a plurality of sub-areas, an arrangement direction of the plurality of sub-areas is the same as an arrangement direction of the plurality of viewpoints, and different sub-areas correspond to at least partially different viewpoints, the method comprising: receiving indication information, where the indication information is used to indicate the number of target sub-areas, where the target sub-areas are sub-areas in the viewing area where viewers exist; determining a target view based on the indication information, wherein the number of target views determined when the number of the target sub-regions is equal to 1 is smaller than the number of target views determined when the number of the target sub-regions is greater than 1; The image data of the target view is sent to the 3D display terminal.

2. The method according to claim 1, characterized in that The multiple viewpoints each correspond to a view, the number of the target sub-regions is greater than 1, The determining the target view based on the indication information includes: The views corresponding to the multiple viewpoints are all used as the target views.

3. The method according to claim 1, characterized in that The multiple viewpoints each correspond to a view, the number of the target sub-regions is equal to 1, The determining the target view based on the indication information includes: determining a viewpoint used by a viewer of the three-dimensional display terminal; Among the views corresponding to the multiple viewpoints, the view corresponding to the viewpoint used by the viewer is used as the target view.

4. The method according to claim 3, characterized in that The indication information includes a viewing position of a viewer of the three-dimensional display terminal, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; The determining of the viewpoint used by the viewer of the three-dimensional display terminal includes: Determining a first viewpoint corresponding to the target sub-region according to a preset correspondence between viewpoints and viewing positions; using the first viewpoint and N second viewpoints as viewpoints used by the viewer, wherein the N second viewpoints are the N viewpoints closest to the first viewpoint among the plurality of viewpoints; Wherein, N is an even number and N≥0.

5. The method according to claim 3, characterized in that The indication information includes an identifier of a target viewpoint, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; The determining of the viewpoint used by the viewer of the three-dimensional display terminal includes: determining the viewpoint used by the viewer of the three-dimensional display terminal according to the identifier of the target viewpoint, The target viewpoint includes a first viewpoint, or the target viewpoint includes a first viewpoint and N second viewpoints, the first viewpoint is the viewpoint corresponding to the target sub-area, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints, wherein N is an even number and N≥0; the viewpoint used by the viewer includes the first viewpoint and the N second viewpoints.

6. The method according to any one of claims 3 to 5, characterized in that The sending the image data of the target view to the three-dimensional display terminal includes: In response to determining that the viewer is in motion, sending image data of the target view with a first resolution to the three-dimensional display terminal; In response to determining that the viewer is in a stationary state, sending image data of the target view with a second resolution to the 3D display terminal; The first resolution is lower than the second resolution.

7. The method according to claim 1, characterized in that The resolution of the target view determined when the number of the target sub-regions is equal to 1 is greater than the resolution of the target view determined when the number of the target sub-regions is greater than 1.

8. A three-dimensional image data processing device, characterized in that: A device for providing three-dimensional image data for a three-dimensional display terminal, wherein the three-dimensional display terminal has a plurality of viewpoints arranged in sequence, a viewing area of ​​the three-dimensional display terminal including a plurality of sub-areas, an arrangement direction of the plurality of sub-areas being the same as an arrangement direction of the plurality of viewpoints, and different sub-areas corresponding to at least partially different viewpoints, the device comprising: A receiving module, configured to receive indication information, wherein the indication information is used to indicate the number of target sub-areas, where the target sub-areas are sub-areas in the viewing area where viewers exist; a determining module, configured to determine a target view based on the indication information, wherein the number of target views determined when the number of target sub-regions is equal to 1 is smaller than the number of target views determined when the number of target sub-regions is greater than 1; A sending module is used to send the image data of the target view to the three-dimensional display terminal.

9. The device according to claim 8, characterized in that The multiple viewpoints each correspond to a view, the number of the target sub-regions is greater than 1, The determining module is configured to use the views corresponding to the multiple viewpoints as the target views.

10. The device according to claim 8, characterized in that The multiple viewpoints each correspond to a view, the number of the target sub-regions is equal to 1, The determining module is used to determine the viewpoint used by the viewer of the 3D display terminal; Among the views corresponding to the multiple viewpoints, the view corresponding to the viewpoint used by the viewer is used as the target view.

11. The device according to claim 10, characterized in that The indication information includes a viewing position of a viewer of the three-dimensional display terminal, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; The determination module is used to determine a first viewpoint corresponding to the target sub-area based on a correspondence between a preset viewpoint and a viewing position; use the first viewpoint and N second viewpoints as viewpoints used by the viewer, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints; wherein N is an even number and N≥0.

12. The device according to claim 10, characterized in that The indication information includes an identifier of a target viewpoint, and the indication information is generated by the three-dimensional display terminal when the number of the target sub-areas is 1; The determining of the viewpoint used by the viewer of the three-dimensional display terminal includes: determining the viewpoint used by the viewer of the three-dimensional display terminal according to the identifier of the target viewpoint, wherein the target viewpoint includes a first viewpoint, or the target viewpoint includes a first viewpoint and N second viewpoints, the first viewpoint is a viewpoint corresponding to the target sub-area, and the N second viewpoints are the N viewpoints closest to the first viewpoint among the multiple viewpoints, wherein N is an even number and N≥0; the viewpoint used by the viewer includes the first viewpoint and the N second viewpoints.

13. The device according to any one of claims 10 to 12, characterized in that The sending module is configured to, in response to determining that the viewer is in motion, send the image data of the target view with a first resolution to the 3D display terminal; In response to determining that the viewer is in a stationary state, image data of the target view with a second resolution is sent to the 3D display terminal; wherein the first resolution is lower than the second resolution.

14. A computer device, characterized in that: The computer device includes a processor and a memory; Wherein, the memory is used to store computer programs; The processor is configured to execute the computer program stored in the memory to implement the three-dimensional image data processing method according to any one of claims 1 to 7.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and when the stored computer instructions are executed by a processor, the method for processing three-dimensional image data according to any one of claims 1 to 7 can be implemented.

16. A computer program product, characterized in that The computer program product stores instructions, and when the computer program product is run on a computer, the computer is enabled to execute the method for processing three-dimensional image data according to any one of claims 1 to 7.

Images