Display method, system, device, equipment, program and medium

Abstract

A display method, system, apparatus, device, program and medium are applied to a video data processing end. The display method comprises: in response to a frame start signal, acquiring a 3D video signal (S101); processing the 3D video signal according to the human eye coordinates sent by the human eye data acquisition terminal to obtain left and right eye images (S102); in response to the third trigger signal, transmitting the left and right eye images to a display terminal, so as to display the left and right eye images on the display terminal (S103); and according to the third trigger signal, generating a first trigger signal and / or a second trigger signal, and sending the first trigger signal and / or the second trigger signal to a human eye data acquisition end, so that the human eye data acquisition end acquires a human eye image in response to the first trigger signal, and performs human eye tracking processing based on the human eye image in response to the second trigger signal. And acquiring a human eye coordinate (S104).

Description

Display method, system, device, equipment, program and medium Technical Field

[0001] The embodiments of the present disclosure relate to the field of display technology, and more specifically, to a display method, system, device, equipment, program, and medium. Background Art

[0002] Display devices used in daily life generally use two-dimensional (2D) displays, which cannot intuitively represent the depth of a scene. With the development of computer information technology and display technology, three-dimensional display technology has become a research focus in the display field. Three-dimensional (3D) display technology allows the viewer's left and right eyes to receive images of the same scene separately. The position difference caused by the distance between the pupils of the viewer's two eyes results in two slightly different images appearing on the viewer's left and right retinas. This difference is called "binocular parallax." These two different images form a "stereoscopic image pair." After the "stereoscopic image pair" is fused by the brain's visual cortex, a three-dimensional effect is formed.

[0003] Currently, 3D display technologies are divided into two categories: glasses-free and glasses-based. Glasses-free 3D display technology, which significantly improves user experience by eliminating the need for viewers to wear 3D glasses, has become a hot research topic within the field.

[0004] Summary of the Invention

[0005] The present disclosure provides a display method, system, device, apparatus, program, and medium. The technical solutions adopted by the present disclosure are as follows:

[0006] A first aspect of an embodiment of the present disclosure provides a display method, applied to a video data processing terminal, the method comprising:

[0007] In response to a frame start signal, acquiring a 3D video signal;

[0008] Processing the 3D video signal according to the eye coordinates sent by the eye data acquisition terminal to obtain left and right eye images;

[0009] In response to a third trigger signal, sending the left-eye and right-eye images to a display end so as to display the left-eye and right-eye images on the display end;

[0010] According to the third trigger signal, a first trigger signal and / or a second trigger signal is generated, and the first trigger signal and / or the second trigger signal is sent to the human eye data acquisition end, so that the human eye data acquisition end collects a human eye image in response to the first trigger signal, and performs human eye tracking processing based on the human eye image in response to the second trigger signal to obtain the human eye coordinates.

[0011] In an optional implementation, before processing the 3D video signal, the method further includes:

[0012] performing segmentation processing on the 3D video signal to obtain a first video signal and a second video signal, wherein one of the first video signal and the second video signal is a left-eye video signal corresponding to the 3D video signal, and the other is a right-eye video signal;

[0013] acquiring, based on the first video signal, first video data and timing information corresponding to the first video signal, and writing the first video data into a memory over a fifth time period, where the fifth time period is half the time of inputting one frame of the 3D video signal;

[0014] Based on the timing information, output timing information is generated, where the output timing information represents an output timing of the left-eye and right-eye images at the display end.

[0015] In an optional implementation, generating a second trigger signal according to the third trigger signal includes:

[0016] Determining a third moment, where the third moment is the moment when the third trigger signal triggers the left-eye and right-eye images to be sent to the display end;

[0017] Obtaining a third time period, and reversely delaying the third time period from the third moment to determine a second moment, wherein the third time period is the time for the human eye data acquisition end to perform human eye tracking processing on a frame of human eye image;

[0018] The second trigger signal is generated based on the second moment, so that the second trigger signal triggers the human eye data acquisition end to acquire the human eye coordinates at the second moment.

[0019] In an optional implementation, determining the third moment includes:

[0020] Acquire a first time period, where the first time period is the time for inputting one frame of the 3D video signal;

[0021] The third moment is determined based on the first time period corresponding to the current frame, where the third moment is the midpoint of the first time period.

[0022] In an optional implementation, generating a first trigger signal according to the third trigger signal includes:

[0023] Acquire a fourth time period, where the fourth time period is the time for the human eye data acquisition end to acquire one frame of the human eye image;

[0024] Delaying the fourth time period in reverse from the second time to determine the first time;

[0025] The first trigger signal is generated based on the first moment, so that the first trigger signal triggers the human eye data acquisition end to acquire the human eye image of the current frame at the first moment.

[0026] In an optional implementation, generating a first trigger signal according to the third trigger signal includes:

[0027] Acquire a fourth time period, where the fourth time period is the time for the human eye data acquisition end to acquire one frame of the human eye image;

[0028] Determining a fourth moment based on the third time period, where the fourth moment is the moment when the human eye data acquisition end completes the human eye tracking process on the previous frame of human eye image;

[0029] Delaying the fourth moment in a positive direction by a time period equal to the difference between the third time period and the fourth time period to determine a first moment;

[0030] The first trigger signal is generated based on the first moment, so that the first trigger signal triggers the human eye data acquisition end to acquire the human eye image of the current frame at the first moment.

[0031] In an optional implementation, generating a second trigger signal according to the third trigger signal, and sending the second trigger signal to the human eye data acquisition terminal includes:

[0032] determining a first quantity based on the first time period and the third time period;

[0033] generating the first number of second trigger signals at the second moment, so that a frequency of acquiring the eye coordinates in response to the first number of second trigger signals matches a frequency of acquiring 3D video signals;

[0034] The first number of second trigger signals are sequentially sent to a second number of human eye tracking subsystems in the human eye data acquisition terminal, where the second number is greater than or equal to the first number.

[0035] In an optional implementation, determining the first quantity based on the first time period and the third time period includes:

[0036] The ratio of the third time period to the first time period is calculated, and the ratio is rounded up to obtain the first quantity.

[0037] In an optional implementation, processing the 3D video signal according to the eye coordinates sent by the eye data acquisition terminal includes:

[0038] acquiring second video data based on the second video signal;

[0039] Reading the first video data from the memory, and performing distribution stretching on the first video data and the second video data to obtain left and right video data, wherein the left and right video data have the same resolution as the 3D video signal;

[0040] In response to the eye coordinates sent by the eye data acquisition terminal, the left and right video data are pixel-rearranged based on the eye coordinates and the output timing information to generate the left and right eye images.

[0041] In an optional implementation, reading the first video data from the memory, and performing distribution stretching on the first video data and the second video data to obtain left and right video data includes:

[0042] After the first video data is completely written, the first video data is read during a sixth time period, where the sixth time period is the same length as the fifth time period;

[0043] The first video data and the second video data are distributed and stretched to obtain the left and right video data.

[0044] A second aspect of the present disclosure provides a display method, which is applied to a human eye data acquisition terminal. The method includes:

[0045] In response to a first trigger signal sent by the video data processing end, collecting a human eye image;

[0046] In response to a second trigger signal sent by the video data processing end, performing eye tracking processing on the human eye image to obtain human eye coordinates;

[0047] The human eye coordinates are sent to the video data processing end so that the video data processing end processes the 3D video signal based on the human eye coordinates to generate left and right eye images, and sends the left and right eye images to the display end in response to a third trigger signal, wherein the first trigger signal and / or the second trigger signal are generated according to the third trigger signal.

[0048] In an optional embodiment, in response to a first trigger signal sent by the video data processing end, collecting a human eye image includes:

[0049] receiving the first trigger signal sent by the video data processing end;

[0050] In response to the first trigger signal at a first moment, controlling the image acquisition device to acquire a frame of the human eye image over a fourth time period;

[0051] In response to the second trigger signal sent by the video data processing end, performing eye tracking processing on the human eye image to obtain human eye coordinates, including:

[0052] receiving the second trigger signal sent by the video data processing end;

[0053] In response to the second trigger signal at the second moment, a human eye tracking process is performed on a frame of the human eye image during a third period to obtain the human eye coordinates.

[0054] In an optional embodiment, the human eye data acquisition end includes a second number of human eye tracking subsystems, and receiving the second trigger signal sent by the video data processing end includes:

[0055] receiving a first number of the second trigger signals sequentially sent by the video data processing end within the third time period, where the second number is greater than or equal to the first number;

[0056] In response to each second trigger signal, the eye tracking subsystem is controlled to perform eye tracking processing on the eye image, so that each newly received second trigger signal triggers the eye tracking subsystem that has not been triggered within the third time period.

[0057] A third aspect of the present disclosure provides a display system, including:

[0058] A human eye data acquisition terminal, configured to acquire a human eye image in response to a first trigger signal, and perform human eye tracking processing based on the human eye image in response to a second trigger signal to obtain human eye coordinates;

[0059] a video data processing end, the video data acquisition end being communicatively connected to the human eye data acquisition end, configured to process the 3D video signal based on the human eye coordinates to generate left and right eye images, and transmit the left and right eye images to the display end in response to a third trigger signal;

[0060] The display terminal is communicatively connected to the video data processing terminal, and is configured to receive and display the left and right eye images;

[0061] At least one of the first trigger signal and the second trigger signal is generated according to the third trigger signal.

[0062] In an optional embodiment, the human eye data acquisition terminal is configured with a human eye data acquisition subsystem and a human eye tracking subsystem, and the human eye data acquisition subsystem is communicatively connected to the human eye tracking subsystem;

[0063] The human eye data acquisition subsystem is configured to respond to the first trigger signal at a first moment and acquire a frame of the human eye image over a fourth time period;

[0064] The eye tracking subsystem is communicatively connected to the video data processing terminal, and is configured to respond to the second trigger signal at the second moment, perform eye tracking processing on a frame of the eye image during a third period of time, and obtain eye coordinates;

[0065] The difference between the first moment and the second moment is equal to the fourth time period, the difference between the second moment and the third moment is equal to the third time period, and the third moment is the triggering moment of the third trigger signal.

[0066] In an optional embodiment, the video data processing end is configured with a video receiving subsystem, a video post-processing subsystem and a video sending subsystem;

[0067] The video receiving subsystem is configured to acquire the 3D video signal and perform segmentation processing on the 3D video signal to obtain a first video signal and a second video signal;

[0068] The video post-processing subsystem is configured to generate output timing information based on the first video signal, and generate the left-eye and right-eye images based on the post-processing information, wherein the post-processing information includes at least one of the following: the eye coordinates, the first video signal, the second video signal, and the output timing information;

[0069] The video sending subsystem is configured to send the left-eye and right-eye images to the display end in response to the third trigger signal at a third moment.

[0070] In an optional embodiment, the video data processing end reversely generates the first trigger signal based on the third moment, the third time period, and the fourth time period, so that the first trigger signal triggers the human eye data acquisition subsystem to acquire the human eye image for the current frame at the first moment;

[0071] The first moment is used to represent the moment when the human eye data acquisition subsystem finishes acquiring the human eye image of the previous frame.

[0072] In an optional embodiment, the video data processing end reversely generates the first trigger signal based on the second trigger signal and the fourth time period, so that the first trigger signal triggers the human eye data acquisition subsystem to acquire the human eye image of the current frame at the first moment.

[0073] In an optional embodiment, the video data processing end reversely generates the second trigger signal based on the third moment and the third time period, so that the second trigger signal triggers the eye tracking subsystem to obtain the eye coordinates of the current frame at the second moment;

[0074] The second moment is used to represent the moment when the eye tracking subsystem finishes acquiring the eye coordinates of the previous frame.

[0075] In an optional embodiment, the video data processing end generates the third trigger signal based on the first time period, so that the third trigger signal triggers the video data processing end to send the left and right eye images to the display end at the third moment;

[0076] The first time period is used to represent the time it takes for the video data processing end to input one frame of the 3D video signal.

[0077] In an optional embodiment, the video data processing end determines at least one second trigger signal based on the third moment and the third time period, so that the frequency of the human eye tracking subsystem collecting the human eye image in response to the at least one second trigger signal matches the frequency of the video data processing end acquiring the 3D video signal.

[0078] In an optional implementation, the video post-processing subsystem is configured to generate output timing information based on the first video signal, including:

[0079] The video post-processing subsystem obtains first video data and timing information corresponding to the first video signal based on the first video signal, writes the first video data into a memory, and generates the output timing information based on the timing information.

[0080] In an optional implementation, the video post-processing subsystem generates the left and right eye images based on the post-processing information, including:

[0081] The video post-processing subsystem reads the first video data from the memory, distributes and stretches the first video data and the second video data corresponding to the second video signal, and rearranges pixels based on the human eye coordinates and the output timing information to generate the left and right eye images.

[0082] In an optional embodiment, the video post-processing subsystem reads one frame of the first video data and one frame of the second video data from the memory in the same time period during which the video data processing end inputs one frame of the 3D video signal.

[0083] A fourth aspect of the present disclosure provides a display device, applied to a video data processing end, comprising:

[0084] A video acquisition module, configured to acquire a 3D video signal in response to a frame start signal;

[0085] A video processing module, configured to process the 3D video signal according to the eye coordinates sent by the eye data acquisition terminal to obtain left and right eye images;

[0086] a sending module, configured to send the left-eye and right-eye images to a display terminal in response to a third trigger signal, so as to display the left-eye and right-eye images on the display terminal;

[0087] A trigger signal module is used to generate a first trigger signal and / or a second trigger signal according to the third trigger signal, and send the first trigger signal and / or the second trigger signal to the human eye data acquisition end, so that the human eye data acquisition end collects a human eye image in response to the first trigger signal, and performs human eye tracking processing based on the human eye image in response to the second trigger signal to obtain the human eye coordinates.

[0088] A fifth aspect of the present disclosure provides a display device, which is applied to a human eye data collection terminal. The device includes:

[0089] A human eye acquisition module, configured to acquire a human eye image in response to a first trigger signal sent by the video data processing end;

[0090] an eye tracking module, configured to perform eye tracking processing on the eye image in response to a second trigger signal sent by the video data processing end, and obtain eye coordinates;

[0091] A coordinate sending module is used to send the human eye coordinates to the video data processing end, so that the video data processing end processes the 3D video signal based on the human eye coordinates to generate left and right eye images, and sends the left and right eye images to the display end in response to a third trigger signal, wherein the first trigger signal and / or the second trigger signal are generated according to the third trigger signal.

[0092] A sixth aspect of the present disclosure provides a computing and processing device, including:

[0093] a memory having computer readable code stored therein; and

[0094] One or more processors, when the computer-readable code is executed by the one or more processors, the computing and processing device executes the display method as described in any one of the first aspects, or the computing and processing device executes the display method as described in any one of the second aspects.

[0095] A seventh aspect of an embodiment of the present disclosure provides a computer program, comprising a computer-readable code, which, when executed on a computing and processing device, causes the computing and processing device to execute the display method according to any one of the first aspects, or causes the computing and processing device to execute the display method according to any one of the second aspects.

[0096] An eighth aspect of the embodiments of the present disclosure provides a computer-readable medium, in which the computer program described in the seventh aspect is stored.

[0097] The above description is only an overview of the technical solution of the present disclosure. In order to more clearly understand the technical means of the present disclosure, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present disclosure more obvious and easy to understand, the specific implementation methods of the present disclosure are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0098] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or related technologies, the following is a brief introduction to the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technical personnel in this field, other drawings can be obtained based on these drawings without any creative work.

[0099] FIG1 schematically shows a flow chart of a display method applied to a video data processing terminal for executing the method according to the present disclosure;

[0100] FIG2 schematically shows a schematic diagram of end-to-end system delay in the prior art;

[0101] FIG3 schematically shows a flow chart of video pre-processing for executing the method according to the present disclosure;

[0102] FIG4 schematically shows a reverse trigger timing diagram for executing the method according to the present disclosure;

[0103] FIG5 schematically shows a flow chart of a display method for executing the method according to the present disclosure;

[0104] FIG6 schematically shows a flow chart of a display method applied to a human eye data acquisition terminal for executing the method according to the present disclosure;

[0105] FIG7 schematically shows a schematic diagram of the structure of a display system for executing the method according to the present disclosure;

[0106] FIG8 schematically shows a structural diagram of an example of a display system for executing the method according to the present disclosure;

[0107] FIG9 schematically shows a schematic structural diagram of a display device applied to a video data processing terminal for executing the method according to the present disclosure;

[0108] FIG10 schematically shows a schematic structural diagram of a display device applied to a human eye data acquisition terminal for executing the method according to the present disclosure;

[0109] FIG11 schematically shows a structural diagram of a computing and processing device for executing the method according to the present disclosure. Specific embodiments

[0110] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of them. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary skill in the art without creative effort are within the scope of protection of the present disclosure.

[0111] Display devices used in daily life generally use two-dimensional (2D) displays, which cannot intuitively represent the depth of a scene. With the development of computer information technology and display technology, three-dimensional display technology has become a research focus in the display field. Three-dimensional (3D) display technology allows the viewer's left and right eyes to receive images of the same scene separately. The position difference caused by the distance between the pupils of the viewer's two eyes results in two slightly different images appearing on the viewer's left and right retinas. This difference is called "binocular parallax." These two different images form a "stereoscopic image pair." After the "stereoscopic image pair" is fused by the brain's visual cortex, a three-dimensional effect is formed.

[0112] Currently, 3D display technologies fall into two categories: glasses-free and glasses-based. Glasses-free 3D display technology, which eliminates the need for viewers to wear 3D glasses, uses an image acquisition device to capture the viewer's eye coordinates in real time. The coordinates of the left and right eyes are then used to sequentially control the on / off switching of pixels on the display terminal, creating a three-dimensional effect on the image displayed on the display terminal. Therefore, glasses-free 3D display technology can significantly enhance user experience and has become a hot research topic in the field of 3D display technology.

[0113] However, in the application of naked-eye 3D display technology, there is a long and variable delay between the time the image acquisition device captures the human eye image and the time the viewer sees the 3D display image on the display terminal. This delay is caused by asynchronous triggering between different modules of the naked-eye 3D display system. The existence of this asynchronous delay reduces the real-time performance of naked-eye 3D display technology, making it impossible to achieve real-time tracking of the naked-eye 3D display effect, and significantly degrading the user experience.

[0114] In view of this, an embodiment of the present disclosure provides a display method applied to a video data processing end. FIG1 schematically shows a flow chart of the display method applied to a video data processing end for executing the method according to the present disclosure. As shown in FIG1 , the method includes:

[0115] S101 : Responding to a frame start signal, acquiring a 3D video signal.

[0116] S102 : Process the 3D video signal according to the eye coordinates sent by the eye data acquisition terminal to obtain left and right eye images.

[0117] S103 . In response to a third trigger signal, send the left-eye and right-eye images to a display end, so as to display the left-eye and right-eye images on the display end.

[0118] S104. Generate a first trigger signal and / or a second trigger signal according to the third trigger signal, and send the first trigger signal and / or the second trigger signal to the human eye data acquisition end, so that the human eye data acquisition end collects a human eye image in response to the first trigger signal, and performs human eye tracking processing based on the human eye image in response to the second trigger signal to obtain the human eye coordinates.

[0119] In an embodiment of the present disclosure, the video data processing end is a system that processes a 3D video signal to obtain left and right eye images for display on a display end, and the eye data acquisition end is a system that processes the eye image to obtain eye coordinates for generating the left and right eye images. The 3D video signal is a video signal obtained by the video data processing end from a server, which can be a local server or a cloud server. The 3D video signal includes video data and timing information corresponding to the video data. The format of the 3D video signal can be a common 3D video signal format, such as side-by-side, top-and-bottom, and interlaced. It should be noted that the format of the 3D video signal can be determined according to actual conditions and is not specifically limited in this disclosure.

[0120] In the embodiment of the present disclosure, the frame start signal is a start signal for processing each frame of 3D video signal, and is used to trigger the video processing process of the current frame of 3D video signal after the video processing process of the previous frame of 3D video signal is completed. Since the frequency of sending each frame of 3D video signal by the server to the video data processing end is fixed, at the starting moment of each frame, the frame start signal is triggered along with the fixed sending frequency of each frame of 3D video signal.

[0121] The eye coordinates are the coordinates of the eye images in the face image collected in real time by the eye data acquisition end in a specified coordinate system. The specified coordinate system may be an image coordinate system or a pixel coordinate system corresponding to the image acquisition device in the eye data acquisition subsystem. The eye coordinates are used to determine the pixel offset values ​​of the left and right eyes when processing the 3D video signal. This allows for real-time correction of the pixel rearrangement process when generating the left and right eye images for each frame of the video signal based on the eye coordinates, thereby improving the naked-eye 3D display effect of the left and right eye images corresponding to the 3D video signal when displayed on the display end. The left and right eye images are a combination of left and right eye images, wherein the left and right eye images are 2D views, which are combined into the left and right eye images in the 3D format. When the left and right eye images are displayed on the display end, the left and right eye images are sent to the viewer's left and right eyes, respectively, according to a preset output timing, to achieve naked-eye 3D display.

[0122] In an embodiment of the present disclosure, the display end is used to display the left and right eye images on the screen in a time sequence so that the left and right eyes of the viewer receive the left eye image and the right eye image respectively, thereby realizing naked eye 3D display. The display end can be a device with a display function, which can be a display or a product including a display, wherein the display can be a flat panel display (Flat Panel Display, FPD), a large display or a micro display, etc. If divided according to whether the user can see the back of the display, the display can be a transparent display or an opaque display. It should be noted that the specific display device can be determined according to actual conditions, and the present disclosure does not limit it here.

[0123] There is an end-to-end asynchronous delay in the existing naked-eye 3D display system. FIG2 schematically shows a schematic diagram of the end-to-end system delay in the prior art. In FIG2, T4 represents the time period required for the image acquisition device to acquire a frame of human eye image, T3 represents the time period required for performing eye tracking processing on the human eye image to obtain the corresponding human eye coordinates, T2 represents the response time period for the display end to receive the left and right eye images for display on the screen, and T1 represents the time period required for the server to input a frame of 3D video signal to the video data processing end. As shown in FIG2, in the existing processing flow for each frame of the 3D video signal, the human eye image of the current frame is first acquired by the image acquisition device over a period of T4. After the human eye image is acquired, the human eye tracking processing is performed on the human eye image over a period of T3 to obtain the human eye coordinates corresponding to the human eye image. Since the human eye tracking processing is not accurately triggered at the same time as the acquisition of the human eye image is completed, there is a first asynchronous delay after the human eye image is acquired and before the eye tracking processing is performed on the human eye image, namely, T shown in FIG2. ASYNC_1 , the duration of the first asynchronous delay is greater than or equal to 0 and less than or equal to T4. On the other hand, during the process of performing eye tracking processing on the human eye image, the video data processing end starts to receive the 3D video signal sent by the server, completes the reception of the 3D video signal after a duration of T1, and then performs video processing on the 3D video signal based on the human eye coordinates after a duration of T2, obtains left and right eye images and sends them to the display end, completing the naked eye 3D display of one frame of 3D video signal. Since the video processing of the 3D video signal needs to be corrected based on the human eye coordinates, and the time when the human eye coordinates and the 3D video signal are finished being obtained cannot be unified, a second asynchronous delay occurs between the eye tracking processing and the output of the left and right eye images, namely T shown in FIG. ASYNC_2 , the duration of the second asynchronous delay is greater than or equal to 0 and less than or equal to T3. Therefore, for existing naked-eye 3D display systems, the existence of the first asynchronous delay and the second asynchronous delay makes the total video processing time of each frame (from the start of each frame to the left and right eye images displayed on the viewer's receiving display) extended. The total video processing time of each frame can be expressed by the following formula: T total =T4+T ASYNC_1 +T3+T ASYNC_2 +T2

[0124] Among them, T total is the total video processing time of each frame; T4 is the time period required for the image acquisition device to acquire a frame of human eye image; T3 is the time period required for performing eye tracking processing on the human eye image to obtain the corresponding human eye coordinates; T2 is the response time period for the display end to receive the left and right eye images for display on the screen; T ASYNC_1 is the first asynchronous delay; T ASYNC_2is the second asynchronous delay.

[0125] In an embodiment of the present disclosure, the third trigger signal is used to trigger the video data processing end to send the generated left and right eye images to the display end in the processing flow of each frame of 3D video signal. In the embodiment of the present disclosure, since the time and frequency of the server inputting a frame of 3D video signal are fixed, and the moment when the video data processing end sends the generated left and right eye images to the display end (i.e., the triggering moment of the third trigger signal) is directly related to the time when the server inputs a frame of 3D video signal, the triggering moment of human eye tracking and the triggering moment of human eye image acquisition in the processing process of this frame of 3D video signal can be corresponded with the triggering moment of human eye tracking and human eye image acquisition in the processing process of the previous frame of 3D video signal based on the triggering moment of the third trigger signal. In this way, during the processing of the 3D video signal, the human eye tracking and human eye image acquisition of the previous frame are triggered on time at the same time as the human eye tracking and human eye image acquisition of the previous frame are completed, thereby eliminating the asynchronous delay in the naked eye 3D display system.

[0126] Among them, the second trigger signal is a trigger signal generated based on the third trigger signal, and the triggering time of the second trigger signal is earlier than that of the third trigger signal. It is a trigger signal used to trigger the current frame to perform eye tracking processing on the human eye image at the same time as the human eye tracking of the previous frame is completed, and accurately trigger the processing of the 3D video signal while generating the human eye coordinates of the current frame, thereby eliminating the second asynchronous delay; the first trigger signal is a trigger signal generated based on the third trigger signal, and the triggering time of the first trigger signal is earlier than the second trigger signal and the third trigger signal. It is a trigger signal used to trigger the current frame to perform human eye image acquisition at the same time as the human eye image acquisition of the previous frame is completed, thereby eliminating the first asynchronous delay. The present disclosure generates a second trigger signal and / or a second trigger signal through reverse delay of a third trigger signal, so as to accurately trigger the eye tracking processing of the current frame when the eye tracking processing of the previous frame is completed through the second trigger signal, and accurately trigger the processing of the 3D video signal while generating the eye coordinates of the current frame, and accurately trigger the eye image acquisition of the current frame when the eye image acquisition of the previous frame is completed through the first trigger signal, thereby eliminating the first asynchronous delay and the second asynchronous delay, effectively reducing the end-to-end delay of the naked-eye 3D display system, and improving the user experience.

[0127] In order to enable those skilled in the art to better understand the technical solution of the present disclosure, FIG5 schematically shows a flow chart of a display method for executing the method according to the present disclosure. In conjunction with FIG5 , the following describes in detail the steps of the display method applied to the video data processing terminal provided by the present disclosure:

[0128] When step S101 is specifically implemented, after the video processing flow of the previous frame of 3D video signal is completed, the video data processing end generates a frame start signal of the current frame, and in response to the frame start signal of the current frame, obtains the 3D video signal of the current frame from the server with which the connection is established, wherein the video data processing end and the server are connected via a video interface, and the video interface can be an HDMI interface, an SDI interface, a VGA interface, a DVI interface, etc. The specific video interface can be determined according to actual conditions, and the present disclosure does not impose any restrictions on this.

[0129] In response to a frame start signal of the current frame, the video data processing terminal obtains a frame of 3D video signal from the server over a first period of time. Since the server transmits each frame of 3D video signal to the video data processing terminal at a fixed frequency, the time period between two consecutive frames of 3D video signal transmission is the first period of time, and the period of this first period of time is also fixed. For example, the server transmits each frame of 3D video signal to the video data processing terminal at a frequency of 60 frames per second, and the first period of time is the duration between the server transmitting two adjacent frames of 3D video signal to the video data processing terminal.

[0130] In an optional embodiment, since the left and right eye images ultimately outputted on the display end need to be outputted according to corresponding timing sequences so that the viewer's left and right eyes receive different images, respectively, thereby viewing an image with a stereoscopic effect on the display end, after acquiring the 3D video signal, it is necessary to pre-process the 3D video signal to obtain timing information dependent on image display based on the 3D video signal. Specifically, since the 3D video signal is a video signal composed of 2D video signals in different combinations, the 3D video signal is first segmented to obtain a first video signal and a second video signal. The first video signal and the second video signal maintain the same resolution in the 3D video signal, and therefore the resolution of the first video signal and the second video signal is less than the resolution of the 3D video signal. One of the first video signal and the second video signal is a left-eye video signal corresponding to the 3D video signal, and the other is a right-eye video signal. For example, the first video signal is a left-eye video signal and the second video signal is a right-eye video signal; or, the first video signal is a right-eye video signal and the second video signal is a left-eye video signal.

[0131] Since both the first video signal and the second video signal contain corresponding video data and timing information corresponding to the video data, the timing information can be used to generate output timing information for outputting left and right eye images at the display end to achieve a naked-eye 3D effect. Therefore, any one of the first video signal and the second video signal is selected to obtain the output timing information, and after obtaining the output timing information, subsequent video post-processing is performed together with the other to obtain left and right eye images for output to the display end.

[0132] The output timing information can be obtained from either the first or second video signal, and the process is identical. The following describes the process of obtaining the output timing information based on the first video signal: First, based on the first video signal, first video data and timing information corresponding to the first video signal are obtained. This timing information represents the output timing of the first video data in the 3D video signal. Subsequently, the first video data is written into a memory for frame buffering, and based on the timing information of the first video data, output timing information for the left and right eye images to be output on the display end is generated.

[0133] In an embodiment of the present disclosure, during the process of acquiring a 3D video signal for a current frame and obtaining output timing information based on a first video signal obtained by segmenting the 3D video signal, since the second video signal has not yet undergone pre-processing, the first time period is divided into two equal parts. The first video data is written to the display after a fifth time period before the midpoint of the first time period. The moment when the first video data is written is defined as the third time period, wherein the fifth time period is half the time it takes to input a frame of the 3D video signal. At this point, the pre-processing of the 3D video signal for the current frame is completed. In response to a third trigger signal, the post-processing of the 3D video signal is triggered at the third time period until the left and right eye images are transmitted to the display. That is, in the present disclosure, since the first video data is only read in during the first half of the first time period (i.e., the fifth time period) for each frame, the triggering time of the third trigger signal can be determined by delaying the frame start time by the length of the fifth time period, or by determining the triggering time of the third trigger signal at the midpoint of the first time period.

[0134] Specifically, during the implementation of step S102, while the video data processing end is acquiring the 3D video signal, the eye data acquisition end completes acquisition of eye coordinates based on the second trigger signal and the first trigger signal generated by the video data processing end. After receiving the eye coordinates sent by the eye data acquisition end and completing the acquisition and pre-processing of the 3D video signal, the eye data acquisition end performs post-processing on the 3D video signal to obtain the left and right eye images. Specifically, first, a video signal that is not frame buffered is acquired, and the corresponding video data is acquired. For example, when the output timing information is acquired based on the first video signal, the second video signal is a video signal that is not frame buffered, and second video data corresponding to the second video signal is acquired. Subsequently, after the first video data is completely written to the memory after a fifth time period, the first video data is read from the memory. The first video data is completely read from the memory after a sixth time period. Since the reading and storing processes of the first video data are symmetrical, the sixth time period and the fifth time period have the same duration, which is half the duration of the first time period. Since the resolutions of the first video signal and the second video signal are both smaller than the resolution of the 3D video signal, after obtaining the first video data and the second video data, it is necessary to perform distribution stretching on the first video data and the second video data so that the first video data and the second video data have the same resolution as the 3D video signal, and use the first video data and the second video data after distribution stretching as left-eye video data and right-eye video data, respectively, to obtain left and right video data, wherein, since one of the first video signal and the second video signal is a left-eye video signal corresponding to the 3D video signal and the other is a right-eye video signal, one of the first video data and the second video data after distribution stretching is left-eye video data and the other is right-eye video data, and corresponds to the first video signal and the second video signal, that is, when the first video signal is a left-eye video signal and the second video signal is a right-eye video signal, the first video data after distribution stretching is left-eye video data and the second video data is right-eye video data; when the first video signal is a right-eye video signal and the second video signal is a left-eye video signal, the first video data after distribution stretching is right-eye video data and the second video data is left-eye video data.

[0135] It should be noted that the distribution stretching method is determined based on the format of the 3D video signal in actual situations. For example, if the 3D video signal is in a top-and-bottom format, after obtaining the first video data and the second video data, distribution stretching is performed in the vertical direction to obtain left and right video data with the same resolution as the 3D video signal after distribution stretching. The above example is merely an optional scenario provided to help those skilled in the art better understand the solution of this application, and the specific distribution stretching method is not limited herein.

[0136] Finally, in response to the human eye coordinates sent by the human eye data acquisition end, the left and right video data are respectively rearranged in pixels based on the image interleaving algorithm, and the pixel offset values ​​of the left and right eyes are determined based on the human eye coordinates, and the pixel rearrangement result is corrected with the pixel offset value, thereby improving the naked eye 3D display effect; and then the left and right eye images are synthesized according to the output timing information.

[0137] Exemplarily, the 3D video signal is a top-and-bottom format 3D video signal. FIG3 schematically shows a schematic diagram of a video pre-processing process for executing the method according to the present disclosure. As shown in FIG3 , the 3D video signal has a resolution of 8K4K and includes an L-type video signal and an R-type video signal. The 3D video signal is segmented to obtain separate L-type video signals and R-type video signals after segmentation. The resolution of the L-type video signal and the R-type video signal is smaller than that of the 3D video signal. After obtaining the output timing information through one of the L-type video signal and the R-type video signal, the first video data corresponding to the L-type video signal and the second video data corresponding to the R-type video signal are vertically distributed and stretched to achieve a resolution of 8K4K, and the left and right video data after distribution stretching are obtained.

[0138] Specifically, in step S103, after acquiring the left-eye and right-eye images, in response to a third trigger signal triggered at a third moment, the left-eye and right-eye images are transmitted to the display end after a second period of time. The second period of time represents the time during which the display end receives and displays the left-eye and right-eye images transmitted by the video data processing end. The display end displays the left-eye and right-eye images according to the output timing information, and the viewer's left and right eyes receive corresponding images according to the output timing, thereby achieving a glasses-free 3D display effect.

[0139] This completes the display process of a frame of 3D video signal on the display end. To avoid asynchronous delays between the human eye data acquisition end and the display end, a first trigger signal, a second trigger signal, and a third trigger signal are set to trigger corresponding processing flows at corresponding times. The second trigger signal and the first trigger signal determine their triggering times based on the third trigger signal. In step S104, the first trigger signal and / or the second trigger signal are generated based on the third trigger signal. Step S104 occurs after the third trigger signal is generated and before the first trigger signal is triggered. Since the triggering time of the third trigger signal is determined based on the first time period, and the first time period is fixed, the third trigger signal can be generated at any time before the third time period and triggered at the third time period.

[0140] When implementing step S104, FIG4 schematically illustrates a reverse trigger timing diagram for executing the method according to the present disclosure. As shown in FIG4 , the first time period corresponding to the current frame is first acquired, and the midpoint of the first time period is determined as a third time period. The third time period is the time when the third trigger signal triggers the transmission of the left and right eye images to the display terminal. In an alternative embodiment, the triggering time of the third trigger signal can also be determined by delaying the frame start time by the duration of the fifth time period in a forward direction. Subsequently, the time when the eye data acquisition terminal performs eye tracking processing on a frame of eye image is acquired as the third time period. Because the second trigger signal is triggered earlier than the third trigger signal, to ensure that the third trigger signal is triggered precisely at the third time period when the eye data acquisition terminal completes eye tracking processing on the eye image, the third trigger signal is delayed in reverse order from the third time period along the timing sequence to determine a second time period. This second time period is the time when the second trigger signal triggers eye tracking processing. Finally, a second trigger signal is generated based on the second time period. The second trigger signal is generated no later than the second time period, so that the second trigger signal triggers the eye data acquisition terminal to acquire the eye coordinates at the second time period.

[0141] The second moment determined in the embodiment of the present disclosure is the moment when the second trigger signal triggers the human eye tracking process. Since the second moment is generated based on the reverse delay of the third moment by the third time period, in the forward timing, the human eye data acquisition end triggers the human eye tracking process in response to the second trigger signal at the second moment, and completes the human eye tracking process after the duration of the third time period to obtain the human eye coordinates. At this time, after the third time period has passed at the second moment, the third moment is just reached. At the third moment, in response to the third trigger signal, the video data processing end is triggered to send the left and right eye images to the display end, thereby eliminating the second asynchronous delay originally located between the human eye tracking process and the left and right eye image output.

[0142] In an optional embodiment, since the determination of the second moment depends on the third time period and the third moment, and the third moment depends on the duration of acquiring a frame of 3D video signal, i.e., the first time period, when the frequency of acquiring a frame of 3D video signal at the video image processing end and the acquisition of the eye coordinates by the eye data acquisition end do not match, it is impossible to implement naked-eye 3D image processing based on eye coordinates for each frame. In this case, the embodiment of the present disclosure sets a second number of eye tracking subsystems in the eye data acquisition end, alternately acquiring eye coordinates to satisfy the implementation of naked-eye 3D image processing based on eye coordinates for each frame, and the eye tracking subsystem is a module in the eye data acquisition end for performing eye tracking processing on the eye image.

[0143] Exemplarily, the video image processing end acquires a frame of 3D video signal at a frequency of 60 times per second, while the processing frequency of an eye tracking subsystem in the eye data acquisition end is only 30 times per second. If there is only one eye tracking subsystem in the eye data acquisition end, the eye coordinates of the current frame cannot be acquired for a frame of 3D video signal acquired every second. Therefore, in order to avoid this situation, it is ensured that the eye coordinates of the current frame can be acquired for video processing in each frame. A first eye tracking subsystem and a second eye tracking subsystem are set in the eye data acquisition end. The first eye tracking subsystem acquires the eye coordinates in the current frame, and the second eye tracking subsystem acquires the eye coordinates in the frame next to the current frame. By alternating the execution of the first eye tracking subsystem and the second eye tracking subsystem, the frequency of acquiring the eye coordinates can be achieved, which matches the frequency of acquiring the 3D video signal.

[0144] Specifically, first, based on the first time period and the third time period, a first quantity is determined. Since the first time period corresponds to the duration of the video image processing end obtaining a frame of 3D video signal, and the third time period corresponds to the duration of the human eye data acquisition end obtaining the human eye coordinates, based on the first time period and the third time period, the number of second trigger signals for triggering the human eye data acquisition end to perform human eye tracking processing is obtained as the first quantity; then, the first number of second trigger signals is generated at the second moment, and the first number of second trigger signals is used to sequentially trigger different human eye tracking subsystems to obtain human eye coordinates at the second moment of the corresponding periodic alternating frame, so that the frequency of collecting the human eye image in response to the first number of second trigger signals matches the frequency of obtaining the 3D video signal; finally, the first number of second trigger signals are sent sequentially to the second number of human eye tracking subsystems in the human eye data acquisition end. Since it is necessary to ensure that the human eye tracking subsystem can ensure the triggering of the first number of second trigger signals, the second number is greater than or equal to the first number.

[0145] Preferably, the ratio of the third time period to the first time period is calculated, and the ratio is rounded up to obtain the first number. The first number is obtained according to the following formula: N = ROUNDUP (T3 / T1)

[0146] Wherein, N is the first number, T3 is the duration of the third time period, T1 is the duration of the first time period, and ROUNDUP is a round-up function.

[0147] In the embodiment of the present disclosure, the first trigger signal is used to trigger the human eye data acquisition end to acquire the human eye image of the current frame, and the second trigger signal is used to trigger the human eye data acquisition end to perform eye tracking processing on the human eye image. Therefore, the triggering time of the first trigger signal is earlier than the second trigger signal. In order to eliminate the first asynchronous delay between the human eye image acquisition process and the human eye tracking processing, the first trigger signal is generated based on the third trigger signal. Specifically, since the frequency of the human eye data acquisition end acquiring a frame of human eye image is fixed, the time when the human eye data acquisition end acquires a frame of the human eye image is first obtained and determined as the fourth time period; since the first trigger signal is triggered earlier than the second trigger signal, in order to ensure that the second trigger signal is triggered at the second time when the human eye data acquisition end completes the acquisition of the human eye image, the fourth time period is reversely delayed from the second time period (the second time period is the triggering time of the second trigger signal determined based on the third trigger signal), and a first time period that is the length of the fourth time period before the second time period is determined. The first time period is the time when the human eye data acquisition end triggers the human eye image acquisition in response to the first trigger signal in this frame. Finally, the first trigger signal is generated based on the first moment, so that the first trigger signal triggers the human eye data acquisition end to acquire the human eye image of the current frame at the first moment.

[0148] In an optional embodiment, since the frequency of the human eye tracking processing performed by the human eye data acquisition end is fixed, the first moment can also be determined by forward delaying the moment when the human eye tracking processing of the previous frame of human eye image is completed. Specifically, first obtain the fourth time period; then, based on the third time period, determine the moment when the human eye data acquisition end completes the human eye tracking processing of the previous frame of human eye image as the fourth moment; since the fourth moment is earlier than the first moment of this frame, the difference between the third time period and the fourth time period is forward delayed from the fourth moment, and the moment after the fourth moment that is the length of the difference time period is determined as the first moment; finally, generate the first trigger signal based on the first moment, so that the first trigger signal triggers the human eye data acquisition end to collect the human eye image of the current frame at the first moment.

[0149] The first moment determined in the embodiment of the present disclosure is the moment when the first trigger signal triggers the human eye image acquisition. Since the first moment is generated based on the reverse delay of the second moment by the fourth time period, in the forward timing, the human eye data acquisition end responds to the first trigger signal to trigger the human eye image acquisition at the first moment, and completes the human eye image acquisition of the current frame after the fourth time period to obtain the human eye image. At this time, after the fourth time period passes at the first moment, the second moment is just reached. At the second moment, the human eye data acquisition end is triggered to perform human eye tracking processing on the human eye image in response to the second trigger signal, thereby eliminating the first asynchronous delay originally located between the human eye image acquisition and the human eye tracking processing.

[0150] In the embodiment of the present disclosure, the asynchronous delay between the human eye data acquisition end and the display end is eliminated based on the first trigger signal, the second trigger signal, and the third trigger signal. In the forward timing, the human eye data acquisition end responds to the first trigger signal at the first moment to acquire the human eye image of the current frame, and completes the human eye image acquisition after the fourth time period, reaching the second moment; the human eye data acquisition end responds to the second trigger signal at the second moment to perform human eye tracking processing based on the acquired human eye image, completes the human eye tracking processing after the third time period, obtains the human eye coordinates, and reaches the third moment; during the process of the human eye data acquisition end performing human eye tracking processing, the video data processing end acquires a 3D video signal and performs video processing, completes the acquisition of left and right video data at the third moment, corrects the left and right video data according to the human eye coordinates simultaneously acquired at the third moment, and obtains left and right eye images; the video data processing end responds to the third trigger signal and sends the left and right eye images acquired at the third moment to the display end after the second time period. The display end displays the left and right eye images according to the output timing information, and the viewer's left and right eyes receive corresponding images according to the output timing, thereby achieving a naked-eye 3D display effect. The total video processing time of each frame in the embodiment of the present disclosure can be expressed by the following formula: total =T4+T3+T2

[0151] Among them, T′ total is the total video processing time of each frame; T4 is the time period required for the image acquisition device to capture a frame of human eye image; T3 is the time period required for human eye tracking processing of the human eye image to obtain the corresponding human eye coordinates; T2 is the response time period for the display end to receive the left and right eye images for display on the screen.

[0152] An embodiment of the present disclosure provides a display method, which is applied to a video data processing end. The method includes: obtaining a 3D video signal in response to a frame start signal; processing the 3D video signal according to the human eye coordinates sent by a human eye data acquisition end to obtain left and right eye images; sending the left and right eye images to a display end in response to a third trigger signal to display the left and right eye images on the display end; generating a first trigger signal and / or a second trigger signal according to the third trigger signal, and sending the first trigger signal and / or the second trigger signal to the human eye data acquisition end, so that the human eye data acquisition end acquires the human eye image in response to the first trigger signal, and performs human eye tracking processing based on the human eye image in response to the second trigger signal to acquire the human eye coordinates.

[0153] The embodiment of the present disclosure sets a first trigger signal and / or a second trigger signal generated based on the reverse delay of the third trigger signal, ensuring that the acquisition of human eye coordinates is accurately triggered at the end of human eye image acquisition, and that the video processing is accurately completed and the left and right eye images are sent to the display end at the end of human eye coordinate acquisition, thereby eliminating the asynchronous delay in the processing of each frame of video, reducing the end-to-end system delay, and improving the naked-eye 3D display effect and user experience.

[0154] Based on the same inventive concept, an embodiment of the present disclosure provides a display method applied to a human eye data acquisition terminal. FIG6 schematically shows a flow chart of the display method applied to a human eye data acquisition terminal for executing the method according to the present disclosure. As shown in FIG6 , the method includes:

[0155] S201 . In response to a first trigger signal sent by a video data processing terminal, collect a human eye image.

[0156] S202: In response to a second trigger signal sent by the video data processing end, perform eye tracking processing on the human eye image to obtain eye coordinates.

[0157] S203: Send the eye coordinates to the video data processing end, so that the video data processing end processes the 3D video signal based on the eye coordinates to generate left and right eye images, and sends the left and right eye images to the display end in response to a third trigger signal.

[0158] The human eye coordinates are sent to the video data processing end so that the video data processing end processes the 3D video signal based on the human eye coordinates to generate left and right eye images, and sends the left and right eye images to the display end in response to a third trigger signal, wherein the first trigger signal and / or the second trigger signal are generated according to the third trigger signal.

[0159] When specifically implementing step S201, the first trigger signal sent by the video data processing end is received. The first trigger signal is generated based on the third trigger signal and is generated no later than the moment when the human eye data acquisition end acquires the human eye image of the current frame (i.e., the first moment). After the first trigger signal is generated, the first trigger signal is sent from the video data processing end to the human eye data acquisition end. For details on the process of determining the first moment, please refer to step S104 in the display method applied to the video data processing end, and the present embodiment will not be repeated here. After determining the first moment, since the first trigger signal obtained is no later than the first moment, the image acquisition device can be controlled to acquire a frame of the human eye image during a fourth time period in response to the first trigger signal at the first moment. The fourth time period is the time for the human eye data acquisition end to acquire a frame of the human eye image. The image acquisition device can be a target recognition camera or an infrared camera, or other devices with image acquisition and target recognition functions. Exemplarily, in response to the first trigger signal, a facial image is acquired and target recognition is performed by the target recognition camera, and a human eye image is acquired from the facial image. It should be noted that the above example is only an optional method provided to enable those skilled in the art to better understand the method of the present disclosure. The specific process of obtaining human eye images based on the image acquisition device can be determined according to actual conditions, and the present disclosure does not limit it here.

[0160] When specifically implementing step S202, the second trigger signal sent by the video data processing end is received. The second trigger signal is generated based on the third trigger signal, and the generation time is no later than the moment when the human eye data acquisition end performs human eye tracking processing on the human eye image of the current frame (i.e., the second moment). After the second trigger signal is generated, the second trigger signal is sent from the video data processing end to the human eye data acquisition end. The details of the determination process of the second moment can be found in step S104 of the display method applied to the video data processing end, and the embodiments of the present disclosure will not be repeated here. After determining the second moment, since the second trigger signal obtained is no later than the second moment, the image acquisition device can be controlled to perform human eye tracking processing on the human eye image for a third period of time to obtain human eye coordinates in response to the second trigger signal at the second moment. The third period is the time when the human eye data acquisition end performs human eye tracking processing on the human eye image, and the human eye data acquisition end obtains the human eye coordinates in the human eye image within a preset coordinate system (such as the image coordinates corresponding to the image acquisition device).

[0161] In an optional embodiment, when the frequency of acquiring a frame of 3D video signal at the video image processing end and the acquisition of the eye coordinates by the eye data acquisition end do not match, it is impossible to implement naked-eye 3D image processing based on eye coordinates for each frame. At this time, the embodiment of the present disclosure sets a second number of eye tracking subsystems in the eye data acquisition end, and alternately acquires eye coordinates to satisfy the implementation of naked-eye 3D image processing based on eye coordinates for each frame. Specifically, first, the first number of second trigger signals sent sequentially by the video data processing end within the third time period are received, and the second number is greater than or equal to the first number; in response to each second trigger signal, the eye tracking subsystem is controlled to perform eye tracking processing on the eye image, so that each newly received second trigger signal triggers the eye tracking subsystem that has not been triggered within the third time period.

[0162] For example, the video image processing end obtains a frame of 3D video signal at a frequency of 60 times per second, and the processing frequency of an eye tracking subsystem in the human eye data acquisition end is 20 times per second. At this time, the first number is determined to be 3, and the video data processing end generates 3 second trigger signals and sends them to the human eye data acquisition end; the human eye data acquisition end is provided with at least 3 human eye tracking subsystems (a first human eye tracking subsystem, a second human eye tracking subsystem and a third human eye tracking subsystem), and the first human eye tracking subsystem responds to a second trigger signal at the second moment, and after 1 / 3 of the third time period, The first eye coordinates are obtained by performing eye tracking on the eye image for a period of 1 / 3 of the third time period; the second eye tracking subsystem responds to another second trigger signal after the first eye tracking subsystem completes the processing, and performs eye tracking on the eye image for a period of 1 / 3 of the third time period to obtain the second eye coordinates; the third eye tracking subsystem responds to the last second trigger signal after the second eye tracking subsystem completes the processing, and performs eye tracking on the eye image for a period of 1 / 3 of the third time period to obtain the third eye coordinates. At this time, a complete third time period has passed since the second moment, and the third moment is reached.

[0163] Based on the same inventive concept, an embodiment of the present disclosure provides a display system. FIG7 schematically shows a schematic diagram of the structure of a display system for executing the method according to the present disclosure. As shown in FIG7 , the system includes:

[0164] A human eye data acquisition terminal, configured to acquire a human eye image in response to a first trigger signal, and perform human eye tracking processing based on the human eye image in response to a second trigger signal to obtain human eye coordinates;

[0165] a video data processing end, the video data acquisition end being communicatively connected to the human eye data acquisition end, configured to process the 3D video signal based on the human eye coordinates to generate left and right eye images, and transmit the left and right eye images to the display end in response to a third trigger signal;

[0166] The display terminal is communicatively connected to the video data processing terminal, and is configured to receive and display the left and right eye images;

[0167] Among them, at least one of the first trigger signal and the second trigger signal is generated according to the third trigger signal. The specific details of the generation process of the first trigger signal and the second trigger signal can be found in the content of step S104 in the display method applied to the video data processing end, and the embodiments of the present disclosure will not be repeated here.

[0168] In an embodiment of the present disclosure, the eye data acquisition end is configured with an eye data acquisition subsystem and an eye tracking subsystem, and the eye data acquisition subsystem is communicatively connected to the eye tracking subsystem. The eye data acquisition subsystem is configured to respond to the first trigger signal at a first moment and acquire a frame of the eye image over a fourth time period, where the difference between the first moment and the second moment is equal to the fourth time period; the eye tracking subsystem is communicatively connected to the video data processing end and is configured to respond to the second trigger signal at a second moment and perform eye tracking processing on a frame of the eye image over a third time period to obtain the eye coordinates, where the difference between the second moment and the third moment is equal to the third time period, and the third moment is the triggering moment of the third trigger signal.

[0169] In an embodiment of the present disclosure, the video data processing end is configured with a video receiving subsystem, a video post-processing subsystem and a video sending subsystem; the video receiving subsystem is communicatively connected to the server, and is used to obtain the 3D video signal from the server through a video interface, and split the 3D video signal to obtain a first video signal and a second video signal; the video post-processing subsystem receives the first video signal and the second video signal obtained by the video sending subsystem, generates output timing information based on the first video signal, and generates the left and right eye images based on the post-processing information, and the post-processing information includes at least one of the following: the human eye coordinates, the first video signal, the second video signal and the output timing information; the video sending subsystem receives the left and right eye images sent by the video post-processing subsystem, and is used to send the left and right eye images to the display end in response to the third trigger signal at a third moment.

[0170] Specifically, the video post-processing subsystem obtains first video data and timing information corresponding to the first video signal based on the first video signal, writes the first video data into a memory, and generates the output timing information based on the timing information. Subsequently, the video post-processing subsystem sequentially reads one frame of the first video data and one frame of the second video data from the memory at the same time within the time when the video data processing end inputs one frame of the 3D video signal, distributes and stretches the first video data and the second video data corresponding to the second video signal, and rearranges pixels based on the human eye coordinates and the output timing information to generate the left and right eye images.

[0171] In an optional embodiment, the video data processing end extends the third time period and the fourth time period to the moment before the third time period based on the third moment, the third time period and the fourth time period, and reversely generates the first trigger signal so that the first trigger signal triggers the human eye data acquisition subsystem to acquire the human eye image of the current frame at the first moment; wherein, the first moment is used to represent the moment when the human eye data acquisition subsystem finishes acquiring the human eye image of the previous frame.

[0172] In another optional embodiment, the video data processing end extends the duration of the fourth time period at a moment before the second moment when the second trigger signal is triggered based on the second trigger signal and the fourth time period, and reversely generates the first trigger signal so that the first trigger signal triggers the human eye data acquisition subsystem to acquire the human eye image of the current frame at the first moment.

[0173] In an optional embodiment, the video data processing end extends the length of the third time period to the moment before the third moment based on the third moment and the third time period, and reversely generates the second trigger signal, so that the second trigger signal triggers the human eye tracking subsystem to obtain the human eye coordinates of the current frame at the second moment; wherein, the second moment is used to represent the moment when the human eye tracking subsystem finishes obtaining the human eye coordinates of the previous frame.

[0174] In an optional embodiment, the video data processing end generates the third trigger signal based on the first time period, so that the third trigger signal triggers the video data processing end to send the left and right eye images to the display end at the third moment; wherein the first time period is used to represent the time for the video data processing end to input one frame of the 3D video signal.

[0175] In an optional embodiment, the video data processing end determines at least one second trigger signal based on the third moment and the third time period, so that the frequency at which the eye tracking subsystem captures the eye image in response to the at least one second trigger signal matches the frequency at which the video data processing end acquires the 3D video signal. Preferably, the eye data acquisition end is provided with at least one eye tracking subsystem to alternately perform eye tracking processing in response to the at least one second trigger signal, and the number of eye tracking subsystems is greater than or equal to the number of second trigger signals.

[0176] In order to enable technical personnel in this field to understand the display system of the present invention more clearly, Figure 8 schematically shows a structural diagram of an example of a display system for executing the method according to the present invention. As shown in Figure 8, referring to Figure 8, the display system described in this application is now described in detail through the following embodiments.

[0177] The eye data acquisition end uses a SOC (System on Chip), which includes a camera as a human eye image acquisition subsystem and a human eye tracking subsystem. The camera is connected to the human eye tracking subsystem via a USB interface, and the human eye tracking subsystem is connected to the video data processing end via an IIC interface (Inter-Integrated Circuit). The eye coordinates and the first trigger signal and the second trigger signal received from the video data processing end are sent to the video data processing end via the IIC interface. The eye tracking subsystem includes an eye tracking module (EYE_TRACK) and an image reading module (VID_RX). The image reading module is used to transmit the human eye image acquired by the camera to the eye tracking module. The eye tracking module is used to perform eye tracking processing on the human eye image and obtain eye coordinates.

[0178] The video data processing end adopts FPGA (Field Programmable Gate Array), which includes a video receiving subsystem, a video post-processing subsystem and a video sending subsystem. The video receiving subsystem includes a video receiving module (HDMI_RX) and a video splitting module (VID_SPLIT). The video receiving module establishes a connection with the server through a four-way HDMI interface (High Definition Multimedia Interface), receives 8K4K and TOP-BOTTOM format 3D video signals (3D-SIG) transmitted by the server, and transmits the 3D video signals to the video splitting module for video splitting pre-processing to obtain TOP video signals and BOTTOM video signals.

[0179] The video post-processing subsystem includes a write memory control module (WDMA), an AXI bus arbitration module (AXI_ARBITRATE), a timing generation module (VTG), a read memory control module (RDMA), a memory module (DDR3), a vertical stretching module (V_SCALER), and a pixel rearrangement module (PIX_ARRANGE). The TOP video signal writes the corresponding TOP video data into the memory module through the write memory control module, and inputs the timing information into the timing generation module to generate output timing information; then the TOP video data is read through the read memory control module, and together with the BOTTOM video data, it is input into the vertical stretching module, distributed and stretched into the completed 8K left and right video data input into the pixel rearrangement module, while the human eye coordinates from the human eye data acquisition end are transmitted to the pixel rearrangement module through the IIC interface (IIC_RX), and the left and right video data are pixel rearranged based on the human eye coordinates to obtain the left and right eye images input into the video sending subsystem. In addition, the timing generation module is also used to generate a trigger signal, and the AXI bus arbitration module is used to distinguish the priority of the write memory control module and the read memory control module to access the memory module according to a predetermined format. The video sending subsystem includes a video sending module (VBO_TX) for sending the received left and right eye images to a display end.

[0180] The display end is a naked-eye 3D screen (3D-PANEL) with a resolution of 8K4K, specifically 7680x4320@60Hz. It is connected to the video sending subsystem through the VBO interface of 32Lane, receives the left and right eye images sent by the video sending subsystem, and displays them on the screen according to the output timing information, so that the viewer can achieve the naked-eye 3D display effect when watching the left and right eye images.

[0181] Based on the same inventive concept, an embodiment of the present disclosure provides a display device applied to a video data processing end. FIG9 schematically shows a structural diagram of a display device applied to a video data processing end for executing the method according to the present disclosure. As shown in FIG9 , the device includes:

[0182] A video acquisition module, configured to acquire a 3D video signal in response to a frame start signal;

[0183] A video processing module, configured to process the 3D video signal according to the eye coordinates sent by the eye data acquisition terminal to obtain left and right eye images;

[0184] a sending module, configured to send the left-eye and right-eye images to a display terminal in response to a third trigger signal, so as to display the left-eye and right-eye images on the display terminal;

[0185] A trigger signal module is used to generate a first trigger signal and / or a second trigger signal according to the third trigger signal, and send the first trigger signal and / or the second trigger signal to the human eye data acquisition end, so that the human eye data acquisition end collects a human eye image in response to the first trigger signal, and performs human eye tracking processing based on the human eye image in response to the second trigger signal to obtain the human eye coordinates.

[0186] In an optional implementation, the video processing module includes:

[0187] a segmentation submodule, configured to segment the 3D video signal to obtain a first video signal and a second video signal, wherein one of the first video signal and the second video signal is a left-eye video signal corresponding to the 3D video signal, and the other is a right-eye video signal;

[0188] a writing submodule, configured to obtain, based on the first video signal, first video data and timing information corresponding to the first video signal, and write the first video data into a memory over a fifth time period, where the fifth time period is half the time of inputting one frame of the 3D video signal;

[0189] The timing submodule is configured to generate output timing information based on the timing information, wherein the output timing information represents an output timing of the left-eye and right-eye images on the display end.

[0190] In an optional implementation, the trigger signal module includes:

[0191] A third moment submodule, configured to determine a third moment, where the third moment is the moment when the third trigger signal triggers the left-eye and right-eye images to be sent to the display end;

[0192] A second time submodule is configured to obtain a third time period, reversely delay the third time period from the third time period, and determine the second time period, wherein the third time period is the time for the human eye data acquisition end to perform human eye tracking processing on a frame of human eye image;

[0193] The second trigger signal first determination submodule is used to generate the second trigger signal based on the second moment, so that the second trigger signal triggers the human eye data acquisition end to obtain the human eye coordinates at the second moment.

[0194] In an optional implementation, the third moment submodule includes:

[0195] A first time period unit, configured to obtain a first time period and a third time period, wherein the first time period is the time for inputting one frame of the 3D video signal;

[0196] The third time unit is used to determine the third time based on the first time period corresponding to the current frame, and the third time is the midpoint time of the first time period.

[0197] In an optional implementation, the trigger signal module further includes:

[0198] A fourth time period submodule is configured to obtain a fourth time period, where the fourth time period is the time it takes for the human eye data acquisition end to acquire one frame of the human eye image;

[0199] A first determining submodule for a first moment, configured to reversely delay the fourth time period from the second moment to determine a first moment;

[0200] The first trigger signal first determination submodule is used to generate the first trigger signal based on the first moment, so that the first trigger signal triggers the human eye data acquisition end to acquire the human eye image of the current frame at the first moment.

[0201] In an optional implementation, the trigger signal module further includes:

[0202] A fourth time period submodule is configured to obtain a fourth time period, where the fourth time period is the time it takes for the human eye data acquisition end to acquire one frame of the human eye image;

[0203] A fourth time submodule is configured to determine a fourth time based on the third time period, where the fourth time is the time when the human eye data acquisition end completes the human eye tracking process on the previous frame of human eye image;

[0204] A second first moment determination submodule, configured to positively delay the fourth moment by a difference between the third time period and the fourth time period to determine the first moment;

[0205] The first trigger signal sub-second determination sub-module is used to generate the first trigger signal based on the first moment, so that the first trigger signal triggers the human eye data acquisition end to acquire the human eye image of the current frame at the first moment.

[0206] In an optional implementation, the trigger signal module further includes:

[0207] A first quantity submodule, configured to determine a first quantity based on the first time period and the third time period;

[0208] a second trigger signal second determination submodule, configured to generate the first number of second trigger signals at the second moment, so that a frequency of acquiring the eye coordinates in response to the first number of second trigger signals matches a frequency of acquiring 3D video signals;

[0209] The sending submodule is used to sequentially send the first number of second trigger signals to the second number of human eye tracking subsystems in the human eye data acquisition terminal, where the second number is greater than or equal to the first number.

[0210] In an optional implementation, the first quantity submodule includes:

[0211] A calculation unit is used to calculate the ratio of the third time period to the first time period, and round up the ratio to obtain the first number.

[0212] In an optional implementation, the video processing module further includes:

[0213] A second video data submodule, configured to obtain second video data based on the second video signal;

[0214] a reading submodule, configured to read the first video data from the memory, and perform distribution stretching on the first video data and the second video data to obtain left and right video data, wherein the left and right video data have the same resolution as the 3D video signal;

[0215] The pixel rearrangement submodule is used to respond to the eye coordinates sent by the eye data acquisition end, and to rearrange the pixels of the left and right video data based on the eye coordinates and the output timing information to generate the left and right eye images.

[0216] In an optional embodiment, the reading submodule includes:

[0217] a first video reading unit, configured to read the first video data during a sixth time period after the first video data is completely written, wherein the sixth time period is the same as the fifth time period;

[0218] The distribution stretching unit is used to perform distribution stretching on the first video data and the second video data to obtain the left and right video data.

[0219] Based on the same inventive concept, an embodiment of the present disclosure provides a display device applied to a human eye data acquisition terminal. FIG10 schematically shows a schematic structural diagram of a display device applied to a human eye data acquisition terminal for executing the method according to the present disclosure. As shown in FIG10 , the device includes:

[0220] A human eye acquisition module, configured to acquire a human eye image in response to a first trigger signal sent by the video data processing end;

[0221] an eye tracking module, configured to perform eye tracking processing on the eye image in response to a second trigger signal sent by the video data processing end, and obtain eye coordinates;

[0222] A coordinate sending module is used to send the human eye coordinates to the video data processing end, so that the video data processing end processes the 3D video signal based on the human eye coordinates to generate left and right eye images, and sends the left and right eye images to the display end in response to a third trigger signal, wherein the first trigger signal and / or the second trigger signal are generated according to the third trigger signal.

[0223] In an optional embodiment, the human eye acquisition module includes:

[0224] a first receiving submodule, configured to receive the first trigger signal sent by the video data processing end;

[0225] The first trigger submodule is configured to respond to the first trigger signal at a first moment and control the image acquisition device to acquire a frame of the human eye image during a fourth time period.

[0226] In an optional embodiment, the eye tracking module includes:

[0227] a second receiving submodule, configured to receive the second trigger signal sent by the video data processing end;

[0228] The second trigger submodule is configured to respond to the second trigger signal at a second moment, perform eye tracking processing on a frame of the human eye image during a third time period, and obtain the human eye coordinates.

[0229] In an optional implementation, the second receiving submodule includes:

[0230] a second receiving unit, configured to receive a first number of second trigger signals sequentially sent by the video data processing end within the third time period, where the second number is greater than or equal to the first number;

[0231] The eye tracking unit is used to control the eye tracking subsystem to perform eye tracking processing on the eye image in response to each second trigger signal, so that each newly received second trigger signal triggers the eye tracking subsystem that has not been triggered within the third time period.

[0232] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of this embodiment. A person of ordinary skill in the art can understand and implement the present invention without inventive effort.

[0233] The various component embodiments of the present disclosure can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all of the functions of some or all of the components in the computing processing equipment according to the embodiments of the present disclosure. The present disclosure can also be implemented as a device or apparatus program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing the present disclosure can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0234] For example, FIG11 schematically illustrates a block diagram of a computing and processing device for executing the method according to the present disclosure. As shown in FIG11 , the computing and processing device 100 conventionally includes a processor 120 and a computer program product or computer-readable medium in the form of a memory 110. The memory 110 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), an EPROM, a hard disk, or a ROM. The memory 110 has storage space for program code for executing any of the method steps described above. For example, the storage space for program code may include individual program codes for implementing various steps in the method described above. These program codes may be read from or written to one or more computer program products. These computer program products include program code carriers such as a hard disk, a compact disc (CD), a memory card, or a floppy disk. Such computer program products are typically portable or fixed storage units. The storage unit may have storage segments, storage space, etc. arranged similarly to the memory 110 in the computing and processing device of FIG11 . The program code may, for example, be compressed in a suitable form. Typically, the storage unit includes computer-readable codes, ie, codes that can be read by a processor such as 120 , which, when executed by a computing processing device, cause the computing processing device to perform the steps of the method described above.

[0235] References herein to "one embodiment," "an embodiment," or "one or more embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Furthermore, please note that instances of the phrase "in one embodiment" do not necessarily all refer to the same embodiment.

[0236] In the description provided herein, numerous specific details are described. However, it is understood that embodiments of the present disclosure may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of this description.

[0237] In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in the claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present disclosure may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names.

[0238] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them. Although the present disclosure has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present disclosure.

Claims

1. A display method, characterized in that: Applied to a video data processing end, the method comprises: In response to a frame start signal, acquiring a 3D video signal; Processing the 3D video signal according to the eye coordinates sent by the eye data acquisition terminal to obtain left and right eye images; In response to a third trigger signal, sending the left-eye and right-eye images to a display end so as to display the left-eye and right-eye images on the display end; According to the third trigger signal, a first trigger signal and / or a second trigger signal is generated, and the first trigger signal and / or the second trigger signal is sent to the human eye data acquisition end, so that the human eye data acquisition end collects human eye images in response to the first trigger signal, and performs human eye tracking processing based on the human eye image in response to the second trigger signal to obtain the human eye coordinates.

2. The display method according to claim 1, characterized in that: Before processing the 3D video signal, the method further includes: Segmenting the 3D video signal to obtain a first video signal and a second video signal, wherein one of the first video signal and the second video signal is a left-eye video signal corresponding to the 3D video signal, and the other is a right-eye video signal; Based on the first video signal, first video data and timing information corresponding to the first video signal are acquired, and the first video data is written into the memory during a fifth time period, where the fifth time period is half of the time of inputting one frame of the 3D video signal; Based on the timing information, output timing information is generated, where the output timing information represents an output timing of the left-eye and right-eye images at the display end.

3. The display method according to claim 1, characterized in that: Generating a second trigger signal according to the third trigger signal includes: Determine a third moment, where the third moment is the moment when the third trigger signal triggers the left-eye and right-eye images to be sent to the display end; Acquire a third time period, reversely delay the third time period from the third moment, and determine the second moment, wherein the third time period is the time for the human eye data acquisition end to perform human eye tracking processing on a frame of human eye image; The second trigger signal is generated based on the second time, so that the second trigger signal The second moment triggers the human eye data acquisition end to acquire the human eye coordinates.

4. The display method according to claim 3, characterized in that: Determine the third moment, including: Acquire a first time period, where the first time period is the time for inputting one frame of the 3D video signal; The third moment is determined based on the first time period corresponding to the current frame, and the third moment is the midpoint of the first time period.

5. The display method according to claim 3, characterized in that: Generating a first trigger signal according to the third trigger signal includes: Acquire a fourth time period, where the fourth time period is the time for the human eye data acquisition end to acquire a frame of the human eye image; Delaying the fourth time period in reverse from the second time to determine the first time; The first trigger signal is generated based on the first moment, so that the first trigger signal triggers the human eye data acquisition end to acquire the human eye image of the current frame at the first moment.

6. The display method according to claim 3, characterized in that: Generating a first trigger signal according to the third trigger signal includes: Acquire a fourth time period, where the fourth time period is the time for the human eye data acquisition end to acquire a frame of the human eye image; Based on the third time period, determining a fourth moment, the fourth moment being the moment when the human eye data acquisition end completes the human eye tracking process on the previous frame of human eye image; Delaying the difference between the third time period and the fourth time period from the fourth time period in a positive direction to determine the first time period; The first trigger signal is generated based on the first moment, so that the first trigger signal triggers the human eye data acquisition end to acquire the human eye image of the current frame at the first moment.

7. The display method according to claim 4, characterized in that: Generating a second trigger signal according to the third trigger signal, and sending the second trigger signal to the human eye data acquisition end, including: Determining a first quantity based on the first time period and the third time period; generating the first number of second trigger signals at the second moment, so that the frequency of acquiring the eye coordinates in response to the first number of second trigger signals matches the frequency of acquiring the 3D video signal; The first number of second trigger signals are sequentially sent to a second number of human eye tracking subsystems in the human eye data acquisition terminal, where the second number is greater than or equal to the first number.

8. The display method according to claim 7, characterized in that: Determining a first quantity based on the first time period and the third time period includes: The ratio of the third time period to the first time period is calculated, and the ratio is rounded up to obtain the first number.

9. The display method according to claim 2, characterized in that: Processing the 3D video signal according to the eye coordinates sent by the eye data acquisition terminal includes: Based on the second video signal, acquiring second video data; Reading the first video data from the memory, performing distribution stretching on the first video data and the second video data to obtain left and right video data, wherein the left and right video data have the same resolution as the 3D video signal; In response to the eye coordinates sent by the eye data acquisition end, the left and right video data are pixel-rearranged based on the eye coordinates and the output timing information to generate the left and right eye images.

10. The display method according to claim 9, characterized in that: The first video data is read from the memory, and the first video data and the second video data are distributed and stretched to obtain left and right video data, including: After the first video data is completely written, the first video data is read during a sixth time period, the sixth time period being the same in length as the fifth time period; The first video data and the second video data are distributed and stretched to obtain the left and right video data.

11. A display method, characterized in that: Applied to the human eye data collection end, the method includes: In response to a first trigger signal sent by the video data processing end, collecting a human eye image; In response to a second trigger signal sent by the video data processing end, performing eye tracking processing on the eye image to obtain eye coordinates; The human eye coordinates are sent to the video data processing end so that the video data processing end processes the 3D video signal based on the human eye coordinates to generate left and right eye images, and sends the left and right eye images to the display end in response to a third trigger signal, wherein the first trigger signal and / or the second trigger signal are generated according to the third trigger signal.

12. The display method according to claim 11, characterized in that: In response to a first trigger signal sent by the video data processing end, collecting a human eye image includes: Receiving the first trigger signal sent by the video data processing end; In response to the first trigger signal at a first moment, controlling an image acquisition device to acquire a frame of the human eye image during a fourth time period; In response to the second trigger signal sent by the video data processing end, performing eye tracking processing on the human eye image to obtain the human eye coordinates includes: receiving the second trigger signal sent by the video data processing end; In response to the second trigger signal at the second moment, a human eye tracking process is performed on a frame of the human eye image during a third period of time to obtain the human eye coordinates.

13. The display method according to claim 12, characterized in that: The human eye data acquisition end includes a second number of human eye tracking subsystems, and receives the second trigger signal sent by the video data processing end, including: receiving a first number of the second trigger signals sequentially sent by the video data processing end within the third time period, the second number being greater than or equal to the first number; In response to each of the second trigger signals, the eye tracking subsystem is controlled to perform eye tracking processing on the eye image, so that each of the second trigger signals most recently received triggers the eye tracking subsystem that has not been triggered within the third time period.

14. A display system, characterized in that: include: The human eye data acquisition terminal is used to collect human eye images in response to the first trigger signal and to The trigger signal performs eye tracking processing based on the eye image to obtain eye coordinates; A video data processing end, the video data acquisition end is communicatively connected with the human eye data acquisition end, and is used to process the 3D video signal based on the human eye coordinates to generate left and right eye images, and send the left and right eye images to the display end in response to a third trigger signal; The display end is communicatively connected to the video data processing end, and is used to receive and display the left and right eye images; At least one of the first trigger signal and the second trigger signal is generated according to the third trigger signal.

15. The display system according to claim 14, characterized in that: The human eye data acquisition end is equipped with a human eye data acquisition subsystem and a human eye tracking subsystem, and the human eye data acquisition subsystem is communicatively connected with the human eye tracking subsystem; The human eye data acquisition subsystem is used for responding to the first trigger signal at a first moment and acquiring a frame of the human eye image during a fourth time period; The human eye tracking subsystem is communicatively connected to the video data processing end, and is used for responding to the second trigger signal at the second moment, performing human eye tracking processing on a frame of the human eye image during a third period of time, and obtaining the human eye coordinates; The difference between the first moment and the second moment is equal to the fourth time period, the difference between the second moment and the third moment is equal to the third time period, and the third moment is the triggering moment of the third trigger signal.

16. The display system according to claim 14, characterized in that: The video data processing end is configured with a video receiving subsystem, a video post-processing subsystem and a video sending subsystem; The video receiving subsystem is used to obtain the 3D video signal, and segment the 3D video signal to obtain a first video signal and a second video signal; The video post-processing subsystem is used to generate output timing information based on the first video signal, and generate the left and right eye images based on the post-processing information, wherein the post-processing information includes at least one of the following: the eye coordinates, the first video signal, the second video signal, and the output timing information; The video sending subsystem is used to respond to the third trigger signal at a third moment. The left and right eye images are sent to the display end.

17. The display system according to claim 15, characterized in that: The video data processing end reversely generates the first trigger signal based on the third moment, the third time period and the fourth time period, so that the first trigger signal triggers the human eye data acquisition subsystem to acquire the human eye image of the current frame at the first moment; The first moment is used to represent the moment when the human eye data acquisition subsystem finishes acquiring the human eye image of the previous frame.

18. The display system according to claim 15, characterized in that: The video data processing end reversely generates the first trigger signal based on the second trigger signal and the fourth time period, so that the first trigger signal triggers the human eye data acquisition subsystem to acquire the human eye image of the current frame at the first moment.

19. The display system according to claim 15, characterized in that: The video data processing end reversely generates the second trigger signal based on the third moment and the third time period, so that the second trigger signal triggers the human eye tracking subsystem to obtain the human eye coordinates of the current frame at the second moment; The second moment is used to represent the moment when the eye tracking subsystem finishes acquiring the eye coordinates of the previous frame.

20. The display system according to claim 15, characterized in that: The video data processing end generates the third trigger signal based on the first time period, so that the third trigger signal triggers the video data processing end to send the left and right eye images to the display end at the third moment; The first time period is used to represent the time for the video data processing end to input one frame of the 3D video signal.

21. The display system according to claim 19, characterized in that: The video data processing end determines at least one second trigger signal based on the third moment and the third time period, so that the frequency of the human eye tracking subsystem collecting the human eye image in response to the at least one second trigger signal matches the frequency of the video data processing end acquiring the 3D video signal.

22. The display system according to claim 16, characterized in that: The video post-processing subsystem is used to generate output timing information based on the first video signal, including: The video post-processing subsystem obtains first video data and timing information corresponding to the first video signal based on the first video signal, writes the first video data into a memory, and generates the output timing information based on the timing information.

23. The display system according to claim 22, characterized in that: The video post-processing subsystem generates the left and right eye images based on the post-processing information, including: The video post-processing subsystem reads the first video data from the memory, distributes and stretches the first video data and the second video data corresponding to the second video signal, and rearranges pixels based on the human eye coordinates and the output timing information to generate the left and right eye images.

24. The display system according to claim 23, characterized in that: The video post-processing subsystem reads one frame of the first video data and one frame of the second video data from the memory in the same time period when the video data processing end inputs one frame of the 3D video signal.

25. A display device, characterized in that: Applied to a video data processing end, the device comprises: A video acquisition module, configured to acquire a 3D video signal in response to a frame start signal; A video processing module, used to process the 3D video signal according to the eye coordinates sent by the eye data acquisition terminal to obtain left and right eye images; A sending module, configured to send the left-eye and right-eye images to a display terminal in response to a third trigger signal, so as to display the left-eye and right-eye images on the display terminal; a trigger signal module, configured to generate a first trigger signal and / or a second trigger signal according to the third trigger signal, and send the first trigger signal and / or the second trigger signal to the human eye data acquisition end, so that the human eye data acquisition end collects human eye images in response to the first trigger signal, performs human eye tracking processing based on the human eye images in response to the second trigger signal, and obtains the human eye coordinate.

26. A display device, characterized in that: Applied to the human eye data collection end, the device comprises: A human eye acquisition module, used for acquiring a human eye image in response to a first trigger signal sent by the video data processing end; An eye tracking module, configured to perform eye tracking processing on the eye image in response to a second trigger signal sent by the video data processing end, and obtain eye coordinates; A coordinate sending module is used to send the human eye coordinates to the video data processing end, so that the video data processing end processes the 3D video signal based on the human eye coordinates to generate left and right eye images, and sends the left and right eye images to the display end in response to a third trigger signal, wherein the first trigger signal and / or the second trigger signal is generated according to the third trigger signal.

27. A computing device, characterized in that: include: a memory having computer readable code stored therein; as well as One or more processors, when the computer-readable code is executed by the one or more processors, the computing and processing device executes the display method as described in any one of claims 1-10, or the computing and processing device executes the display method as described in any one of claims 11-13.

28. A computer program, characterized in that The computer-readable code includes a computer-readable code, which, when executed on a computing and processing device, causes the computing and processing device to execute a display method according to any one of claims 1 to 10, or causes the computing and processing device to execute a display method according to any one of claims 11 to 13.

29. A computer readable medium, characterized in that A computer program as claimed in claim 28 is stored therein.

Images