A display device and an image acquisition method thereof

Abstract

Disclosed are a display device and an image acquisition method thereof. The display device comprises: a display area and a peripheral area surrounding the display area; the peripheral area comprises: an image acquisition module; the image acquisition module comprises: an acquisition window layer, comprising a plurality of window units arranged in a continuous manner; the acquisition window layer is used to: determine part of the window units that need to be transparent as acquisition windows according to the user's position, and control the acquisition window to be in a transparent state; at least one layer of lens module, located on the backlight side of the acquisition window layer; used to provide a convergent lens structure; an image acquisition unit array, located on the side of the lens module away from the acquisition window layer; the orthographic projection of each acquisition window on the image acquisition unit array covers at least one image acquisition unit; the image acquisition unit array is used to: control at least one image acquisition unit corresponding to the acquisition window to acquire a light field image through the convergent lens structure and the acquisition window.

Description

Technical Field

[0001] The present disclosure relates to the field of display technologies, and particularly to a display device and an image acquisition method thereof. Background Art

[0002] By recording higher-dimensional light data, a light field can obtain three-dimensional information with higher accuracy than traditional two-dimensional imaging and traditional three-dimensional imaging represented by binocular stereovision, so as to accurately perceive a dynamic environment. However, in the prior art, for a camera module used for light field information acquisition, the camera spacing cannot be made small. Therefore, a view synthesis algorithm is required to supplement intermediate viewpoints, which is slow and has poor effects. Summary of the Invention

[0003] A display device provided by an embodiment of the present disclosure includes: a display area and a peripheral area surrounding the display area; the peripheral area includes: an image acquisition module; the image acquisition module includes:

[0004] An acquisition window layer, including a plurality of continuously arranged window units; the acquisition window layer is configured to: determine a part of the window units that need to transmit light as an acquisition window according to the user's position, and control the acquisition window to be in a light-transmitting state;

[0005] At least one lens module, located on the backlight side of the acquisition window layer; configured to provide a converging lens structure;

[0006] An image acquisition unit array, located on the side of the lens module away from the acquisition window layer; the orthographic projection of each acquisition window on the image acquisition unit array covers at least one image acquisition unit; the image acquisition unit array is configured to: control at least one image acquisition unit corresponding to the acquisition window to acquire a light field image through the converging lens structure and the acquisition window.

[0007] In some embodiments, the plurality of window units are arranged along a first direction; the window unit includes: a first substrate and a second substrate disposed opposite to each other, and a first liquid crystal layer located between the first substrate and the second substrate;

[0008] The first substrate includes a strip-shaped first transparent electrode extending along a second direction; the first direction intersects the second direction;

[0009] The second substrate includes a second transparent electrode; the second transparent electrodes included in the plurality of window units are integrally connected.

[0010] In some embodiments, the lens module includes:

[0011] A first cylindrical lens layer, including a plurality of first cylindrical lenses extending along the first direction;

[0012] A second cylindrical lens layer, located on the side of the first cylindrical lens layer away from the image acquisition unit array; including second cylindrical lenses extending along the second direction.

[0013] In some embodiments, the second lenticular lens layer includes:

[0014] A third substrate comprises a plurality of strip-shaped third transparent electrodes arranged along the first direction and extending along the second direction;

[0015] A fourth substrate, located on a side of the third substrate away from the first cylindrical lens layer, comprising a fourth transparent electrode;

[0016] The second liquid crystal layer is located between the third substrate and the fourth substrate.

[0017] In some embodiments, the second cylindrical lenses correspond to at least two third transparent electrodes.

[0018] In some embodiments, the display device includes a multi-layer lens module; the multi-layer lens module is stacked in sequence in a direction perpendicular to the plane where the collection window layer is located.

[0019] In some embodiments, the image acquisition unit includes: a contact image sensor chip.

[0020] In some embodiments, the image acquisition unit includes: a photodiode, and a transistor electrically connected to the photosensitive diode.

[0021] In some embodiments, the image acquisition module further includes: an image acquisition driving chip, a plurality of scanning signal lines, and a plurality of reading signal lines;

[0022] The scanning signal line is electrically connected to the image acquisition driving chip and the gate of the transistor; the reading signal line is electrically connected to the image acquisition driving chip and the photodiode.

[0023] In some embodiments, the image acquisition module further includes: a data selector, and a plurality of read signal lines are electrically connected to the image acquisition driving chip through the data selector.

[0024] In some embodiments, the image acquisition unit and the focus of the converging lens structure are located in the same plane.

[0025] In some embodiments, the peripheral region further comprises:

[0026] A depth image acquisition camera is used to collect the depth information of the user's eyes;

[0027] The positioning module is electrically connected to the depth image acquisition camera and is used to determine the eye coordinates of the user's eyes relative to the display device based on the user's eye depth information acquired by the depth image acquisition camera.

[0028] In some embodiments, the depth image acquisition camera and the image acquisition module are located on different sides of the display area.

[0029] In some embodiments, the display device further includes:

[0030] A delay compensation module, configured to compensate the eye coordinates determined by the positioning module according to a delay parameter to obtain predicted eye coordinates.

[0031] An image acquisition method for a display device provided by an embodiment of the present disclosure includes:

[0032] Determine the position of the acquisition window of the acquisition window layer according to the position of the user's eyes, and control the window unit corresponding to the acquisition window to be in a light-transmitting state;

[0033] Control at least one image acquisition unit corresponding to the acquisition window to acquire a light field image through a converging lens structure.

[0034] In some embodiments, the window unit includes: a first transparent electrode, a first liquid crystal layer, and a second transparent electrode; controlling the window unit corresponding to the acquisition window to be in a light-transmitting state specifically includes:

[0035] Apply a driving voltage to the second transparent electrode and the first transparent electrode corresponding to the acquisition window, and control the deflection of the first liquid crystal layer corresponding to the acquisition window, so that the acquisition window is in a light-transmitting state.

[0036] In some embodiments, the lens module includes a first cylindrical lens layer and a second cylindrical lens layer. The first cylindrical lens layer includes a first cylindrical lens, and the second cylindrical lens layer includes: a third transparent electrode, a second liquid crystal layer, and a fourth transparent electrode; while controlling the window unit corresponding to the acquisition window to be in a light-transmitting state, it further includes:

[0037] Apply a driving voltage to the fourth transparent electrode and the third transparent electrode corresponding to the acquisition window, and control the deflection of the second liquid crystal layer corresponding to the acquisition window to form a liquid crystal lens, so that the liquid crystal lens corresponding to the acquisition window and the first cylindrical lens form a converging lens structure.

[0038] In some embodiments, the display device further includes: a depth image acquisition camera and a positioning module; before determining the acquisition window of the acquisition window layer according to the position of the user's eyes, it further includes:

[0039] Control the depth image acquisition camera included in the display device corresponding to the viewing user to acquire the eye depth information of the user;

[0040] Control the positioning module to determine the eye coordinates of the user relative to the display device for acquiring the light field image according to the eye depth information of the user.

[0041] In some embodiments, the display device further includes: a delay compensation module; after determining the eye coordinates of the user's eyes relative to the display device for acquiring the light field image, it further includes:

[0042] The delay compensation module compensates the eye coordinates according to the delay parameters, obtains the predicted eye coordinates of the viewing user relative to the display device that captures the light field image, and sends the predicted eye coordinates to the display device that captures the light field image;

[0043] Determine the acquisition window of the acquisition window layer according to the user's eye position, specifically including:

[0044] The display device that captures the light field image determines the acquisition window of the acquisition window layer according to the predicted eye coordinates. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following briefly introduces the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0046] Figure 1 Structural schematic diagram of a display device provided by an embodiment of the present disclosure;

[0047] Figure 2 For the present disclosure embodiment provided along Figure 1 Cross-sectional view of AA' in;

[0048] Figure 3 Top view of a first substrate provided by an embodiment of the present disclosure;

[0049] Figure 4 Structural schematic diagram of an acquisition window layer provided by an embodiment of the present disclosure;

[0050] Figure 5 Structural schematic diagram of a second lenticular lens layer provided by an embodiment of the present disclosure;

[0051] Figure 6 Structural schematic diagram of another display device provided by an embodiment of the present disclosure;

[0052] Figure 7 Structural schematic diagram of yet another display device provided by an embodiment of the present disclosure;

[0053] Figure 8 Structural schematic diagram of an image acquisition unit array provided by an embodiment of the present disclosure;

[0054] Figure 9 Structural schematic diagram of another image acquisition unit array provided by an embodiment of the present disclosure;

[0055] Figure 10 Schematic diagram of eye coordinate prediction provided by an embodiment of the present disclosure;

[0056] Figure 11 The flowchart of an image acquisition method for a display device provided by an embodiment of the present disclosure. Specific embodiments

[0057] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present disclosure. Obviously, the described embodiments are some but not all of the embodiments of the present disclosure. And, without conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other. All other embodiments obtained by those of ordinary skill in the art based on the described embodiments of the present disclosure without creative efforts shall fall within the scope of protection of the present disclosure.

[0058] Unless otherwise defined, the technical terms or scientific terms used in the present disclosure shall have the ordinary meanings understood by those of ordinary skill in the art to which the present disclosure pertains. The "first", "second", and similar terms used in the present disclosure do not denote any order, quantity, or importance, but are only used to distinguish different components. The terms such as "comprising" or "including" mean that the elements or items appearing before this term cover the elements or items listed after this term and their equivalents, without excluding other elements or items. The terms such as "connected" or "coupled" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect.

[0059] It should be noted that the sizes and shapes of the various figures in the drawings do not reflect the true proportions, and the purpose is only to schematically illustrate the content of the present disclosure. And the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout.

[0060] An embodiment of the present disclosure provides a display device, as Figure 1 , Figure 2 shown. The display device includes: a display area 1 and a peripheral area 2 surrounding the display area 1; the peripheral area 2 includes: an image acquisition module 3; the image acquisition module 3 includes:

[0061] An acquisition window layer 31, including a plurality of continuously arranged window units 311; the acquisition window layer 31 is configured to: determine, according to the position of the viewing user, the partial window units 311 that need to transmit light as an acquisition window 312, and control the acquisition window 312 to be in a light-transmitting state;

[0062] At least one lens module 32, located on the backlight side of the acquisition window layer 31; configured to provide a converging lens structure 321;

[0063] The image acquisition unit 33 array is located on the side of the lens module 32 away from the acquisition window layer 31; the orthographic projection of each acquisition window 312 on the image acquisition unit 33 array covers at least one image acquisition unit 33; the image acquisition unit 33 array is configured to: control at least one image acquisition unit 33 corresponding to the acquisition window 312 to collect a light field image through the converging lens structure 321 and the acquisition window 312.

[0064] In the display device provided by the embodiments of the present disclosure, since the window units included in the acquisition window layer are arranged continuously, when the position of the viewing user changes, the position of the acquisition window can also change continuously. Moreover, since the orthographic projection of each acquisition window on the image acquisition unit array covers at least one image acquisition unit, when the position of the acquisition window changes continuously, a light field image of the viewed scene can also be collected by the actually provided image acquisition units to form a 3D image. Since there is no area that cannot be collected by the image acquisition units in the display device provided by the embodiments of the present disclosure, there is no need to use a view synthesis algorithm to supplement viewpoints, which can improve the speed and quality of light field image acquisition and enhance the user experience.

[0065] It should be noted that the display device provided by the embodiments of the present disclosure can be applied to the following scenarios: Two users, a and b, respectively use two display devices, A and B, for video communication; user a views the 3D image of user b through display device A, and the 3D image of user b is collected through display device B. Then user a is the viewing user. When using display device B to collect a light field image, it is necessary to determine the position of the acquisition window of display device B according to the position of user a relative to display device B. If user a moves, the position of the acquisition window of display device B also changes; user b views the 3D image of user a through display device B, and the 3D image of user a is collected through display device A. Then user b is the viewing user. When using display device A to collect a light field image, it is necessary to determine the position of the acquisition window of display device A according to the position of user b relative to display device A. If user b moves, the position of the acquisition window of display device A also changes.

[0066] Of course, in specific implementation, for the video communication scenario, multiple users can view on one side of any display device. Alternatively, the display device can also be applied to a scenario where video communication is carried out using more than two display devices. One of any two display devices among the more than two display devices corresponds to the display device on the viewing user side, and the other corresponds to the display device that needs to collect a light field image.

[0067] It should be noted that Figure 2 is a cross-sectional view along Figure 1 AA' in

[0068] It should be noted that in the acquisition window layer, the area outside the acquisition window is in a light-tight state.

[0069] It should be noted that as Figure 1 shown, the peripheral area 2 includes: a first peripheral area 21 and a second peripheral area 22 respectively located on both sides of the display area 1 in the Y direction, and a third peripheral area 23 and a fourth peripheral area 24 respectively located on both sides of the display area 1 in the X direction; Figure 1 Taking the image acquisition module 3 located in the first peripheral area 21 as an example for illustration. Of course, in specific implementation, the image acquisition module can also be located in other peripheral areas.

[0070] In some embodiments, as Figure 2 、 Figure 3 shown, a plurality of window units 311 are arranged along the first direction, i.e., the X direction; the window unit 311 includes: a first substrate 313 and a second substrate 314 which are oppositely arranged, and a first liquid crystal layer 315 located between the first substrate 313 and the second substrate 314;

[0071] The first substrate 313 includes a strip-shaped first transparent electrode 3131 extending along the second direction, i.e., the Y direction; the first direction intersects with the second direction;

[0072] The second substrate 314 includes a second transparent electrode 3141; the second transparent electrodes 3141 included in the plurality of window units 311 are integrally connected, that is, the second transparent electrode 3141 is a planar electrode.

[0073] That is, in the display device provided by the embodiments of the present disclosure, the acquisition window layer included in the image acquisition module is a liquid crystal cell structure, and by applying voltages to the first transparent electrode and the second transparent electrode, the liquid crystals in the first liquid crystal layer are deflected, so that the area corresponding to the acquisition window is in a light-transmitting state.

[0074] It should be noted that Figure 3 is a top view of a partial area of the first substrate.

[0075] In specific implementation, in the acquisition window layer, a plurality of first transparent electrodes are arranged at intervals along the first direction. For example, the widths of the plurality of first transparent electrodes in the first direction are the same, and the distance between any two adjacent first transparent electrodes is the same.

[0076] In specific implementation, as Figure 2 shown, the first substrate 313 further includes a first substrate 3132, and the first transparent electrode 3131 is located between the first substrate 3132 and the first liquid crystal layer 315; the second substrate 314 further includes a second substrate 3142, and the second transparent electrode 3141 is located between the second substrate 3142 and the first liquid crystal layer 315.

[0077] In a specific implementation, such as Figure 4 shown, the acquisition window layer 31 further includes: a first alignment film 316 located between the first substrate 313 and the first liquid crystal layer 315, a second alignment film 317 located between the second substrate 314 and the first liquid crystal layer 315, a first polarizer 318 located on the side of the first substrate 313 facing away from the first liquid crystal layer 315, and a second polarizer 319 located on the side of the second substrate 314 facing away from the first liquid crystal layer 315. The first alignment film and the second alignment film are used to align the liquid crystal molecules of the first liquid crystal layer.

[0078] In a specific implementation, the alignment angle of the first alignment film is 0°, the alignment angle of the second alignment film is 90°, and the transmission axes of both the first polarizer and the second polarizer are 90°. Alternatively, the alignment angle of the first alignment film is 90°, the alignment angle of the second alignment film is 0°, the transmission axis of the first polarizer is 90°, and the transmission axis of the second polarizer is 0°.

[0079] It should be noted that if the image acquisition module is disposed in the third peripheral area or the fourth peripheral area, the first direction is the Y direction and the second direction is the X direction.

[0080] In some embodiments, such as Figure 2 shown, the lens module 32 includes:

[0081] A first cylindrical lens layer 322, including first cylindrical lenses 3221 extending along the first direction, i.e., the X direction;

[0082] A second cylindrical lens layer 323, located on the side of the first cylindrical lens layer 322 facing away from the image acquisition unit 33 array; including second cylindrical lenses 3234 extending along the second direction.

[0083] It should be noted that the superposition of the first cylindrical lens and the second cylindrical lens is equivalent to a spherical lens as a converging lens structure. The spherical lens is a convex lens with a circular top view, which can converge a beam of parallel light into a point.

[0084] In a specific implementation, the first cylindrical lens layer may include one or more first cylindrical lenses. When the first cylindrical lens layer includes multiple first cylindrical lenses, the multiple first cylindrical lenses are arranged in sequence along the second direction, i.e., the Y direction.

[0085] In some embodiments, the second cylindrical lens layer 323 includes:

[0086] A third substrate 3231, including a plurality of strip-shaped third transparent electrodes 32311 arranged along the first direction and extending along the second direction;

[0087] A fourth substrate 3232, located on the side of the third substrate 3231 facing away from the first cylindrical lens layer 322, including a fourth transparent electrode 32321;

[0088] The second liquid crystal layer 3233 is located between the third substrate 3231 and the fourth substrate 3232.

[0089] That is, in the display device provided by the embodiments of the present disclosure, the second lenticular lens layer is a liquid crystal cell structure, that is, the second lenticular lens layer is a liquid crystal lens layer. By applying a voltage to the third transparent electrode and the fourth transparent electrode, the refractive power of the liquid crystal molecules in the second liquid crystal layer can be changed, so that the liquid crystal molecules in the second liquid crystal layer in the area corresponding to the acquisition window form a liquid crystal lens, that is, the second lenticular lens. When it is necessary to acquire a light field image through the acquisition window, forming a liquid crystal lens in the area corresponding to the acquisition window can be superimposed with the first lenticular lens to be equivalent to a converging lens structure, and the image acquisition unit corresponding to the acquisition window can acquire the light field image through the converging lens structure and the acquisition window. Moreover, by controlling the voltage applied to the third transparent electrode, it is possible to achieve that the formed liquid crystal lens, that is, the second lenticular lens, moves with the movement of the acquisition window. When the position of the acquisition window changes continuously, the position of the second lenticular lens can also change continuously, that is, the optical path is moved along the first direction, which can improve the acquisition accuracy of the light field image.

[0090] In specific implementation, a plurality of third transparent electrodes are arranged at intervals in the first direction. For example, the widths of the plurality of third transparent electrodes in the first direction are the same, and the distance between any two adjacent third transparent electrodes is the same.

[0091] In specific implementation, the minimum moving distance of the second lenticular lens is: the sum of the width of the third transparent electrode in the first direction and the distance between two adjacent third transparent electrodes.

[0092] In specific implementation, the fourth transparent electrode is a planar electrode provided as a whole surface.

[0093] In some embodiments, the second lenticular lens corresponds to at least two third transparent electrodes. That is, the liquid crystal is controlled to form a liquid crystal lens through at least two third transparent electrodes and the fourth transparent electrode. Thereby, it can be ensured that the formed liquid crystal lens has a good morphology. In specific implementation, the specific number of third transparent electrodes corresponding to the second lenticular lens can be selected according to actual needs.

[0094] In some embodiments, as Figure 2 shown, the third substrate 3231 further includes a third substrate 32312, and the third transparent electrode 32311 is located between the third substrate 32312 and the second liquid crystal layer 3233; the fourth substrate further includes a fourth substrate 32322, and the fourth transparent electrode 32321 is located between the fourth substrate 32322 and the second liquid crystal layer 3233.

[0095] In some embodiments, as Figure 5As shown, the second cylindrical lens layer 32 further includes: a third alignment film 3235 located between the third substrate 3231 and the second liquid crystal layer 3233, and a fourth alignment film 3236 located between the fourth substrate 3232 and the second liquid crystal layer 3233.

[0096] In a specific implementation, the alignment angles of both the third alignment film and the fourth alignment film are 90°.

[0097] In a specific implementation, the width of the acquisition window in the first direction is equal to the width of the second cylindrical lens in the first direction.

[0098] In a specific implementation, Figure 1 Taking the example that the acquisition window layer has only one acquisition window when performing light field image acquisition for illustration. Of course, as Figure 6 shown, when performing light field image acquisition, it may also include multiple acquisition windows 312. For example, when there are multiple viewing users, the acquisition windows correspond to the viewing users one by one. Of course, as Figure 6 shown, it can also be set such that the two eyes 10 of each viewing user respectively correspond to two acquisition windows 312.

[0099] In a specific implementation, the number and width of the first transparent electrode and the third transparent electrode can be the same, and the distance between two adjacent first transparent electrodes can be the same as the distance between two adjacent third transparent electrodes.

[0100] In some embodiments, the materials of the first transparent electrode, the second transparent electrode, the third transparent electrode, and the fourth transparent electrode all include indium tin oxide (ITO).

[0101] In a specific implementation, the first cylindrical lens layer can also be a liquid crystal lens layer. That is, the first cylindrical lens layer can also be a liquid crystal cell structure.

[0102] It should be noted that, Figure 2 the distance is described by taking the image acquisition module including one layer of lens module as an example.

[0103] Alternatively, in some embodiments, as Figure 7 shown, the display device includes multiple layers of lens modules 32; the multiple layers of lens modules 32 are stacked in sequence in a direction perpendicular to the plane where the acquisition window layer 31 is located.

[0104] For the display device provided by the embodiments of the present disclosure, the image acquisition module includes multiple layers of lens modules. The converging lens structure equivalently obtained by the multiple layers of lens modules has good imaging quality, can also reduce optical aberration, and further improve the image acquisition effect.

[0105] It should be noted that, Figure 7Taking the example that the middle image acquisition module includes three layers of lens modules for distance explanation, in specific implementation, the number of lens modules can be selected according to actual needs. For example, the number of lens modules can be selected according to the thickness requirement of the display device, the imaging quality requirement, etc.

[0106] In some embodiments, the image acquisition unit includes: a contact image sensor chip (Contact Image Sensor, CIS). In specific implementation, multiple CISs are arranged closely in sequence along the first direction.

[0107] Alternatively, in some embodiments, the image acquisition unit includes: a photodiode, and a transistor electrically connected to the photosensitive diode.

[0108] In specific implementation, the photosensitive diode can be an inorganic photosensitive diode or an organic photosensitive diode; the transistor is, for example, a thin film transistor. The drain of the transistor is electrically connected to the first pole of the photodiode, and the second pole of the photodiode outputs the acquisition signal of the light field image.

[0109] When the image acquisition unit includes a photodiode and a transistor, in some embodiments, as Figure 8 shown, the image acquisition module 3 further includes: an image acquisition driving chip 34, a plurality of scanning signal lines 35, and a plurality of reading signal lines 36;

[0110] In specific implementation, the scanning signal lines 35 are electrically connected to the image acquisition driving chip 34 and the gates of the transistors (not shown); the reading signal lines 36 are electrically connected to the image acquisition driving chip 34 and the photodiodes (not shown). That is, the image acquisition driving chip performs gating through the scanning signal lines to select the image acquisition unit corresponding to the acquisition window to acquire the light field image.

[0111] In some embodiments, as Figure 9 shown, the image acquisition module 3 further includes: a data selector 37, and a plurality of reading signal lines 36 are electrically connected to the image acquisition driving chip 34 through the data selector 37. That is, the image acquisition driving chip performs gating through the data selector to select the light field image acquired by the image acquisition unit corresponding to the acquisition window. As Figure 9 shown, the image acquisition module 3 further includes: a connection lead 38 electrically connecting the data selector 37 and the image acquisition driving chip 34.

[0112] In some embodiments, the focus of the image acquisition unit and the converging lens structure is located on the same plane. That is, the image acquisition unit is located on the focal plane of the converging lens structure. Thereby, the image acquisition effect can be ensured.

[0113] In some embodiments, as Figure 1 shown, the peripheral area 2 further includes:

[0114] A depth image acquisition (Red Green Blue Depth, RGBD) camera 4 is used to acquire the depth information of the eyes of the viewing user.

[0115] A positioning module (not shown), electrically connected to the depth image acquisition camera 4, is used to determine the eye coordinates of the viewing user's eyes relative to the display device according to the depth information of the viewing user's eyes acquired by the depth image acquisition camera 4.

[0116] In a specific implementation, the RGBD camera placed on the display border is used to acquire the depth image. The positioning module processes the depth image, locates the positions of the viewing user's binoculars in the depth image, and simultaneously reads the depth information of the eyes in the depth image to obtain the 3D coordinates of the viewing user's eyes. Then, the eye coordinates of the viewing user are transmitted to the acquisition - end display device that needs to perform light - field image acquisition through the network. Based on the projection position of the eye coordinates on the screen of the acquisition - end display device, the area where the acquisition window of the acquisition - end display device is located is determined, and the image acquisition unit corresponding to the acquisition window is selected to perform light - field image acquisition. For the display device provided by the embodiments of the present disclosure, the remaining image acquisition units outside the acquisition window do not participate in data processing and transmission, which can improve the speed of image acquisition, processing, and transmission. In a specific implementation, the light - field image data acquired by the image acquisition unit corresponding to the acquisition window is video data, and operations such as compression transmission, decoding, and rendering can be performed on this video data, so that the viewing user can view the view corresponding to the position of the viewed user.

[0117] In a specific implementation, the positioning module performs face detection on the depth image. After detecting the face area, it then locates the key points of the face to obtain the eye positioning and the 3D coordinates of the viewing user's eyes.

[0118] In some embodiments, as Figure 1 shown, the depth image acquisition camera 4 and the image acquisition module 3 are located on different sides of the display area 1.

[0119] Thus, the setting of the depth image acquisition camera will not affect the acquisition range of the image acquisition module.

[0120] It should be noted that Figure 1 the example takes the image acquisition module 3 located in the first peripheral area 21 and the depth image acquisition camera 4 located in the second peripheral area 22. Of course, in a specific implementation, the positions of the image acquisition module and the depth image acquisition camera can be interchanged. Of course, the depth image acquisition camera can also be located in the third peripheral area or the fourth peripheral area.

[0121] In some embodiments, the display device further includes:

[0122] A delay compensation module is used to compensate the eye coordinates determined by the positioning module according to the delay parameter to obtain predicted eye coordinates.

[0123] It should be noted that since the eye coordinates of the viewing user need to be transmitted over the network to the acquisition end display device, there will inevitably be network delay (denoted as D1); during the processes of the acquisition end display device controlling the image acquisition unit corresponding to the acquisition window for acquisition, processing, encoding, etc. based on the received eye coordinates, there is acquisition processing delay (denoted as D2); when the acquisition end display device transmits the video data to the viewing user's display device, it will experience network delay again. Therefore, from the eye positioning of the viewing user to the display of the video data on the viewing user's display device, the total delay is 2D1 + D2. If no compensation is performed, when the viewing user is moving, the displayed video picture will lag, affecting the user experience.

[0124] The display device provided by the embodiments of the present disclosure includes a delay compensation module that can compensate the eye coordinates determined by the positioning module according to the delay parameter. Even when the viewing user is in a moving state, it is possible to avoid the situation where the displayed video picture lags.

[0125] In specific implementation, the delay parameter D = 2D1 + D2. It should be noted that for a certain display device, its acquisition processing delay D2 is basically a fixed value and can be obtained through offline measurement. The network delay D1 varies greatly with the change of the network environment, so it must be measured and estimated in real time. In specific implementation, the display device also includes a network transmission module. By adding a response mechanism in the network transmission module and calculating the response time difference, the current network delay can be estimated. After obtaining the delay parameter D, the eye coordinates can be predicted.

[0126] In specific implementation, predicting the eye coordinates can use linear motion prediction or non - linear prediction algorithms such as Kalman filtering. Next, taking linear motion prediction as an example, an illustration is given.

[0127] As Figure 10 shown, at time T0, the eye positioning position is X0, and at time T1 (the current latest eye positioning time), the eye positioning position is X1. By linear fitting, a straight line can be determined. Of course, multiple points can also be used to fit the straight line. After determining the delay parameter D, the position Xpredict of the human eye at time T1 + D can be calculated through the straight line equation, and this position is transmitted to the acquisition end display device. The acquisition window corresponding to this position and the corresponding image acquisition unit are selected to perform light field image acquisition to obtain video data, and then the video data is transmitted to the viewing user's display device, which can ensure the correspondence between the current viewing user's position and the viewing viewpoint, improve the image acquisition accuracy, and enhance the user experience.

[0128] It should be noted that for the application scenario where two users, a and b, conduct video communication using two display devices, A and B respectively, taking the example that user a views the 3D image of user b through display device A and the 3D image of user b is collected through display device B, and the image acquisition module is located in the first peripheral area. The predicted eye coordinates of user a relative to display device A are: left eye coordinates (x1, y1, z1), right eye coordinates (x2, y1, z1). Then the predicted eye coordinates of user a relative to display device B are: left eye coordinates (xn - x1, y1, z1), right eye coordinates (xn - x2, y1, z1). It should be noted that the coordinate value of the leftmost edge of the display device in the X direction is 0, and the coordinate value of the rightmost edge of the display device in the X direction is xn. If the left and right eyes respectively correspond to two acquisition windows, the width of the acquisition window in the X direction is equal to the width of the second lenticular lens in the X direction. In the X direction, the center coordinate value of the acquisition window corresponding to the left eye is xn - x1, the left edge coordinate of the acquisition window corresponding to the left eye is xn - x1 - h, the right edge coordinate of the acquisition window corresponding to the left eye is xn - x1 + h, the center coordinate value of the acquisition window corresponding to the right eye is xn - x2, the left edge coordinate of the acquisition window corresponding to the right eye is xn - x2 - h, and the right edge coordinate of the acquisition window corresponding to the right eye is xn - x12 + h, where h is half of the width of the second lenticular lens in the X direction.

[0129] In some embodiments, the display device further includes: a display panel covering the display area and extending to the peripheral area; the display panel includes a plurality of pixel islands arranged in an array in the display area, and each pixel island includes a plurality of sub - pixels;

[0130] It may further include a light - transmissive spacer layer on the light - emitting side of the display panel and a light - splitting component on the side of the spacer layer away from the display panel; the light - splitting structure is used to control the light - emitting angle of each sub - pixel to make it emit light directionally; the light - splitting structure is, for example, a lenticular lens, a grating, etc.

[0131] It should be noted that the display device provided by the embodiments of the present disclosure can be applied to 3D display and can also achieve the switching between 3D and 2D displays. The pixel island can be used as a sub - pixel for 2D display. Since a pixel island includes a plurality of sub - pixels, the same resolution as 2D display can be maintained in the 3D display mode.

[0132] In specific implementation, the display panel can be one of a liquid crystal display panel (LCD), an organic light - emitting diode (OLED) display panel, a quantum dot light - emitting diode (QLED), a micro - inorganic light - emitting diode (micro LED) display panel, and a mini - light - emitting diode (mini LED) display panel.

[0133] In specific implementation, the display panel and the image acquisition module are independently arranged and then assembled into a display device.

[0134] The display device provided by the embodiments of the present disclosure is: any product or component with a display function, such as a mobile phone, a tablet computer, a television, a monitor, etc. Other essential components of the display device should be understood by those of ordinary skill in the art and will not be elaborated herein, nor should they be considered as a limitation to the present disclosure.

[0135] Based on the same inventive concept, the embodiments of the present disclosure further provide an image acquisition method for the above display device, as Figure 11 shown, including:

[0136] S101. Determine the position of the acquisition window of the acquisition window layer according to the position of the eyes of the viewing user, and control the window unit corresponding to the acquisition window to be in a light-transmitting state;

[0137] S102. Control at least one image acquisition unit corresponding to the acquisition window to acquire a light field image through a converging lens structure.

[0138] For the image acquisition method of the display device provided by the embodiments of the present disclosure, since the window units included in the acquisition window layer are arranged continuously, when the position of the viewing user changes, the position of the acquisition window can also change continuously. Moreover, since the orthographic projection of each acquisition window on the image acquisition unit array covers at least one image acquisition unit, when the position of the acquisition window changes continuously, a light field image of the viewed scene can also be acquired by controlling the actually arranged image acquisition units to form a 3D image, without using a view synthesis algorithm to supplement viewpoints, which can improve the speed and quality of light field image acquisition and enhance the user experience.

[0139] It should be noted that the image acquisition method of the display device provided by the embodiments of the present disclosure can be applied to a scenario where two users, a and b, respectively use two display devices, A and B, for video communication; user a views the 3D image of user b through display device A, and the 3D image of user b is acquired through display device B. Then user a is the viewing user. When using display device B for light field image acquisition, it is necessary to determine the position of the acquisition window of display device B according to the position of user a relative to display device B, and then display device B executes the above steps S101 and S102; user b views the 3D image of user a through display device B, and the 3D image of user a is acquired through display device A. Then user b is the viewing user. When using display device A for light field image acquisition, it is necessary to determine the position of the acquisition window of display device A according to the position of user b relative to display device A, and then display device A executes the above steps S101 and S102.

[0140] Of course, in specific implementation, the display device can also be applied to a scenario of video communication using two or more display devices. In this case, in the video communication scenario, each display device that needs to collect light field images needs to execute the above steps S101 and S102.

[0141] In some embodiments, the window unit includes: a first transparent electrode, a first liquid crystal layer, and a second transparent electrode; step S101 controls the window unit corresponding to the acquisition window to be in a light-transmitting state, specifically including:

[0142] Apply a driving voltage to the second transparent electrode and the first transparent electrode corresponding to the acquisition window, and control the deflection of the first liquid crystal layer corresponding to the acquisition window, so that the acquisition window is in a light-transmitting state.

[0143] In some embodiments, when the lens module includes a first cylindrical lens layer and a second cylindrical lens layer, and the second cylindrical lens layer is a liquid crystal lens layer, while controlling the window unit corresponding to the acquisition window to be in a light-transmitting state, it further includes: controlling the lens module to form a converging lens structure in the area corresponding to the acquisition window.

[0144] In some embodiments, the second cylindrical lens layer includes: a third transparent electrode, a second liquid crystal layer, and a fourth transparent electrode; controlling the lens module to form a converging lens structure in the area corresponding to the acquisition window specifically includes:

[0145] Apply a driving voltage to the fourth transparent electrode and the third transparent electrode corresponding to the acquisition window, and control the deflection of the second liquid crystal layer corresponding to the acquisition window to form a liquid crystal lens, so that the liquid crystal lens corresponding to the acquisition window and the first cylindrical lens form a converging lens structure.

[0146] In some embodiments, the display device further includes: a depth image acquisition camera and a positioning module; before step S101 determines the acquisition window of the acquisition window layer according to the eye position of the viewing user, it further includes: the step of determining the eye position of the viewing user, specifically including:

[0147] Control the depth image acquisition camera included in the display device corresponding to the viewing user to acquire the eye depth information of the viewing user;

[0148] Control the positioning module to determine the eye coordinates of the viewing user relative to the display device for acquiring the light field image according to the eye depth information of the viewing user.

[0149] It should be noted that the specific process of determining the eye coordinates of the viewing user relative to the display device for acquiring the light field image according to the eye depth information of the viewing user can be referred to the description of the display device embodiment, and will not be elaborated here.

[0150] It should be noted that for the application scenario where two users, a and b, conduct video communication using two display devices, A and B respectively, user a views the 3D image of user b through display device A, and the 3D image of user b is captured by display device B. Then user a is the viewing user, display device A is the display device corresponding to the viewing user, and display device B is the display device for capturing the light field image. It is necessary to use display device A to perform the above steps of determining the eye position of viewing user a; user b views the 3D image of user a through display device B, and the 3D image of user a is captured by display device A. Then user a is the viewing user, display device B is the display device corresponding to the viewing user, and display device A is the display device for capturing the light field image. It is necessary to use display device B to perform the above steps of determining the eye position of viewing user b.

[0151] In specific implementation, when there are multiple viewing users and the multiple viewing users view video information through the same display device, controlling the depth image acquisition camera included in the display device corresponding to the viewing user to acquire the eye depth information of the viewing user specifically includes: controlling the depth image acquisition camera included in the display device corresponding to the viewing user to acquire the eye depth information of each viewing user; controlling the positioning module to determine the eye coordinates of the viewing user relative to the display device for capturing the light field image according to the eye depth information of the viewing user, specifically including: controlling the positioning module to determine the number of viewing users according to the eye depth information of the viewing user, and determining the eye coordinates of each viewing user relative to the display device for capturing the light field image. For example, if user a and user c view the 3D image of user b through display device A, then control the depth image acquisition camera included in display device A to acquire the eye depth information of user a and user c, and control the positioning module of display device A to determine the eye coordinates of user a and user c relative to display device B according to the eye depth information of user a and user c.

[0152] In specific implementation, when there are multiple viewing users and the multiple viewing users view video information through display devices that are not exactly the same, controlling the depth image acquisition cameras included in the display devices corresponding to the viewing users to acquire the eye depth information of the viewing users specifically includes: controlling the depth image acquisition cameras included in each of the display devices corresponding to the multiple viewing users to respectively acquire the eye depth information of the multiple viewing users; controlling the positioning module to determine the eye coordinates of the viewing users relative to the display device that acquires the light field image according to the eye depth information of the viewing users, specifically including: controlling the positioning modules of different display devices corresponding to the multiple viewing users to respectively determine the eye coordinates of the viewing users relative to the display device that acquires the light field image according to the corresponding eye depth information of the viewing users. For example, if user a views the 3D image of user b through display device A, and user c views the 3D image of user b through display device C, then control the depth image acquisition camera included in display device A to acquire the eye depth information of user a, control the positioning module of display device A to determine the eye coordinates of user a relative to display device B according to the eye depth information of user a, and also need to control the depth image acquisition camera included in display device C to acquire the eye depth information of user c, and control the positioning module of display device C to determine the eye coordinates of user c relative to display device B according to the eye depth information of user c.

[0153] In some embodiments, the display device further includes: a delay compensation module; after determining the eye coordinates of the viewing user's eyes relative to the display device that acquires the light field image, it further includes:

[0154] The delay compensation module compensates the eye coordinates according to the delay parameter to obtain the predicted eye coordinates of the viewing user relative to the display device that acquires the light field image, and sends the predicted eye coordinates to the display device that acquires the light field image;

[0155] Determining the acquisition window of the acquisition window layer according to the eye position of the viewing user specifically includes:

[0156] The display device that acquires the light field image determines the acquisition window of the acquisition window layer according to the predicted eye coordinates.

[0157] In specific implementation, the delay parameter is 2D1 + D2. For the method of using the delay compensation module to compensate the eye coordinates according to the delay parameter to obtain the predicted eye coordinates, refer to the embodiments of the display device in the present disclosure, which will not be elaborated here.

[0158] The image acquisition method of the display device provided by the embodiments of the present disclosure uses the delay compensation module to compensate the eye coordinates determined by the positioning module according to the delay parameter. Even when the viewing user is in a moving state, it is possible to avoid the situation that the displayed video picture lags.

[0159] In specific implementation, the display device further includes a network transmission module, and the predicted eye coordinates can be sent to the display device that captures the light field image through the network transmission module.

[0160] It should be noted that for the application scenario where two users, a and b, conduct video communication using two display devices, A and B respectively, when user a views the 3D image of user b through display device A, it is necessary to use the delay compensation module of display device A to compensate the eye coordinates of user a according to the delay parameter to obtain the predicted eye coordinates of user a relative to display device B. The network transmission module of display device A sends the predicted eye coordinates of user a to display device B, and display device B determines the acquisition window of the acquisition window layer according to the predicted eye coordinates of user a; when user b views the 3D image of user a through display device B, it is necessary to use the delay compensation module of display device B to compensate the eye coordinates of user b according to the delay parameter to obtain the predicted eye coordinates of user b relative to display device A. The network transmission module of display device B sends the predicted eye coordinates of user b to display device A, and display device A determines the acquisition window of the acquisition window layer according to the predicted eye coordinates of user b.

[0161] In specific implementation, when there are multiple viewing users and the multiple viewing users view video information through the same display device, the delay compensation module compensates the eye coordinates according to the delay parameter to obtain the predicted eye coordinates of the viewing users relative to the display device that captures the light field image. Specifically, it includes: the delay compensation module compensates each eye coordinate according to the delay parameter to obtain the predicted eye coordinates of each viewing user relative to the display device that captures the light field image. For example, if user a and user c view the 3D image of user b through display device A, then control the delay compensation module included in display device A to compensate the eye coordinates of user a and user c respectively according to the delay parameter to obtain the predicted eye coordinates of user a relative to display device B and the predicted eye coordinates of user c relative to display device B. The network transmission module of display device A sends the predicted eye coordinates of user a relative to display device B and the predicted eye coordinates of user c relative to display device B to display device B, and display device B determines the acquisition window of the acquisition window layer according to the predicted eye coordinates of user a relative to display device B and the predicted eye coordinates of user c relative to the display device.

[0162] In specific implementation, when there are multiple viewing users and the multiple viewing users view video information through display devices that are not exactly the same, the delay compensation module compensates the eye coordinates according to the delay parameter to obtain the predicted eye coordinates of the viewing users relative to the display device that captures the light field image. Specifically, it includes: controlling the delay compensation module of each display device corresponding to the multiple viewing users to compensate the eye coordinates of the viewing users corresponding to the display device, and obtaining the predicted eye coordinates of the viewing users corresponding to the display device relative to the display device that captures the light field image. For example, if user a views the 3D image of user b through display device A, and user c views the 3D image of user b through display device C, then control the delay compensation module included in display device A to compensate the eye coordinates of user a according to the delay parameter, and obtain the predicted eye coordinates of user a relative to display device B. The network transmission module of display device A sends the predicted eye coordinates of user a relative to display device B to display device B; control the delay compensation module included in display device C to compensate the eye coordinates of user c according to the delay parameter, and obtain the predicted eye coordinates of user c relative to display device B. The network transmission module of display device C sends the predicted eye coordinates of user c relative to display device B to display device B; display device B determines the acquisition window of the acquisition window layer according to the predicted eye coordinates of user a relative to display device B and the predicted eye coordinates of user c relative to display device B.

[0163] For the video communication scenario, in some embodiments, after step S102 controls at least one image acquisition unit corresponding to the acquisition window to acquire the light field image through the converging lens structure, it further includes:

[0164] The display device that captures the light field image sends the captured light field image information to the display device corresponding to the viewing user.

[0165] In specific implementation, the display device that captures the light field image sends the captured light field image information to the display device corresponding to the viewing user through the network transmission module.

[0166] It should be noted that for the application scenario where two users, a and b, use two display devices, A and B, respectively, for video communication. User a views the 3D image of user b through display device A. After display device B captures the light field image, the network transmission module of display device B sends the captured light field image information to display device A for display; user b views the 3D image of user a through display device B. After display device A captures the light field image, the network transmission module of display device A sends the captured light field image information to display device B for display.

[0167] In summary, for the display device and its image acquisition method provided by the embodiments of the present disclosure, since the window units included in the acquisition window layer are arranged continuously, when the position of the viewing user changes, the position of the acquisition window can also change continuously. Moreover, since the orthographic projection of each acquisition window on the image acquisition unit array covers at least one image acquisition unit, when the position of the acquisition window changes continuously, the light field image of the viewed scene can also be acquired by the actually provided image acquisition units to form a 3D image. Since there is no area in the display device provided by the embodiments of the present disclosure that cannot be acquired by the image acquisition units, there is no need to use a view synthesis algorithm to supplement viewpoints, which can improve the speed and quality of the square image acquisition and enhance the user experience.

[0168] Although the preferred embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications once they know the basic creative concept. Therefore, the appended claims are intended to be construed to include the preferred embodiments as well as all changes and modifications falling within the scope of the present invention.

[0169] Obviously, those skilled in the art can make various changes and modifications to the present disclosure without departing from the spirit and scope of the present disclosure. Thus, if these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and their equivalent technologies, the present disclosure is also intended to include these modifications and variations.

Claims

1. A display device, wherein, The display device includes: a display area and a peripheral area surrounding the display area; the peripheral area includes: an image acquisition module; the image acquisition module includes: An acquisition window layer, including a plurality of continuously arranged window units; the acquisition window layer is configured to: determine, according to the user's position, the window units that need to be light-transmissive as acquisition windows, and control the acquisition windows to be in a light-transmissive state; At least one lens module, located on the backlight side of the acquisition window layer; used to provide a converging lens structure; An image acquisition unit array, located on the side of the lens module away from the acquisition window layer; the orthographic projection of each acquisition window on the image acquisition unit array covers at least one of the image acquisition units; the image acquisition unit array is configured to: control at least one of the image acquisition units corresponding to the acquisition window to collect a light field image through the converging lens structure and the acquisition window; The lens module includes: A first cylindrical lens layer, including first cylindrical lenses extending in a first direction; A second cylindrical lens layer, located on the side of the first cylindrical lens layer away from the image acquisition unit array; including second cylindrical lenses extending in a second direction; The second cylindrical lens layer includes: A third substrate, including a plurality of strip-shaped third transparent electrodes arranged in the first direction and extending in the second direction; A fourth substrate, located on the side of the third substrate away from the first cylindrical lens layer, including a fourth transparent electrode; A second liquid crystal layer, located between the third substrate and the fourth substrate.

2. The display device according to claim 1, wherein, The plurality of window units are arranged in the first direction; the window unit includes: a first substrate and a second substrate arranged opposite to each other, and a first liquid crystal layer located between the first substrate and the second substrate; The first substrate includes a strip-shaped first transparent electrode extending in the second direction; the first direction intersects with the second direction; The second substrate includes a second transparent electrode; the second transparent electrodes included in the plurality of window units are integrally connected.

3. The display device according to claim 1, wherein, The second cylindrical lens corresponds to at least two of the third transparent electrodes.

4. The display device according to any one of claims 1 to 3, wherein, The display device includes multiple layers of the lens module; the multiple layers of the lens module are stacked in sequence in a direction perpendicular to the plane where the acquisition window layer is located.

5. The display device according to any one of claims 1 to 3, wherein, The image acquisition unit includes: a contact image sensor chip.

6. The display device according to any one of claims 1 to 3, wherein, The image acquisition unit includes: a photodiode and a transistor electrically connected to the photosensitive diode.

7. The display device according to claim 6, wherein, The image acquisition module further includes: an image acquisition driving chip, a plurality of scanning signal lines, and a plurality of reading signal lines; The scanning signal lines are electrically connected to the image acquisition driving chip and the gates of the transistors; the reading signal lines are electrically connected to the image acquisition driving chip and the photodiodes.

8. The display device according to claim 7, wherein, The image acquisition module further includes: a data selector, and the plurality of reading signal lines are electrically connected to the image acquisition driving chip through the data selector.

9. The display device according to any one of claims 1 to 3, 7, and 8, wherein, The image acquisition unit and the focal point of the converging lens structure are located on the same plane.

10. The display device according to any one of claims 1 to 5, 8, and 9, wherein, The peripheral area further includes: A depth image acquisition camera, used to acquire the depth information of the user's eyes; A positioning module, electrically connected to the depth image acquisition camera, is configured to determine the eye coordinates of the user's eyes relative to the display device according to the user's eye depth information acquired by the depth image acquisition camera.

11. The display device according to claim 10, wherein, The depth image acquisition camera and the image acquisition module are located on different sides of the display area.

12. The display device according to claim 10, wherein, The display device further includes: A delay compensation module, configured to compensate the eye coordinates determined by the positioning module according to a delay parameter to obtain predicted eye coordinates.

13. An image acquisition method for a display device according to any one of claims 1 to 12, wherein, The method includes: Determine the position of the acquisition window of the acquisition window layer according to the position of the user's eyes, and control the window unit corresponding to the acquisition window to be in a light-transmitting state; Control at least one of the image acquisition units corresponding to the acquisition window to acquire a light field image through the converging lens structure; Wherein, the lens module includes a first cylindrical lens layer and a second cylindrical lens layer, the first cylindrical lens layer includes a first cylindrical lens, and the second cylindrical lens layer includes: a third transparent electrode, a second liquid crystal layer, and a fourth transparent electrode; controlling the window unit corresponding to the acquisition window to be in a light-transmitting state further includes: Applying a driving voltage to the fourth transparent electrode and the third transparent electrode corresponding to the acquisition window, and controlling the second liquid crystal layer corresponding to the acquisition window to deflect to form a liquid crystal lens, so that the liquid crystal lens corresponding to the acquisition window and the first cylindrical lens form the converging lens structure.

14. The method according to claim 13, wherein, The window unit includes: a first transparent electrode, a first liquid crystal layer, and a second transparent electrode; controlling the window unit corresponding to the acquisition window to be in a light-transmitting state specifically includes: Applying a driving voltage to the second transparent electrode and the first transparent electrode corresponding to the acquisition window, and controlling the first liquid crystal layer corresponding to the acquisition window to deflect, so that the acquisition window is in a light-transmitting state.

15. The method according to any one of claims 13 to 14, wherein, The display device further includes: a depth image acquisition camera and a positioning module; before determining the acquisition window of the acquisition window layer according to the position of the user's eyes, it further includes: Controlling the depth image acquisition camera included in the display device corresponding to the viewing user to acquire the user's eye depth information; Controlling the positioning module to determine the eye coordinates of the user relative to the display device for acquiring the light field image according to the user's eye depth information.

16. The method according to claim 15, wherein, The display device further includes: a delay compensation module; after determining the eye coordinates of the user's eyes relative to the display device for acquiring the light field image, it further includes: The delay compensation module compensates the eye coordinates according to the delay parameter to obtain the predicted eye coordinates of the viewing user relative to the display device for acquiring the light field image, and sends the predicted eye coordinates to the display device for acquiring the light field image; The determining the acquisition window of the acquisition window layer according to the position of the user's eyes specifically includes: The display device for acquiring the light field image determines the acquisition window of the acquisition window layer according to the predicted eye coordinates.

Images