Image rendering method and device, display device and naked eye 3D display system

Abstract

The invention provides an image rendering method and device, a display device and a naked eye 3D display system, and belongs to the technical field of display, and the image rendering method comprises the steps: obtaining a to-be-displayed image; real-time position information under real-time tracking of the target human eyes is obtained, and the current moving distance from the target human eyes to the display screen is determined; the to-be-displayed image is an image obtained by cutting a film source image shot by a shooting device; obtaining a film source image shot by the shooting equipment, and cutting the film source image according to the size proportion of the display screen to obtain a to-be-displayed image; rendering the to-be-displayed image according to the first parameter information of the shooting equipment, the second parameter information of the display screen, the current moving distance and a preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image; and according to the left-eye rendering image and the right-eye rendering image, generating a stereoscopic display picture to be displayed.

Description

Technical Field

[0001] The present disclosure belongs to the field of display technology, and in particular relates to an image rendering method and device, a display device, and a naked-eye 3D display system. Background Art

[0002] With the rapid development of three-dimensional (3D) display technology, 3D display has attracted more and more attention, but the problem of viewing dizziness has been criticized. There are many factors that cause dizziness, such as crosstalk, convergence and focus conflict, image parallax, and the mismatch between the viewing effect of the human eye and the actual object. Therefore, how to avoid the disadvantages of viewing dizziness in 3D display has become a problem that needs to be solved urgently in the field of 3D display. Summary of the invention

[0003] The present disclosure aims to solve at least one of the technical problems existing in the prior art, and provides an image rendering method and device, a display device and a naked-eye 3D display system.

[0004] In a first aspect, the technical solution adopted to solve the technical problem of the present disclosure is an image rendering method, which includes:

[0005] Acquire the image to be displayed; and acquire the real-time position information of the target human eye under real-time tracking, and determine the current moving distance of the target human eye to the display screen; the image to be displayed is an image obtained by cropping the source image captured by the shooting device;

[0006] Acquire a source image captured by a shooting device, and crop the source image according to the size ratio of the display screen to obtain an image to be displayed;

[0007] Rendering the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and a preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image;

[0008] A stereoscopic display picture to be displayed is generated according to the left-eye rendering image and the right-eye rendering image.

[0009] In some embodiments, the shooting device includes multiple cameras, which are recorded as a first camera and a second camera; the first camera and the second camera shoot pictures in the same application scene, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed;

[0010] The step of obtaining the image to be displayed comprises:

[0011] Obtain a left image to be displayed after cropping the left-eye source image, and a right image to be displayed after cropping the right-eye source image; the left-eye source image is an image captured by the first camera, and the right-eye source image is an image captured by the second camera; the images to be displayed include the left image to be displayed and the right image to be displayed.

[0012] In some embodiments, the first parameter information includes the first spacing, the field viewing angle of the first camera or the second camera in the horizontal direction; the second parameter information includes at least a first width of the display screen in the horizontal direction;

[0013] The method of rendering the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image includes:

[0014] Constructing a first mapping relationship between a camera world coordinate system and a human eye world coordinate system according to the first spacing and the preset human eye pupil distance;

[0015] According to the field viewing angle, construct a second mapping relationship between a distance variable and a projection width variable; the distance variable is used to represent the distance from the camera to the virtual display screen in the camera world coordinate system, and the projection width variable is used to represent the width of the projection of the content captured by the camera in the camera world coordinate system on the virtual display screen;

[0016] Determine a second width according to the first width and the first mapping relationship, where the second width represents a width of the virtual display screen in the horizontal direction in the camera world coordinate system;

[0017] Determining a first projection width according to the current moving distance, the first mapping relationship, and the second mapping relationship;

[0018] The left image to be displayed and the right image to be displayed are processed respectively according to the second width and the first projection width to obtain the left-eye rendered image and the right-eye rendered image.

[0019] In some embodiments, the expression of the first mapping relationship is: Among them, y represents the parameter variable of the camera world coordinate system; x represents the parameter variable in the human eye world coordinate system; d represents the first spacing; and D represents the preset human eye pupil distance.

[0020] In some embodiments, the expression of the second mapping relationship is: Wherein, v represents the projection width variable, u represents the distance variable, FOV xRepresents the field viewing angle.

[0021] In some embodiments, determining the first projection width according to the current moving distance, the first mapping relationship, and the second mapping relationship includes:

[0022] Determining a camera mapping distance according to the current moving distance and the first mapping relationship;

[0023] The first projection width is determined according to the camera mapping distance and the second mapping relationship.

[0024] In some embodiments, determining the first projection width according to the current moving distance, the first mapping relationship, and the second mapping relationship includes:

[0025] Determining a second projection width according to the current moving distance and the second mapping relationship;

[0026] The first projection width is determined according to the second projection width and the first mapping relationship.

[0027] In some embodiments, the second parameter information further includes a single view resolution associated with the optical module in the display screen;

[0028] The step of processing the left image to be displayed and the right image to be displayed respectively according to the second width and the first projection width to obtain the left-eye rendered image and the right-eye rendered image comprises:

[0029] determining a first retained image of the left image to be displayed and a second retained image of the right image to be displayed according to the second width and the first projection width;

[0030] The resolution of the first retained image is adjusted to the single-view resolution to obtain the left-eye rendered image, and the resolution of the second retained image is adjusted to the single-view resolution to obtain the right-eye rendered image.

[0031] In some embodiments, determining the first retained image of the left image to be displayed and the second retained image of the right image to be displayed according to the second width and the first projection width includes:

[0032] Determine, according to the second width and the first projection width, a first source ratio corresponding to the left image to be displayed and a second source ratio corresponding to the right image to be displayed in accordance with a preset algorithm;

[0033] According to the first film source ratio, performing regional planning on the left image to be displayed to obtain a first retained image of the left image to be displayed;

[0034] According to the second film source ratio, a region planning is performed on the right image to be displayed to obtain a second retained image of the left image to be displayed.

[0035] In some embodiments, the left image to be displayed and the right image to be displayed are both rectangular images; the first film source ratio includes the left increase / decrease ratio, right increase / decrease ratio, upper increase / decrease ratio and lower increase / decrease ratio corresponding to the left image to be displayed; the second film source ratio includes the left increase / decrease ratio, right increase / decrease ratio, upper increase / decrease ratio and lower increase / decrease ratio corresponding to the right image to be displayed;

[0036] The calculation formula for the left increase / decrease ratio corresponding to the left image to be displayed is: The calculation formula for the right side increase / decrease ratio corresponding to the left image to be displayed is: The upper increase / decrease ratio and the lower increase / decrease ratio corresponding to the left image to be displayed are both:

[0037] The calculation formula for the increase / decrease ratio of the left side corresponding to the right image to be displayed is: The calculation formula for the right side increase / decrease ratio corresponding to the right image to be displayed is: The upper and lower increase / decrease ratios corresponding to the right image to be displayed are:

[0038] Among them, V L1 V represents the left increase / decrease ratio corresponding to the left image to be displayed; L2 V represents the increase or decrease ratio of the right side corresponding to the left image to be displayed; R1 V represents the increase or decrease ratio of the left side corresponding to the right image to be displayed; R2 represents the right side increase or decrease ratio corresponding to the right image to be displayed; w represents the first projection width, and w1 represents the second width.

[0039] In a second aspect, an embodiment of the present disclosure further provides an image rendering device, including a first information acquisition module, a second information acquisition module, an image rendering module, and a picture generation module;

[0040] The first information acquisition module is configured to acquire real-time position information of the target human eye under real-time tracking, and determine the current moving distance from the target human eye to the display screen;

[0041] The second information acquisition module is configured to acquire an image to be displayed; the image to be displayed is an image obtained by cropping a source image captured by a shooting device;

[0042] The image rendering module is configured to render the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image;

[0043] The picture generation module is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image.

[0044] In some embodiments, the image rendering device includes a field programmable gate array (FPGA).

[0045] In a third aspect, the embodiments of the present disclosure further provide a display device, including an image rendering device and a display screen; the image rendering device includes a first information acquisition module, a second information acquisition module, an image rendering module and a screen generation module;

[0046] The first information acquisition module is configured to acquire real-time position information of the target human eye under real-time tracking, and determine the current moving distance from the target human eye to the display screen;

[0047] The second information acquisition module is configured to acquire an image to be displayed; the image to be displayed is an image obtained by cropping a source image captured by a shooting device;

[0048] The image rendering module is configured to render the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image;

[0049] The picture generation module is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image;

[0050] The display screen is configured to display the stereoscopic display image.

[0051] In some embodiments, the display device further includes an eye tracking device; the eye tracking device includes an eye tracking module and a first processing module;

[0052] The eye tracking module is configured to track the target human eyes in the environment where the display screen is located in real time to obtain a face image;

[0053] The first processing module is configured to extract the features of the target human eye from the face image, determine the real-time position information of the target human eye, and send the real-time position information to the first information acquisition module.

[0054] In some embodiments, the display device further includes a video pre-processing chip;

[0055] The video preprocessing chip is configured to obtain a source image captured by a shooting device, crop the source image according to the size ratio of the display screen to obtain an image to be displayed, and send the image to be displayed to the second information acquisition module.

[0056] In some embodiments, the shooting device includes multiple cameras, which are recorded as a first camera and a second camera; the first camera and the second camera shoot pictures in the same application scene, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed;

[0057] The video preprocessing chip is configured to obtain a left-eye source image captured by the first camera and a right-eye source image captured by the second camera; the source images include the left-eye source image and the right-eye source image; the left-eye source image is cropped according to the size ratio of the display screen to obtain a left image to be displayed; and the right-eye source image is cropped according to the size ratio of the display screen to obtain a right image to be displayed; the images to be displayed include the left image to be displayed and the right image to be displayed.

[0058] In a fourth aspect, the embodiments of the present disclosure further provide a naked-eye 3D display system, comprising a shooting device and a display device; the display device comprises an eye tracking device, a video preprocessing chip, an image rendering device and a display screen; the image rendering device comprises a first information acquisition module, a second information acquisition module, an image rendering module and a picture generation module;

[0059] The eye tracking device is configured to track the target human eye in the environment where the display screen is located in real time, determine the real-time position information of the target human eye, and send it to the first information acquisition module;

[0060] The shooting device is configured to collect source images and send them to the video preprocessing chip;

[0061] The video preprocessing chip is configured to crop the source image according to the size ratio of the display screen to obtain an image to be displayed, and send the image to be displayed to the second information acquisition module;

[0062] The first information acquisition module is configured to acquire real-time position information of the target human eye under real-time tracking, and determine the current moving distance from the target human eye to the display screen;

[0063] The second information acquisition module is configured to acquire the image to be displayed;

[0064] The image rendering module is configured to render the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image;

[0065] The picture generation module is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image;

[0066] The display screen is configured to display the stereoscopic display image.

[0067] In some embodiments, the shooting device includes multiple cameras, recorded as a first camera and a second camera, and a second processing module; the first camera and the second camera shoot pictures in the same application scene, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed;

[0068] The first camera is configured to capture a left-eye source image;

[0069] The second camera is configured to capture a right-eye source image; the source image includes the left-eye source image and the right-eye source image;

[0070] The second processing module is configured to send the left-eye source image and the right-eye source image to the video pre-processing chip;

[0071] The video preprocessing chip is configured to crop the left-eye source image according to the size ratio of the display screen to obtain a left image to be displayed; and to crop the right-eye source image according to the size ratio of the display screen to obtain a right image to be displayed; the image to be displayed includes the left image to be displayed and the right image to be displayed.

[0072] In a fifth aspect, an embodiment of the present disclosure further provides a computer device, including:

[0073] one or more processors;

[0074] A memory for storing one or more programs;

[0075] When the one or more programs are executed by the one or more processors, the one or more processors implement the steps of the image rendering method as described in any one of the first aspects.

[0076] In a sixth aspect, an embodiment of the present disclosure further provides a computer non-volatile readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the image rendering method as described in any one of the first aspects are executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0077] Figure 1a is a schematic diagram of the display effect corresponding to the existing zero parallax;

[0078] Figure 1b is a schematic diagram of the display effect corresponding to the existing positive parallax;

[0079] Figure 1c is a schematic diagram of the display effect corresponding to the existing negative parallax;

[0080] Figure 1d This is a schematic diagram showing that the 3D perception of the human eye and the actual object are not in the same position under the existing rendering method;

[0081] Figure 1e A schematic diagram of display effects rendered according to the positions of human eyes in an embodiment of the present disclosure;

[0082] Figure 2 A flowchart of an image rendering method provided by an embodiment of the present disclosure;

[0083] Figure 3 A schematic diagram of a specific process for determining a left-eye rendering image and a right-eye rendering image provided in an embodiment of the present disclosure;

[0084] Figure 4 A schematic diagram of a camera world coordinate system established for an embodiment of the present disclosure;

[0085] Figure 5 A schematic diagram of a human eye world coordinate system established for an embodiment of the present disclosure;

[0086] Figure 6 A partial flowchart of image parallax adjustment provided by an embodiment of the present disclosure;

[0087] Figure 7 A schematic diagram of the viewing effect when the current moving distance provided by the embodiment of the present disclosure is the optimal viewing distance adapted to the endoscope;

[0088] Figure 8a For Figure 7 A schematic diagram of a left-eye rendered image obtained by performing parallax adjustment under corresponding parameters;

[0089] Figure 8b For Figure 7 A schematic diagram of a right eye rendered image obtained by performing parallax adjustment under corresponding parameters;

[0090] Fig. 9 A schematic diagram of the viewing effect when the current moving distance provided by the embodiment of the present disclosure is greater than the optimal viewing distance adapted to the endoscope;

[0091] Fig.10a For Fig. 9 A schematic diagram of a left-eye rendered image obtained by performing parallax adjustment under corresponding parameters;

[0092] Fig.10b For Fig. 9 A schematic diagram of a right eye rendered image obtained by performing parallax adjustment under corresponding parameters;

[0093] Fig.11 A schematic diagram of a viewing effect under an example when the current moving distance provided by the embodiment of the present disclosure is less than the optimal viewing distance adapted to the endoscope;

[0094] Fig.12a For Fig.11 A schematic diagram of a left-eye rendered image obtained by performing parallax adjustment under corresponding parameters;

[0095] Figure 12b For Fig.11 A schematic diagram of a right eye rendered image obtained by performing parallax adjustment under corresponding parameters;

[0096] Fig.13 A schematic diagram of viewing effect under another example when the current moving distance provided by the embodiment of the present disclosure is less than the optimal viewing distance adapted to the endoscope;

[0097] Fig.14a For Fig.13 A schematic diagram of a left-eye rendered image obtained by performing parallax adjustment under corresponding parameters;

[0098] Fig.14b For Fig.13 A schematic diagram of a right eye rendered image obtained by performing parallax adjustment under corresponding parameters;

[0099] Fig.15 A schematic diagram of an image rendering device provided by an embodiment of the present disclosure;

[0100] Fig.16 A schematic diagram of a display device provided in an embodiment of the present disclosure;

[0101] Fig.17 A schematic diagram of a naked-eye 3D display system provided in an embodiment of the present disclosure;

[0102] Fig.18 A schematic diagram of the structure of a computer device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0103] In order to make the purpose, technical scheme and advantages of the embodiments of the present disclosure clearer, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.

[0104] Unless otherwise defined, the technical terms or scientific terms used in the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, similar words such as "one", "one" or "the" do not indicate quantity restrictions, but indicate that there is at least one. Similar words such as "include" or "comprise" mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Similar words such as "connect" or "connected" are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0105] The "multiple or several" mentioned in this disclosure refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0106] In the related art, the existence of image parallax often causes the human eye to see things that are not consistent with the actual object, thus causing the problem of 3D display viewing dizziness. Image parallax refers to the projection of a 3D object (represented by point O) relative to the human eye on the display plane (represented by point O relative to the projection position of the left eye). L Indicates that the projection position relative to the right eye is O R The difference between L With O R The distance between Figure 1a , 1b1c respectively illustrate the display effects of zero parallax (2D display), positive parallax (3D on-screen), and negative parallax (3D off-screen). The larger the image parallax, the greater the depth of the 3D object on or off-screen. It can be seen that for a fixed viewing distance of the human eye and a fixed depth of the 3D object on and off-screen, the size of the image parallax is fixed. However, since the image parallax given by the source is fixed, that is, the 3D object has a unique corresponding projection position (O1) at a certain position (O2). L1 and O R1 ), so the image parallax does not change with the change of the eye position. Figure 1d As shown, the positions of left eye 1 and right eye 1 correspond exactly to the 3D object at O1, and the image disparity O L1 and O R1 If the human eye moves to position 2, that is, left eye 2 and right eye 2, the image parallax remains unchanged, and the human eye sees the 3D object at O2, but the 3D object in the real scene is at O1, which means that the 3D perception of the human eye and the actual object are not in the same position, causing physiological discomfort to the human eye. In other words, traditional parallax rendering methods (such as Figure 1d As shown in the figure, users can only watch at a fixed distance from the display screen, otherwise it will cause physiological discomfort and dizziness.

[0107] In order to meet the condition of no dizziness, theoretically the projection position and parallax size should be adjusted accordingly, otherwise the following will occur: Figure 1d If you want to see the correct 3D image at position 2, you need to follow the steps below: Figure 1e As shown, the image parallax is adjusted in real time according to the viewing position of the human eye to obtain the left and right eye rendering images. Based on this, the embodiment of the present disclosure provides an image rendering method, and its execution subject can be a device with certain computing capabilities, such as the following image rendering device, such as a field programmable gate array (FPGA), or a computer device, such as a terminal or a server.

[0108] Figure 2 A flowchart of an image rendering method provided by an embodiment of the present disclosure is shown in FIG. Figure 2 As shown, the image rendering method includes steps S11 to S13, wherein:

[0109] S11, obtaining an image to be displayed; and obtaining real-time position information of a target human eye under real-time tracking, and determining a current moving distance from the target human eye to the display screen.

[0110] Among them, the image to be displayed is an image obtained after cropping the source image captured by the shooting device. Among them, the shooting device is an external device outside the execution subject of the present disclosure, which is used to shoot the picture in the actual application scene to obtain the source image. Here, the source image can be an image captured in real time by the shooting device, or it can also be an image in a video stream pre-captured and stored by the shooting device. The process of cropping the source image refers to adjusting the size ratio of the source image to the same as the size ratio of the display screen through the video preprocessing chip. Among them, the size ratio of the display screen can be considered as the ratio of the length and width of the actual display area in the display screen, such as a ratio of 16:9. The actual display area is also the area where the subsequent stereoscopic display picture is displayed, and it is also the area where the pixels are located.

[0111] Exemplarily, the size ratio of the source image is 4:3; the size ratio of the display screen is 16:9. The video preprocessing chip may be a system on chip (SoC). The SoC may crop the source image according to the size ratio of the display screen, so that the size ratio of the image to be displayed is the same as the size ratio of the display screen, that is, 16:9. The actual cropping rule may be to retain the long side of the source image as much as possible and crop the short side of the source image.

[0112] It should be noted that the above data description on the size ratio is only for the convenience of understanding one possible situation under the embodiment of the present disclosure, and the embodiment of the present disclosure is not limited to the display screen application of the above size ratio. The processing method of the present disclosure has the same principle for displays of any other size ratio.

[0113] In one possible implementation, the shooting device includes a plurality of cameras, and the source image includes the image captured by each camera. Therefore, the image to be displayed obtained after the source image is cropped also includes the cropped image of the image corresponding to each camera. For example, the shooting device includes a first camera and a second camera; the first camera and the second camera capture the screen in the same application scenario, the shooting positions of the first camera and the second camera are different, and the first distance between the first camera and the second camera is fixed. Exemplarily, the image to be displayed includes multiple images, such as a left image to be displayed that matches the left eye and a right image to be displayed that matches the right eye. Acquiring the image to be displayed specifically includes: acquiring the left image to be displayed after cropping the left eye source image, and the right image to be displayed after cropping the right eye source image; wherein, the left eye source image is the image captured by the first camera, and the right eye source image is the image captured by the second camera.

[0114] In another possible implementation, the shooting device includes a camera, and the source image is an image. Then, the source image is segmented into a left-eye source image and a right-eye source image using an image segmentation algorithm. Acquiring the image to be displayed specifically includes: acquiring a left image to be displayed after cropping the left-eye source image, and acquiring a right image to be displayed after cropping the right-eye source image.

[0115] The target human eyes in this step are the eyes of the user in front of the display screen and viewing the displayed image on the display screen, and are the eyes of the user in a real scene.

[0116] Exemplarily, in a naked eye display application, the target human eye watches a display screen, and an eye tracking device is integrated on the display screen. The eye tracking device is an external device outside the execution subject of the present disclosure, and the eye tracking device feeds back the tracked real-time position information to an image rendering device or a computer device. Exemplarily, the real-time position information can be the position coordinates of the center of the left eye and the right eye in the target human eye in the human eye world coordinate system. The current moving distance from the target human eye to the display screen can be the vertical distance (or shortest distance) from the center of the left eye and the right eye to the display screen in the human eye world coordinate system.

[0117] S12, rendering the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image.

[0118] In a possible implementation, the left image to be displayed is rendered according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a left eye rendered image; the right image to be displayed is rendered according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a right eye rendered image.

[0119] Exemplarily, the present disclosure is applied to a medical scenario, and the photographing device may be an endoscope, including dual cameras, denoted as a first camera and a second camera, and the device parameters of the first camera and the second camera are the same.

[0120] Exemplarily, the first parameter information includes a first spacing, a field viewing angle of the first camera or the second camera in the horizontal direction; and the second parameter information includes at least a first width of the display screen in the horizontal direction. According to the first spacing, the field viewing angle, the first width, the current moving distance, and the preset human eye pupil distance, the left image to be displayed and the right image to be displayed are rendered respectively to obtain a left eye rendered image and a right eye rendered image respectively.

[0121] It should be noted that the first width refers to the width of the actual display area in the display screen in the horizontal direction.

[0122] In another possible implementation, the left image is rendered according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a left eye rendered image; the right image is rendered according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a right eye rendered image.

[0123] S13 . Generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image.

[0124] Specifically, a pixel rearrangement algorithm is used to rearrange pixels of a left-eye rendering image and a right-eye rendering image to obtain a stereoscopic display picture, and the stereoscopic display picture is sent to a display screen for display.

[0125] The image rendering method provided by the disclosed embodiment tracks the real-time position information of the target human eye in real time, and adjusts the parallax size of the image to be displayed viewed by the target human eye in real time according to the first parameter information of the shooting device corresponding to the film source, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance, so as to realize real-time 3D parallax rendering, so that the target human eye will not produce the above-mentioned physiological discomfort and other problems at any distance, thereby improving the viewing comfort of naked-eye 3D display.

[0126] In some embodiments, the first parameter information includes the first spacing, the field of view of the first camera or the second camera in the horizontal direction; the second parameter information includes at least the first width of the display screen in the horizontal direction. x same.

[0127] Exemplarily, the first distance is the distance between the first camera and the second camera, which is relatively small, for example, smaller than the pupil distance of the human eye. In the application of medical devices such as endoscopes, the first distance d = 4.2 mm; field of view FOV x =54.9°.

[0128] For step S12, the steps of determining the left eye rendering image and the right eye rendering image are as follows: Figure 3 As shown, it specifically includes S121 to S125, wherein:

[0129] S121. Construct a first mapping relationship between a camera world coordinate system and a human eye world coordinate system according to the first distance and a preset human eye pupil distance.

[0130] The camera world coordinate system and the human eye world coordinate system are established in advance, such as Figure 4 As shown, it is a schematic diagram of the camera world coordinate system; Figure 5 As shown, it is a schematic diagram of the human eye world coordinate system.

[0131] The human eye world coordinate system is scaled proportionally, and the human eye is equivalent to a camera to be mapped to the camera world coordinate system, and a first mapping relationship is constructed, such as the following expression 1:

[0132]

[0133] Wherein, y represents the parameter variable of the camera world coordinate system; x represents the parameter variable of the human eye world coordinate system; d represents the first distance; D represents the preset human eye pupil distance; Indicates the zoom ratio.

[0134] S122. Construct a second mapping relationship between the distance variable and the projection width variable according to the field viewing angle.

[0135] Among them, the distance variable is used to represent the distance from the camera to the virtual display screen in the camera world coordinate system, and the projection width variable is used to represent the width of the projection of the content captured by the camera in the camera world coordinate system on the virtual display screen.

[0136] like Figure 4 As shown, the second mapping relationship is constructed using geometric principles, see expression 2:

[0137]

[0138] Among them, v represents the projection width variable, u represents the distance variable, FOV x Indicates the field perspective.

[0139] S123. Determine a second width according to the first width and the first mapping relationship.

[0140] The second width represents the width of the virtual display screen in the horizontal direction in the camera world coordinate system.

[0141] It is known that when the display screen is fixed, the first width W1 of the display screen in the horizontal direction is fixed; Substituting W1 into x in Expression 1, the second width w1 is obtained, which is recorded as

[0142] S124. Determine a first projection width according to the current moving distance, the first mapping relationship, and the second mapping relationship.

[0143] In a possible implementation, S124 includes S124-1-1 to S124-1-2, wherein:

[0144] S124-1-1. Determine the camera mapping distance according to the current moving distance and the first mapping relationship.

[0145] Substitute the current moving distance Z into x in expression 1 to get the camera mapping distance

[0146] S124-1-2. Determine a first projection width according to the camera mapping distance and the second mapping relationship.

[0147] Substitute the camera mapping distance z into u in expression 2 to get the first projection width

[0148] In another possible implementation, S124 includes S124-2-1 to S124-2-2, wherein:

[0149] S124-2-1. Determine a second projection width according to the current moving distance and the second mapping relationship.

[0150] Since the camera world coordinate system and the human eye world coordinate system can be converted proportionally, the human eye can be equivalent to a camera. Therefore, Expression 2 can be used to calculate the second projection width of the content captured by the camera at a distance Z.

[0151] Substitute the current moving distance Z into u in expression 2 to get the second projection width

[0152] S124-2-2. Determine the first projection width according to the second projection width and the first mapping relationship.

[0153] Substituting the second projection width W into x in expression 1, we get the first projection width

[0154] S125 . Process the left image to be displayed and the right image to be displayed respectively according to the second width and the first projection width to obtain a left-eye rendered image and a right-eye rendered image.

[0155] Specifically, the area to be removed and / or the area to be supplemented around the left image to be displayed can be determined based on the second width and the first projection width, and the image in the area to be removed in the left image to be displayed can be deleted, or the image can be supplemented in the area to be supplemented to update the left image to be displayed, and obtain the image after parallax processing, that is, the first retained image. It should be noted that the size ratio of the left image to be displayed and the first retained image before and after the parallax processing is the same, for example, both are 16:9. Afterwards, it is determined whether the resolution of the first retained image is equal to the single view resolution, and if the first retained image is not equal to the single view resolution, the resolution of the first retained image is adjusted to the single view resolution to obtain the left eye rendered image. When the resolution of the first retained image is equal to the single view resolution, the first retained image is the left eye rendered image.

[0156] Similarly, the area to be removed and / or the area to be supplemented around the right image to be displayed can be determined based on the second width and the first projection width, and the image in the area to be removed in the right image to be displayed can be deleted, or the image in the area to be supplemented can be supplemented to update the left image to be displayed, and obtain the image after parallax processing, that is, the second retained image. It should be noted that the size ratio of the right image to be displayed and the second retained image before and after the parallax processing is the same, for example, both are 16:9. Afterwards, it is determined whether the resolution of the second retained image is equal to the single view resolution, and if the resolution of the second retained image is not equal to the single view resolution, the resolution of the second retained image is adjusted to the single view resolution to obtain the right eye rendered image. When the second retained image is equal to the single view resolution, the second retained image is the right eye rendered image.

[0157] The single view resolution is part of the second parameter information and is related to the optical module in the display screen. The single view resolution can also be understood as the 3D resolution of the optical module, also called the single view resolution, which may be different from the pixel resolution of the display screen. Among them, the single view resolution includes the left view resolution and the right view resolution. Exemplarily, the left view resolution and the right view resolution may be the same, for example, 4800×2160. The pixel resolution is, for example, 3840×16×2160.

[0158] When w≥w1+d, the area to be removed can be obtained, but the area to be supplemented cannot be obtained.

[0159] In the case of w<w1+d, a region to be supplemented can be obtained, and a region to be removed may be obtained.

[0160] Exemplarily, pixels of any gray scale may be interpolated in the area to be supplemented, wherein the interpolation principle ensures that the image is not distorted. For example, black pixels are inserted in the area to be supplemented, and the area supplemented in the image to be displayed is a black image.

[0161] Of course, other beautifying backgrounds may also be inserted into the area to be supplemented, as long as they do not affect the image parallax.

[0162] In some embodiments, Figure 6 A partial flow chart of image parallax adjustment provided in an embodiment of the present disclosure is shown in FIG. Figure 6 As shown, it includes steps S1251 to S1253, wherein:

[0163] S1251. Determine, according to the second width and the first projection width and in accordance with a preset algorithm, a first source ratio corresponding to the left image to be displayed and a second source ratio corresponding to the right image to be displayed.

[0164] In a possible implementation, Figure 4As shown, the left image to be displayed and the right image to be displayed are both rectangular images. The first source ratio includes the left increase / decrease ratio, right increase / decrease ratio, upper increase / decrease ratio and lower increase / decrease ratio corresponding to the left image to be displayed; the second source ratio includes the left increase / decrease ratio, right increase / decrease ratio, upper increase / decrease ratio and lower increase / decrease ratio corresponding to the right image to be displayed.

[0165] Using geometric principles, the left increase / decrease ratio corresponding to the left image to be displayed is determined according to the second width and the first projection width. The calculation formula for the left increase / decrease ratio corresponding to the left image to be displayed is shown in the following formula 1:

[0166]

[0167] Using geometric principles, the right increase / decrease ratio corresponding to the left image to be displayed is determined according to the second width and the first projection width. The calculation formula for the right increase / decrease ratio corresponding to the left image to be displayed is shown in the following formula 2:

[0168]

[0169] The upper and lower increase / decrease ratios of the left image to be displayed are

[0170] Using geometric principles, the left increase / decrease ratio corresponding to the right image to be displayed is determined according to the second width and the first projection width. The calculation formula for the left increase / decrease ratio corresponding to the right image to be displayed is shown in the following formula 3:

[0171]

[0172] Using geometric principles, the right side increase / decrease ratio corresponding to the right image to be displayed is determined according to the second width and the first projection width. The calculation formula for the right side increase / decrease ratio corresponding to the right image to be displayed is shown in the following formula 2:

[0173]

[0174] The corresponding upper and lower increase / decrease ratios of the right image to be displayed are

[0175] Among them, V L1 Indicates the increase or decrease ratio of the left side corresponding to the left image to be displayed; V L2 Indicates the increase or decrease ratio of the right side corresponding to the left image to be displayed; V R1 Indicates the increase or decrease ratio of the left side corresponding to the right image to be displayed; V R2 Indicates the right side increase or decrease ratio corresponding to the right image to be displayed; w represents the first projection width, and w1 represents the second width.

[0176] In another possible implementation, the left image to be displayed and the right image to be displayed are images of other shapes, such as rounded rectangles, circles, and other polygons, and the same geometric principles as in the above method are used to calculate the first source ratio corresponding to the left image to be displayed and the second source ratio corresponding to the right image to be displayed, which are no longer listed one by one in the present disclosure.

[0177] S1252: Performing area planning on the left image to be displayed according to the first source ratio to obtain a first retained image of the left image to be displayed.

[0178] S1253: Performing area planning for the right image to be displayed according to the second source ratio to obtain a second retained image of the right image to be displayed.

[0179] When the increase or decrease ratio on the left is positive, V L1 ×W is the width of the area to be removed on the left side of the left image to be displayed, V R1 ×W is the width of the area to be removed on the left side of the right image to be displayed. When the increase or decrease ratio on the left side is a negative value, V L1 ×W is the width of the area to be supplemented on the left side of the left image to be displayed, V R2 ×W is the width of the area to be supplemented on the left side of the right image to be displayed. Among them, W represents the second projection width of the content captured by the camera at a distance of Z. The width of the area to be removed and the area to be supplemented is calculated using the right increase and decrease ratio, which is the same as the width of the area to be removed and the area to be supplemented calculated using the above-mentioned left increase and decrease ratio, and will not be repeated here. In addition, the width of the area to be removed and the area to be supplemented is calculated using the upper increase and decrease ratio and the lower increase and decrease ratio, which is different from the width of the area to be removed and the area to be supplemented calculated using the left increase and decrease ratio. The width of the area to be removed and the area to be supplemented is calculated using the upper increase and decrease ratio and the lower increase and decrease ratio. The width of the area to be removed and the area to be supplemented is no longer multiplied by the second projection width, but the projection width of the short side under the size ratio of the second projection width (long side projection width, that is, the projection width in the horizontal direction) corresponding to the left image to be displayed (or the right image to be displayed), that is, the width of the area to be removed and the area to be supplemented is calculated using the upper increase and decrease ratio and the lower increase and decrease ratio. Here, ρ1:ρ2 represents the size ratio of the left image to be displayed (or the right image to be displayed), for example, 16:9.

[0180] Similarly, a first retained image and a second retained image are obtained after image subtraction and / or supplementation.

[0181] The parallax processing process of S1251 to S1253 is further illustrated below based on multiple examples.

[0182] The source image captured by a dual-camera endoscope is rendered and displayed on the display screen in real time. The applied parameter information includes: the size of the display screen is 31.5 inches, and its horizontal width W1 = 698.112 mm; the single view resolution (that is, the left view resolution or the right view resolution) is 4800 × 2160; the preset human eye pupil distance D = 65 mm; the camera's field of view FOVx in the horizontal direction = 54.9°; the first spacing d = 4.2 mm. Exemplarily, Z can take any data between 150 mm and 10 m.

[0183] Example 1: Figure 7 As shown in FIG. 1 , when w=w1+d, the first mapping relationship and the second mapping relationship can be used to obtain the current moving distance Z from the target human eye to the display screen at this time = 734.53 mm, which is also the best viewing distance adapted to the endoscope. At this distance, the first projection width w and the second width w1 are substituted into formulas 1 to 4 to obtain V L1 =8.52%, V L2 =0, V R1 =0, and V R2 =8.52%.

[0184] Determine the left eye rendered image, such as Figure 8a As shown, the width of the area to be removed 81 on the left side of the left image to be displayed in the horizontal direction is 8.52%×W. L2 = 0, so the right side of the left image to be displayed does not need to remove the image, nor does it need to supplement the image. The width of the area to be removed 82 on the upper side of the left image to be displayed in the vertical direction is The area to be removed 83 on the lower side of the left image to be displayed is the same size as the area to be removed 82 on the upper side. That is, 8.52% of the long side ratio of the left side of the left image to be displayed is removed, and 4.26% of the short side ratio of the upper and lower sides are removed, respectively, to obtain the first retained image. Figure 8a As shown, the resolution of the first retained image is adjusted to a single-view resolution to obtain a left-eye rendered image.

[0185] Determine the right eye rendered image, such as Figure 8b As shown, V R1 = 0, so the left side of the right image to be displayed does not need to remove the image or supplement the image. The width of the area to be removed 84 on the right side of the right image to be displayed in the horizontal direction is 8.52% × W. The width of the area to be removed 85 on the upper side of the right image to be displayed in the vertical direction is The area to be removed 86 on the lower side of the right image to be displayed is the same size as the area to be removed 85 on the upper side. That is, 8.52% of the long side ratio of the right side of the right image to be displayed is removed, and 4.26% of the short side ratio of the upper and lower sides are removed, respectively, to obtain the second retained image. Figure 8bAs shown, the resolution of the second retained image is adjusted to the single-view resolution, and the image size ratio is ensured to remain unchanged before and after the adjustment, so as to obtain a right-eye rendered image.

[0186] It should be noted that the size ratio of the left-eye rendered image and the size ratio of the right-eye rendered image are the same as the size ratio of the first retained image, that is, the same as the size ratio of the left image to be displayed, for example, 16:9.

[0187] Example 2: Fig. 9 As shown, when Z=1500 mm, the first projection width w and the second width w1 are obtained by using the first mapping relationship and the second mapping relationship. Substituting the first projection width w and the second width w1 into Formulas 1 to 4, V L1 =25.52%, V L2 =29.69%, V R1 =29.69%, and V R2 =25.52%.

[0188] Determine the left eye rendered image, such as Fig.10a As shown, the width of the area to be removed 101 on the left side of the left image to be displayed in the horizontal direction is 25.52%×W. The width of the area to be removed 102 on the right side of the left image to be displayed in the horizontal direction is 29.69%×W. The width of the area to be removed 103 on the upper side of the left image to be displayed in the vertical direction is The area to be removed 104 at the lower side of the left image to be displayed is the same size as the area to be removed 103 at the upper side. That is, remove 25.52% of the long side ratio of the left side of the left image to be displayed, remove 29.69% of the long side ratio of the right side of the left image to be displayed, and remove 27.605% of the short side ratio of the upper and lower sides, respectively, to obtain the first retained image. Fig.10a As shown, the resolution of the first retained image is adjusted to the single-view resolution, and the image size ratio is ensured to remain unchanged before and after the adjustment, so as to obtain a left-eye rendered image.

[0189] Determine the right eye rendered image, such as Fig.10b As shown, the horizontal width of the area to be removed 105 on the left side of the right image to be displayed is 29.69%×W. The horizontal width of the area to be removed 106 on the right side of the right image to be displayed is 25.52%×W. The vertical width of the area to be removed 107 on the upper side of the left image to be displayed is The area to be removed 108 at the lower side of the right image to be displayed is the same size as the area to be removed 107 at the upper side. That is, remove 29.69% of the long side ratio of the left side of the right image to be displayed, remove 25.52% of the long side ratio of the right side of the right image to be displayed, and remove 27.605% of the short side ratio of the upper and lower sides, respectively, to obtain the second retained image. Fig.10bAs shown, the resolution of the second retained image is adjusted to the single-view resolution, and the image size ratio is ensured to remain unchanged before and after the adjustment, so as to obtain a right-eye rendered image.

[0190] Example 3: Fig.11 As shown, when Z=700 mm, the first projection width w and the second width w1 are obtained by using the first mapping relationship and the second mapping relationship. Substituting the first projection width w and the second width w1 into Formulas 1 to 4, V L1 =-2.47%, V L2 =6.47%, V R1 =6.47%, and V R2 =-2.47%.

[0191] Determine the left eye rendered image, such as Fig.12a As shown, the width of the area to be compensated 121 on the left side of the left image to be displayed in the horizontal direction is -2.47%×W. The width of the area to be removed 122 on the right side of the left image to be displayed in the horizontal direction is 6.47%×W. The width of the area to be removed 123 on the upper side of the left image to be displayed in the vertical direction is The area to be removed 124 at the lower side of the left image to be displayed is the same size as the area to be removed 123 at the upper side. That is, the left side of the left image to be displayed is supplemented with 2.47% of the long side ratio, the right side of the left image to be displayed is removed by 6.47% of the long side ratio, and the upper and lower sides are respectively removed by 2% of the short side ratio to obtain the first retained image. Fig.12a As shown, the resolution of the first retained image is adjusted to the single-view resolution, and the image size ratio is ensured to remain unchanged before and after the adjustment, so as to obtain a left-eye rendered image.

[0192] Determine the right eye rendered image, such as Figure 12b As shown, the width of the area to be removed 125 on the left side of the right image to be displayed in the horizontal direction is 6.47%×W. The width of the area to be compensated 126 on the right side of the right image to be displayed in the horizontal direction is -2.47%×W. The width of the area to be removed 127 on the upper side of the left image to be displayed in the vertical direction is The area to be removed 128 at the lower side of the right image to be displayed is the same size as the area to be removed 127 at the upper side. That is, the left side of the left image to be displayed is removed by 6.47% of the long side ratio, the right side of the left image to be displayed is supplemented by 2.47% of the long side ratio, and the upper and lower sides are respectively removed by 2% of the short side ratio to obtain the second retained image. Figure 12b As shown, the resolution of the second retained image is adjusted to the single-view resolution, and the image size ratio is ensured to remain unchanged before and after the adjustment, so as to obtain a right-eye rendered image.

[0193] Example 4: Fig.13As shown, when Z=500 mm, the first projection width w and the second width w1 are obtained by using the first mapping relationship and the second mapping relationship. Substituting the first projection width w and the second width w1 into Formulas 1 to 4, V L1 =-23.45%, V L2 =-10.94%, V R1 = -10.94%, and V R2 =-23.45%.

[0194] Determine the left eye rendered image, such as Fig.14a As shown, the width of the area to be compensated 141 on the left side of the left image to be displayed in the horizontal direction is -23.45%×W. The width of the area to be compensated 142 on the right side of the left image to be displayed in the horizontal direction is -10.94%×W. The width of the area to be compensated 143 on the upper side of the left image to be displayed in the vertical direction is The area to be compensated 144 at the lower side of the left image to be displayed is the same size as the area to be compensated 143 at the upper side. That is, the left side of the left image to be displayed is supplemented with 23.45% of the long side ratio, the right side of the left image to be displayed is supplemented with 10.94% of the long side ratio, and the upper and lower sides are supplemented with 17.195% of the short side ratio, to obtain the first retained image. Fig.14a As shown, the resolution of the first retained image is adjusted to the single-view resolution, and the image size ratio is ensured to remain unchanged before and after the adjustment, so as to obtain a left-eye rendered image.

[0195] Determine the right eye rendered image, such as Fig.14b As shown, the width of the area to be compensated 145 on the left side of the right image to be displayed in the horizontal direction is -10.94%×W. The width of the area to be compensated 146 on the right side of the right image to be displayed in the horizontal direction is -23.45%×W. The width of the area to be compensated 147 on the upper side of the left image to be displayed in the vertical direction is The area to be compensated 148 at the lower side of the right image to be displayed is the same size as the area to be compensated 147 at the upper side. That is, the left side of the left image to be displayed is supplemented with 10.94% of the long side ratio, the right side of the left image to be displayed is supplemented with 23.45% of the long side ratio, and the upper and lower sides are supplemented with 17.195% of the short side ratio, to obtain the second retained image. Fig.14b As shown, the resolution of the second retained image is adjusted to the single-view resolution, and the image size ratio is ensured to remain unchanged before and after the adjustment, so as to obtain a right-eye rendered image.

[0196] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0197] Based on the same inventive concept, an image rendering device corresponding to the image rendering method is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the above-mentioned image rendering method in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0198] Fig.15 A schematic diagram of an image rendering device provided by an embodiment of the present disclosure, such as Fig.15 As shown, the image rendering device includes a first information acquisition module 151 , a second information acquisition module 152 , an image rendering module 153 and a picture generation module 154 .

[0199] The first information acquisition module 151 is configured to acquire real-time position information of the target human eye under real-time tracking, and determine the current moving distance from the target human eye to the display screen.

[0200] It should be noted that the first information acquisition module 151 in the embodiment of the present disclosure is configured to execute step S11 in the above-mentioned image rendering method. For specific implementation, please refer to the relevant description of step S11, which will not be repeated here.

[0201] The second information acquisition module 152 is configured to acquire the image to be displayed; the image to be displayed is an image obtained by cropping the source image captured by the shooting device.

[0202] It should be noted that the second information acquisition module 152 in the embodiment of the present disclosure is configured to execute step S11 in the above-mentioned image rendering method. For specific implementation, please refer to the relevant description of step S11, which will not be repeated here.

[0203] The first information acquisition module 151 and the second information acquisition module 152 may be two different interface channels for acquiring data.

[0204] The image rendering module 153 is configured to render the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a left eye rendering image and a right eye rendering image.

[0205] It should be noted that the image rendering module 153 in the embodiment of the present disclosure is configured to execute step S12 in the above-mentioned image rendering method. For the specific implementation, please refer to the relevant description of step S12, which will not be repeated here.

[0206] The picture generation module 154 is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image.

[0207] It should be noted that the picture generation module 154 in the embodiment of the present disclosure is configured to execute step S13 in the above-mentioned image rendering method. For the specific implementation, please refer to the relevant description of step S13, which will not be repeated here.

[0208] The image rendering device provided by the embodiment of the present disclosure tracks the real-time position information of the target human eye in real time, and adjusts the parallax size of the image to be displayed viewed by the target human eye in real time according to the first parameter information of the shooting device corresponding to the film source (the image to be displayed), the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance, so as to realize real-time 3D parallax rendering, so that the target human eye will not produce the above-mentioned physiological discomfort and other problems at any distance, thereby improving the viewing comfort of naked-eye 3D display.

[0209] In some embodiments, the image rendering device includes a field programmable gate array FPGA, and at least an image rendering module 153 and a picture generation module 154 are integrated in the FPGA to achieve rendering of the image to be displayed and generation of a stereoscopic display picture.

[0210] In some embodiments, the shooting device includes multiple cameras, recorded as a first camera and a second camera; the first camera and the second camera shoot pictures in the same application scenario, the shooting positions of the first camera and the second camera are different, and the first distance between the first camera and the second camera is fixed.

[0211] The second information acquisition module 152 is specifically configured to obtain a left image to be displayed after cropping the left eye source image, and a right image to be displayed after cropping the right eye source image; the left eye source image is the image captured by the first camera, and the right eye source image is the image captured by the second camera; the images to be displayed include the left image to be displayed and the right image to be displayed.

[0212] In some embodiments, the first parameter information includes a first spacing, a field viewing angle of the first camera or the second camera in the horizontal direction; and the second parameter information includes at least a first width of the display screen in the horizontal direction.

[0213] The image rendering module 153 is specifically configured to construct a first mapping relationship between the camera world coordinate system and the human eye world coordinate system according to the first spacing and the preset human eye pupil distance; construct a second mapping relationship between the distance variable and the projection width variable according to the field viewing angle; the distance variable is used to represent the distance from the camera to the virtual display screen in the camera world coordinate system, and the projection width variable is used to represent the width of the projection of the content collected by the camera in the camera world coordinate system on the virtual display screen; determine the second width according to the first width and the first mapping relationship, and the second width represents the width of the virtual display screen in the horizontal direction in the camera world coordinate system; determine the first projection width according to the current moving distance, the first mapping relationship and the second mapping relationship; and process the left image to be displayed and the right image to be displayed according to the second width and the first projection width, respectively, to obtain the left eye rendered image and the right eye rendered image.

[0214] In some embodiments, the expression of the first mapping relationship is: Among them, y represents the parameter variable of the camera world coordinate system; x represents the parameter variable in the human eye world coordinate system; d represents the first distance; and D represents the preset human eye pupil distance.

[0215] In some embodiments, the expression of the second mapping relationship is: Among them, v represents the projection width variable, u represents the distance variable, FOV x Indicates the field perspective.

[0216] In some embodiments, the image rendering module 153 determines the first projection width based on the current moving distance, the first mapping relationship and the second mapping relationship, specifically including: determining the camera mapping distance based on the current moving distance and the first mapping relationship; determining the first projection width based on the camera mapping distance and the second mapping relationship.

[0217] In some embodiments, the image rendering module 153 determines the first projection width according to the current moving distance, the first mapping relationship and the second mapping relationship, specifically including: determining the second projection width according to the current moving distance and the second mapping relationship; determining the first projection width according to the second projection width and the first mapping relationship.

[0218] In some embodiments, the second parameter information also includes a single-view resolution related to the optical module in the display screen; the image rendering module 153 processes the left image to be displayed and the right image to be displayed according to the second width and the first projection width, respectively, to obtain a left-eye rendered image and a right-eye rendered image, specifically including: determining a first retained image of the left image to be displayed and a second retained image of the right image to be displayed according to the second width and the first projection width; processing the first retained image and the second retained image according to the single-view resolution, respectively, to obtain a left-eye rendered image and a right-eye rendered image.

[0219] In some embodiments, the image rendering module 153 determines a first retained image of the left image to be displayed and a second retained image of the right image to be displayed based on the second width and the first projection width, specifically including: determining a first source ratio corresponding to the left image to be displayed and a second source ratio corresponding to the right image to be displayed according to a preset algorithm based on the second width and the first projection width; performing regional planning for the left image to be displayed according to the first source ratio to obtain a first retained image of the left image to be displayed; performing regional planning for the right image to be displayed according to the second source ratio to obtain a second retained image of the left image to be displayed.

[0220] In some embodiments, the left image to be displayed and the right image to be displayed are both rectangular images; the first film source ratio includes the left side increase and decrease ratio, the right side increase and decrease ratio, the upper side increase and decrease ratio and the lower side increase and decrease ratio corresponding to the left image to be displayed; the second film source ratio includes the left side increase and decrease ratio, the right side increase and decrease ratio, the upper side increase and decrease ratio and the lower side increase and decrease ratio corresponding to the right image to be displayed.

[0221] The calculation formula for the left increase / decrease ratio corresponding to the left image to be displayed is: The calculation formula for the increase and decrease ratio on the right side corresponding to the left image to be displayed is: The corresponding upper and lower increase / decrease ratios of the left image to be displayed are:

[0222] The calculation formula for the increase and decrease ratio on the left side corresponding to the right image to be displayed is: The calculation formula for the right increase and decrease ratio corresponding to the right image to be displayed is: The corresponding increase / decrease ratios of the upper side and the lower side of the right image to be displayed are:

[0223] Among them, V L1 Indicates the increase or decrease ratio of the left side corresponding to the left image to be displayed; V L2 Indicates the increase or decrease ratio of the right side corresponding to the left image to be displayed; V R1 Indicates the increase or decrease ratio of the left side corresponding to the right image to be displayed; V R2 Indicates the right side increase or decrease ratio corresponding to the right image to be displayed; w represents the first projection width, and w1 represents the second width.

[0224] In some embodiments, the image rendering module 153 processes the first retained image and the second retained image according to the single view resolution, respectively, to obtain a left-eye rendered image and a right-eye rendered image, specifically including: expanding the resolution of the first retained image to the single view resolution to obtain a left-eye rendered image; expanding the resolution of the second retained image to the single view resolution to obtain a right-eye rendered image.

[0225] In addition, a display device is also provided in an embodiment of the present disclosure. Fig.16 A schematic diagram of a display device provided in an embodiment of the present disclosure, such as Fig.16 As shown, the display device includes an image rendering device 150 and a display screen 160 , and the image rendering device 150 includes a first information acquisition module 151 , a second information acquisition module 152 , an image rendering module 153 and a picture generation module 154 .

[0226] The first information acquisition module 151 is configured to acquire real-time position information of the target human eye under real-time tracking, and determine the current moving distance from the target human eye to the display screen 160 .

[0227] The second information acquisition module 152 is configured to acquire the image to be displayed; the image to be displayed is an image obtained by cropping the source image captured by the shooting device.

[0228] The image rendering module 153 is configured to render the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen 160, the current moving distance, and the preset human eye pupil distance to obtain a left eye rendering image and a right eye rendering image.

[0229] The picture generation module 154 is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image.

[0230] The display screen 160 is configured to display a stereoscopic display image.

[0231] Exemplarily, the display device includes an FPGA and a display screen electrically connected to the FPGA. The FPGA adjusts the parallax of the image to be displayed viewed by the target human eye in real time to achieve real-time 3D parallax rendering, and generates a stereoscopic display image, which is sent to the display screen for display, so that the target human eye will not have the above-mentioned physiological discomfort and other problems at any distance, thereby improving the viewing comfort of naked-eye 3D display.

[0232] In some embodiments, Fig.16 As shown, the display device further includes an eye tracking device 161; the eye tracking device 161 communicates with the first information acquisition module 151. The eye tracking device 161 includes an eye tracking module 1611 and a first processing module 1612.

[0233] The eye tracking module 1611 is configured to track the target human eyes in the environment where the display screen is located in real time to obtain a face image.

[0234] Exemplarily, the eye tracking module 1611 includes at least one camera, which is used to detect human eye features in the environment where the display screen is located in real time, and perform real-time tracking after determining the target human eye, and obtain a facial image containing the target human eye, and upload the facial image to the first processing module 1612.

[0235] The first processing module 1612 is configured to extract the features of the target eye from the face image, determine the real-time position information of the target eye, and send the real-time position information to the first information acquisition module 151 .

[0236] Exemplarily, the first processing module 1612 extracts the left eye features and the right eye features of the target human eye from the facial image, and determines the center position coordinates of the left eye and the center of gravity position coordinates of the right eye under the constructed human eye world coordinates; based on the center position coordinates of the left eye and the center of gravity position coordinates of the right eye, the position coordinates of the center of the left eye and the right eye are determined as the real-time position information of the target human eye.

[0237] The first processing module 1612 communicates with the first information acquisition module 151 and can upload the real-time position information of the target human eye to the first information acquisition module 151 in real time.

[0238] Exemplarily, the first processing module 1612 may be a system on chip (SoC).

[0239] In some embodiments, the display device further includes an eye tracking device 161. The eye tracking device 161 is configured to track the target human eye in the environment where the display screen is located in real time, obtain a face image, and send the face image to the SoC. The SoC is configured to determine the real-time position information of the target human eye based on the face image, and upload the real-time position information of the target human eye to the first information acquisition module 151 in real time.

[0240] In some embodiments, the eye tracking module 1611 includes a first camera and a second camera. The first camera is configured to collect face images in the environment where the display screen is located in real time and upload them to the first processing module 1612; the second camera is configured to collect pupil images of the target eye in real time and upload them to the first processing module 1612. The first processing module 1612 is configured to locate the eye coordinates according to the face image through a face algorithm; use a preset algorithm to the eye coordinates according to the pupil image to obtain the pupil position coordinates; determine the center position coordinates of the left eye pupil and the right eye pupil according to the pupil position coordinates as the real-time position information of the target eye, and upload them to the first information acquisition module 151.

[0241] In some embodiments, Fig.16As shown, the display device also includes a video preprocessing chip 162; the video preprocessing chip 162 is configured to obtain the source image captured by the shooting device, and crop the source image according to the size ratio of the display screen 160 to obtain the image to be displayed, and send the image to be displayed to the second information acquisition module 152.

[0242] The video pre-processing chip 162 is configured to adjust the size ratio of the source image to be the same as the size ratio of the display screen. The size ratio of the display screen can be considered as the ratio of the length and width of the actual display area in the display screen, such as a ratio of 16:9. The actual display area is also the area where the subsequent stereoscopic display image is displayed, and is also the area where the pixels are located.

[0243] Exemplarily, the size ratio of the source image is 4:3; the size ratio of the display screen is 16:9. The video preprocessing chip may be a system on chip (SoC). The SoC may crop the source image according to the size ratio of the display screen, so that the size ratio of the image to be displayed is the same as the size ratio of the display screen, that is, 16:9. The actual cropping rule may be to retain the long side of the source image as much as possible and crop the short side of the source image.

[0244] In some embodiments, the shooting device includes multiple cameras, and the source image includes the image captured by each camera. Therefore, the image to be displayed obtained after the source image is cropped also includes the image cropped from the image corresponding to each camera. For example, the shooting device includes a first camera and a second camera, and the first camera and the second camera shoot the screen in the same application scene. The shooting positions of the first camera and the second camera are different, and the first distance between the first camera and the second camera is fixed. The video preprocessing chip 162 is configured to obtain the left eye source image captured by the first camera and the right eye source image captured by the second camera; the source image includes the left eye source image and the right eye source image; the left eye source image is cropped according to the size ratio of the display screen to obtain the left image to be displayed; and the right eye source image is cropped according to the size ratio of the display screen to obtain the right image to be displayed; the image to be displayed includes the left image to be displayed and the right image to be displayed.

[0245] Exemplarily, the video preprocessing chip 162 is configured to adjust the size ratio of the left eye source image to be the same as the size ratio of the display screen to obtain the left image to be displayed; and adjust the size ratio of the right eye source image to be the same as the size ratio of the display screen to obtain the right image to be displayed.

[0246] In addition, a naked eye 3D display system is also provided in the embodiments of the present disclosure. Fig.17 Schematic diagram of a naked eye 3D display system provided by an embodiment of the present disclosure. Fig.17As shown, the naked-eye 3D display system includes a shooting device 170 and a display device 171; the display device 171 includes a video preprocessing chip 162, an eye tracking device 161, an image rendering device 150 and a display screen 160; the image rendering device 150 includes a first information acquisition module 151, a second information acquisition module 152, an image rendering module 153 and a picture generation module 154.

[0247] The eye tracking device 161 is configured to track the target human eye in the environment where the display screen 160 is located in real time, determine the real-time position information of the target human eye, and send it to the first information acquisition module 151.

[0248] The shooting device 170 is configured to capture source images and send them to the video pre-processing chip 162 .

[0249] The video pre-processing chip 162 is configured to crop the source image according to the size ratio of the display screen 160 to obtain the image to be displayed, and send the image to be displayed to the second information acquisition module 152 .

[0250] The first information acquisition module 151 is configured to acquire real-time position information of the target human eye under real-time tracking, and determine the current moving distance from the target human eye to the display screen 160 .

[0251] The second information acquisition module 152 is configured to acquire the image to be displayed.

[0252] The image rendering module 153 is configured to render the image to be displayed according to the first parameter information of the shooting device 170, the second parameter information of the display screen 160, the current moving distance, and the preset human eye pupil distance to obtain a left eye rendering image and a right eye rendering image.

[0253] The picture generation module 154 is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image.

[0254] The display screen 160 is configured to display a stereoscopic display image.

[0255] The naked-eye 3D display system provided by the embodiments of the present disclosure tracks the real-time position information of the target human eye in real time, and adjusts the parallax size of the image to be displayed viewed by the target human eye in real time according to the first parameter information of the shooting device 170, the second parameter information of the display screen 160, the current moving distance, and the preset human eye pupil distance, so as to realize real-time rendering of 3D parallax, so that the target human eye will not produce the above-mentioned physiological discomfort and other problems at any distance, thereby improving the viewing comfort of the naked-eye 3D display.

[0256] In some embodiments, Fig.17 As shown, the image rendering device 150 is an FPGA.

[0257] In some embodiments, Fig.17 As shown, the shooting device 170 includes multiple cameras, denoted as a first camera 1701 and a second camera 1702, and a second processing module 1703; the first camera 1701 and the second camera 1702 shoot pictures in the same application scenario, the shooting positions of the first camera 1701 and the second camera 1702 are different, and the first distance between the first camera 1701 and the second camera 1702 is fixed.

[0258] The first camera 1701 is configured to capture a left-eye film source image.

[0259] The second camera 1702 is configured to capture the right-eye film source image.

[0260] The source images include a left-eye source image and a right-eye source image.

[0261] The second processing module 1703 is configured to send the left-eye source image and the right-eye source image to the video pre-processing chip 162 .

[0262] The video preprocessing chip 162 is configured to crop the left-eye source image according to the size ratio of the display screen 160 to obtain a left image to be displayed; and to crop the right-eye source image according to the size ratio of the display screen 160 to obtain a right image to be displayed; the images to be displayed include the left image to be displayed and the right image to be displayed.

[0263] In some embodiments, Fig.17 As shown, the video pre-processing chip 162 is a SoC chip.

[0264] Fig.18 The following is a schematic diagram of the structure of a computer device provided in an embodiment of the present disclosure. Fig.18 As shown, the embodiment of the present disclosure provides a computer device including: one or more processors 1801, a memory 1802, and one or more I / O interfaces 1803. The memory 1802 stores one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement any image rendering method in the above embodiments; the one or more I / O interfaces 1803 are connected between the processor and the memory, and are configured to implement information interaction between the processor and the memory.

[0265] Among them, the processor 1801 is a device with data processing capabilities, including but not limited to a central processing unit (CPU); the memory 1802 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and flash memory (FLASH); the I / O interface (read-write interface) 1803 is connected between the processor 1801 and the memory 1802, and can realize information interaction between the processor 1801 and the memory 1802, including but not limited to a data bus (Bus), etc.

[0266] In some embodiments, the processor 1801 , the memory 1802 , and the I / O interface 1803 are connected to each other via a bus 1804 , and further connected to other components of the computing device.

[0267] According to an embodiment of the present disclosure, a non-transitory computer readable storage medium is further provided. The non-transitory computer readable storage medium stores a computer program, wherein when the program is executed by a processor, the steps in any of the image rendering methods in the above embodiments are implemented.

[0268] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a machine-readable medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part, and / or installed from a removable medium. When the computer program is executed by a central processing unit (CPU), the above-mentioned functions defined in the system of the present disclosure are executed.

[0269] It should be noted that the computer non-transient readable medium shown in the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the above two. The computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable non-transient storage medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable non-transient storage medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0270] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the devices, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the aforementioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two connected boxes can actually represent that they are executed in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0271] The circuits or subcircuits involved in the embodiments described in the present disclosure may be implemented by software or by hardware. The described circuits or subcircuits may also be arranged in a processor, for example, may be described as: a processor comprising: a receiving circuit and a processing circuit, the processing module comprising a writing subcircuit and a reading subcircuit. The names of these circuits or subcircuits do not, in some cases, constitute limitations on the circuits or subcircuits themselves, for example, a receiving circuit may also be described as "receiving a video signal".

[0272] It is to be understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of the present disclosure, but the present disclosure is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and substance of the present disclosure, and these modifications and improvements are also considered to be within the scope of protection of the present disclosure.

Claims

1. An image rendering method, wherein: include: Get the image to be displayed; and obtaining real-time position information of the target human eye under real-time tracking, and determining the current moving distance from the target human eye to the display screen; The image to be displayed is an image obtained by cropping a source image captured by a shooting device; Rendering the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and a preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image; A stereoscopic display picture to be displayed is generated according to the left-eye rendering image and the right-eye rendering image.

2. The image rendering method according to claim 1, wherein: The shooting device includes a plurality of cameras, which are recorded as a first camera and a second camera; the first camera and the second camera shoot images in the same application scenario, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed; The step of obtaining the image to be displayed comprises: Obtain a left image to be displayed after cropping the left-eye source image, and a right image to be displayed after cropping the right-eye source image; the left-eye source image is an image captured by the first camera, and the right-eye source image is an image captured by the second camera; the images to be displayed include the left image to be displayed and the right image to be displayed.

3. The image rendering method according to claim 2, wherein: The first parameter information includes the first spacing, and a field viewing angle of the first camera or the second camera in a horizontal direction; The second parameter information at least includes a first width of the display screen in the horizontal direction; The method of rendering the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image includes: Constructing a first mapping relationship between a camera world coordinate system and a human eye world coordinate system according to the first spacing and the preset human eye pupil distance; According to the field viewing angle, construct a second mapping relationship between a distance variable and a projection width variable; the distance variable is used to represent the distance from the camera to the virtual display screen in the camera world coordinate system, and the projection width variable is used to represent the width of the projection of the content captured by the camera in the camera world coordinate system on the virtual display screen; Determine a second width according to the first width and the first mapping relationship, where the second width represents a width of the virtual display screen in the horizontal direction in the camera world coordinate system; Determining a first projection width according to the current moving distance, the first mapping relationship, and the second mapping relationship; The left image to be displayed and the right image to be displayed are processed respectively according to the second width and the first projection width to obtain the left-eye rendered image and the right-eye rendered image.

4. The image rendering method according to claim 3, wherein: The expression of the first mapping relationship is: Among them, y represents the parameter variable of the camera world coordinate system; x represents the parameter variable in the human eye world coordinate system; d represents the first spacing; and D represents the preset human eye pupil distance.

5. The image rendering method according to claim 3, wherein: The expression of the second mapping relationship is: Wherein, v represents the projection width variable, u represents the distance variable, FOV x Represents the field viewing angle.

6. The image rendering method according to claim 3, wherein: The determining a first projection width according to the current moving distance, the first mapping relationship, and the second mapping relationship includes: Determining a camera mapping distance according to the current moving distance and the first mapping relationship; The first projection width is determined according to the camera mapping distance and the second mapping relationship.

7. The image rendering method according to claim 3, wherein: The determining a first projection width according to the current moving distance, the first mapping relationship, and the second mapping relationship includes: Determining a second projection width according to the current moving distance and the second mapping relationship; The first projection width is determined according to the second projection width and the first mapping relationship.

8. The image rendering method according to any one of claims 3 to 7, wherein: The second parameter information also includes a single view resolution related to the optical module in the display screen; The step of processing the left image to be displayed and the right image to be displayed respectively according to the second width and the first projection width to obtain the left-eye rendered image and the right-eye rendered image comprises: determining a first retained image of the left image to be displayed and a second retained image of the right image to be displayed according to the second width and the first projection width; The resolution of the first retained image is adjusted to the single-view resolution to obtain the left-eye rendered image, and the resolution of the second retained image is adjusted to the single-view resolution to obtain the right-eye rendered image.

9. The image rendering method according to claim 8, wherein: The step of determining the first retained image of the left image to be displayed and the second retained image of the right image to be displayed according to the second width and the first projection width includes: Determine, according to the second width and the first projection width, a first source ratio corresponding to the left image to be displayed and a second source ratio corresponding to the right image to be displayed in accordance with a preset algorithm; According to the first film source ratio, performing regional planning on the left image to be displayed to obtain a first retained image of the left image to be displayed; According to the second film source ratio, a region planning is performed on the right image to be displayed to obtain a second retained image of the left image to be displayed.

10. The image rendering method according to claim 9, wherein: The left image to be displayed and the right image to be displayed are both rectangular images; the first film source ratio includes the left increase / decrease ratio, right increase / decrease ratio, upper increase / decrease ratio and lower increase / decrease ratio corresponding to the left image to be displayed; the second film source ratio includes the left increase / decrease ratio, right increase / decrease ratio, upper increase / decrease ratio and lower increase / decrease ratio corresponding to the right image to be displayed; The calculation formula for the left increase / decrease ratio corresponding to the left image to be displayed is: The calculation formula for the right increase / decrease ratio corresponding to the left image to be displayed is: The upper increase / decrease ratio and the lower increase / decrease ratio corresponding to the left image to be displayed are both: The calculation formula for the increase / decrease ratio of the left side corresponding to the right image to be displayed is: The calculation formula for the right side increase / decrease ratio corresponding to the right image to be displayed is: The upper and lower increase / decrease ratios corresponding to the right image to be displayed are: Among them, V L1 V represents the left increase / decrease ratio corresponding to the left image to be displayed; L2 V represents the increase or decrease ratio of the right side corresponding to the left image to be displayed; R1 V represents the increase or decrease ratio of the left side corresponding to the right image to be displayed; R2 represents the right side increase or decrease ratio corresponding to the right image to be displayed; w represents the first projection width, and w1 represents the second width.

11. An image rendering device, wherein: It includes a first information acquisition module, a second information acquisition module, an image rendering module and a picture generation module; The first information acquisition module is configured to acquire real-time position information of the target human eye under real-time tracking, and determine the current moving distance from the target human eye to the display screen; The second information acquisition module is configured to acquire an image to be displayed; The image to be displayed is an image obtained by cropping a source image captured by a shooting device; The image rendering module is configured to render the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and a preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image; The picture generation module is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image.

12. The image rendering device according to claim 11, wherein: The image rendering device includes a field programmable gate array FPGA.

13. A display device, comprising an image rendering device and a display screen; the image rendering device comprises a first information acquisition module, a second information acquisition module, an image rendering module and a picture generation module; The first information acquisition module is configured to acquire real-time position information of the target human eye under real-time tracking, and determine the current moving distance from the target human eye to the display screen; The second information acquisition module is configured to acquire an image to be displayed; The image to be displayed is an image obtained by cropping a source image captured by a shooting device; The image rendering module is configured to render the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and a preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image; The picture generation module is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image; The display screen is configured to display the stereoscopic display image.

14. The display device according to claim 13, wherein: The display device further includes an eye tracking device; the eye tracking device includes an eye tracking module and a first processing module; The eye tracking module is configured to track the target human eyes in the environment where the display screen is located in real time to obtain a face image; The first processing module is configured to extract the features of the target human eye from the face image, determine the real-time position information of the target human eye, and send the real-time position information to the first information acquisition module.

15. The display device according to claim 13, wherein: The display device also includes a video pre-processing chip; The video preprocessing chip is configured to obtain a source image captured by a shooting device, crop the source image according to the size ratio of the display screen to obtain an image to be displayed, and send the image to be displayed to the second information acquisition module.

16. The display device according to claim 15, wherein: The shooting device includes a plurality of cameras, which are recorded as a first camera and a second camera; the first camera and the second camera shoot images in the same application scenario, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed; The video preprocessing chip is configured to obtain a left-eye source image captured by the first camera and a right-eye source image captured by the second camera; the source images include the left-eye source image and the right-eye source image; The left-eye source image is cropped according to the size ratio of the display screen to obtain a left image to be displayed; and the right-eye source image is cropped according to the size ratio of the display screen to obtain a right image to be displayed; The image to be displayed includes the left image to be displayed and the right image to be displayed.

17. A naked-eye 3D display system, comprising a shooting device and a display device; the display device comprises an eye tracking device, a video preprocessing chip, an image rendering device and a display screen; the image rendering device comprises a first information acquisition module, a second information acquisition module, an image rendering module and a picture generation module; The eye tracking device is configured to track the target human eye in the environment where the display screen is located in real time, determine the real-time position information of the target human eye, and send it to the first information acquisition module; The shooting device is configured to collect source images and send them to the video preprocessing chip; The video preprocessing chip is configured to crop the source image according to the size ratio of the display screen to obtain an image to be displayed, and send the image to be displayed to the second information acquisition module; The first information acquisition module is configured to acquire real-time position information of the target human eye under real-time tracking, and determine the current moving distance from the target human eye to the display screen; The second information acquisition module is configured to acquire the image to be displayed; The image rendering module is configured to render the image to be displayed according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and a preset human eye pupil distance to obtain a left-eye rendered image and a right-eye rendered image; The picture generation module is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image; The display screen is configured to display the stereoscopic display image.

18. The naked eye 3D display system according to claim 17, wherein: The shooting device includes a plurality of cameras, denoted as a first camera and a second camera, and a second processing module; The first camera and the second camera shoot pictures in the same application scenario, the first camera and the second camera have different shooting positions, and a first distance between the first camera and the second camera is fixed; The first camera is configured to capture a left-eye source image; The second camera is configured to capture a right-eye source image; The film source image includes the left-eye film source image and the right-eye film source image; The second processing module is configured to send the left-eye source image and the right-eye source image to the video pre-processing chip; The video preprocessing chip is configured to crop the left-eye source image according to the size ratio of the display screen to obtain a left image to be displayed; and crop the right-eye source image according to the size ratio of the display screen to obtain a right image to be displayed; The image to be displayed includes the left image to be displayed and the right image to be displayed.

19. A computer device, wherein: include: one or more processors; A memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the steps of the image rendering method according to any one of claims 1 to 10.

20. A computer non-transitory readable storage medium, wherein: The computer non-transitory readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the image rendering method according to any one of claims 1 to 10 are executed.

Images