Image rendering method and apparatus, and display apparatus and autostereoscopic 3D display system

Abstract

The present disclosure belongs to the technical field of display. Provided are an image rendering method and apparatus, and a display apparatus and an autostereoscopic 3D display system. The image rendering method comprises: acquiring an image to be displayed; acquiring real-time position information of target human eyes by means of real-time tracking, and determining the current movement distance from the target human eyes to a display screen, wherein the image to be displayed is an image obtained on the basis of cropping a source image captured by a photographic device; acquiring the source image captured by the photographic device, and on the basis of the aspect ratio of the display screen, cropping the source image to obtain the image to be displayed; on the basis of first parameter information of the photographic device, second parameter information of the display screen, the current movement distance and a preset interpupillary distance, rendering the image to be displayed to obtain a left-eye rendered image and a right-eye rendered image; and on the basis of the left-eye rendered image and the right-eye rendered image, generating a stereoscopic display picture to be displayed.

Description

Image rendering method and device, display device and naked eye 3D display system TECHNICAL FIELD

[0001] The present disclosure belongs to the technical field of display, and particularly relates to an image rendering method and device, a display device and a naked eye 3D display system. BACKGROUND

[0002] With the rapid development of three-dimensional (3D) stereoscopic display technology, 3D display is more and more widely concerned, but the viewing dizziness problem has been criticized, and there are many factors causing dizziness, such as crosstalk, vergence-focusing conflict, image parallax causing mismatch between human eye viewing effect and actual object, etc. Therefore, how to avoid the drawbacks of viewing dizziness in 3D display has become a problem to be solved in the field of 3D display. SUMMARY

[0003] The present disclosure aims to at least solve one of the technical problems existing in the prior art, and provides an image rendering method and device, a display device and a naked eye 3D display system.

[0004] In a first aspect, a technical solution adopted to solve the technical problems of the present disclosure is an image rendering method, comprising:

[0005] acquiring a to-be-displayed image, and acquiring real-time position information under real-time tracking of a target human eye to determine a current moving distance of the target human eye to a display screen; the to-be-displayed image is an image obtained by cropping a source image captured by a shooting device;

[0006] acquiring a source image captured by a shooting device, and cropping the source image according to the size ratio of the display screen to obtain a to-be-displayed image;

[0007] rendering the to-be-displayed image according to first parameter information of the shooting device, second parameter information of the display screen, the current moving distance and a preset human eye interpupillary distance to obtain a left-eye rendered image and a right-eye rendered image;

[0008] generating a to-be-displayed stereoscopic display picture according to the left-eye rendered image and the right-eye rendered image.

[0009] In some embodiments, the shooting device includes a plurality of cameras, denoted as a first camera and a second camera; the first camera and the second camera capture pictures in the same application scenario, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed;

[0010] The acquiring of the to-be-displayed image comprises:

[0011] obtaining a to-be-displayed left image cropped from a left-eye partial source image and a to-be-displayed right image cropped from a right-eye partial source image; the left-eye partial source image is an image captured by the first camera, and the right-eye partial source image is an image captured by the second camera; the to-be-displayed image includes the to-be-displayed left image and the to-be-displayed right image.

[0012] In some embodiments, the first parameter information includes the first distance, a field view angle of the first camera or the second camera in a horizontal direction; and the second parameter information includes at least a first width of the display screen in the horizontal direction.

[0013] The rendering of the to-be-displayed image according to the first parameter information of the photographing device, the second parameter information of the display screen, the current movement distance, and a preset interpupillary distance, to obtain a left-eye rendered image and a right-eye rendered image, includes:

[0014] According to the first distance and the preset interpupillary distance, a first mapping relationship between a camera world coordinate system and a human eye world coordinate system is constructed.

[0015] According to the field view angle, a second mapping relationship between a distance variable and a projection width variable is constructed; the distance variable is used to represent a distance from the camera to a virtual display screen in the camera world coordinate system, and the projection width variable is used to represent a width of projection of content collected by the camera on the virtual display screen in the camera world coordinate system.

[0016] According to the first width and the first mapping relationship, a second width is determined, which represents a width of the virtual display screen in the horizontal direction in the camera world coordinate system.

[0017] According to the current movement distance, the first mapping relationship, and the second mapping relationship, a first projection width is determined.

[0018] According to the second width and the first projection width, the to-be-displayed left image and the to-be-displayed right image are processed respectively to obtain the left-eye rendered image and the right-eye rendered image.

[0019] [Incorporated by reference (Rule 20.6) 06.06.2025] In some embodiments, the expression of the first mapping relationship is: wherein y represents a parameter variable of the camera world coordinate system; x represents a parameter variable in the human eye world coordinate system; d represents the first distance; and D represents the preset interpupillary distance.

[0020] [Incorporated by reference (Rule 20.6) 06.06.2025] In some embodiments, the expression of the second mapping relationship is: wherein v represents the projection width variable, u represents the distance variable, FOV represents the field view angle. x represents the field view angle.

[0021] In some embodiments, the determining the first projection width according to the current moving distance, the first mapping relationship and the second mapping relationship comprises:

[0022] determining a camera mapping distance according to the current moving distance and the first mapping relationship;

[0023] determining the first projection width according to the camera mapping distance and the second mapping relationship.

[0024] In some embodiments, the determining the first projection width according to the current moving distance, the first mapping relationship and the second mapping relationship comprises:

[0025] determining a second projection width according to the current moving distance and the second mapping relationship;

[0026] determining the first projection width according to the second projection width and the first mapping relationship.

[0027] In some embodiments, the second parameter information further comprises a single view resolution related to the optical module in the display screen;

[0028] the processing the to-be-displayed left image and the to-be-displayed right image according to the second width and the first projection width to obtain the left eye rendering image and the right eye rendering image comprises:

[0029] determining a first reserved image of the to-be-displayed left image and a second reserved image of the to-be-displayed right image according to the second width and the first projection width;

[0030] adjusting a resolution of the first reserved image to the single view resolution to obtain the left eye rendering image, and adjusting a resolution of the second reserved image to the single view resolution to obtain the right eye rendering image.

[0031] In some embodiments, the determining the first reserved image of the to-be-displayed left image and the second reserved image of the to-be-displayed right image according to the second width and the first projection width comprises:

[0032] determining a first patch source ratio corresponding to the to-be-displayed left image and a second patch source ratio corresponding to the to-be-displayed right image according to the second width and the first projection width according to a preset algorithm;

[0033] According to the first slice source ratio, the left image to be displayed is regionally planned to obtain a first reserved image of the left image to be displayed;

[0034] According to the second slice source ratio, the right image to be displayed is regionally planned to obtain a second reserved image of the left image to be displayed.

[0035] In some embodiments, the left image to be displayed and the right image to be displayed are rectangular images; the first slice source ratio includes a left side increase / decrease ratio, a right side increase / decrease ratio, an upper side increase / decrease ratio and a lower side increase / decrease ratio corresponding to the left image to be displayed; and the second slice source ratio includes a left side increase / decrease ratio, a right side increase / decrease ratio, an upper side increase / decrease ratio and a lower side increase / decrease ratio corresponding to the right image to be displayed.

[0036] [Rule 20.6 incorporated by reference (06.06.2025)] The calculation formula of the left side increase / decrease ratio corresponding to the left image to be displayed is: The calculation formula of the right side increase / decrease ratio corresponding to the left image to be displayed is: The upper side increase / decrease ratio and the lower side increase / decrease ratio corresponding to the left image to be displayed are both:

[0037] [Rule 20.6 incorporated by reference (06.06.2025)] The calculation formula of the left side increase / decrease ratio corresponding to the right image to be displayed is: The calculation formula of the right side increase / decrease ratio corresponding to the right image to be displayed is: The upper side increase / decrease ratio and the lower side increase / decrease ratio corresponding to the right image to be displayed are both:

[0038] wherein V L1 represents the left side increase / decrease ratio corresponding to the left image to be displayed; V L2 represents the right side increase / decrease ratio corresponding to the left image to be displayed; V R1 represents the left side increase / decrease ratio corresponding to the right image to be displayed; V R2 represents the right side increase / decrease ratio corresponding to the right image to be displayed; W represents the first projection width, and w1 represents the second width.

[0039] In a second aspect, the embodiments of the present disclosure further provide an image rendering device, comprising a first information acquisition module, a second information acquisition module, an image rendering module and a picture generation module.

[0040] The first information acquisition module is configured to acquire real-time position information under real-time tracking of a target human eye, and determine a current movement distance of the target human eye to a display screen.

[0041] The second information obtaining module is configured to obtain a to-be-displayed image, the to-be-displayed image being an image obtained by cropping a piece source image captured by a shooting device;

[0042] The image rendering module is configured to render the to-be-displayed image according to the first parameter information of the shooting device, the second parameter information of the display screen, the current movement distance, and a preset human eye pupil distance, to obtain a left-eye rendered image and a right-eye rendered image;

[0043] The picture generation module is configured to generate a to-be-displayed stereoscopic display picture according to the left-eye rendered image and the right-eye rendered image.

[0044] In some embodiments, the image rendering device includes a field programmable gate array (FPGA).

[0045] In a third aspect, the embodiments of the present disclosure further provide a display device, including an image rendering device and a display screen, wherein the image rendering device includes a first information obtaining module, a second information obtaining module, an image rendering module, and a picture generation module;

[0046] The first information obtaining module is configured to obtain real-time position information of a target human eye under real-time tracking, and determine a current movement distance of the target human eye to the display screen.

[0047] The second information obtaining module is configured to obtain a to-be-displayed image, the to-be-displayed image being an image obtained by cropping a piece source image captured by a shooting device;

[0048] The image rendering module is configured to render the to-be-displayed image according to the first parameter information of the shooting device, the second parameter information of the display screen, the current movement distance, and a preset human eye pupil distance, to obtain a left-eye rendered image and a right-eye rendered image;

[0049] The picture generation module is configured to generate a to-be-displayed stereoscopic display picture according to the left-eye rendered image and the right-eye rendered image.

[0050] The display screen is configured to display the stereoscopic display picture.

[0051] In some embodiments, the display device further includes an eye movement tracking device, and the eye movement tracking device includes an eye movement tracking module and a first processing module.

[0052] The eye movement tracking module is configured to track a target human eye in an environment where the display screen is located in real time, to obtain a face image.

[0053] The first processing module is configured to extract a feature of the target human eye from the human face image, determine real-time position information of the target human eye, and send the real-time position information to the first information acquisition module.

[0054] In some embodiments, the display device further comprises a video preprocessing chip.

[0055] The video preprocessing chip is configured to acquire a source image captured by a shooting device, crop the source image according to a size ratio of the display screen to obtain a to-be-displayed image, and send the to-be-displayed image to the second information acquisition module.

[0056] In some embodiments, the shooting device comprises a plurality of cameras, denoted as a first camera and a second camera; the first camera and the second camera capture pictures in the same application scenario, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed.

[0057] The video preprocessing chip is configured to acquire a left-eye source image captured by the first camera and a right-eye source image captured by the second camera; the source image comprises the left-eye source image and the right-eye source image; crop the left-eye source image according to a size ratio of the display screen to obtain a to-be-displayed left image, and crop the right-eye source image according to the size ratio of the display screen to obtain a to-be-displayed right image; and the to-be-displayed image comprises the to-be-displayed left image and the to-be-displayed right image.

[0058] In a fourth aspect, the embodiments of the present disclosure further provide a naked-eye 3D display system, comprising a shooting device and a display device; the display device comprises an eye movement tracking device, a video preprocessing chip, an image rendering device, and a display screen; the image rendering device comprises a first information acquisition module, a second information acquisition module, an image rendering module, and a picture generation module.

[0059] The eye movement tracking device is configured to track a target human eye in an environment where the display screen is located in real time, determine real-time position information of the target human eye, and send the real-time position information to the first information acquisition module.

[0060] The shooting device is configured to collect a source image and send the source image to the video preprocessing chip.

[0061] The video preprocessing chip is configured to crop the source image according to a size ratio of the display screen to obtain a to-be-displayed image, and send the to-be-displayed image to the second information acquisition module.

[0062] The first information acquisition module is configured to acquire real-time position information of the target human eye under real-time tracking, and determine a current moving distance of the target human eye to the display screen.

[0063] The second information acquisition module is configured to acquire the image to be displayed.

[0064] The image rendering module is configured to render the image to be displayed according to the first parameter information of the photographing device, the second parameter information of the display screen, the current moving distance, and a preset human eye interpupillary distance, to obtain a left-eye rendered image and a right-eye rendered image.

[0065] The picture generation module is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendered image and the right-eye rendered image.

[0066] The display screen is configured to display the stereoscopic display picture.

[0067] In some embodiments, the photographing device includes a plurality of cameras, denoted as a first camera and a second camera, and a second processing module; the first camera and the second camera photograph pictures in the same application scenario, the photographing positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed.

[0068] The first camera is configured to collect a left-eye slice source image.

[0069] The second camera is configured to collect a right-eye slice source image; the slice source image includes the left-eye slice source image and the right-eye slice source image.

[0070] The second processing module is configured to send the left-eye slice source image and the right-eye slice source image to the video pre-processing chip.

[0071] The video pre-processing chip is configured to crop the left-eye slice source image according to a size ratio of the display screen to obtain a left-eye image to be displayed, and crop the right-eye slice source image according to the size ratio of the display screen to obtain a right-eye image to be displayed; the image to be displayed includes the left-eye image to be displayed and the right-eye image to be displayed.

[0072] In a fifth aspect, the embodiments of the present disclosure further provide a computer device, including:

[0073] One or more processors;

[0074] A memory for storing one or more programs;

[0075] When the one or more programs are executed by the one or more processors, the one or more processors implement the steps of the image rendering method according to any one of the first aspect.

[0076] In a sixth aspect, the embodiments of the present disclosure further provide a computer non-transitory readable storage medium, and the computer non-transitory readable storage medium stores a computer program. When the computer program is run by a processor, the steps of the image rendering method according to any one of the first aspect are executed. BRIEF DESCRIPTION OF DRAWINGS

[0077] FIG. 1a is a schematic diagram of a display effect corresponding to a zero parallax of the prior art;

[0078] FIG. 1b is a schematic diagram of a display effect corresponding to a positive parallax of the prior art;

[0079] FIG. 1c is a schematic diagram of a display effect corresponding to a negative parallax of the prior art;

[0080] FIG. 1d is a schematic diagram of a 3D experience of a human eye not being at the same position as an actual object under a rendering mode of the prior art;

[0081] FIG. 1e is a schematic diagram of a display effect rendered according to a position of a human eye in an embodiment of the present disclosure;

[0082] FIG. 2 is a flowchart of an image rendering method provided by an embodiment of the present disclosure;

[0083] FIG. 3 is a schematic diagram of a specific flow of determining a left-eye rendering image and a right-eye rendering image provided by an embodiment of the present disclosure;

[0084] FIG. 4 is a schematic diagram of a camera world coordinate system established by an embodiment of the present disclosure;

[0085] FIG. 5 is a schematic diagram of a human eye world coordinate system established by an embodiment of the present disclosure;

[0086] FIG. 6 is a schematic diagram of a partial flow of image parallax adjustment provided by an embodiment of the present disclosure;

[0087] FIG. 7 is a schematic diagram of a viewing effect when a current moving distance is a best viewing distance adapted to an endoscope provided by an embodiment of the present disclosure;

[0088] FIG. 8a is a schematic diagram of a left-eye rendering image obtained by performing parallax adjustment under parameters corresponding to FIG. 7;

[0089] FIG. 8b is a schematic diagram of a right-eye rendering image obtained by performing parallax adjustment under parameters corresponding to FIG. 7;

[0090] FIG. 9 is a schematic diagram of a viewing effect when a current moving distance is greater than a best viewing distance adapted to an endoscope provided by an embodiment of the present disclosure;

[0091] FIG. 10a is a schematic diagram of a left-eye rendered image obtained by adjusting the parallax under the corresponding parameters of FIG. 9;

[0092] FIG. 10b is a schematic diagram of a right-eye rendered image obtained by adjusting the parallax under the corresponding parameters of FIG. 9;

[0093] FIG. 11 is a schematic diagram of a viewing effect under one example when the current moving distance is less than the optimal viewing distance adapted to the endoscope according to an embodiment of the present disclosure;

[0094] FIG. 12a is a schematic diagram of a left-eye rendered image obtained by adjusting the parallax under the corresponding parameters of FIG. 11;

[0095] FIG. 12b is a schematic diagram of a right-eye rendered image obtained by adjusting the parallax under the corresponding parameters of FIG. 11;

[0096] FIG. 13 is a schematic diagram of a viewing effect under another example when the current moving distance is less than the optimal viewing distance adapted to the endoscope according to an embodiment of the present disclosure;

[0097] FIG. 14a is a schematic diagram of a left-eye rendered image obtained by adjusting the parallax under the corresponding parameters of FIG. 13;

[0098] FIG. 14b is a schematic diagram of a right-eye rendered image obtained by adjusting the parallax under the corresponding parameters of FIG. 13;

[0099] FIG. 15 is a schematic diagram of an image rendering device according to an embodiment of the present disclosure;

[0100] FIG. 16 is a schematic diagram of a display device according to an embodiment of the present disclosure;

[0101] FIG. 17 is a schematic diagram of a naked-eye 3D display system according to an embodiment of the present disclosure;

[0102] FIG. 18 is a schematic diagram of a structure of a computer device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0103] In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure clearer, the following will be combined with the accompanying drawings for the embodiments of the present disclosure to briefly describe the technical solutions in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure and not all the embodiments. The components of the embodiments of the present disclosure described and shown in the accompanying drawings can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed present disclosure, but only represents selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.

[0104] Unless otherwise defined, technical terms or scientific terms used in the present disclosure shall have the meanings as commonly understood by one of ordinary skill in the art to which this disclosure belongs. The terms "first", "second", and similar terms do not denote any order, quantity, or importance, but are used to distinguish different components. Also, the terms "one", "a", or "the" do not denote a quantity of particular noun, but denote the existence of at least one of the particular noun. The terms "comprising" or "including" or similar terms mean that the elements or objects before the term encompass the elements or objects listed after the term and equivalents thereof, and do not exclude other elements or objects. The terms "connected" or "linked" or similar terms are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. The terms "upper", "lower", "left", "right", and the like are used only to indicate relative positional relationships, and when the absolute positions of the described objects are changed, the relative positional relationships can also be changed accordingly.

[0105] In the present disclosure, "a plurality of or several" means two or more. The term "and / or" describes an association relationship of associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A existing alone, A and B existing together, and B existing alone. The character " / " generally represents an "or" relationship between the front and rear associated objects.

[0106] In the related art, the existence of image parallax often causes the viewing effect of the human eye to be mismatched with the actual object, thereby leading to the problem of 3D display viewing dizziness. Among them, the image parallax refers to the difference (i.e., the distance between O L and O R ) of the projection of the 3D object (represented by O) on the display plane relative to the human eye (the projection position relative to the left eye is represented by O L and the projection position relative to the right eye is represented by O R ). As shown in FIGS. 1a, 1b, and 1c, the display effects of zero parallax (2D display), positive parallax (in-screen 3D), and negative parallax (out-of-screen 3D) are respectively illustrated, and the greater the image parallax, the greater the out-of-screen depth or in-screen depth of the 3D object. As can be seen, for the fixed viewing distance of the human eye and the fixed out-of-screen depth or in-screen depth of the 3D object, the size of the image parallax is fixed. However, since the image parallax given by the slice source is fixed and unchangeable, that is, the 3D object has a unique corresponding projection position (O L1 and O R1 ) at a certain position (O1), the image parallax will not change with the change of the position of the human eye. As shown in FIG. 1d, the positions of the left eye 1 and the right eye 1 correspond to the 3D object at O1, and the image parallax O L1 and O R1If the human eye moves to position 2, i.e. the left eye 2 and the right eye 2, the image parallax is unchanged, and the human eye watches the 3D object at O2, but the 3D object in the real scene is at O1, so that the human eye 3D experience is not in the same position as the actual object, thereby causing the human eye to be not comfortable and dizzy.

[0107] To meet the non-dizzy condition, theoretically, the projection position and the parallax size need to be adjusted accordingly, otherwise the situation shown in FIG. 1d will occur. If the correct 3D image needs to be seen at position 2, the image parallax needs to be adjusted in real time according to the viewing position of the human eye, as shown in FIG. 1e, to obtain the left and right eye rendering pictures. Based on this, the embodiment of the present disclosure provides an image rendering method, and the execution subject of the image rendering method can be a device with certain computing capability, for example, the image rendering apparatus described below, such as a Field Programmable Gate Array (FPGA), or a computer device, such as a terminal or a server, etc.

[0108] FIG. 2 is a flowchart of an image rendering method provided by an embodiment of the present disclosure, as shown in FIG. 2, the image rendering method includes steps S11-S13, wherein:

[0109] S11, obtaining a to-be-displayed image; and obtaining real-time position information of a target human eye tracked in real time, to determine a current moving distance of the target human eye to the display screen.

[0110] The to-be-displayed image is an image obtained by cropping a source image captured by a shooting device. The shooting device is an external device other than the execution subject of the present disclosure, and is used to capture a picture in an actual application scene to obtain the source image. Here, the source image can be an image captured in real time by the shooting device, or can also be an image in a video stream pre-captured and stored by the shooting device. The process of cropping the source image is to adjust the size ratio of the source image to be the same as the size ratio of the display screen by a video preprocessing chip. The size ratio of the display screen can be considered as the ratio of the length and the width of the actual display area in the display screen, for example, the ratio of 16:9. The actual display area is the area for displaying the subsequent stereoscopic display picture, and is also the pixel area.

[0111] For example, the size ratio of the slice source image is 4:3, and the size ratio of the display screen is 16:9. The video pre-processing chip can be a system on chip (SoC). The SoC can crop the slice source image according to the size ratio of the display screen, so that the size ratio of the to-be-displayed image is the same as that of the display screen, that is, 16:9. The actual cropping rule can be to retain the long side of the slice source image as much as possible and crop the short side of the slice source image.

[0112] It should be noted that the above data description about the size ratio is only for the convenience of understanding one possible case of the embodiments of the present disclosure, and the embodiments of the present disclosure are not limited to the above one size ratio of the display screen. The principle of the processing method of the present disclosure is the same for any size ratio of the display.

[0113] In a possible implementation, the shooting device includes a plurality of cameras, and the slice source image includes an image captured by each camera. Therefore, the to-be-displayed image obtained by cropping the slice source image also includes an image cropped from an image captured by each camera. For example, the shooting device includes a first camera and a second camera; the first camera and the second camera capture pictures in the same application scenario, the shooting positions of the first camera and the second camera are different, and the first distance between the first camera and the second camera is fixed. For example, the to-be-displayed image includes a plurality of images, such as a to-be-displayed left image matched with a left eye and a to-be-displayed right image matched with a right eye. The to-be-displayed image is obtained by: obtaining a to-be-displayed left image cropped from a left eye slice source image and a to-be-displayed right image cropped from a right eye slice source image; wherein the left eye slice source image is an image captured by the first camera, and the right eye slice source image is an image captured by the second camera.

[0114] In another possible implementation, the shooting device includes one camera, and the slice source image is one image. Then, the slice source image is divided into a left eye slice source image and a right eye slice source image by using an image segmentation algorithm. The to-be-displayed image is obtained by: obtaining a to-be-displayed left image cropped from the left eye slice source image and a to-be-displayed right image cropped from the right eye slice source image.

[0115] In this step, the target human eye is an eye of a person who watches the display screen to display a picture in front of the display screen, and is an eye of a user in a real scene.

[0116] Exemplarily, in a naked eye display application, a target human eye watches a display screen, the display screen is integrated with an eye movement tracking device, the eye movement tracking device is an external device other than the subject of the present disclosure, and the eye movement tracking device feeds back real-time position information tracked to an image rendering device or a computer device. Exemplarily, the real-time position information can be position coordinates of centers of left and right eyes in the target human eye in a human eye world coordinate system. A current movement distance of the target human eye to the display screen can be a vertical distance (or shortest distance) from the centers of the left and right eyes to the display screen in the human eye world coordinate system.

[0117] S12, rendering the to-be-displayed image according to the first parameter information of the shooting device, the second parameter information of the display screen, the current movement distance, and the preset human eye interpupillary distance, to obtain a left-eye rendered image and a right-eye rendered image.

[0118] In a possible implementation, the to-be-displayed left image is rendered according to the first parameter information of the shooting device, the second parameter information of the display screen, the current movement distance, and the preset human eye interpupillary distance, to obtain the left-eye rendered image; and the to-be-displayed right image is rendered according to the first parameter information of the shooting device, the second parameter information of the display screen, the current movement distance, and the preset human eye interpupillary distance, to obtain the right-eye rendered image.

[0119] Exemplarily, the present disclosure is applied to a medical scenario, the shooting device can be an endoscope, including two cameras, denoted as a first camera and a second camera, and the device parameters of the first camera and the second camera are the same.

[0120] Exemplarily, the first parameter information includes a first distance, a field view angle of the first camera or the second camera in a horizontal direction; and the second parameter information at least includes a first width of the display screen in the horizontal direction. The to-be-displayed left image and the to-be-displayed right image are respectively rendered according to the first distance, the field view angle, the first width, the current movement distance, and the preset human eye interpupillary distance, to respectively obtain the left-eye rendered image and the right-eye rendered image.

[0121] It should be noted that the first width refers to a width of an actual display area of the display screen in the horizontal direction.

[0122] In another possible implementation, the left image is rendered according to the first parameter information of the shooting device, the second parameter information of the display screen, the current movement distance, and the preset human eye interpupillary distance, to obtain the left-eye rendered image; and the right image is rendered according to the first parameter information of the shooting device, the second parameter information of the display screen, the current movement distance, and the preset human eye interpupillary distance, to obtain the right-eye rendered image.

[0123] S213, generating a to-be-displayed stereoscopic display picture according to the left-eye rendered image and the right-eye rendered image.

[0124] Specifically, pixel rearrangement algorithms are used to rearrange the pixels of the left-eye rendered image and the right-eye rendered image to obtain a stereoscopic display image, so as to send the stereoscopic display image to a display screen for display.

[0125] The image rendering method provided by the embodiments of the present disclosure can track the real-time position information of the target human eye in real time, and adjust the parallax size of the to-be-displayed image watched by the target human eye according to the first parameter information of the shooting device corresponding to the film source, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance, so as to realize real-time 3D parallax rendering, and can make the target human eye not produce the above physiological discomfort and other problems at any distance, thereby improving the viewing comfort of naked-eye 3D display.

[0126] In some embodiments, the first parameter information includes a first distance, a field of view of the first camera or the second camera in a horizontal direction; and the second parameter information at least includes a first width of the display screen in the horizontal direction. The field of view of the first camera and the second camera in the horizontal direction FOV x is the same.

[0127] For example, the first distance is the distance between the first camera and the second camera, which is relatively small, for example, less than the pupil distance of the human eye in a normal case. In the application of medical instruments, such as an endoscope, the first distance d = 4.2 mm; the field of view FOV x = 54.9°.

[0128] For step S12, the steps of determining the left-eye rendered image and the right-eye rendered image are shown in FIG. 3, and specifically include S121-S125, wherein:

[0129] S121, according to the first distance and the preset human eye pupil distance, constructing a first mapping relationship between the camera world coordinate system and the human eye world coordinate system.

[0130] The camera world coordinate system and the human eye world coordinate system are established in advance, as shown in FIG. 4, which is a schematic diagram of the camera world coordinate system; and as shown in FIG. 5, which is a schematic diagram of the human eye world coordinate system.

[0131] [Rule 20.6 incorporated by reference (06.06.2025)] The human eye world coordinate system is scaled proportionally, and the human eye is equivalent to a camera to be mapped into the camera world coordinate system, to construct the first mapping relationship, as shown in the following expression I:

[0132] [Rule 20.6 incorporated by reference (06.06.2025)] Wherein y represents a parameter variable of the camera world coordinate system; x represents a parameter variable under the human eye world coordinate system; d represents the first distance; D represents the preset human eye pupil distance; represents the scaling ratio.

[0133] S122, constructing a second mapping relationship between the distance variable and the projection width variable according to the field view angle.

[0134] The distance variable is used to represent the distance from the camera to the virtual display screen in the camera world coordinate system, and the projection width variable is used to represent the width of the projection of the content collected by the camera on the virtual display screen in the camera world coordinate system.

[0135] [Rule 20.6 incorporated by reference (06.06.2025)] As shown in FIG. 4, the second mapping relationship is constructed using geometric principles, see expression two:

[0136] Where v represents the projection width variable, u represents the distance variable, FOV x represents the field view angle.

[0137] S123, determining a second width according to the first width and the first mapping relationship.

[0138] The second width represents the width of the virtual display screen in the horizontal direction in the camera world coordinate system.

[0139] [Rule 20.6 incorporated by reference (06.06.2025)] It is known that in the case of a fixed display screen, the first width W1 of the display screen in the horizontal direction is fixed; substituting W1 into expression one, the second width w1 is obtained, denoted as

[0140] S124, determining a first projection width according to the current movement distance, the first mapping relationship and the second mapping relationship.

[0141] In one possible implementation, S124 includes S124-1-1~S124-1-2, wherein:

[0142] S124-1-1, determining a camera mapping distance according to the current movement distance and the first mapping relationship.

[0143] [Rule 20.6 incorporated by reference (06.06.2025)] Substitute the current movement distance Z into expression one to obtain the camera mapping distance

[0144] S124-1-2, determining a first projection width according to the camera mapping distance and the second mapping relationship.

[0145] [Rule 20.6 incorporated by reference (06.06.2025)] Substitute the camera mapping distance z into expression two to obtain the first projection width w = 2 × z ×

[0146] In another possible implementation, S124 comprises S124-2-1~S124-2-2, wherein:

[0147] S124-2-1, determining the second projection width according to the current moving distance and the second mapping relationship.

[0148] Since the camera world coordinate system and the human eye world coordinate system can be converted proportionally, the human eye can be equivalent to the camera, and therefore the second projection width of the content collected by the camera at the distance Z can be calculated by using Expression Two.

[0149] [Rule 20.6 incorporated by reference (06.06.2025)] Substitute the current moving distance Z into u in Expression Two to obtain the second projection width

[0150] S124-2-2, determining the first projection width according to the second projection width and the first mapping relationship.

[0151] [Rule 20.6 incorporated by reference (06.06.2025)] Substitute the second projection width W into x in Expression One to obtain the first projection width

[0152] S125, processing the to-be-displayed left image and the to-be-displayed right image according to the second width and the first projection width, respectively, to obtain the left eye rendering image and the right eye rendering image.

[0153] Specifically, the to-be-displayed left image can be updated to obtain the parallax-processed image, i.e., the first reserved image, according to the second width and the first projection width, by determining the to-be-removed area and / or the to-be-supplemented area around the to-be-displayed left image, deleting the image in the to-be-removed area of the to-be-displayed left image, or supplementing the image to the to-be-supplemented area. It should be noted that the size ratio of the to-be-displayed left image before and after parallax processing and the first reserved image is the same, for example, both are 16:9. Then, it is determined whether the resolution of the first reserved image is equal to the single-view resolution, and in the case that the first reserved image is not equal to the single-view resolution, the resolution of the first reserved image is adjusted to the single-view resolution to obtain the left eye rendering image. In the case that the resolution of the first reserved image is equal to the single-view resolution, the first reserved image is the left eye rendering image.

[0154] Similarly, the to-be-displayed right image surrounding the to-be-removed region and / or the to-be-supplemented region can be determined according to the second width and the first projection width, the image in the to-be-displayed right image located in the to-be-removed region is deleted, or the image is supplemented for the to-be-supplemented region, so as to update the to-be-displayed left image, and the image after the parallax processing, that is, the second reserved image, is obtained. It should be noted that the size ratio of the to-be-displayed right image before and after the parallax processing and the second reserved image is the same, for example, both are 16:9. Then, it is determined whether the resolution of the second reserved image is equal to the single-view resolution, and in the case that the resolution of the second reserved image is not equal to the single-view resolution, the resolution of the second reserved image is adjusted to the single-view resolution, and the right-eye rendering image is obtained. In the case that the second reserved image is equal to the single-view resolution, the second reserved image is the right-eye rendering image.

[0155] The single-view resolution is part of the second parameter information and is related to the optical module in the display screen. The single-view resolution can also be understood as the 3D resolution of the optical module, also known as the single-view resolution, which can be different from the pixel resolution of the display screen. The single-view resolution includes the left-view resolution and the right-view resolution. For example, the left-view resolution and the right-view resolution can be the same, for example, 4800x2160. The pixel resolution is, for example, 3840x16x2160.

[0156] In the case of w≥w1+d, the to-be-removed region can be obtained, and the to-be-supplemented region cannot be obtained.

[0157] In the case of w

[0158] For example, any gray-scale pixel can be interpolated in the to-be-supplemented region, and the interpolation principle ensures that the image does not be distorted. For example, black pixels are inserted in the to-be-supplemented region, and the region supplemented to the to-be-displayed image is a black image.

[0159] Of course, other beautified backgrounds can also be inserted in the to-be-supplemented region, as long as the image parallax is not affected.

[0160] In some embodiments, FIG. 6 is a partial flow diagram of image parallax adjustment provided by an embodiment of the present disclosure, as shown in FIG. 6, including steps S1251-S1253, wherein:

[0161] S1251, according to the second width and the first projection width, the first source ratio corresponding to the to-be-displayed left image and the second source ratio corresponding to the to-be-displayed right image are determined according to a preset algorithm.

[0162] In a possible implementation, as shown in FIG. 4, the to-be-displayed left image and the to-be-displayed right image are both rectangular images. The first piece source ratio includes a left side increase / decrease ratio, a right side increase / decrease ratio, an upper side increase / decrease ratio, and a lower side increase / decrease ratio corresponding to the to-be-displayed left image; and the second piece source ratio includes a left side increase / decrease ratio, a right side increase / decrease ratio, an upper side increase / decrease ratio, and a lower side increase / decrease ratio corresponding to the to-be-displayed right image.

[0163] [Rule 20.6] By using geometric principles, the left side increase / decrease ratio corresponding to the to-be-displayed left image is determined according to the second width and the first projection width. The calculation formula of the left side increase / decrease ratio corresponding to the to-be-displayed left image is shown in the following Formula 1.

[0164] [Rule 20.6] By using geometric principles, the right side increase / decrease ratio corresponding to the to-be-displayed left image is determined according to the second width and the first projection width. The calculation formula of the right side increase / decrease ratio corresponding to the to-be-displayed left image is shown in the following Formula 2.

[0165] [Rule 20.6] The upper side increase / decrease ratio and the lower side increase / decrease ratio corresponding to the to-be-displayed left image are both

[0166] [Rule 20.6] By using geometric principles, the left side increase / decrease ratio corresponding to the to-be-displayed right image is determined according to the second width and the first projection width. The calculation formula of the left side increase / decrease ratio corresponding to the to-be-displayed right image is shown in the following Formula 3.

[0167] [Rule 20.6] By using geometric principles, the right side increase / decrease ratio corresponding to the to-be-displayed right image is determined according to the second width and the first projection width. The calculation formula of the right side increase / decrease ratio corresponding to the to-be-displayed right image is shown in the following Formula 2.

[0168] [Rule 20.6] The upper side increase / decrease ratio and the lower side increase / decrease ratio corresponding to the to-be-displayed right image are both

[0169] wherein, V L1 represents the left side increase / decrease ratio corresponding to the to-be-displayed left image; V L2 represents the right side increase / decrease ratio corresponding to the to-be-displayed left image; V R1 represents the left side increase / decrease ratio corresponding to the to-be-displayed right image; V R2 represents the right side increase / decrease ratio corresponding to the to-be-displayed right image; and w represents the first projection width, and w1 represents the second width.

[0170] In another possible implementation, the to-be-displayed left image and the to-be-displayed right image are other shaped images, such as a rounded rectangle, a circle, and other polygons, and the same geometric principle as in the above manner is used to calculate the first patch source ratio corresponding to the to-be-displayed left image and the second patch source ratio corresponding to the to-be-displayed right image, and the disclosure will not be listed one by one.

[0171] S1252, region planning is performed on the to-be-displayed left image according to the first patch source ratio, to obtain a first reserved image of the to-be-displayed left image.

[0172] S1253, region planning is performed on the to-be-displayed right image according to the second patch source ratio, to obtain a second reserved image of the to-be-displayed right image.

[0173] [Incorporated by reference (Rule 20.6) 06.06.2025] In the case where the left side increase / decrease ratio is a positive value, V L1 ×W is the width of the left side to-be-removed area of the to-be-displayed left image, V R1 ×W is the width of the left side to-be-removed area of the to-be-displayed right image. In the case where the left side increase / decrease ratio is a negative value, V L1 ×W is the width of the left side to-be-supplemented area of the to-be-displayed left image, V R2 ×W is the width of the left side to-be-supplemented area of the to-be-displayed right image. Wherein, W represents the second projection width of the content collected by the camera at a distance Z. The width of the to-be-removed area and the to-be-supplemented area is calculated by using the right side increase / decrease ratio, which is the same as the calculation of the width of the to-be-removed area and the to-be-supplemented area by using the left side increase / decrease ratio, which will not be repeated here. In addition, the width of the to-be-removed area and the to-be-supplemented area is calculated by using the upper side increase / decrease ratio and the lower side increase / decrease ratio, which is different from the calculation of the width of the to-be-removed area and the to-be-supplemented area by using the left side increase / decrease ratio. The width of the to-be-removed area and the to-be-supplemented area is calculated by using the upper side increase / decrease ratio and the lower side increase / decrease ratio, which is not multiplied by the second projection width, but by the projection width of the short side corresponding to the size ratio of the to-be-displayed left image (or the to-be-displayed right image) under the second projection width (the long side projection width, that is, the projection width in the horizontal direction), that is, the width of the to-be-removed area and the to-be-supplemented area calculated by using the upper side increase / decrease ratio and the lower side increase / decrease ratio is Wherein, ρ1:ρ2 represents the size ratio of the to-be-displayed left image (or the to-be-displayed right image), for example, 16:9.

[0174] Similarly, the first reserved image and the second reserved image after image subtraction and / or supplementation are obtained.

[0175] The process of the parallax processing of S1251-S1253 described above is further illustrated based on a plurality of examples as follows.

[0176] A certain dual-camera endoscope takes a piece of source image, which is rendered and displayed on a display screen in real time. The applied parameter information includes: the size of the display screen is 31.5 inches, the horizontal width W1 is 698.112 mm; the single-view resolution (i.e. the left-view resolution or the right-view resolution) is 4800x2160; the preset interpupillary distance D is 65 mm; the field view angle of the camera in the horizontal direction FOVx is 54.9°; the first distance d is 4.2 mm. Exemplarily, Z can be any data between 150 mm and 10 m.

[0177] In Example 1, as shown in FIG. 7, when w = w1 + d, the current moving distance Z of the target human eye to the display screen can be obtained by using the first mapping relationship and the second mapping relationship, which is 734.53 mm, which is also the best viewing distance adapted to the endoscope. At this distance, the first projection width w and the second width w1 are substituted into Formulas 1-4 to obtain V L1 = 8.52%, V L2 = 0, V R1 = 0, and V R2 = 8.52%.

[0178] [Rule 20.6 incorporated by reference (06.06.2025)] The left-eye rendered image is determined, as shown in FIG. 8a, the width of the to-be-removed area 81 on the left side of the to-be-displayed left image in the horizontal direction is 8.52% x W. V L2 = 0, so the right side of the to-be-displayed left image neither needs to remove the image nor needs to supplement the image. The width of the to-be-removed area 82 on the top side of the to-be-displayed left image in the vertical direction is The to-be-removed area 83 on the bottom side of the to-be-displayed left image has the same size as the to-be-removed area 82 on the top side. That is, the left side of the to-be-displayed left image is removed by 8.52% of the long side, and the top and bottom sides are each removed by 4.26% of the short side, to obtain a first reserved image. Continue as shown in FIG. 8a, the resolution of the first reserved image is adjusted to the single-view resolution to obtain the left-eye rendered image.

[0179] [Rule 20.6 incorporated by reference (06.06.2025)] The right-eye rendered image is determined, as shown in FIG. 8b, V R1 = 0, so the left side of the to-be-displayed right image neither needs to remove the image nor needs to supplement the image. The width of the to-be-removed area 84 on the right side of the to-be-displayed right image in the horizontal direction is 8.52% x W. The width of the to-be-removed area 85 on the top side of the to-be-displayed right image in the vertical direction is The to-be-removed region 86 on the lower side of the to-be-displayed right image has the same size as the to-be-removed region 85 on the upper side. That is, the right side of the to-be-displayed right image is removed by 8.52% of the length, and the upper and lower sides are each removed by 4.26% of the width, to obtain a second reserved image. As shown in FIG. 8b, the resolution of the second reserved image is adjusted to a single-view resolution, and the image size ratio is ensured to be unchanged before and after the adjustment, to obtain a right-eye rendering image.

[0180] It should be noted that the size ratio of the left-eye rendering image and the size ratio of the right-eye rendering image are both the same as the size ratio of the first reserved image, that is, the same as the size ratio of the to-be-displayed left image, for example, 16:9.

[0181] As shown in FIG. 9, when Z = 1500 mm, the first projection width w and the second width w1 are obtained by using the first mapping relationship and the second mapping relationship. The first projection width w and the second width w1 are substituted into Formulas 1-4, respectively, to obtain V L1 = 25.52%, V L2 = 29.69%, V R1 = 29.69%, and V R2 = 25.52%.

[0182] As shown in FIG. 10a, the to-be-removed region 101 on the left side of the to-be-displayed left image has a width of 25.52% × W in the horizontal direction. The to-be-removed region 102 on the right side of the to-be-displayed left image has a width of 29.69% × W in the horizontal direction. The to-be-removed region 103 on the upper side of the to-be-displayed left image has a width of The to-be-removed region 104 on the lower side of the to-be-displayed left image has the same size as the to-be-removed region 103 on the upper side. That is, the left side of the to-be-displayed left image is removed by 25.52% of the length, and the right side of the to-be-displayed left image is removed by 29.69% of the length, and the upper and lower sides are each removed by 27.605% of the width, to obtain a first reserved image. As shown in FIG. 10a, the resolution of the first reserved image is adjusted to a single-view resolution, and the image size ratio is ensured to be unchanged before and after the adjustment, to obtain a left-eye rendering image.

[0183] As shown in FIG. 10b, the to-be-removed region 105 on the left side of the to-be-displayed right image has a width of 29.69% × W in the horizontal direction. The to-be-removed region 106 on the right side of the to-be-displayed right image has a width of 25.52% × W in the horizontal direction. The to-be-removed region 107 on the upper side of the to-be-displayed left image has a width of The to-be-removed region 108 at the lower side of the to-be-displayed right image has the same size as the to-be-removed region 107 at the upper side. That is, the left side of the to-be-displayed right image is removed by 29.69% of the length, the right side of the to-be-displayed right image is removed by 25.52% of the length, and the upper and lower sides are each removed by 27.605% of the width, to obtain a second reserved image. As shown in FIG. 10b, the resolution of the second reserved image is adjusted to a single-view resolution, and it is ensured that the image size ratio is unchanged before and after the adjustment, to obtain a right-eye rendering image.

[0184] As shown in FIG. 11, when Z = 700 mm, the first projection width w and the second width w1 are obtained by using the first mapping relationship and the second mapping relationship. The first projection width w and the second width w1 are substituted into Formulas 1-4, respectively, to obtain V L1 = -2.47%, V L2 = 6.47%, V R1 = 6.47%, and V R2 = -2.47%.

[0185] As shown in FIG. 12a, the left-eye rendering image is determined. The to-be-removed region 121 at the left side of the to-be-displayed left image has a width of -2.47% x W in the horizontal direction. The to-be-removed region 122 at the right side of the to-be-displayed left image has a width of 6.47% x W in the horizontal direction. The to-be-removed region 123 at the upper side of the to-be-displayed left image has a width of The to-be-removed region 124 at the lower side of the to-be-displayed left image has the same size as the to-be-removed region 123 at the upper side. That is, the left side of the to-be-displayed left image is supplemented by 2.47% of the length, the right side of the to-be-displayed left image is removed by 6.47% of the length, and the upper and lower sides are each removed by 2% of the width, to obtain a first reserved image. As shown in FIG. 12a, the resolution of the first reserved image is adjusted to a single-view resolution, and it is ensured that the image size ratio is unchanged before and after the adjustment, to obtain a left-eye rendering image.

[0186] As shown in FIG. 12b, the right-eye rendering image is determined. The to-be-removed region 125 at the left side of the to-be-displayed right image has a width of 6.47% x W in the horizontal direction. The to-be-removed region 126 at the right side of the to-be-displayed right image has a width of -2.47% x W in the horizontal direction. The to-be-removed region 127 at the upper side of the to-be-displayed left image has a width of The to-be-removed region 128 on the lower side of the to-be-displayed right image has the same size as the to-be-removed region 127 on the upper side. That is, the left side of the to-be-displayed left image is removed by 6.47% of the length, the right side of the to-be-displayed left image is supplemented by 2.47% of the length, and each of the upper and lower sides is removed by 2% of the short side, to obtain a second reserved image. As shown in FIG. 12b, the resolution of the second reserved image is adjusted to a single-view resolution, and it is ensured that the size ratio of the image before and after the adjustment is unchanged, to obtain a right-eye rendering image.

[0187] As shown in FIG. 13, when Z = 500 mm, the first projection width w and the second width W1 are obtained by using the first mapping relationship and the second mapping relationship. The first projection width w and the second width W1 are substituted into Formulas 1-4, respectively, to obtain V L1 = -23.45%, V L2 = -10.94%, V R1 = -10.94%, and V R2 = -23.45%.

[0188] As shown in FIG. 14a, the to-be-compensated region 141 on the left side of the to-be-displayed left image has a width of -23.45% × W in the horizontal direction. The to-be-compensated region 142 on the right side of the to-be-displayed left image has a width of -10.94% × W in the horizontal direction. The to-be-compensated region 143 on the upper side of the to-be-displayed left image has a width of The to-be-compensated region 144 on the lower side of the to-be-displayed left image has the same size as the to-be-compensated region 143 on the upper side. That is, the left side of the to-be-displayed left image is supplemented by 23.45% of the length, the right side of the to-be-displayed left image is supplemented by 10.94% of the length, and each of the upper and lower sides is supplemented by 17.195% of the short side, to obtain a first reserved image. As shown in FIG. 14a, the resolution of the first reserved image is adjusted to a single-view resolution, and it is ensured that the size ratio of the image before and after the adjustment is unchanged, to obtain a left-eye rendering image.

[0189] As shown in FIG. 14b, the to-be-compensated region 145 on the left side of the to-be-displayed right image has a width of -10.94% × W in the horizontal direction. The to-be-compensated region 146 on the right side of the to-be-displayed right image has a width of -23.45% × W in the horizontal direction. The to-be-compensated region 147 on the upper side of the to-be-displayed left image has a width of The to-be-displayed right image lower side to-be-compensated area 148 has the same size as the to-be-displayed right image upper side to-be-compensated area 147. That is, the content of the left side of the to-be-displayed left image is supplemented by 10.94% of the long side, the content of the right side of the to-be-displayed left image is supplemented by 23.45% of the long side, and the content of the upper and lower sides is supplemented by 17.195% of the short side, respectively, to obtain a second reserved image. As shown in FIG. 14b, the resolution of the second reserved image is adjusted to a single-view resolution, and the image size ratio before and after the adjustment is ensured to be unchanged, to obtain a right-eye rendering image.

[0190] Those skilled in the art can understand that the writing order of each step in the above method of the specific embodiment does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0191] Based on the same inventive concept, the image rendering method in the embodiments of the present disclosure also provides an image rendering device corresponding to the image rendering method. Since the principle of solving problems of the device in the embodiments of the present disclosure is similar to the above-mentioned image rendering method, the implementation of the device can be referred to the implementation of the method, and the repeated parts will not be described here.

[0192] FIG. 15 is a schematic diagram of an image rendering device provided by the embodiments of the present disclosure. As shown in FIG. 15, the image rendering device includes a first information acquisition module 151, a second information acquisition module 152, an image rendering module 153, and a picture generation module 154.

[0193] The first information acquisition module 151 is configured to acquire real-time position information under real-time tracking of a target human eye, and determine a current movement distance of the target human eye to the display screen.

[0194] It should be noted that the first information acquisition module 151 in the embodiments of the present disclosure is configured to perform step S11 in the above-mentioned image rendering method, and the specific implementation can be referred to the related description of step S11, which will not be repeated here.

[0195] The second information acquisition module 152 is configured to acquire a to-be-displayed image. The to-be-displayed image is an image obtained by cropping a shot source image captured by a shooting device.

[0196] It should be noted that the second information acquisition module 152 in the embodiments of the present disclosure is configured to perform step S11 in the above-mentioned image rendering method, and the specific implementation can be referred to the related description of step S11, which will not be repeated here.

[0197] The first information acquisition module 151 and the second information acquisition module 152 described above can be two different data acquisition interface channels.

[0198] The image rendering module 153 is configured to render the to-be-displayed image according to the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance, to obtain the left-eye rendered image and the right-eye rendered image.

[0199] It should be noted that the image rendering module 153 in the embodiment of the present disclosure is configured to perform step S12 in the image rendering method described above, and the specific implementation can be referred to the related description of step S12, which will not be repeated here.

[0200] The picture generation module 154 is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendered image and the right-eye rendered image.

[0201] It should be noted that the picture generation module 154 in the embodiment of the present disclosure is configured to perform step S13 in the image rendering method described above, and the specific implementation can be referred to the related description of step S13, which will not be repeated here.

[0202] The image rendering device provided by the embodiment of the present disclosure can realize real-time 3D parallax rendering by tracking the real-time position information of the target human eye in real time, adjusting the parallax size of the to-be-displayed image watched by the target human eye in real time according to the first parameter information of the shooting device corresponding to the film source (to-be-displayed image), the second parameter information of the display screen, the current moving distance, and the preset human eye pupil distance, so that the target human eye will not have the above physiological discomfort and other problems at any distance, thereby improving the viewing comfort of naked-eye 3D display.

[0203] In some embodiments, the image rendering device includes a field programmable gate array (FPGA), and the FPGA is integrated with at least the image rendering module 153 and the picture generation module 154 to realize the rendering of the to-be-displayed image and the generation of the stereoscopic display picture.

[0204] In some embodiments, the shooting device includes a plurality of cameras, denoted as a first camera and a second camera; the first camera and the second camera shoot pictures in the same application scenario, the shooting positions of the first camera and the second camera are different, and the first distance between the first camera and the second camera is fixed.

[0205] The second information acquisition module 152 is specifically configured to acquire a to-be-displayed left image obtained by cropping a left-eye film source image, and a to-be-displayed right image obtained by cropping a right-eye film source image; the left-eye film source image is an image shot by the first camera, and the right-eye film source image is an image shot by the second camera; the to-be-displayed image includes the to-be-displayed left image and the to-be-displayed right image.

[0206] In some embodiments, the first parameter information comprises a first interval, a field view angle of the first camera or the second camera in a horizontal direction; and the second parameter information comprises at least a first width of the display screen in the horizontal direction.

[0207] The image rendering module 153 is specifically configured to: construct a first mapping relationship between the camera world coordinate system and the human eye world coordinate system according to the first interval and a preset human eye pupil distance; construct a second mapping relationship between a distance variable and a projection width variable according to the field view angle, the distance variable being used to represent a distance from the camera to a virtual display screen in the camera world coordinate system, and the projection width variable being used to represent a projection width of content collected by the camera on the virtual display screen in the camera world coordinate system; determine a second width according to the first width and the first mapping relationship, the second width representing a width of the virtual display screen in the horizontal direction in the camera world coordinate system; determine a first projection width according to the current moving distance, the first mapping relationship and the second mapping relationship; and process the left image to be displayed and the right image to be displayed respectively according to the second width and the first projection width, to obtain the left-eye rendered image and the right-eye rendered image.

[0208] [Rule 20.6] In some embodiments, an expression of the first mapping relationship is as follows: wherein y represents a parameter variable of the camera world coordinate system, x represents a parameter variable in the human eye world coordinate system, d represents the first interval, and D represents the preset human eye pupil distance.

[0209] [Rule 20.6] In some embodiments, an expression of the second mapping relationship is as follows: wherein v represents the projection width variable, u represents the distance variable, and FOV represents the field view angle. x

[0210] In some embodiments, the image rendering module 153 determines the first projection width according to the current moving distance, the first mapping relationship and the second mapping relationship, specifically including: determining a camera mapping distance according to the current moving distance and the first mapping relationship; and determining the first projection width according to the camera mapping distance and the second mapping relationship.

[0211] In some embodiments, the image rendering module 153 determines the first projection width according to the current moving distance, the first mapping relationship and the second mapping relationship, specifically including: determining a second projection width according to the current moving distance and the second mapping relationship; and determining the first projection width according to the second projection width and the first mapping relationship.

[0212] ​In some embodiments, the second parameter information further includes the single-view resolution related to the optical module within the display screen; the image rendering module 153 processes the left image to be displayed and the right image to be displayed according to the second width and the first projection width to obtain a left-eye rendered image and a right-eye rendered image, specifically including: determining a first retained image of the left image to be displayed and a second retained image of the right image to be displayed according to the second width and the first projection width; and processing the first retained image and the second retained image according to the single-view resolution to obtain a left-eye rendered image and a right-eye rendered image.

[0213] In some embodiments, the image rendering module 153 determines a first retained image of the left image to be displayed and a second retained image of the right image to be displayed based on the second width and the first projection width. Specifically, this includes: determining a first source ratio corresponding to the left image to be displayed and a second source ratio corresponding to the right image to be displayed according to a preset algorithm based on the second width and the first projection width; performing region planning on the left image to be displayed according to the first source ratio to obtain the first retained image of the left image to be displayed; and performing region planning on the right image to be displayed according to the second source ratio to obtain the second retained image of the left image to be displayed.

[0214] In some embodiments, both the left image to be displayed and the right image to be displayed are rectangular images; the first source ratio includes the left side increase / decrease ratio, right side increase / decrease ratio, top side increase / decrease ratio, and bottom side increase / decrease ratio corresponding to the left image to be displayed; the second source ratio includes the left side increase / decrease ratio, right side increase / decrease ratio, top side increase / decrease ratio, and bottom side increase / decrease ratio corresponding to the right image to be displayed.

[0215] [Referencing (Detailed Rules 20.6) 06.06.2025] The formula for calculating the left-side increase / decrease ratio corresponding to the left image to be displayed is as follows: The formula for calculating the increase / decrease ratio on the right side corresponding to the left image to be displayed is: The increase / decrease ratios for both the upper and lower sides of the left image to be displayed are:

[0216] [Referencing (Detailed Rules 20.6) 06.06.2025] The formula for calculating the increase / decrease ratio on the left side corresponding to the right-hand image to be displayed is: The formula for calculating the increase / decrease ratio on the right side of the image to be displayed is: The increase / decrease ratios for both the upper and lower sides of the image to be displayed are as follows:

[0217] Among them, V L1 This indicates the percentage increase or decrease on the left side of the image to be displayed; V L2 This indicates the increase / decrease ratio on the right side corresponding to the left image to be displayed; V R1 This indicates the percentage increase or decrease on the left side corresponding to the right image to be displayed; V R2The right side increase / decrease ratio corresponding to the right image to be displayed is represented by r; w represents the first projection width, and w1 represents the second width.

[0218] In some embodiments, the image rendering module 153 processes the first reserved image and the second reserved image respectively according to a single-view resolution to obtain a left-eye rendering image and a right-eye rendering image, specifically including: expanding the resolution of the first reserved image to the single-view resolution to obtain the left-eye rendering image; and expanding the resolution of the second reserved image to the single-view resolution to obtain the right-eye rendering image.

[0219] In addition, the display device provided in the embodiments of the present disclosure is also provided, as shown in FIG. 16, the display device includes the image rendering device 150 and the display screen 160, the image rendering device 150 includes the first information acquisition module 151, the second information acquisition module 152, the image rendering module 153 and the picture generation module 154.

[0220] The first information acquisition module 151 is configured to acquire real-time position information under real-time tracking of a target human eye, and determine a current moving distance of the target human eye to the display screen 160.

[0221] The second information acquisition module 152 is configured to acquire an image to be displayed; the image to be displayed is an image obtained by cropping a shot source image shot by a shooting device.

[0222] The image rendering module 153 is configured to render the image to be displayed according to first parameter information of the shooting device, second parameter information of the display screen 160, the current moving distance, and a preset human eye interpupillary distance, to obtain a left-eye rendering image and a right-eye rendering image.

[0223] The picture generation module 154 is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendering image and the right-eye rendering image.

[0224] The display screen 160 is configured to display the stereoscopic display picture.

[0225] For example, the display device includes an FPGA and a display screen electrically connected to the FPGA. The FPGA adjusts the parallax size of the image to be displayed by the target human eye in real time, realizes real-time rendering of 3D parallax, and generates a stereoscopic display picture, which is sent to the display screen for display, so that the target human eye will not have the above physiological discomfort and other problems at any distance, thereby improving the viewing comfort of naked-eye 3D display.

[0226] In some embodiments, as shown in FIG. 16, the display device further comprises an eye tracking device 161; the eye tracking device 161 is in communication with the first information acquisition module 151. Among them, the eye tracking device 161 comprises an eye tracking module 1611 and a first processing module 1612.

[0227] The eye tracking module 1611 is configured to track the target human eye in the environment where the display screen is located in real time to obtain a human face image.

[0228] Illustratively, the eye tracking module 1611 comprises at least one camera, which is used to detect the human eye features in the environment where the display screen is located in real time, and to track in real time in the case of determining the target human eye, and to obtain the human face image containing the target human eye, and to upload the human face image to the first processing module 1612.

[0229] The first processing module 1612 is configured to extract the features of the target human eye from the human face image, determine the real-time position information of the target human eye, and send the real-time position information to the first information acquisition module 151.

[0230] Illustratively, the first processing module 1612 extracts the left eye features and the right eye features of the target human eye from the human face image, determines the center position coordinates of the left eye and the center of gravity position coordinates of the right eye in the constructed human eye world coordinates, and determines the position coordinates of the centers of the left eye and the right eye as the real-time position information of the target human eye.

[0231] The first processing module 1612 is in communication with the first information acquisition module 151, and can upload the real-time position information of the target human eye to the first information acquisition module 151 in real time.

[0232] Illustratively, the first processing module 1612 can be a system on chip (SoC).

[0233] In some embodiments, the display device further comprises an eye tracking device 161. The eye tracking device 161 is configured to track the target human eye in the environment where the display screen is located in real time to obtain a human face image, and send the human face image to the SoC. The SoC is configured to determine the real-time position information of the target human eye according to the human face image, and upload the real-time position information of the target human eye to the first information acquisition module 151 in real time.

[0234] In some embodiments, the eye movement tracking module 1611 includes a first camera and a second camera. The first camera is configured to capture a face image of a person in an environment where the display screen is located in real time and upload to the first processing module 1612. The second camera is configured to capture a pupil image of a target eye in real time and upload to the first processing module 1612. The first processing module 1612 is configured to locate an eye coordinate according to the face image by a face algorithm, and obtain a pupil position coordinate of the eye coordinate according to the pupil image by a preset algorithm. The center position coordinates of the left eye pupil and the right eye pupil are determined as real-time position information of the target eye according to the pupil position coordinate, and uploaded to the first information acquisition module 151.

[0235] In some embodiments, as shown in FIG. 16, the display device further includes a video preprocessing chip 162. The video preprocessing chip 162 is configured to obtain a source image captured by a shooting device, and crop the source image according to the size ratio of the display screen 160 to obtain a to-be-displayed image, and send the to-be-displayed image to the second information acquisition module 152.

[0236] The video preprocessing chip 162 is configured to adjust the size ratio of the source image to be the same as the size ratio of the display screen. The size ratio of the display screen can be considered as the ratio of the length and width of the actual display area in the display screen, for example, the ratio of 16:9. The actual display area is the area where the subsequent stereoscopic display picture is displayed, which is also the pixel area.

[0237] For example, the size ratio of the source image is 4:3, and the size ratio of the display screen is 16:9. The video preprocessing chip can be a system on chip (SoC). The SoC can crop the source image according to the size ratio of the display screen to obtain a to-be-displayed image with the same size ratio as the display screen, i.e., 16:9. The actual cropping rule can be to retain the long side of the source image as much as possible and crop the short side of the source image.

[0238] In some embodiments, the photographing device includes a plurality of cameras, and the slice source image includes images photographed by each camera. Thus, the to-be-displayed image obtained after the slice source image is cropped also includes images cropped from images photographed by each camera. For example, the photographing device includes a first camera and a second camera, the first camera and the second camera photograph pictures in the same application scenario, the photographing positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed. The video preprocessing chip 162 is configured to acquire a left-eye slice source image photographed by the first camera and a right-eye slice source image photographed by the second camera; the slice source image includes the left-eye slice source image and the right-eye slice source image; crop the left-eye slice source image according to the size ratio of the display screen to obtain a to-be-displayed left image; and crop the right-eye slice source image according to the size ratio of the display screen to obtain a to-be-displayed right image; and the to-be-displayed image includes the to-be-displayed left image and the to-be-displayed right image.

[0239] For example, the video preprocessing chip 162 is configured to adjust the size ratio of the left-eye slice source image to be the same as the size ratio of the display screen to obtain the to-be-displayed left image, and adjust the size ratio of the right-eye slice source image to be the same as the size ratio of the display screen to obtain the to-be-displayed right image.

[0240] In addition, the naked-eye 3D display system provided in the embodiments of the present disclosure is also provided. FIG. 17 is a schematic diagram of a naked-eye 3D display system provided in the embodiments of the present disclosure. As shown in FIG. 17, the naked-eye 3D display system includes a photographing device 170 and a display device 171; the display device 171 includes a video preprocessing chip 162, an eye movement tracking device 161, an image rendering device 150, and a display screen 160; and the image rendering device 150 includes a first information acquisition module 151, a second information acquisition module 152, an image rendering module 153, and a picture generation module 154.

[0241] The eye movement tracking device 161 is configured to track a target human eye in an environment where the display screen 160 is located in real time, determine real-time position information of the target human eye, and send the real-time position information to the first information acquisition module 151.

[0242] The photographing device 170 is configured to acquire a slice source image and send the slice source image to the video preprocessing chip 162.

[0243] The video preprocessing chip 162 is configured to crop the slice source image according to the size ratio of the display screen 160 to obtain a to-be-displayed image, and send the to-be-displayed image to the second information acquisition module 152.

[0244] The first information acquisition module 151 is configured to acquire real-time position information of the target human eye tracked in real time, and determine a current moving distance of the target human eye to the display screen 160.

[0245] The second information obtaining module 152 is configured to obtain the image to be displayed.

[0246] The image rendering module 153 is configured to render the image to be displayed according to the first parameter information of the photographing device 170, the second parameter information of the display screen 160, the current moving distance, and the preset interpupillary distance, to obtain a left-eye rendered image and a right-eye rendered image.

[0247] The picture generation module 154 is configured to generate a stereoscopic display picture to be displayed according to the left-eye rendered image and the right-eye rendered image.

[0248] The display screen 160 is configured to display the stereoscopic display picture.

[0249] The naked-eye 3D display system provided by the embodiments of the present disclosure can track the real-time position information of the target human eye in real time, and adjust the parallax size of the image to be displayed for the target human eye to watch in real time according to the first parameter information of the photographing device 170, the second parameter information of the display screen 160, the current moving distance, and the preset interpupillary distance, so as to realize real-time rendering of 3D parallax, and can make the target human eye not produce the physiological discomfort and other problems at any distance, thereby improving the viewing comfort of naked-eye 3D display.

[0250] In some embodiments, as shown in FIG. 17, the image rendering device 150 is an FPGA.

[0251] In some embodiments, as shown in FIG. 17, the photographing device 170 includes a plurality of cameras, denoted as a first camera 1701 and a second camera 1702, and a second processing module 1703; the first camera 1701 and the second camera 1702 photograph pictures in the same application scenario, the photographing positions of the first camera 1701 and the second camera 1702 are different, and the first distance between the first camera 1701 and the second camera 1702 is fixed.

[0252] The first camera 1701 is configured to collect a left-eye slice source image.

[0253] The second camera 1702 is configured to collect a right-eye slice source image.

[0254] The slice source image includes the left-eye slice source image and the right-eye slice source image.

[0255] The second processing module 1703 is configured to send the left-eye slice source image and the right-eye slice source image to the video preprocessing chip 162.

[0256] The video pre-processing chip 162 is configured to crop the left eye slice source image according to the size of the display screen 160 to obtain a to-be-displayed left image, and crop the right eye slice source image according to the size of the display screen 160 to obtain a to-be-displayed right image; the to-be-displayed image includes the to-be-displayed left image and the to-be-displayed right image.

[0257] In some embodiments, as shown in FIG. 17, the video pre-processing chip 162 is a SoC chip.

[0258] FIG. 18 is a structural schematic diagram of a computer device according to an embodiment of the present disclosure. As shown in FIG. 18, the computer device according to an embodiment of the present disclosure includes one or more processors 1801, a memory 1802, and one or more I / O interfaces 1803. The memory 1802 stores one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the image rendering method according to any one of the above embodiments. The one or more I / O interfaces 1803 are connected between the processor and the memory, and are configured to implement information interaction between the processor and the memory.

[0259] The processor 1801 is a device with data processing capability, including but not limited to a central processing unit (CPU) and the like; the memory 1802 is a device with data storage capability, including but not limited to a random access memory (RAM, more specifically, SDRAM, DDR, etc.), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), and a flash memory (FLASH); the I / O interface (read-write interface) 1803 is connected between the processor 1801 and the memory 1802, and can implement information interaction between the processor 1801 and the memory 1802, including but not limited to a data bus (Bus) and the like.

[0260] In some embodiments, the processor 1801, the memory 1802, and the I / O interface 1803 are connected to each other through a bus 1804, and further connected to other components of the computer device.

[0261] According to an embodiment of the present disclosure, a computer non-transient readable storage medium is also provided. The computer non-transient readable storage medium stores a computer program, and when the program is executed by a processor, the steps in the image rendering method according to any one of the above embodiments are implemented.

[0262] In particular, the processes described above with reference to the flow charts can be implemented as a computer software program in accordance with embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a machine-readable medium, the computer program comprising program code for executing the methods illustrated by the flow charts. In such embodiments, the computer program can be downloaded and installed from a network via a communication section, and / or installed from a removable medium. When the computer program is executed by a central processing unit (CPU), the above-described functions defined in the system of the present disclosure are executed.

[0263] It should be noted that the computer non-transitory readable medium shown in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination of the above. More specific examples of the computer readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device or apparatus. In the present disclosure, the computer readable signal medium can include a data signal carried in a baseband or as a part of a carrier wave, which carries computer readable program code. Such a propagated data signal can take many forms, including but not limited to an electromagnetic signal, an optical signal or any suitable combination of the above. The computer readable signal medium can also be any computer non-transitory readable medium that can send, propagate or transfer a program for use by or in connection with an instruction execution system, device or apparatus. The program code contained on the computer non-transitory readable medium can be transmitted by any suitable medium, including but not limited to wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0264] The flow and block diagrams in the drawings represent possible architectural, functional, and operational architectures of apparatuses, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustrations, and combinations thereof, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or combinations of hardware and software.

[0265] The circuit or sub-circuit described in the embodiments of the present disclosure can be implemented by software or by hardware. The described circuit or sub-circuit can also be arranged in a processor, for example, it can be described as: a processor comprising a receiving circuit and a processing circuit, the processing module comprises a writing sub-circuit and a reading sub-circuit. Among them, the name of these circuits or sub-circuits does not constitute a limitation to the circuit or sub-circuit itself in some cases, for example, the receiving circuit can also be described as "receiving a video signal".

[0266] It can be understood that the above embodiments are only exemplary embodiments adopted for illustrating the principles of the present disclosure, and the present disclosure is not limited thereto. Various modifications and improvements can be made by those skilled in the art without departing from the spirit and essence of the present disclosure, and these modifications and improvements are also considered to be within the protection scope of the present disclosure.

Claims

1. A method of image rendering, wherein, The method comprises: acquiring an image to be displayed; acquiring real-time position information of a target human eye under real-time tracking, and determining a current moving distance of the target human eye to a display screen; the image to be displayed is an image obtained by cropping a source image captured by a shooting device; performing rendering on the image to be displayed based on first parameter information of the shooting device, second parameter information of the display screen, the current moving distance, and a preset human eye interpupillary distance, to obtain a left-eye rendered image and a right-eye rendered image; generating a stereoscopic display image to be displayed based on the left-eye rendered image and the right-eye rendered image.

2. The image rendering method of claim 1, wherein, The shooting device comprises a plurality of cameras, denoted as a first camera and a second camera; the first camera and the second camera capture images in the same application scenario, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed; the acquiring of the image to be displayed comprises: acquiring a left image to be displayed obtained by cropping a left-eye source image, and a right image to be displayed obtained by cropping a right-eye source image; the left-eye source image is an image captured by the first camera, and the right-eye source image is an image captured by the second camera; the image to be displayed comprises the left image to be displayed and the right image to be displayed.

3. The image rendering method of claim 2, wherein, The first parameter information comprises the first distance, a field view angle of the first camera or the second camera in a horizontal direction; the second parameter information at least comprises a first width of the display screen in the horizontal direction; the rendering of the image to be displayed based on the first parameter information of the shooting device, the second parameter information of the display screen, the current moving distance, and the preset human eye interpupillary distance, to obtain the left-eye rendered image and the right-eye rendered image, comprises: constructing a first mapping relationship between a camera world coordinate system and a human eye world coordinate system based on the first distance and the preset human eye interpupillary distance; constructing a second mapping relationship between a distance variable and a projection width variable based on the field view angle; the distance variable is used to represent a distance from the camera to a virtual display screen in the camera world coordinate system, and the projection width variable is used to represent a width of projection of content collected by the camera on the virtual display screen in the camera world coordinate system; determining a second width based on the first width and the first mapping relationship, the second width representing a width of the virtual display screen in the horizontal direction in the camera world coordinate system; determining a first projection width based on the current moving distance, the first mapping relationship, and the second mapping relationship; processing the left image to be displayed and the right image to be displayed based on the second width and the first projection width, to obtain the left-eye rendered image and the right-eye rendered image.

4. [Rule 20.6] The image rendering method of claim 3, wherein, An expression of the first mapping relationship is: wherein y represents a parameter variable of the camera world coordinate system; x represents a parameter variable under the human eye world coordinate system; d represents the first distance; and D represents the preset human eye pupil distance.

5. [Rule 20.6] The image rendering method of claim 3, wherein, An expression of the second mapping relationship is: wherein v represents the projection width variable, u represents the distance variable, and FOVx represents the field view angle.

6. The image rendering method of claim 3, wherein, the determining of the first projection width based on the current moving distance, the first mapping relationship, and the second mapping relationship comprises: determining a camera mapping distance based on the current moving distance and the first mapping relationship; According to the camera mapping distance and the second mapping relationship, the first projection width is determined.

7. The image rendering method of claim 3, wherein, The first projection width is determined according to the current movement distance, the first mapping relationship and the second mapping relationship, including: A second projection width is determined according to the current movement distance and the second mapping relationship; The first projection width is determined according to the second projection width and the first mapping relationship.

8. The image rendering method according to any one of claims 3 to 7, wherein, The second parameter information further includes a single view resolution of the display screen related to the optical module; The left eye rendering image and the right eye rendering image are obtained by processing the to-be-displayed left image and the to-be-displayed right image respectively according to the second width and the first projection width, including: A first reserved image of the to-be-displayed left image and a second reserved image of the to-be-displayed right image are determined according to the second width and the first projection width; The resolution of the first reserved image is adjusted to the single view resolution to obtain the left eye rendering image, and the resolution of the second reserved image is adjusted to the single view resolution to obtain the right eye rendering image.

9. The image rendering method of claim 8, wherein, The first reserved image of the to-be-displayed left image and the second reserved image of the to-be-displayed right image are determined according to the second width and the first projection width, including: According to the second width and the first projection width, a first piece source ratio corresponding to the to-be-displayed left image and a second piece source ratio corresponding to the to-be-displayed right image are determined according to a preset algorithm; According to the first piece source ratio, the to-be-displayed left image is regionally planned to obtain the first reserved image of the to-be-displayed left image; According to the second piece source ratio, the to-be-displayed right image is regionally planned to obtain the second reserved image of the to-be-displayed left image.

10. [Rule 20.6] The image rendering method of claim 9, wherein, The to-be-displayed left image and the to-be-displayed right image are both rectangular images; the first piece source ratio includes a left side increase / decrease ratio, a right side increase / decrease ratio, an upper side increase / decrease ratio and a lower side increase / decrease ratio corresponding to the to-be-displayed left image; and the second piece source ratio includes a left side increase / decrease ratio, a right side increase / decrease ratio, an upper side increase / decrease ratio and a lower side increase / decrease ratio corresponding to the to-be-displayed right image. The calculation formula of the left side increase-decrease ratio corresponding to the left image to be displayed is: The calculation formula of the right side increase-decrease ratio corresponding to the left picture to be displayed is: The upper and lower increase / decrease ratios of the left image to be displayed are both: The calculation formula of the left side increase-decrease ratio corresponding to the right picture to be displayed is: The calculation formula of the right side increase-decrease ratio corresponding to the right image to be displayed is: The upper and lower increase / decrease ratios of the right image to be displayed are both: wherein, V L1 represents the left side increase / decrease ratio corresponding to the left image to be displayed; V L2 represents the right side increase / decrease ratio corresponding to the left image to be displayed; V R1 represents the left side increase / decrease ratio corresponding to the right image to be displayed; V R2 represents the right side increase / decrease ratio corresponding to the right image to be displayed; w represents the first projection width, and w1 represents the second width.

11. An image rendering apparatus, wherein, The image rendering device includes a field programmable gate array (FPGA). The first information acquisition module is configured to acquire real-time position information under real-time tracking of a target human eye, and determine a current movement distance of the target human eye to a display screen; The second information acquisition module is configured to acquire a to-be-displayed image; The to-be-displayed image is an image obtained by cropping a piece source image captured by a shooting device; The image rendering module is configured to render the to-be-displayed image according to first parameter information of the shooting device, second parameter information of the display screen, the current movement distance and a preset human eye pupil distance, to obtain a left eye rendering image and a right eye rendering image; The picture generation module is configured to generate a to-be-displayed stereoscopic display picture according to the left eye rendering image and the right eye rendering image.

12. The image rendering apparatus of claim 11, wherein, The image rendering device includes a field programmable gate array (FPGA).

13. A display device comprising an image rendering device and a display screen; the image rendering device comprising a first information acquisition module, a second information acquisition module, an image rendering module and a picture generation module; the first information acquisition module is configured to acquire real-time position information of a target human eye under real-time tracking, and determine a current moving distance of the target human eye to the display screen; the second information acquisition module is configured to acquire a to-be-displayed image; the to-be-displayed image is an image obtained by cropping a source image captured by a shooting device; the image rendering module is configured to render the to-be-displayed image according to first parameter information of the shooting device, second parameter information of the display screen, the current moving distance, and a preset human eye interpupillary distance, to obtain a left-eye rendered image and a right-eye rendered image; the picture generation module is configured to generate a to-be-displayed stereoscopic display picture according to the left-eye rendered image and the right-eye rendered image; the display screen is configured to display the stereoscopic display picture.

14. The display device of claim 13, wherein, The display device further comprises an eye movement tracking device; the eye movement tracking device comprises an eye movement tracking module and a first processing module; the eye movement tracking module is configured to track a target human eye in an environment where the display screen is located in real time, to obtain a human face image; the first processing module is configured to extract features of the target human eye from the human face image, determine real-time position information of the target human eye, and send the real-time position information to the first information acquisition module.

15. The display device of claim 13, wherein, The display device further comprises a video preprocessing chip; the video preprocessing chip is configured to acquire a source image captured by a shooting device, crop the source image according to a size ratio of the display screen to obtain a to-be-displayed image, and send the to-be-displayed image to the second information acquisition module.

16. The display device of claim 15, wherein, The shooting device comprises a plurality of cameras, denoted as a first camera and a second camera; the first camera and the second camera capture pictures in the same application scenario, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed; the video preprocessing chip is configured to acquire a left-eye source image captured by the first camera and a right-eye source image captured by the second camera; the source images comprise the left-eye source image and the right-eye source image; the left-eye source image is cropped according to the size ratio of the display screen to obtain a to-be-displayed left image, and the right-eye source image is cropped according to the size ratio of the display screen to obtain a to-be-displayed right image; the to-be-displayed image comprises the to-be-displayed left image and the to-be-displayed right image.

17. A naked-eye 3D display system comprising a shooting device and a display device; the display device comprising an eye movement tracking device, a video preprocessing chip, an image rendering device and a display screen; the image rendering device comprising a first information acquisition module, a second information acquisition module, an image rendering module and a picture generation module; The eye tracking device is configured to track a target human eye in an environment where the display screen is located in real time, determine real-time position information of the target human eye, and send the real-time position information to the first information acquisition module; The shooting device is configured to collect a slice source image and send the slice source image to the video pre-processing chip; The video pre-processing chip is configured to crop the slice source image according to a size ratio of the display screen to obtain a to-be-displayed image, and send the to-be-displayed image to the second information acquisition module; The first information acquisition module is configured to acquire real-time position information of the target human eye tracked in real time, and determine a current moving distance of the target human eye to the display screen; The second information acquisition module is configured to acquire the to-be-displayed image; The image rendering module is configured to render the to-be-displayed image according to first parameter information of the shooting device, second parameter information of the display screen, the current moving distance, and a preset human eye pupil distance to obtain a left eye rendering image and a right eye rendering image; The picture generation module is configured to generate a to-be-displayed stereoscopic display picture according to the left eye rendering image and the right eye rendering image; The display screen is configured to display the stereoscopic display picture.

18. The naked-eye 3D display system of claim 17, wherein, The shooting device includes a plurality of cameras, denoted as a first camera and a second camera, and a second processing module; The first camera and the second camera shoot pictures in the same application scenario, the shooting positions of the first camera and the second camera are different, and a first distance between the first camera and the second camera is fixed; The first camera is configured to collect a left eye slice source image; The second camera is configured to collect a right eye slice source image; The slice source image includes the left eye slice source image and the right eye slice source image; The second processing module is configured to send the left eye slice source image and the right eye slice source image to the video pre-processing chip; The video pre-processing chip is configured to crop the left eye slice source image according to a size ratio of the display screen to obtain a to-be-displayed left image, and crop the right eye slice source image according to the size ratio of the display screen to obtain a to-be-displayed right image; The to-be-displayed image includes the to-be-displayed left image and the to-be-displayed right image.

19. A computer device, wherein, comprise: one or more processors; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the steps of the image rendering method according to any one of claims 1 to 10.

20. A computer non-transitory readable storage medium, wherein, The computer program is stored on the computer non-transitory readable storage medium and is run by the processor to perform the steps of the image rendering method according to any one of claims 1 to 10.

Images