Adaptive resolution adjustment three-dimensional display architecture

Abstract

The invention discloses a self-adaptive resolution adjustment three-dimensional display architecture, and relates to the field of image display. A processor of the display architecture reads back the EDID information, analyzes screen resolution parameters and sends the parameters to a logic reconfiguration control unit; the logic reconfiguration control unit matches the screen resolution parameters of the current read-back operation with the screen resolution parameters of the previous read-back operation, determines target viewpoint loading information of the current display equipment, and sends a reading instruction to the starting equipment; the viewpoint calculation and sampling unit receives a target viewpoint sub-pixel mapping file in the starting equipment, viewpoint calculation and view sampling are carried out according to the mapping relation between viewpoint sub-images and sub-pixels and the mapping relation, and a grating coding image is generated; and the video stream output unit receives the grating coding pattern, generates an output video stream according to the instruction and the time sequence, and displays the output video stream on the display equipment. According to the scheme, the viewpoint sampling sequence can be calculated in real time by calling the hardware resources and the mapping relation between the pre-stored viewpoint sub-images and the sub-pixels, and self-adaptive resolution adjustment and bandwidth saving are achieved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of image display, and particularly to an adaptive resolution adjustment three-dimensional display architecture. Background Art

[0002] The development of neural network technology, the continuous improvement of DIBR technology, and the rapid rise of current large models have all brought strong impetus to the field of three-dimensional display. The lenticular grating autostereoscopic 3D display device is a popular medium for realizing autostereoscopic 3D display at present. The dimming device of this display system is usually composed of multiple cylindrical lenses arranged horizontally. The directional refraction ability of the lenses is used to decode the multi-viewpoint encoded images, refract the light rays emitted by the pixels of each viewpoint to the corresponding positions in space, and complete the expression of the viewpoint content.

[0003] Currently, the real-time processing of autostereoscopic 3D video streams is developing towards high resolution, multi-viewpoint, and large viewing angle. This also brings many problems to the real-time acceleration processing on the hardware side. If the viewpoint parameters are stored in the internal high-speed RAM / ROM, taking an 8K resolution 100-viewpoint screen as an example, with the viewpoint parameters encoded in 7-bit width, the storage space required is 7680*4320*3*7 / 8≈80MB, and the capacity of the internal high-speed RAM / ROM of the chip usually cannot meet the requirements; if external storage is used and then transferred to the hardware internally for processing in real time, taking a 30fps video stream as an example, the bandwidth required for reading only the viewpoint parameters is approximately 19.47Gbps (7680*4320*3*7*30), which will seriously squeeze the bandwidth requirements for the transmission of other data and is also difficult to meet on the hardware.

[0004] Calculating the viewpoint parameters in real time on the hardware side can effectively avoid the above problems. However, there are huge differences in the hardware-side calculation and sampling processes of the viewpoint parameters for screens with different resolutions. If multiple resolutions are not compatible, a set of hardware can only be adapted to a lenticular grating screen with one resolution for three-dimensional display, lacking flexibility; if all common resolutions are compatible in a set of logic, it will not only greatly increase resource consumption but also easily lead to difficult timing convergence. Summary of the Invention

[0005] The embodiments of the present application provide an adaptive resolution adjustment three-dimensional display architecture to solve the problem of multi-resolution adaptation faced when calculating the viewpoint parameters in real time on the hardware side.

[0006] The display architecture includes a processor, a logic reconfiguration control unit, a viewpoint calculation and sampling unit, a video stream output unit, and a startup device; The processor reads back the Extended Display Identification Data (EDID) information of the external display device, parses the screen resolution parameter information of the current display device, and sends it to the logical reconfiguration control unit; The logical reconfiguration control unit matches the screen resolution parameter information obtained from the current read-back with that of the previous read-back operation, determines the target viewpoint loading information corresponding to the current display device, and sends a read instruction to the startup device; the read instruction is used to obtain the target sub-pixel mapping file corresponding to the viewpoint loading information; The viewpoint calculation and sampling unit receives the target sub-pixel mapping file in the startup device, determines the mapping relationship between the viewpoint sub-images and the sub-pixels, and performs viewpoint calculation and view sampling according to the mapping relationship to generate a raster encoded image; among them, the horizontal and vertical sampling methods for the viewpoint sub-images are determined according to the resolution and size ratio of the input and output images, and upsampling magnification or downsampling reduction operations in the horizontal and vertical directions are performed; The video stream output unit receives the raster encoded image, generates an output video stream according to the instructions and timing, and displays it on the display device.

[0007] Specifically, the historical viewpoint loading information of the previous read-back operation is stored in the logical reconfiguration control unit; When the screen resolution parameters obtained from the two read-back operations are the same, it indicates that the resolution of the external display device remains unchanged; directly determine the stored historical viewpoint loading information as the target viewpoint loading information; When the screen resolution parameters obtained from the two read-back operations are different, it indicates that the resolution of the external display device has changed; re-determine the matching target viewpoint loading information according to the actual resolution.

[0008] Specifically, when the resolution of the external display device remains unchanged, the viewpoint calculation and sampling unit uses the historical sub-pixel mapping file of the previous read-back operation as the target sub-pixel mapping file for the current read-back operation; When the resolution of the external display device changes, the logical reconfiguration control unit generates a read address and a read instruction according to the target viewpoint loading information and sends them to the startup device; the viewpoint calculation and sampling unit reads the target sub-pixel mapping file from the startup device according to the address; Among them, the startup device stores sub-pixel mapping files corresponding to different screen resolution parameters.

[0009] Specifically, the target sub-pixel mapping file records the viewpoint sorting calculation formula for the sub-pixels at the corresponding coordinates of the lenticular grating screen of the current display device under the corresponding screen resolution parameters, which is expressed as follows:

[0010]

[0011] wherein i represents the integer part of the operation result, f represents the fractional part of the operation result; N represents the corresponding view point of the current sub-pixel, and (x, y) is the coordinate of the current sub-pixel in the pixel coordinate system, is the grating tilt angle, is the offset of the leftmost grating edge relative to the origin, is the arrangement period of the sub-pixels, is the total number of view points.

[0012] Specifically, the display architecture configures a static area and a dynamic area based on DSP resources. The static area includes a logic reconfiguration control unit, a logic processing unit, and a video stream output unit, and the dynamic area includes a view point calculation and sampling unit; The processor converts the remainder and division in the view point sorting calculation formula into multiplication and subtraction to adapt to hardware processing, calls the DSP resources of the view point calculation and sampling unit for dynamic calculation, and encodes and samples the view point sub-graph according to the N value to generate a grating encoded graph.

[0013] Specifically, after the view point calculation and sampling unit obtains the target view point sub-pixel mapping file, the logic reconfiguration control unit sends a loading completion signal to the processor; Based on the loading completion signal and the total number of view points the processor updates the quantization parameters of the parameter register in the view point calculation and sampling unit; the view point calculation and sampling unit performs calculations based on the updated quantization parameters.

[0014] Specifically, the screen resolution of the output video stream is set to H*V, the vertical resolution sampling of the view point sub-graph is V / v, and the horizontal resolution sampling is H / h; Set , v = ; represents the floor function symbol, is the total number of view points; When the horizontal resolution of the original video stream is greater than H / h, horizontal downsampling is performed, otherwise horizontal upsampling is performed; when the vertical resolution of the original video stream is greater than V / v, vertical downsampling is performed, otherwise vertical upsampling is performed.

[0015] Specifically, after the view point calculation and sampling unit completes the encoding and sampling, it returns the grating encoded graph to the video stream output unit in the static area. The video stream output unit integrates the output video stream based on the timing logic and sends it to the display device.

[0016] Specifically, the static area further includes a video stream input unit. The display architecture receives the original video stream, and the video stream input unit samples based on timing instructions to obtain a number of sub-viewpoint images of the same scene from different perspectives.

[0017] Specifically, when the number of RGB images of the same scene from different perspectives obtained from the original video stream is not less than the set value, the RGB images are spliced into one or more frames of images, and the target number of sub-viewpoint images are segmented by hardware and cached; When the number of RGB images of the same scene from different perspectives obtained from the original video stream is less than the set value, the RGB images and the corresponding depth images of this scene are obtained, and the target number of sub-viewpoint images are generated by means of virtual viewpoint mapping.

[0018] The beneficial effects brought by the technical solutions provided by the embodiments of the present application at least include: 1. By performing reconfigurable compilation through real-time calculation of viewpoint parameters and upsampling (downsampling) calculation, multiple reconfigurable bitstream files with different resolutions can be stored in a startup device (such as flash), and selection is made according to the actual resolution parameters of the screen, so as to realize the dynamic adaptation of a set of programs to lenticular grating displays with different resolutions.

[0019] 2. Decouple the real-time calculation of viewpoint parameters, upsampling (downsampling) calculation from the overall architecture. The parameter calculation and sampling calculation corresponding to various resolutions share the same reconfigurable area, reducing the additional resource consumption brought by compatible different resolutions, and also being beneficial to timing convergence.

[0020] 3. Performing real-time calculation of viewpoint parameters on the hardware side reduces the storage requirements of the hardware and the bandwidth pressure of parameter transmission, enabling the system to meet the real-time processing requirements of high-resolution 3D video streams. Description of the Drawings

[0021] Figure 1 is a schematic diagram of an adaptive resolution adjustment three-dimensional display architecture provided by the embodiments of the present application; Figure 2 is a detailed schematic diagram of the adaptive resolution adjustment three-dimensional display architecture; Figure 3 is a schematic diagram of the simulation process of viewpoint parameter calculation provided by the embodiments of the present application; Figure 4 lists the lenticular grating parameters and viewpoint diagrams in a possible form; Figure 5 is a schematic diagram of the extraction of multi-view sub-pixels; Figure 6 is a schematic diagram of two schemes for obtaining multi-viewpoint sub-images provided by the present application; Figure 7Shows a schematic diagram of synthesizing a grating encoded image from an RGB image and a depth image; Figure 8 Provides two simple sampling example diagrams shown in the embodiments of the present application. Detailed implementation manners

[0022] To make the objectives, technical solutions and advantages of the present application clearer, the following will further describe in detail the embodiments of the present application with reference to the accompanying drawings.

[0023] As mentioned herein, "a plurality of" means two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after.

[0024] See Figure 1 As shown, to solve the multi-resolution adaptation problem faced when calculating viewpoint parameters in real time on the hardware side, the overall design of the adaptive resolution adjustment 3D display architecture provided by the present application is a hardware-side device and an externally connected display device. The display device includes a lenticular grating screen for displaying a naked-eye 3D effect video (figure). The hardware-side part is designed as structural units such as a core processor, a logic reconfiguration control unit, a viewpoint calculation and sampling unit, a video stream output unit, and a startup device.

[0025] The processor is the core part that controls the operation of the entire system architecture. During normal operation, it periodically reads back the extended display identification data EDID information of the externally connected display device, parses the screen resolution parameter information of the current display device therefrom, and sends it to the logic reconfiguration control unit. Since the resolution parameters of the display can be adjusted by the user, or the size and model of the externally connected display are changed, etc., the link state with the hardware side will change. Therefore, the processor needs to periodically detect the link state of the display device. After each re-link, the processor reads back the EDID information of the display and parses the resolution parameters of the display device.

[0026] The logical reconfiguration control unit is the key to the system architecture for achieving adaptive resolution adjustment. It is responsible for detecting resolution changes. Specifically, it compares the current screen resolution parameter information read back by the processor with that obtained from the previous read operation to determine the target viewpoint loading information corresponding to the current display device, and sends a read instruction to the Boot Device. The comparison of the screen resolution parameter information here is to detect whether the output image / video resolution needs to be changed. The target viewpoint loading information is a kind of index information that is temporarily stored in the logical reconfiguration control unit (register or buffer) and is used to represent the sub-pixel mapping file of the viewpoint. For example, in the form of 2K resolution for size A, 8K resolution for size B, or 1080P resolution for size A, etc. Each size resolution should have its own sub-pixel mapping file of the viewpoint because display devices with different resolutions and sizes have corresponding physical parameters, such as grating tilt angle, number of viewpoints, and offset. These information and sampling calculation rules need to be determined by the mapping file. The read instruction is issued when the logical reconfiguration control unit switches different resolution logics to obtain the target sub-pixel mapping file of the viewpoint corresponding to the loading information.

[0027] The Boot Device is a device built into the hardware side or an external hardware side, and it can also be a storage device such as flash. It stores the sub-pixel mapping files of the viewpoints under all possible sizes and resolutions, reads based on the instructions and addresses generated by the logical reconfiguration control unit, and reads back to the viewpoint calculation and sampling unit.

[0028] The viewpoint calculation and sampling unit receives the target sub-pixel mapping file of the viewpoint read back by the Boot Device, determines the mapping relationship between the sub-viewpoint and the sub-pixel therein, performs data configuration, viewpoint calculation, and view sampling according to the mapping relationship, and generates a raster encoded image. The raster encoded image is a fused image that fuses multi-viewpoint images, and a stereoscopic effect can be presented under the action of a lenticular grating.

[0029] The video stream output unit receives the raster encoded image, generates an output video stream according to the instructions and timing, and displays it on the display device. In some embodiments, the system architecture also includes a video stream input unit. This part mainly receives an externally input video source, performs image sampling processing on the video source to obtain multi-viewpoint sub-images, and the viewpoint calculation and sampling unit performs sampling operations based on the sampled multi-viewpoint sub-images.

[0030] This solution decouples the calculation and sampling logic of the viewpoint parameters with different resolutions from the overall processing flow, compiles them into dynamically reconfigurable logic, selects and loads the corresponding reconfigurable logic according to the resolution requirements of the actual display device, and realizes the adaptation to lenticular grating display devices with different resolutions. For this reason, this application can be paired with hardware computing resources to perform real-time sampling calculations according to the mapping relationship, so that there is no need to store a large amount of viewpoint parameters, and the transmission bandwidth pressure can also be reduced.

[0031] For the logic reconfiguration control unit, since it needs to have reconfigurable logic and this logic is dynamically switched according to the resolution requirement, the historical view point loading information of the previous read operation needs to be stored / cached in the logic reconfiguration control unit. When the screen resolution parameters obtained by two read operations are the same, it indicates that the resolution of the external display device remains unchanged; then the stored historical view point loading information can be directly determined as the target view point loading information. When the screen resolution parameters obtained by two read operations are different, it indicates that the resolution of the external display device has changed; at this time, the target view point loading information that matches the actual resolution is re-determined.

[0032] When the resolution of the external display device remains unchanged, that is, no switching is required, the view point calculation and sampling unit uses the historical view point sub-pixel mapping file obtained from the previous read operation as the target view point sub-pixel mapping file for the current read operation.

[0033] When the resolution of the external display device changes, that is, switching is required, the logic reconfiguration control unit generates a read address and a read instruction according to the target view point loading information and sends them to the startup device. The view point calculation and sampling unit reads the target view point sub-pixel mapping file from the startup device according to the address. After the switching is completed, the completion signal is fed back to the processor for subsequent operations. In this embodiment, a corresponding reconfigurable bit stream file can be assigned to each resolution and stored in the external startup device according to the corresponding address for reading back as needed.

[0034] This system architecture configures a static area and a dynamic area based on DSP resources or FPGA resources. The static area includes a logic reconfiguration control unit, a logic processing unit, and a video stream output unit, and the dynamic area includes a view point calculation and sampling unit. The processor converts the remainder and division of the view point sorting calculation formula into multiplication and subtraction to adapt to hardware processing, and calls the DSP resources or FPGA resources of the view point calculation and sampling unit for dynamic calculation and processing.

[0035] For the determined target view point sub-pixel mapping file. It records the view point sorting calculation formula corresponding to the sub-pixels of the cylindrical lens grating screen of the current display device under the corresponding screen resolution parameters, which is expressed as follows:

[0036]

[0037] Among them i represents the integer part of the operation result, f represents The fractional part of the operation result; N represents the corresponding viewing point of the current sub-pixel, and (x, y) is the coordinate of the current sub-pixel in the pixel coordinate system in the sub-picture of the viewing point, is the inclination angle of the grating, is the offset of the leftmost grating edge relative to the origin, is the arrangement period of the sub-pixels, is the total number of viewing points. Figure 4 Lists the cylindrical lens grating parameters and the viewing point diagram in a possible form. Xoff represents the horizontal displacement of the RGB sub-pixel (x, y) from the grating edge, and P represents the grating pitch, represents the sub-pixel width.

[0038] After the viewing point calculation and sampling unit obtains the target sub-pixel mapping file of the viewing point, the logical reconfiguration control unit will send a loading completion signal to the processor. At this time, the processor can, based on the loading completion signal and the total number of viewing points update the quantization parameters of the parameter register Para_Reg in the viewing point calculation and sampling unit, and the viewing point calculation and sampling unit performs calculations based on the updated quantization parameters. The quantization here is the process of mapping continuous values (such as and in this application are all floating-point numbers) to finite discrete values. The quantization result is sent to the viewing point parameter calculation and sampling unit through the bus, and then the N value is calculated and the sub-picture of the viewing point is encoded and sampled to generate a grating encoded picture.

[0039] In this solution, the size of n depends on and the quantization precision required by these two numbers. If the number of viewing points is relatively small, it is equivalent to a relatively large jump threshold between viewing points. At this time, n can be taken smaller; if the total number of viewing points is relatively large, the jump threshold between viewing points will be relatively small. At this time, it is necessary to improve the calculation precision, and n also needs to be taken larger. As for this power-of-2 quantization, it is because it is relatively complex and resource-consuming to implement division in hardware. The difference between 1000 and 1024 is not large, but dividing by 1000 requires division calculation; dividing by 1024 can be implemented in hardware by shifting a number to the right by 10 bits, which is fast in operation and less resource-consuming.

[0040] Because the hardware end uses hardware resources for calculation instead of reading the viewing point parameter encoding stream, and for the determined screen resolution parameters, , , , and are all fixed values, so they can be directly stored in the register. And according to formula, its value can be split into an integer i and a decimal fTwo parts, equivalent to an integer i It is also a fixed value. Through transformation, the following can be obtained:

[0041] In this way, the original formula The division and remainder operations in can be completely replaced by multiplication and subtraction. By calling DSP resources, the operation cycle can be shortened when the timing meets the requirements, and the dequantization of the operation result can also be quickly realized through shifting, which is beneficial to the timing convergence at high clock frequencies. The simulation process of the viewpoint parameter calculation is as Figure 3 shown. The two orange marked signals respectively represent the enable of the calculation and the validity of the calculation result. The viewpoint parameters of a single sub-pixel can be obtained after a delay of about 20 clock cycles, and pipelined and parallelized calculations can be achieved.

[0042] After the viewpoint calculation and sampling unit completes the encoding and sampling, it can send the raster encoded map back to the video stream output unit in the static area. The video stream output unit integrates and outputs the video stream based on the timing logic and sends it to the display device.

[0043] When the encoding result (raster encoded map) and the viewpoint calculation sub-map have the same resolution, the extraction of multi-viewpoint sub-pixels is shown as Figure 5 shown. Assume that the N values obtained by calculating the viewpoint parameters of the RGB three channels of the current pixel through the viewpoint parameter calculation module are 3, 6, and 8 respectively, indicating that the R channel of the current coordinate encoding result needs to be extracted from the R channel of the coordinates corresponding to viewpoint 3, the G channel of the current coordinate encoding result needs to be extracted from the G channel of the coordinates corresponding to viewpoint 6, and the B channel of the current coordinate encoding result needs to be extracted from the B channel of the coordinates corresponding to viewpoint 8. The process of selecting these three channel points is the process of sampling the viewpoint calculation sub-map. The three sampled points (i.e., the positions of 3, 6, and 8) are used as sub-pixels to jointly form the pixel at the i-th row and j-th column in the raster encoded map.

[0044] In some embodiments, the system may further include the process of generating the viewpoint calculation sub-map, that is Figure 2 the video stream input unit in. This unit mainly processes the input video source (original video stream) and samples to obtain multi-viewpoint sub-maps. This application provides two schemes for obtaining multi-viewpoint sub-maps. See Figure 6As shown, for an original video stream with a determined input, when the number of RGB images of different perspectives in the same scene is less than the set value, the RGB images and corresponding depth images in this scene are acquired, and the target number of virtual view sub-images are generated through virtual viewpoint mapping, that is, all the virtual view sub-images in this solution are obtained by virtual mapping of RGB and depth images. When the number of RGB images of different perspectives in the same scene is not less than the set value, the RGB images are spliced into one or more frames of images, and the target number of virtual view sub-images are segmented by hardware and cached, that is, all the virtual view sub-images in this solution are obtained by splicing and segmentation of RGB images.

[0045] Figure 7 The schematic diagram of synthesizing a raster encoded image with RGB images and depth images is shown. Although the final output video is in 3D display, it is still a frame of raster encoded images. Each raster encoded image contains virtual view sub-images of different perspectives in the same scene, and the acquisition method of multiple virtual view sub-images is arbitrary. It can come from the video stream exported and recombined by 3D modeling software, or can be generated in real time by deploying a viewpoint mapping algorithm on the hardware side. For the sampling process of virtual view sub-images, it is specifically divided into upsampling and downsampling.

[0046] Under standard conditions, the screen resolution size is designed according to international standards. That is, when the input and output resolutions are determined, if the output resolution is greater than the input resolution, the upsampling method is used; otherwise, the downsampling method is used. For example, if the input sub-image uses a 4k standard resolution (3840×2160) and the output is an 8k standard resolution (7680 ×4320), the images in this international standard size are all in a 16:9 size, and this input and output images are enlarged or reduced proportionally (7680 / 3840 = 4320 / 2160 = 2). Therefore, only the input sub-image needs to be upsampled and enlarged simultaneously in the horizontal and vertical directions. If the output is a 2k standard resolution, the input sub-image needs to be downsampled and reduced simultaneously in the horizontal and vertical directions. As for the horizontal and vertical sampling frequencies, they are set according to international standards and can be quickly set by referring to the device manual or preset mode, which will not be elaborated here in detail.

[0047] However, in some special cases where the input or output is a non-standard resolution, since the input and output resolutions are not enlarged or reduced proportionally, it is necessary to consider according to the resolutions in the horizontal and vertical directions. Based on this, this application separately provides a method for obtaining virtual view sub-images of different perspectives in the case of non-standard resolutions, that is, first set the screen resolution of the output video stream to H*V, the vertical resolution sampling of the virtual view sub-image is V / v , and the horizontal resolution sampling is H / h . Set , ; where represents the floor function symbol. Here and The values of mainly consider the universality of non-standard sizes. The size ratios are close, and the visual effect of the synthesized 3D image is more in line with the comfort of the human eye.

[0048] When the horizontal resolution of the original video stream is greater than H / h , horizontal downsampling is performed; otherwise, horizontal upsampling is performed. When the vertical resolution of the original video stream is greater than V / v , vertical downsampling is performed; otherwise, vertical upsampling is performed.

[0049] Example: Suppose there is a 3D display device with 4 viewpoints and an output resolution of 1920*1080. At this time, V = 1920, H = 1080, , v = 2, . The vertical resolution sampling is V / v = 1080 / 2 = 540, and the horizontal resolution sampling is H / h = 1920 / 2 = 960. Suppose the original resolution of the sampled sub-viewpoint image is 1024*480, then it can be determined that horizontal downsampling and vertical upsampling should be performed for the 4 viewpoints.

[0050] For the convenience of presentation, Figure 8 provides two simple sampling examples: Figure 8 In (a) of Figure 8 , it means that the resolution of the sub-viewpoint image is the same as that of the lenticular grating screen viewpoint. In this case, the sub-pixels corresponding to the coordinates in the corresponding viewpoint can be directly extracted and filled. The sampling logic part is connected to the front and back modules in a direct-through manner. Figure 8 In (b) of Figure 8 , it means that the resolution of the sub-viewpoint image is different from that of the lenticular grating resolution (taking twice the length and width as an example). The four sub-pixels with coordinates (2i - 1, 2j - 1), (2i, 2j - 1), (2i - 1, 2j), and (2i, 2j) in the encoded result are all extracted from the sub-pixel with coordinates (i, j) in the corresponding viewpoint. In this way, a simple nearest-neighbor interpolation (upsampling) can be completed for the sub-viewpoint image. The upsampling process here can be flexibly adjusted according to needs and actual hardware designs. For example, when the difference between the resolution of the sub-viewpoint image and the lenticular grating resolution is large, it is difficult for nearest-neighbor interpolation to achieve a good display effect, and other methods can also be used to perform upsampling on the sub-viewpoint image.

[0051] In summary, compared with the traditional technical solution, the technical solution of this application has the following beneficial effects: 1. By performing real-time calculation of viewpoint parameters and upsampling (downsampling) calculation for recompilation, multiple reconfigurable bit stream files with different resolutions can be stored in the startup device (such as flash), and selected according to the actual resolution parameters of the screen, realizing the dynamic adaptation of a set of programs to lenticular grating displays with different resolutions.

[0052] 2. Decouple the real-time calculation of viewpoint parameters, upsampling (downsampling) calculation from the overall architecture. The parameter calculation and sampling calculation corresponding to various resolutions reuse the same reconfigurable area, reducing the additional resource consumption caused by compatibility with different resolutions and also facilitating timing convergence.

[0053] 3. Real-time calculation of viewpoint parameters on the hardware side reduces the storage requirements of the hardware and the bandwidth pressure of parameter transfer, enabling the system to meet the real-time processing requirements for high-resolution 3D video streams.

[0054] This specific embodiment is only an interpretation of the present invention and does not limit the present invention. After reading this specification, those skilled in the art can make modifications to this embodiment without creative contributions as needed, but as long as it is within the scope of the claims of the present invention, it is protected by the patent law.

Claims

1. An adaptive resolution adjustment three-dimensional display architecture, characterized in that, The display architecture includes a processor, a logic reconfiguration control unit, a viewpoint calculation and sampling unit, a video stream output unit, and a startup device; The processor reads back the extended display identification data EDID information of the external display device, parses the screen resolution parameter information of the current display device, and sends it to the logic reconfiguration control unit; The logic reconfiguration control unit matches the screen resolution parameter information obtained from the current read-back with that obtained from the previous read-back operation, determines the target viewpoint loading information corresponding to the current display device, and sends a read instruction to the startup device; The read instruction is used to obtain the target sub-pixel mapping file of the viewpoint loading information; The viewpoint calculation and sampling unit receives the target sub-pixel mapping file of the viewpoint in the startup device, determines the mapping relationship between the sub-graphs of the viewpoint and the sub-pixels, and performs viewpoint calculation and view sampling according to the mapping relationship to generate a raster encoded image; Among them, the horizontal and vertical sampling methods of the sub-graphs of the viewpoint are determined according to the resolution and size ratio of the input and output images, and upsampling magnification or downsampling reduction operations in the horizontal and vertical directions are performed; The video stream output unit receives the raster encoded image, generates an output video stream according to the instructions and timing, and displays it on the display device.

2. The adaptive resolution adjustment three-dimensional display architecture according to claim 1, characterized in that The historical viewpoint loading information of the previous read-back operation is stored in the logic reconfiguration control unit; When the screen resolution parameters obtained from the two read-back operations are the same, it indicates that the resolution of the external display device remains unchanged; The stored historical viewpoint loading information is directly determined as the target viewpoint loading information; When the screen resolution parameters obtained from the two read-back operations are different, it indicates that the resolution of the external display device has changed; Re-determine the matching target viewpoint loading information according to the actual resolution.

3. The adaptive resolution adjustment three-dimensional display architecture according to claim 2, wherein When the resolution of the external display device remains unchanged, the viewpoint calculation and sampling unit uses the historical sub-pixel mapping file of the viewpoint obtained from the previous read-back operation as the target sub-pixel mapping file of the current read-back operation; When the resolution of the external display device changes, the logic reconfiguration control unit generates a read address and a read instruction according to the target viewpoint loading information and sends them to the startup device; The viewpoint calculation and sampling unit reads the target sub-pixel mapping file from the startup device according to the address; Among them, the startup device stores sub-pixel mapping files of viewpoints corresponding to different screen resolution parameters.

4. The adaptive resolution adjustment three-dimensional display architecture according to claim 1, characterized in that The target sub-pixel mapping file of the viewpoint records the viewpoint sorting calculation formula of the sub-pixels corresponding to the coordinates of the cylindrical lens screen of the current display device under the corresponding screen resolution parameters, which is expressed as follows: Among them, i represents the integer part of the operation result, f represents the fractional part of the operation result; N represents the corresponding viewing point of the current sub-pixel, and (x, y) is the coordinate of the current sub-pixel in the pixel coordinate system. is the grating tilt angle, is the offset of the leftmost grating edge relative to the origin, is the arrangement period of the sub-pixels, is the total number of viewing points.

5. The adaptive resolution adjustment three-dimensional display architecture according to claim 4, characterized in that, The display architecture configures a static area and a dynamic area based on DSP resources. The static area includes a logic reconfiguration control unit, a logic processing unit, and a video stream output unit, and the dynamic area includes a viewpoint calculation and sampling unit; The processor converts the modulo and division of the viewpoint sorting calculation formula into multiplication and subtraction to adapt to hardware processing, calls the DSP resources of the viewpoint calculation and sampling unit for dynamic calculation, and encodes and samples the sub-graphs of the viewpoint according to the N value to generate a raster encoded image.

6. The adaptive resolution adjustment three-dimensional display architecture according to claim 5, wherein, After the viewpoint calculation and sampling unit obtains the target sub-pixel mapping file of the viewpoint, the logic reconfiguration control unit sends a loading completion signal to the processor; The processor updates the quantization parameters of the parameter register in the view point calculation and sampling unit based on the load completion signal and the total number of view points The view point calculation and sampling unit performs calculations based on the updated quantization parameters.

7. The adaptive resolution adjustment three-dimensional display architecture according to any one of claims 1-6, characterized in that When the input and output image sizes are not in proportion, set the screen resolution of the output video stream to H*V, and sample the vertical resolution of the view sub-image as V / v , and sample the horizontal resolution as H / h ; Set , ; represents the floor symbol, is the total number of viewpoints; When the horizontal resolution of the original video stream is greater than H / h downsampling is performed horizontally; otherwise, upsampling is performed horizontally. When the vertical resolution of the original video stream is greater than V / v downsampling is performed vertically; otherwise, upsampling is performed vertically.

8. The adaptive resolution adjustment three-dimensional display architecture according to claim 6, wherein After the viewpoint calculation and sampling unit completes encoding and sampling, it sends the raster encoded map back to the video stream output unit in the static area. The video stream output unit integrates and outputs the video stream based on the timing logic and sends it to the display device.

9. The adaptive resolution adjustment three-dimensional display architecture according to claim 1, characterized in that The static area also includes a video stream input unit. The display architecture receives the original video stream, and the video stream input unit samples based on the timing instructions to obtain a number of sub-viewpoint maps of the same scene from different viewpoints.

10. The adaptive resolution adjustment three-dimensional display architecture according to claim 9, wherein When the number of RGB images of the same scene from different viewpoints obtained from the original video stream is not less than the set value, splice the RGB images into one or more frames of images, and use hardware to segment out the target number of sub-viewpoint maps and cache them; When the number of RGB images of the same scene from different viewpoints obtained from the original video stream is less than the set value, obtain the RGB images and the corresponding depth images in this scene, and generate the target number of sub-viewpoint maps through the virtual viewpoint mapping method.

Images