Micro-display system and method and display equipment

Abstract

The invention provides a micro-display system and method and display device.The micro-display system comprises an image collection module, a coordination configuration module, a host module and a display module, the image collection module collects a current image and sends the current image to the host module, and the coordination configuration module obtains a current head posture and a previous head posture; according to the present head posture and the previous head posture, a plurality of pieces of display offset information are determined, the display offset information is sequentially sent to the display module, and the display module displays the previous image and performs pixel offset and fitting according to the display offset information and a preset time interval so as to display an offset image. And in the process of displaying the multiple frames of offset images or after the display is completed, the current image is sent to the display module to be displayed. Pixel offset and fitting are directly carried out on the previous image through the display module, the offset image can be generated and displayed without occupying the interface bandwidth of the host module and the display module, motion compensation can be accurately carried out, and the problem of image blurring is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of augmented reality technology, in particular to a micro display system, method and display device. BACKGROUND

[0002] With the rapid development of augmented reality (AR) technology, various AR devices are gradually pushed into the consumer market and widely used. However, in the process of using the device, the user is prone to image distortion due to head rotation or eye movement, which has become a key bottleneck affecting the user experience of AR devices.

[0003] In the prior art, the image blur problem caused by motion is usually solved by increasing the image frame rate. Specifically, a host module generates a display image according to real-time collected motion tracking data at a high frame rate, and transmits the display image to a display module through an interface between the host module and the display module. Since the frame rate of the image is high, even if the user rotates his head or eyes, the image blur caused by motion can be reduced to some extent, and the stability of the visual picture can be improved.

[0004] Although the above scheme solves the image blur problem, the above scheme requires a very high data throughput between the host module and the display module, and a large amount of dynamically adjusted image data needs to be transmitted in real time. With the increase of image resolution, the demand for data transmission will further increase, resulting in the need for the system to match higher transmission bandwidth and working clock frequency. The above requirements may force the size of the display module to increase, the power consumption of the system to increase significantly, the battery life of the device to shorten, and the overall hardware cost to be high, which limits the popularization and experience optimization of AR products. SUMMARY

[0005] The purpose of the present application is to provide a micro display system, method and display device to solve the problem of high transmission bandwidth pressure in the prior art.

[0006] To achieve the above purpose, the technical scheme adopted by the present application is as follows: In a first aspect, the present application provides a micro display system, which comprises an image acquisition module, a coordination configuration module, a host module and a display module. The image acquisition module acquires a current image and sends the current image to the host module. The coordination configuration module obtains a current head posture and a previous head posture of a user, the current head posture being the head posture of the user when the image acquisition module acquires the current image, and the previous head posture being the head posture of the user when the image acquisition module acquires a previous image of the current image. The coordination configuration module determines a plurality of display offset information according to the current head posture and the previous head posture, each of the display offset information being used to indicate an offset amount of a pixel displayed in the display module; and the coordination configuration module sequentially sends the plurality of display offset information to the display module. The display module displays the previous image, and the display module performs pixel offset and fitting according to the display offset information and a preset time interval to display a plurality of offset images after the previous image; and the host module sends the current image to the display module for display after the display module displays the plurality of offset images or after the display of the plurality of offset images is completed.

[0007] Optionally, the determining of the plurality of display offset information according to the current head posture and the previous head posture comprises: determining a head deflection angle according to the current head posture and the previous head posture; determining the plurality of display offset information according to the head deflection angle.

[0008] Optionally, the image acquisition module also sends the current image to the coordination configuration module. The determining of the plurality of display offset information according to the head deflection angle comprises: determining a plurality of image regions in the current image according to depth information of the current image; determining a target deflection angle corresponding to each of the image regions according to the head deflection angle and the depth information of each of the image regions; determining the plurality of display offset information according to the target deflection angle corresponding to each of the image regions and unit mapping information, the unit mapping information being used to indicate a pixel offset amount corresponding to a unit deflection angle in the display module.

[0009] Optionally, the determining of the plurality of display offset information according to the target deflection angle corresponding to each of the image regions and the unit mapping information comprises: determining a plurality of display offset amounts corresponding to each of the image regions according to the target deflection angle corresponding to each of the image regions and the unit mapping information; determining a display region corresponding to each of the image regions according to a corresponding relationship between each of the image regions and each display region in a display array of the display module, and taking the plurality of display offset amounts corresponding to each of the image regions as a plurality of display offset amounts of the corresponding display region, the display offset amount of the display region comprising an offset amount of each pixel in the display region.

[0010] Optionally, the determining the plurality of display offset information according to the head deflection angle comprises: If the head deflection angle is greater than a preset angle, the plurality of display offset information is determined according to the head deflection angle.

[0011] Optionally, the display module comprises at least a display array and a shared cache space module. The pixel offsetting and fitting according to the display offset information and a preset time interval comprises: According to the display offset information, at least one group of to-be-fitted pixel positions in the display array and a plurality of groups of to-be-cached pixel positions arranged in sequence are determined. Steps A-C are performed according to the preset time interval: A, caching the pixels in the current group of to-be-cached pixel positions to the shared cache space module; B, assigning the pixels stored in the shared cache space module to a group of target pixel positions in the display array according to the display offset information; C, fitting the pixels at each group of to-be-fitted pixel positions according to the current pixels in the display array, and assigning the fitted pixels to the groups of to-be-fitted pixel positions.

[0012] Optionally, the display module further comprises a timing control module. The timing control module performs steps A-C according to the preset time interval.

[0013] Optionally, the micro display system is any one of the following types: liquid crystal type, light emitting diode type, organic light emitting diode type, micro light emitting diode type, and quantum dot light emitting diode type.

[0014] In a second aspect, the present application provides a micro display method applied to the micro display system of the first aspect. The method comprises: The image acquisition module acquires a current image and sends the current image to the host module. The coordination configuration module obtains a current head posture and a previous head posture of a user, the current head posture being the head posture of the user when the image acquisition module acquires the current image, and the previous head posture being the head posture of the user when the image acquisition module acquires a previous image of the current image. The coordination configuration module determines a plurality of display offset information according to the current head posture and the previous head posture, each of the display offset information being used to indicate an offset amount of a pixel displayed in the display module; and the coordination configuration module sequentially sends the plurality of display offset information to the display module. displaying the previous image in the display module, the display module performing pixel offset and fitting according to the display offset information and a preset time interval to display multiple offset images after the previous image, and the host module sending the current image to the display module for display after the display module displays the multiple offset images or after the display module finishes displaying the multiple offset images.

[0015] In a third aspect, the present application provides a display device comprising the micro display system of the first aspect.

[0016] The present application has the following beneficial effects: the image acquisition module acquires a current image and sends the current image to the host module, the coordination configuration module acquires a current head posture and a previous head posture of a user, the coordination configuration module determines multiple display offset information according to the current head posture and the previous head posture, the coordination configuration module sends the multiple display offset information to the display module in sequence, the previous image is displayed in the display module, the display module performs pixel offset and fitting according to the display offset information and a preset time interval to display multiple offset images after the previous image, and the host module sends the current image to the display module for display after the display module displays the multiple offset images or after the display module finishes displaying the multiple offset images. In this embodiment, the display module directly performs pixel offset and fitting on the previous image to obtain multiple offset images, which has a simple implementation, and the generation and display of the offset images do not need to occupy the interface bandwidth of the host module and the display module, so that motion compensation can be accurately performed, the image blur problem caused by the rapid rotation of the user's head is improved, the dizziness and action mismatch problems of the user caused by the image blur problem are reduced, and the immersive experience of the user is enhanced. In addition, the interface bandwidth pressure is low, so that the system can be small in size, low in power consumption, high in endurance and low in cost. BRIEF DESCRIPTION OF DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.

[0018] Figure 1 is a use scenario diagram of a micro display system provided by the embodiments of the present application; Figure 2 is a structural diagram of a micro display system provided by the embodiments of the present application; Figure 3 is a diagram of an offset direction provided by the embodiments of the present application; Figure 4is a display timing diagram of a display module provided by an embodiment of the present application; Figure 5 is a schematic diagram of a pixel before offset provided by an embodiment of the present application; Figure 6 is a schematic diagram of a pixel after offset provided by an embodiment of the present application; Figure 7 is another schematic diagram of a pixel before offset provided by an embodiment of the present application; Figure 8 is another schematic diagram of a pixel after offset provided by an embodiment of the present application; Figure 9 is a structural schematic diagram of another micro display system provided by an embodiment of the present application; Figure 10 is a schematic diagram of pixel offset storage provided by an embodiment of the present application; Figure 11 is a timing control module timing control schematic diagram provided by an embodiment of the present application; Figure 12 is a flowchart of a micro display method provided by an embodiment of the present application; Figure 13 is a flowchart of another micro display method provided by an embodiment of the present application. DETAILED DESCRIPTION

[0019] To make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. It should be understood that the drawings in the present application only serve the purpose of description and illustration, and are not used to limit the scope of protection of the present application. In addition, it should be understood that the schematic drawings are not drawn according to the actual proportions. The flowchart shows the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowchart can not be implemented in sequence, and the steps without logical context relationship can be reversed in sequence or implemented simultaneously. In addition, one or more other operations can be added to the flowchart or removed from the flowchart under the guidance of the content of the present application by those skilled in the art.

[0020] In addition, the described embodiments are only some of the embodiments of the present application, not all the embodiments. The components of the embodiments of the present application described and shown in the drawings herein can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the claimed present application, but only represents selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0021] It should be noted that the term "comprising" will be used in the embodiments of the present application to specify the presence of the features that follow, but not to exclude the addition of other features.

[0022] In the prior art, the host module generates a display image according to the real-time collected motion tracking data at a high frame rate, and transmits the display image to the display module through an interface, so that the display module displays a clear image. However, the method in the prior art has a very high requirement on the data throughput between the host module and the display module. With the increase of image resolution, the system needs to match a higher transmission bandwidth and working clock frequency. This will lead to the increase of the size of the display module, the increase of the power consumption of the system, the poor endurance of the device, and the increase of the hardware cost.

[0023] Based on this, the present application provides a micro display system. In the system, the image acquisition module is used to acquire a current image, the coordination configuration module is used to determine a plurality of display offset information according to a current head posture and a previous head posture of a user, and the display offset information is sequentially sent to the display module. The display module performs pixel offset and fitting on the previous image according to the display offset information and a preset time interval after displaying the previous image, so as to display a plurality of offset images after the previous image, and display the current image after sequentially displaying the plurality of offset images or in the display process. In the present application, the display module directly performs pixel offset and fitting on the previous image according to the display offset information, without occupying the interface bandwidth of the host module and the display module, so as to improve the image blur problem caused by the rapid rotation of the user's head, thereby reducing the dizziness and action mismatch problems of the user caused by the image blur problem, and enhancing the immersive experience of the user. Moreover, the low interface bandwidth pressure can ensure that the system has small size, low power consumption, high endurance and low cost.

[0024] Reference Figure 1 The use scenario of the micro display system is introduced. The micro display system can be applied to the fields of virtual reality (VR), augmented reality (AR) and mixed reality (MR), to realize the interaction or fusion of virtual and reality. Among them, Figure 1 is a use scenario diagram of a micro display system provided by an embodiment of the present application. As Figure 1 shown, the micro display system can acquire the head posture of a user. When the user's head rotates, the micro display system adjusts the image displayed to the user according to the head posture of the user.

[0025] Next, reference is made to Figure 2 The structure of the micro display system is introduced. Among them, Figure 2 is a structure diagram of a micro display system provided by an embodiment of the present application. As Figure 2As shown, the micro display system comprises an image acquisition module 10, a coordination configuration module 20, a host module 30 and a display module 40.

[0026] The image acquisition module 10 is connected to one end of the coordination configuration module 20 and one end of the host module 30, and the display module 40 is connected to the other end of the coordination configuration module 20 and the other end of the host module 30.

[0027] Optionally, the image acquisition module 10, the coordination configuration module 20, the host module 30 and the display module 40 can be integrated in a head-mounted display device. The user wears the display device and moves the display module 40 by rotating the head to move the picture displayed by the display module 40.

[0028] Optionally, the image acquisition module 10, the coordination configuration module 20 and the display module 40 can be integrated in a head-mounted display device, and the host module 30 can be a separate personal computer (PC) host, which is wirelessly connected to the image acquisition module 10 and the display module 40.

[0029] Next, the specific execution steps of the micro display system are introduced.

[0030] Optionally, the image acquisition module 10 acquires the current image and sends the current image to the host module 30.

[0031] Optionally, the image acquisition module 10 can be a high-definition camera or the like, which is used to acquire the image of the real physical environment around the user. The image acquisition module 10 can be located close to the user's eyes.

[0032] Optionally, after the image acquisition module 10 sends the current image to the host module 30, the host module 30 can analyze the current image according to a preset algorithm and integrate a virtual scene into the current image. The image acquisition module 10 can also analyze the changes of the image feature points according to the preset algorithm, calculate the real-time position and posture of the user's head, and thus adjust the perspective of the virtual scene. For example, if the user turns the head to the left, the host module 30 judges the turning angle according to the acquired current image, and synchronously turns the virtual picture to the left according to the turning angle, so that the virtual picture seen by the user is consistent with the head movement.

[0033] Optionally, the coordination configuration module 20 acquires the current head posture of the user and the previous head posture. The current head posture is the head posture of the user when the image acquisition module 10 acquires the current image, and the previous head posture is the head posture of the user when the image acquisition module 10 acquires the previous image.

[0034] Optionally, the coordination configuration module 20 can comprise a posture sensor, such as an Inertial Measurement Unit (IMU), for monitoring the head posture in real time. The head posture can comprise a yaw angle, a pitch angle and a roll angle, and comprise a time stamp of the head posture.

[0035] Specifically, the image acquisition module 10 can acquire images at a preset acquisition interval, and the coordination matching module can acquire the head posture of the user at the same acquisition interval, and take the head posture with the same time stamp as that of the current image as the current head posture, and take the head posture with the same time stamp as that of the previous image of the current image as the previous head posture. The previous image of the current image is the image acquired by the image acquisition module 10 one acquisition interval before the current image.

[0036] Optionally, the coordination configuration module 20 determines a plurality of display offset information according to the current head posture and the previous head posture, and each display offset information is used to indicate the offset amount of the pixel displayed on the display module 40. The coordination configuration module 20 sends the plurality of display offset information to the display module 40 in sequence.

[0037] As an optional implementation, the coordination configuration module 20 can determine the head deflection angle of the user according to the current head posture and the previous head posture, and then determine a plurality of display deflection information according to the head deflection angle. The head deflection angle is the posture deviation value between the current head posture and the previous head posture.

[0038] When the image acquisition module acquires the current image, the current image is sent to the host module, and the host module needs to process the current image, which will have a certain time delay. Therefore, when the image acquisition module acquires the current image, the display module displays the previous image, and after a certain time, a plurality of offset images are displayed based on the display offset information, until the host module processes the current image and sends it to the display module, and the display module displays the current image. Each display offset information is used to indicate the offset amount of the pixel displayed on the display module 40. For example, if the pixel displayed on the display module 40 needs to be offset 4 times, the coordination configuration module 20 determines 4 display offset information according to the current head posture and the previous head posture. The number of display offset information can be determined according to the preset clarity parameter. The clarity parameter is the picture clarity parameter indicated by the user. If the preset clarity parameter is higher, the number of display offset information is more, and the number of offset images displayed by the display module 40 is more. If the clarity parameter is lower, the number of display offset information is less, and the number of offset images displayed by the display module 40 is less. Optionally, each display offset information can be the same.

[0039] It is worth mentioning that the display offset information can include an offset and an offset direction, and the offset direction can be row-wise offset or column-wise offset. The positive or negative value of the offset can represent row-wise upward or downward offset, or column-wise left or right offset. In addition, the embodiment is not limited to the offset direction, Figure 3 is a schematic diagram of an offset direction provided by the embodiment of the present application. As shown in Figure 3 , the pixels can be offset left, right, down, up, left-up, right-up, left-down and right-down.

[0040] Optionally, the coordination configuration module 20 can directly send the plurality of display offset information to the display module 40 in sequence when generating the plurality of display offset information, or can send the plurality of display offset information to the display module 40 in sequence according to a preset time interval.

[0041] Optionally, the display module 40 displays a previous image, and the display module 40 performs pixel offset and fitting according to the display offset information and a preset time interval to display a plurality of offset images after the previous image. After the display module 40 displays the plurality of offset images or after completing the display of the plurality of offset images, the host module 30 sends a current image to the display module 40 for display.

[0042] Optionally, the previous image displayed by the display module 40 can be an image processed and sent by the host module 30. When the host module 30 processes the current image and sends it to the display module 40, the display module 40 displays the current image.

[0043] Specifically, between the display of the previous image and the current image by the display module 40, a plurality of offset images can be displayed according to a preset time interval. The first offset image is obtained by performing pixel offset and fitting based on the previous image, and the offset images after the first offset image are obtained by performing pixel offset and fitting based on the previous offset image. The number of offset images corresponds to the number of display offset information. The number of offset images displayed between each image sent by the host module 30 can be different.

[0044] Optionally, pixel offset refers to replacing the pixels at the to-be-offset position to the target position. After the display module 40 offsets the pixels in the image according to the display offset information, there is no pixel at the to-be-fitted pixel position. The display module 40 can use fitting to fit the pixels at the to-be-fitted pixel position according to the current offset image.

[0045] Optionally, the preset time interval can be the time interval at which two adjacent offset images start to be displayed. The display duration of each offset image can be a preset offset display duration, and the display duration of the image sent by the host module 30 can be a preset original display duration. The original display duration can be greater than the offset display duration.

[0046] Exemplarily, Figure 4 is a display timing diagram of a display module 40. As shown in the figure, Figure 4 The display module 40 can also display 6 frames of offset images between the previous image and the current image. The display time of the previous image and the display time of the current image are greater than the display time of each offset image. The display module 40 can display 4 frames of offset images between the previous image and the current image.

[0047] As an optional implementation, the display module 40 monitors whether the host module 30 sends the current image in real time during the display of the multiple frames of offset images. If not, the pixel offset and fitting are continued in sequence until the last offset image is displayed. If yes, the current image is directly displayed to ensure the authenticity and integrity of the display of the display module 40.

[0048] In this embodiment, the image acquisition module acquires the current image and sends the current image to the host module, the coordination configuration module obtains the current head posture and the previous head posture of the user, the coordination configuration module determines multiple display offset information according to the current head posture and the previous head posture, the coordination configuration module sends the multiple display offset information to the display module in sequence, the display module displays the previous image, and the display module performs pixel offset and fitting according to the display offset information and the preset time interval to display multiple frames of offset images after the previous image. During the display of the multiple frames of offset images by the display module or after the display of the multiple frames of offset images is completed, the host module sends the current image to the display module for display. In this embodiment, the display module directly performs pixel offset and fitting on the previous image to obtain multiple offset images, which has a simple implementation, and the generation and display of the offset images do not need to occupy the interface bandwidth of the host module and the display module, so that motion compensation can be accurately performed, the image blur problem caused by the rapid rotation of the user's head is improved, and the dizziness and action mismatch problems of the user caused by the image blur problem are reduced, thereby enhancing the immersive experience of the user. Moreover, the interface bandwidth pressure is low, so that the system can be small in size, low in power consumption, high in endurance, and low in cost.

[0049] Next, the specific implementation process of the coordination configuration module 20 determining multiple display offset information according to the current head posture and the previous head posture is introduced.

[0050] Optionally, the head deflection angle is determined according to the current head posture and the previous head posture.

[0051] As an optional implementation, the coordination configuration module 20 calculates the difference between the yaw angle, the pitch angle and the roll angle in the current head posture and the yaw angle, the pitch angle and the roll angle in the previous head posture to determine the head deflection angle. Specifically, the difference between the yaw angle in the current head posture and the yaw angle in the previous head posture is taken as the yaw angle difference, the difference between the pitch angle in the current head posture and the pitch angle in the previous head posture is taken as the pitch angle difference, and the difference between the roll angle in the current head posture and the roll angle in the previous head posture is taken as the roll angle difference. The yaw angle difference, the pitch angle difference and the roll angle difference are taken as the head deflection angle.

[0052] Optionally, the plurality of display offset information is determined according to the head deflection angle.

[0053] As an optional implementation, the coordination configuration module 20 can determine the plurality of display offset information according to the head deflection angle, the predetermined number of offset images and unit mapping information. The unit mapping information indicates the pixel offset amount corresponding to a unit deflection angle in the display module 40, for example, the pixel offset amount corresponding to a one-degree left deflection in the display module 40.

[0054] Specifically, the quotient of the head deflection angle and the number of offset images is taken as a single offset angle, and the product of the single offset angle and the unit mapping information is taken as the display offset information corresponding to one offset image.

[0055] In this embodiment, the head deflection angle is determined according to the current head posture and the previous head posture, and the plurality of display offset information is determined according to the head deflection angle, so that the pixel offset amount of each offset image in the display module can be accurately determined based on the head rotation of the user.

[0056] As an optional implementation, the coordination configuration module 20 can determine the plurality of display offset information according to the current head posture and the previous head posture, and the offset amount of the pixel to be offset in one display offset information is consistent.

[0057] As another optional implementation, the image acquisition module 10 also sends the current image to the coordination configuration module 20.

[0058] It should be understood that in reality, when a person observes objects at different distances, the visual angle offset amount caused by head rotation is different. Figure 5 is a schematic diagram before pixel offset provided by an embodiment of the present application, Figure 6 is a schematic diagram after pixel offset provided by an embodiment of the present application, Figure 7 is another schematic diagram before pixel offset provided by an embodiment of the present application, Figure 8 is another schematic diagram after pixel offset provided by an embodiment of the present application. As Figure 5 ,Figure 6 、 Figure 7 and Figure 8 As shown in FIG. 1, FIG. 2 and FIG. 3, when observing the object from the visual center, the shift angle of the near target is larger, and the shift angle of the far target is smaller, so the shift amount of the pixel displayed in the display module 40 corresponding to the area of different depth of field may be different. From the shift of the object in FIG. 1, the horizontal deflection angle of the near target in the adjacent deflected image is a, and the horizontal deflection angle of the far target in the adjacent deflected image is β, a is greater than β. From the shift of the object in FIG. 2, the horizontal deflection angle of the near target in the adjacent deflected image is θ, and the horizontal deflection angle of the far target in the adjacent deflected image is φ, θ is greater than φ. Figure 5 to Figure 6 Figure 7 to Figure 8 As shown in FIG. 1, FIG. 2 and FIG. 3, when observing the object from the visual center, the shift angle of the near target is larger, and the shift angle of the far target is smaller, so the shift amount of the pixel displayed in the display module 40 corresponding to the area of different depth of field may be different. From the shift of the object in FIG. 1, the horizontal deflection angle of the near target in the adjacent deflected image is a, and the horizontal deflection angle of the far target in the adjacent deflected image is β, a is greater than β. From the shift of the object in FIG. 2, the horizontal deflection angle of the near target in the adjacent deflected image is θ, and the horizontal deflection angle of the far target in the adjacent deflected image is φ, θ is greater than φ.

[0059] Based on this, in order to ensure the realism of the display picture, the coordination configuration module 20 can perform the following steps when determining the plurality of display shift information according to the head deflection angle: Optionally, the plurality of image areas in the current image are determined according to the depth of field information of the current image.

[0060] The depth of field information refers to the distance information of the scene object corresponding to each pixel or area in the image, and reflects the distance of different objects in the scene.

[0061] As an optional implementation, the coordination configuration module 20 can determine the depth of field information of the current image based on perspective and geometric constraint relationship. Specifically, the depth of field information of the current image is determined by calculating the plane equation through parallel lines and vanishing points, and combining the position of the pixel on the plane, by using the geometric structure in the scene. As another optional implementation, the depth of field information of the current image can be determined based on a deep learning method. Specifically, the current image can be input into a pre-trained image recognition model, and the image recognition model outputs the depth of field information of each pixel.

[0062] Optionally, after the depth of field information of the current image is determined, the current image can be divided into a plurality of image areas by clustering or threshold segmentation method. As an optional implementation, the threshold range can be set according to the depth of field information of the pixel, and the pixels falling within the same range are divided into the same image area. As another optional implementation, the pixels can be regarded as feature points, and the pixels with similar features are automatically classified into a plurality of categories by algorithm, and each category constitutes an image area.

[0063] Optionally, the target deflection angle corresponding to each image area is determined according to the head deflection angle and the depth of field information of each image area.

[0064] ​As an optional implementation, the target deflection angle corresponding to each image region can be determined based on the defocus information of each image region and the reference defocus information, with reference to the head deflection angle. For example, if the head deflection angle is θ, the defocus information of an image region is Z, and the reference defocus information is Z0, the quotient of the defocus information Z and the reference defocus information Z0 is multiplied by the head deflection angle θ to obtain the target deflection angle of the image region.

[0065] Optionally, the plurality of display offset information is determined based on the target deflection angle corresponding to each image region and unit mapping information, which is used to indicate the pixel offset corresponding to a unit deflection angle in the display module 40.

[0066] Optionally, the display offset information corresponding to each image region is determined based on the target deflection angle corresponding to each image region, unit mapping information, and the number of offset images. Specifically, the quotient of the target deflection angle corresponding to each image region and the number of offset images is calculated, and then the product of the calculated quotient and the unit mapping information is taken as the display offset information corresponding to each image region.

[0067] The unit mapping information can include horizontal unit mapping information and vertical unit mapping information. Specifically, the unit mapping information is determined based on a preset image resolution, a horizontal field of view angle, and a vertical field of view angle. Specifically, the quotient of the horizontal resolution in the image resolution and the horizontal field of view angle is taken as the horizontal unit mapping information, and the quotient of the vertical resolution in the image resolution and the vertical field of view angle is taken as the vertical unit mapping information. For example, if the image resolution is 1920x1080, the horizontal field of view angle is 60 degrees, and the vertical field of view angle is 45 degrees, the horizontal unit mapping information is 32, and the vertical unit mapping information is 24.

[0068] In this embodiment, the coordination configuration module determines a plurality of image regions in the current image based on the defocus information of the current image, determines the target deflection angle corresponding to each image region based on the head deflection angle and the defocus information of each image region, and determines a plurality of display offset information based on the target deflection angle and unit mapping information. In this embodiment, the display offset information is determined by analyzing different image regions with different defocus, so that the generated offset image is more realistic, thereby improving the user experience.

[0069] Further, the coordination configuration module 20 determines a plurality of display offset information based on the target deflection angle corresponding to each image region and unit mapping information as follows: Optionally, the plurality of display offset information corresponding to each image region is determined based on the target deflection angle corresponding to each image region and unit mapping information.

[0070] Optionally, the image regions are different, the target deflection angles are different, and therefore the display offset amounts corresponding to the image regions are different. Illustratively, the target deflection angle of the image region of the close-up view is greater than the target deflection angle of the image region of the distant view, and therefore the multiple display offset amounts corresponding to the image region of the close-up view are greater than the multiple display offset amounts corresponding to the image region of the distant view.

[0071] Optionally, according to the correspondence between the image regions and the display regions in the display array of the display module 40, the display regions corresponding to the image regions are determined, and the multiple display offset amounts corresponding to the image regions are taken as the multiple display offset amounts of the display regions. The display offset amount of a display region includes the offset amount of each pixel in the display region.

[0072] Illustratively, if an image region is at the top-left corner in a current image, the display region corresponding to the top-left corner in the display array of the display module 40 is determined for the image region. The display offset amount of the image region is the display offset amount of the display region at the top-left corner in the display array.

[0073] The display array of the display module 40 can be an integrated display module composed of multiple independent pixel display blocks arranged in rows and columns, and each pixel display block displays a corresponding pixel point.

[0074] In this embodiment, the display regions corresponding to the image regions are determined, and the display offset amounts corresponding to the image regions are taken as the multiple display offset amounts of the display regions, so that the display module can offset and fit the pixels of different display regions based on the depth-of-field information of different regions in the image, to accurately perform motion compensation and improve the user experience.

[0075] Next, a specific implementation method of the coordination configuration module 20 for determining the multiple display offset information according to the head deflection angle is introduced. The following method is an illustration of determining the multiple display offset information, and the method can be applied to the above-mentioned implementation manner without considering the depth-of-field information in the image and the implementation manner considering the depth-of-field information in the image.

[0076] Optionally, if the head deflection angle is greater than a preset angle, the multiple display offset information is determined according to the head deflection angle.

[0077] Optionally, a preset angle is set in advance. If the head deflection angle is less than the preset angle, it indicates that the head deflection angle is very small, and motion compensation is not needed by generating an offset image. If the head deflection angle is greater than the preset angle, motion compensation is needed by generating an offset image.

[0078] Optionally, the plurality of display offset information is determined according to the head deflection angle, the number of offset images and the unit mapping information. Specifically, the quotient of the head deflection angle and the number of offset images is calculated, and the product of the quotient and the unit mapping information is taken as one display offset information.

[0079] For example, if the head deflection angle is 30 degrees horizontally to the left, the number of offset images is 5, and the vertical unit mapping information in the unit mapping information is 24, then one display offset information is 144.

[0080] As an optional implementation, the head deflection angle and the preset angle are not compared when determining the display offset information, but after the plurality of display offset information is calculated, the display module 40 compares the display offset information with the preset offset threshold, and if the display offset information is less than the preset offset threshold, the display module 40 does not offset and fit each pixel in the display image.

[0081] In this embodiment, by not performing pixel offset and fitting for the head portrait offset angle that is not greater than the preset angle, the calculation amount is reduced.

[0082] Next, the step of the display module 40 performing pixel offset and fitting according to the display offset information and the preset time interval is introduced. Optionally, Figure 9 is another structure diagram of a micro display system provided by the embodiment of the present application. As shown in Figure 9 The display module 40 at least includes a display array 401 and a shared cache space module 402.

[0083] The display array 401 is connected with the shared cache space module 402 and the host module 30 respectively. The display array 401 can include a plurality of pixel R circuits, pixel G circuits and pixel B circuits, and can also include a row gate unit and a column gate unit, as shown in Figure 9 Each pixel circuit can be controlled through the row gate unit and the column gate unit. The row gate unit is connected with each row of pixel circuits through a switch to control the on-off of each pixel circuit. The shared cache space module 404 can store the pixels in the display array 401 in the form of digital information or analog voltage information.

[0084] Optionally, according to the display offset information, at least one group of to-be-fitted pixel positions in the display array 401 and a plurality of groups of to-be-cached pixel positions arranged in sequence are determined.

[0085] The to-be-fitted pixel position is a position vacated after the pixel at the to-be-cached pixel position is moved. The to-be-fitted pixel position and the to-be-cached pixel position can coincide. For example, if the display array 401 is a 3*3 pixel array and the display offset information indicates that the display array 401 is moved up by one row, the to-be-cached pixel positions are the second and third rows, and the to-be-fitted pixel position is the third row.

[0086] It should be noted that the to-be-fitted pixel position and the to-be-cached pixel position can be determined according to the display region corresponding to the image region corresponding to different depth information. For example, if the display array 401 is a 3*3 pixel array, the positions of (1, 1), (1, 2), (2, 1), and (2, 2) are positions corresponding to a first display image, and the other positions are positions corresponding to a second display image, and the depth information corresponding to the first display image and the second display image is different. In the display offset information, the pixel offset value corresponding to the first display image is to move up by one row, and the pixel offset value corresponding to the second display image is 0. Therefore, in the current position corresponding to the position of the first display image, the positions of (2, 1) and (2, 2) can be used as the to-be-cached pixel positions, and the two positions are used as the to-be-fitted pixel positions.

[0087] It should be noted that the number of positions in each group of to-be-cached pixel positions is related to the shared cache space module 402. The to-be-cached pixel position can be a few pixel positions or a few rows of pixel positions. If the shared cache space module 402 is large, the number of positions in each group of to-be-cached pixel positions is large. If the shared cache space module 402 is small, the number of positions in each group of to-be-cached pixel positions is small.

[0088] Next, the following steps are performed at a preset time interval: Optionally, the pixels in the current group of to-be-cached pixel positions are cached to the shared cache space module 402.

[0089] Optionally, in the first offset, the to-be-cached pixel position with the highest priority in the plurality of groups of to-be-cached pixel positions is used as the current group of to-be-cached pixel positions. For example, if the display array 401 is a 3*3 pixel array and the display offset information indicates that the display array 401 is moved up by one row, the current group of to-be-cached pixel positions in the first offset is

[0090] In the subsequent offset process, the to-be-cached pixel positions after the last current group of to-be-cached pixel positions are sequentially used as the current group of to-be-cached pixel positions in the order.

[0091] Optionally, the pixels stored in the shared cache space module 402 are assigned to a group of target pixel positions in the display array 401 according to the display offset information.

[0092] Optionally, the target pixel position can be calculated according to the current group of to-be-cached pixel positions and the display offset information. For example, if one of the current group of to-be-cached pixel positions is (1, 1) and the display offset information indicates that each pixel is offset by one row downwards, the target pixel position corresponding to the pixel position is (2, 1). Optionally, the display module 40 further comprises a row address replacement module and a column address replacement module. Specifically, the timing control module 403 is connected to the shared cache space module 402 through the column address replacement module and is connected to the display array through the row address replacement module. The row address replacement module and the column address replacement module are used to determine the target pixel position according to the display offset information and the current group of to-be-cached pixel positions.

[0093] For example, Figure 10 is a schematic diagram of pixel offset storage provided by an embodiment of the present application. As shown in Figure 10 , the position of the physical behavior pixel displayed in the display array 401, and the position of the original behavior pixel corresponding to the previous image. If the display offset information indicates that each pixel is offset by a row upwards, before offsetting the pixels in the current group of to-be-cached pixel positions, physical row 1 corresponds to original row 1, physical row 2 corresponds to original row 2, physical row a corresponds to original row a, physical row a+1 corresponds to original row a+1, physical row a+2 corresponds to original row a+2, physical row 2a corresponds to original row 2a, physical row 2a+1 corresponds to original row 2a+1, and physical row 2a+2 corresponds to original row 2a+2. After assigning the pixels stored in the shared storage space module to a group of target pixel positions in the display array 401 according to the display offset information, physical row 1 corresponds to original row a+1, physical row 2 corresponds to original row a+2, physical row a corresponds to original row 2a, physical row a+1 corresponds to original row 2a+1, physical row a+2 corresponds to original row 2a+2, physical row 2a corresponds to original row 3a, physical row 2a+1 corresponds to original row 3a+1, and physical row 2a+2 corresponds to original row 3a+2.

[0094] Optionally, the pixels at each group of to-be-fitted pixel positions are fitted according to the current pixels in the display array 401, and the fitted pixels are assigned to each group of to-be-fitted pixel positions.

[0095] As an optional implementation, the pixels adjacent to each group of to-be-fitted pixel positions can be directly used as the pixels of the to-be-fitted pixel positions.

[0096] As another optional implementation, the average value of a preset number of pixels adjacent to each group of to-be-fitted pixel positions can be used as the pixel of the to-be-fitted pixel position.

[0097] In the embodiment, after determining the at least one group of to-be-fitted pixel positions and the plurality of groups of to-be-cached pixel positions arranged in sequence, the shared cache space module is accessed at preset time intervals to offset the pixels and the fitted pixels, so that the pixel offset can be realized without consuming a large amount of storage space, and a plurality of offset images can be generated.

[0098] Optionally, the display module 40 further includes a timing control module 403. Figure 9

[0099] Optionally, the timing control module 403 is connected with the shared cache space module 402 and the coordination configuration module 20 through the interface component module.

[0100] Optionally, the timing control module 403 performs the following steps at preset time intervals: caching the pixels in the current group of to-be-cached pixel positions into the shared cache space module 402, assigning the pixels stored in the shared cache space module 402 to a group of target pixel positions in the display array 401 according to the display offset information, fitting the pixels at the groups of to-be-fitted pixel positions according to the current pixels in the display array 401, and assigning the fitted pixels to the groups of to-be-fitted pixel positions.

[0101] Optionally, Figure 11 is a schematic diagram of the timing control module 403 provided in the embodiment. As shown in Figure 11 , the timing control module 403 first reads the pixels in the current group of to-be-cached pixel positions, caches the pixels in the current group of to-be-cached pixel positions into the shared cache space module 402, and determines the target pixel positions corresponding to the pixels at this time. Then the shared cache space module 402 is read, and the stored pixels in the shared cache space module 402 are written into the target pixel positions, and the pixels at the to-be-fitted pixel positions are fitted, at which time an offset image can be generated. Next, the above steps are continued to be performed at preset time intervals and in the order of the plurality of groups of to-be-cached pixel positions, until the number of generated offset images reaches the preset number of offset images.

[0102] In the embodiment, the timing control module performs the steps of pixel offset and fitting at preset time intervals, so that a plurality of offset images are generated at preset time intervals between the images displayed by the display module and the images collected by the image collection module, for motion compensation, to ensure smooth transition between images.

[0103] Optionally, the micro display system is any one of the following types: liquid crystal type, light emitting diode type, organic light emitting diode type, micro light emitting diode type, and quantum dot light emitting diode.

[0104] ​Specifically, the micro display system can be various types of micro display systems, including but not limited to liquid crystal type, light emitting diode type, organic light emitting diode type, micro light emitting diode type and quantum dot light emitting diode. The type of the micro display system is not limited in the embodiment.

[0105] If the micro display system is a self-luminous display type such as an organic light emitting diode type, no backlight is needed to display the content. If the micro display system is a type that cannot self-luminesce such as a liquid crystal type, the content can be displayed by using a backlight.

[0106] In the embodiment, the micro display system can be various types, thereby improving the system applicability.

[0107] Next, the case of displaying the content by using a backlight is introduced.

[0108] As an optional implementation, as shown in Figure 9 The display module 40 further includes a backlight timing control module 404. The micro display system further includes a light emitting module 50.

[0109] The backlight timing control module 404 is connected to the timing control module 403 and the light emitting module 50 respectively.

[0110] Optionally, the light emitting area of the light emitting module 50 covers the display module 40, thereby providing the display module 40 with a backlight.

[0111] Optionally, the backlight timing control module 403 controls the light emitting module 50 to light up at a preset time interval, so that the display array 401 is lighted up after each completion of the pixel shift and fitting.

[0112] Specifically, the backlight timing control module 404 controls the light emitting module 50 to light up at a preset time interval in addition to the image sent by the host module 30, thereby lighting up the light emitting module 50 after each completion of the pixel shift and fitting, to display the shifted image. When the pixel shift and fitting are completed each time, the light emitting module 50 starts to light up. When the next pixel shift and fitting starts, the light emitting module 50 stops lighting up.

[0113] In the embodiment, the backlight timing control module controls the light emitting module to light up at a preset time interval, thereby avoiding the long-time lighting of the pixel during the shift and fitting, causing motion blur and leading to the smearing of the visual line.

[0114] The embodiment of the application further provides a micro display method applied to the micro display system. Figure 12 The micro display method is introduced, Figure 12 is a flowchart of the micro display method provided by the embodiment of the application.

[0115] S1201, the image acquisition module 10 acquires a current image and sends the current image to the host module 30.

[0116] Optionally, the image acquisition module 10 can be a high-definition camera or the like for acquiring images of the real physical environment around the user. The image acquisition module 10 can be located close to the user's eyes.

[0117] Optionally, after the image acquisition module 10 sends the current image to the host module 30, the host module 30 can analyze the current image according to a preset algorithm and integrate a virtual scene into the current image. The image acquisition module 10 can also analyze the image feature point changes according to the preset algorithm, calculate the real-time position and posture of the user's head, and thus adjust the perspective of the virtual scene. For example, if the user turns his head to the left, the host module 30 synchronously turns the virtual picture to the left according to the turning angle of the head determined according to the current image collected, so that the virtual picture seen by the user is consistent with the head movement.

[0118] S1202, the coordination configuration module 20 acquires a current head posture and a previous head posture of the user, the current head posture being the head posture of the user when the image acquisition module 10 acquires the current image, and the previous head posture being the head posture of the user when the image acquisition module 10 acquires a previous image of the current image.

[0119] Optionally, the coordination configuration module 20 can include a posture sensor, such as an inertial measurement unit (IMU), for real-time monitoring of the head posture. The head posture can include a yaw angle, a pitch angle, and a roll angle, and include a time stamp of the head posture.

[0120] Specifically, the image acquisition module 10 can acquire images at a preset acquisition interval, and the coordination matching module can acquire the head posture of the user at the same acquisition interval, and take the head posture with the same time stamp as that of the current image as the current head posture, and take the head posture with the same time stamp as that of the previous image of the current image as the previous head posture. The previous image of the current image is an image acquired by the image acquisition module 10 one acquisition interval before the current image is acquired.

[0121] S1203, the coordination configuration module 20 determines a plurality of display offset information according to the current head posture and the previous head posture, each display offset information being used to indicate an offset amount of a pixel displayed in the display module 40. The coordination configuration module 20 sends the plurality of display offset information to the display module 40 in sequence.

[0122] As an optional implementation, the coordination configuration module 20 can determine the head deflection angle of the user according to the current head posture and the previous head posture, and then determine the plurality of display offset information according to the head deflection angle. The head deflection angle is the posture deviation value between the current head posture and the previous head posture.

[0123] When the image acquisition module acquires the current image, the current image is sent to the host module, and the host module needs to process the current image, which will have a certain time delay. Therefore, when the image acquisition module acquires the current image, the display module displays the previous image, and displays a plurality of offset images based on the display offset information after a certain time, until the host module processes the current image and sends it to the display module, and the display module displays the current image. Each display offset information is used to indicate the offset amount of the pixels displayed by the display module 40 in a single offset. For example, if the pixels displayed by the display module 40 need to be offset 4 times, the coordination configuration module 20 determines 4 display offset information according to the current head posture and the previous head posture. The number of display offset information can be determined according to the preset clarity parameter. The clarity parameter is the picture clarity parameter indicated by the user. If the preset clarity parameter is higher, the number of display offset information is more, and the number of offset images displayed by the display module 40 is more. The lower the clarity parameter, the fewer the number of display offset information, and the fewer the number of offset images displayed by the display module 40. Alternatively, each display offset information can be the same.

[0124] It is worth noting that the display offset information can include an offset amount and an offset direction, and the offset direction can be row-by-row offset or column-by-column offset. The positive and negative values of the offset amount can represent row-by-row upward or downward offset, or column-by-column left or right offset. In addition, the present embodiment does not limit the offset direction, Figure 3 is a schematic diagram of an offset direction provided by an embodiment of the present application. As Figure 3 shown, the pixels can be offset to the left, right, down, up, left up, right up, left down, and right down.

[0125] Alternatively, the coordination configuration module 20 can directly send the plurality of display offset information to the display module 40 in sequence when generating the plurality of display offset information, or can send the plurality of display offset information to the display module 40 in sequence according to a preset time interval.

[0126] S1204, the previous image is displayed in the display module 40, and the display module 40 offsets and fits the pixels according to the display offset information and the preset time interval to display a plurality of offset images after the previous image. During the display of the plurality of offset images in the display module 40 or after the display of the plurality of offset images is completed, the host module 30 sends the current image to the display module 40 for display.

[0127] Optionally, the previous image displayed in the display module 40 can be an image processed and sent by the host module 30, and the display module 40 displays the current image after the host module 30 processes the current image and sends it to the display module 40.

[0128] Specifically, between the display of the previous image and the current image in the display module 40, a plurality of offset images can be displayed at preset time intervals, the first offset image is obtained by pixel offsetting and fitting based on the previous image, and the offset images after the first offset image are obtained by pixel offsetting and fitting based on the previous offset image. The number of offset images corresponds to the number of display offset information. The number of offset images displayed between each image sent by the host module 30 can be different.

[0129] Optionally, pixel offsetting refers to replacing the pixel at the to-be-offset position to the target position. After the display module 40 offsets the pixels in the image according to the display offset information, there is no pixel at the to-be-fitted pixel position, and the display module 40 can use fitting to fit the pixel at the to-be-fitted pixel position according to the current offset image.

[0130] Optionally, the preset time interval can be the time interval at which the adjacent two offset images start to be displayed. The display duration of each offset image can be a preset offset display duration, and the display duration of the image sent by the host module 30 can be a preset original display duration. The original display duration can be greater than the offset display duration.

[0131] Exemplarily, Figure 4 is a display module 40 display timing diagram provided by an embodiment of the present application. As shown in Figure 4 Between the previous image and the current image, the display module 40 can also display 6 offset images. The display duration of the previous image and the display duration of the current image are greater than the display duration of each offset image. Between the next image and the current image, the display module 40 can display 4 offset images.

[0132] As an optional implementation, the display module 40 monitors whether the host module 30 sends the current image in real time during the display of the plurality of offset images, if not, it continues to offset the pixels in sequence and fit until the last offset image is displayed, and if yes, it directly displays the current image to ensure the authenticity and integrity of the picture displayed by the display module 40.

[0133] In this embodiment, the image acquisition module acquires the current image and sends the current image to the host module, the coordination configuration module acquires the current head posture and the previous head posture of the user, the coordination configuration module determines a plurality of display offset information according to the current head posture and the previous head posture, the coordination configuration module sends the plurality of display offset information to the display module in sequence, the previous image is displayed in the display module, the display module performs pixel offset and fitting according to the display offset information and the preset time interval to display a plurality of offset images after the previous image, and the host module sends the current image to the display module for display during or after the display of the plurality of offset images. In this embodiment, the previous image is directly subjected to pixel offset and fitting by the display module to obtain a plurality of offset images, so that the motion compensation can be accurately performed without occupying the interface bandwidth of the host module and the display module, the image blur problem caused by the rapid rotation of the user's head is improved, the dizziness and action mismatch problems of the user caused by the image blur problem are reduced, and the immersive experience of the user is enhanced. In addition, the interface bandwidth pressure is low, so that the system can be small in size, low in power consumption, high in endurance, and low in cost.

[0134] Figure 13 is a flowchart of another micro display method provided by the embodiment of the present application. Next, the overall process of implementing the micro display method is introduced. Figure 13 The overall process of implementing the micro display method is introduced.

[0135] First, the current image is acquired and sent to the host module, and the current head posture and the previous head posture are acquired, and then a plurality of display offset information is determined according to the current head posture and the previous head posture. It is judged whether the offset amount in the display offset information exceeds the offset threshold, if yes, each pixel remains at the current position. If not, at least one group of to-be-fitted pixel positions and a plurality of groups of to-be-cached pixel positions are determined according to the display offset information, and then the following loop process is executed: the pixels in the current group of to-be-cached pixel positions are cached to the shared cache space module, the pixels stored in the shared cache space module are assigned to a group of target pixel positions in the display array, the pixels at each group of to-be-fitted pixel positions obtained by fitting are assigned to each group of to-be-fitted pixel positions, the current offset image is displayed, and the process ends until the number of displayed offset images reaches the preset number of offset images. At the same time, it is judged whether an image is received from the host module, if not, the above-mentioned step of generating offset images is continued, and if not, the image sent by the host module is displayed.

[0136] The embodiment of the present application also provides a display device, which comprises the above-mentioned micro display system.

[0137] The above merely provides the specific implementation of the present application, but the protection scope of the present application is not limited to this. Any person skilled in the art can easily think of the changes or replacements within the technical range disclosed by the present application, which should be covered in the protection scope of the present application.

Claims

1. A microdisplay system, characterized by, The micro display system comprises an image acquisition module, a coordination configuration module, a host module and a display module; The image acquisition module acquires a current image and sends the current image to the host module; The coordination configuration module obtains a current head posture and a previous head posture of a user, the current head posture being a head posture of the user when the image acquisition module acquires the current image, and the previous head posture being a head posture of the user when the image acquisition module acquires a previous image of the current image; The coordination configuration module determines a plurality of display offset information according to the current head posture and the previous head posture, each of the display offset information being used for indicating an offset amount of a pixel displayed in the display module; and the coordination configuration module sends the plurality of display offset information to the display module in sequence; The display module displays the previous image, and performs pixel offset and fitting according to the display offset information and a preset time interval to display a plurality of offset images after the previous image, and the host module sends the current image to the display module for display after the display module displays the plurality of offset images or after the display of the plurality of offset images is completed.

2. The microdisplay system of claim 1, wherein, The determination of the plurality of display offset information according to the current head posture and the previous head posture comprises: determining a head deflection angle according to the current head posture and the previous head posture; determining the plurality of display offset information according to the head deflection angle.

3. The microdisplay system of claim 2, wherein, The image acquisition module also sends the current image to the coordination configuration module; The determination of the plurality of display offset information according to the head deflection angle comprises: determining a plurality of image regions in the current image according to depth information of the current image; determining a target deflection angle corresponding to each of the image regions according to the head deflection angle and the depth information of each of the image regions; determining the plurality of display offset information according to the target deflection angle corresponding to each of the image regions and unit mapping information, the unit mapping information being used for indicating a pixel offset amount corresponding to a unit deflection angle in the display module.

4. The microdisplay system of claim 3, wherein, The determination of the plurality of display offset information according to the target deflection angle corresponding to each of the image regions and the unit mapping information comprises: determining a plurality of display offset amounts corresponding to each of the image regions according to the target deflection angle corresponding to each of the image regions and the unit mapping information; determining a display region corresponding to each of the image regions according to a corresponding relationship between each of the image regions and each display region in a display array of the display module, and taking the plurality of display offset amounts corresponding to each of the image regions as a plurality of display offset amounts of the corresponding display region, the display offset amount of the display region comprising an offset amount of each pixel in the display region.

5. The microdisplay system of claim 2, wherein, The determination of the plurality of display offset information according to the head deflection angle comprises: if the head deflection angle is greater than a preset angle, determining the plurality of display offset information according to the head deflection angle.

6. The microdisplay system of claim 1, wherein, The display module comprises at least a display array and a shared cache space module. The pixel offsetting and fitting according to the display offset information and the preset time interval comprises: According to the display offset information, at least one group of pixel positions to be fitted and a plurality of groups of pixel positions to be cached in sequence in the display array are determined; Steps A-C are performed according to the preset time interval: A, cache the pixels in the current group of pixel positions to be cached to the shared cache space module; B, according to the display offset information, assign the pixels stored in the shared cache space module to a group of target pixel positions in the display array; C, according to the current pixels in the display array, fit the pixels at each group of pixel positions to be fitted, and assign the fitted pixels to the groups of pixel positions to be fitted.

7. The microdisplay system of claim 6, wherein, The display module further comprises a timing control module. The timing control module performs steps A-C according to the preset time interval.

8. The microdisplay system of claim 6, wherein, The micro display system is any one of the following types: liquid crystal type, light emitting diode type, organic light emitting diode type, micro light emitting diode type and quantum dot light emitting diode type.

9. A microdisplay method, characterized by, The micro display system of any one of claims 1-8 is applied to; The method comprises: The image acquisition module acquires a current image and sends the current image to the host module; The coordination configuration module obtains a current head posture and a previous head posture of a user, the current head posture being the head posture of the user when the image acquisition module acquires the current image, and the previous head posture being the head posture of the user when the image acquisition module acquires a previous image of the current image; The coordination configuration module determines a plurality of display offset information according to the current head posture and the previous head posture, each display offset information being used to indicate the offset amount of the pixels displayed in the display module; the coordination configuration module sends the plurality of display offset information to the display module in sequence; The display module displays the previous image, and the display module offsets and fits the pixels according to the display offset information and a preset time interval to display a plurality of offset images after the previous image; during or after the display module displays the plurality of offset images, the host module sends the current image to the display module for display.

10. A display device, characterized by comprising: The micro display system of any one of claims 1-8 is included.

Images