An image display method, device, near-eye display device and readable storage medium

Abstract

The application provides an image display method and device, a near-eye display device and a readable storage medium, relates to the technical field of terminals, and the image display method is applied to the near-eye display device, the near-eye display device comprises a display screen, and the method comprises the following steps: in a first time period of a first frame time, receiving and processing one frame of initial image data to be displayed to obtain target image data, the length of the first frame time is determined based on the number of image transmission frames of the display screen in a unit time, the unit time comprises a plurality of frame times, and the first frame time is any one of the plurality of frame times; in a second time period of the first frame time, the display screen is controlled to display images according to the target image data. The process of receiving and processing one frame of initial image data and the process of displaying the target image data obtained after processing are completed in different time periods in one frame time, so that the display time delay of the image is effectively shortened, and the ghosting problem is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminals, and in particular to an image display method and device, a near-eye display device, and a readable storage medium. BACKGROUND

[0002] Augmented reality (AR), virtual reality (VR), and extended reality (XR) technologies have been widely applied in near-eye display devices. An image display method of an existing near-eye display device is as follows: after receiving and processing a frame of image data in a current frame time, the processed image data is cached to a storage device at the same time, and a last frame of image data stored in a last frame time is read from the storage device and displayed.

[0003] Based on the above image display method, the processing process of the image and the display process of the image both occupy the entire frame time, and the image data processed in the current frame time cannot be displayed until the next frame time. The display delay of each frame of image is relatively long and is about 1.5 times the length of the frame time, and the prediction delay is about 2.5 times the length of the frame time. The longer the prediction delay is, the more likely the pose prediction of the device is inaccurate, which easily causes the virtual screen to be unstable relative to the background space. In a display mode with three degrees of freedom (Dof) or six degrees of freedom, when the human body drives the near-eye display device to move quickly, the center pixel point of the video area in the display screen of the near-eye display device moves quickly relative to the display screen in the process of the human body moving quickly, which causes serious trailing and affects the visual effect. SUMMARY

[0004] The present application provides an image display method, device, near-eye display device, and readable storage medium, which solves the technical problem of long display delay and serious trailing of the existing image display method to some extent.

[0005] To achieve the above object, the present application adopts the following technical solutions:

[0006] In a first aspect, the present application provides an image display method applied to a near-eye display device, the near-eye display device comprising a display screen, the method comprising: in a first time period of a first frame time, receiving and processing a frame of initial image data to be displayed to obtain target image data, the length of the first frame time being determined based on the number of image transmission frames of the display screen per unit time, the unit time comprising a plurality of frame times, and the first frame time being any one of the plurality of frame times; and in a second time period of the first frame time, controlling the display screen to display an image according to the target image data.

[0007] Based on the image display method provided in the present application, the near-eye display device can sequentially complete the processes of receiving and processing one frame of initial image data in different time periods within the first frame time, and controlling the display screen to display images according to the target image data obtained after processing, thereby saving the time length of one frame of image data in the process of caching and displaying image data, reducing the display time delay and prediction time delay of the near-eye display device, and improving the ghosting caused by the rapid movement of the center pixel point of the video area in the display screen relative to the display screen when the device moves rapidly with the human body in the 3Dof, 6Dof and other multi-degree-of-freedom display modes.

[0008] In the present application, the frame rate of the display screen refers to the number of image transmission frames per unit time of the display screen, and the time length of one frame of image refers to the time length during which one frame of image can be presented on the display screen. For example, if the frame rate of the display screen is 60 fps (frames per second), it means that the number of image transmission frames per unit time of the display screen is 60, the unit time includes 60 continuous frame times, and the time length of each frame time is 1 / 60 second. The display time delay of the display screen can be half the time length of the second time period plus the time length of the first time period.

[0009] For example, the near-eye display device can be a head-mounted near-eye display device for augmented reality, virtual reality, extended reality or mixed reality.

[0010] In a possible implementation manner of the first aspect, the time length of the second time period is less than or equal to half the time length of the first frame time.

[0011] In a possible implementation manner of the first aspect, the method further includes: receiving a trigger instruction of a target display mode of the near-eye display device, the trigger instruction including the degree of freedom of the target display mode; determining a target driving time sequence of a plurality of frame times from a plurality of different driving time sequences pre-stored according to the degree of freedom; wherein the target driving time sequence is used to indicate the time length of the first time period and the time length of the second time period in the corresponding frame time, and the different driving time sequences correspond to different time lengths of the first time period and / or the second time period.

[0012] In the implementation manner, the degree of freedom of the target display mode is used to indicate whether the picture generated by the near-eye display device in the target display mode can be fixed at a certain position in space. According to the degree of freedom of the target display mode, the high and low requirements of the display time delay, the ghosting and the power consumption of the device in the target display mode can be determined, and then the time length of the corresponding first time period and the time length of the corresponding second time period in the corresponding target driving time sequence can be determined. The time length of the first time period and the time length of the second time period are positively correlated with the display time delay, and the time length of the second time period is positively correlated with the length of the ghosting.

[0013] In a possible implementation of the first aspect, if the degree of freedom is 0, the target driving timing of the plurality of frame times is the same, and a sum of a length of the first time period and a length of the second time period corresponding to the target driving timing is equal to a length of the frame time.

[0014] In this implementation, in the 0Dof display mode, the requirements for display latency and smear of the near-eye display device are relatively low, and the length of the time period during which the device processes image data and the length of the time period during which the device displays images can occupy the entire frame time, thereby reducing power consumption of the device. For example, if the length of a frame time is T, the length of the first time period in the frame time corresponding to the target driving timing can be T / 3 and the length of the second time period can be 2T / 3; or the length of the first time period in the frame time corresponding to the target driving timing can be T / 2 and the length of the second time period can be T / 2.

[0015] In a possible implementation of the first aspect, determining the target driving timing of the plurality of frame times from the plurality of different driving timings stored in advance according to the degree of freedom comprises:

[0016] If the degree of freedom is greater than 0, the target driving timing of the first frame time is determined from the plurality of different driving timings stored in advance according to the pose information of the near-eye display device in the last frame time of the first frame time.

[0017] In a possible implementation of the first aspect, determining the target driving timing of the first frame time from the plurality of different driving timings stored in advance according to the pose information of the near-eye display device in the last frame time of the first frame time comprises:

[0018] According to the pose information of the near-eye display device in the last frame time of the first frame time, a displacement amount of a center pixel point of a video region in the display screen in the last frame time of the first frame time is determined, the video region being configured to display target image data; the target driving timing corresponding to the first frame time is determined from the plurality of different driving timings stored in advance according to the displacement amount and at least one preset threshold; and a sum of a length of the first time period and a length of the second time period corresponding to the target driving timing is less than a length of the frame time, and the displacement amount is negatively correlated with the length of the first time period and / or the length of the second time period corresponding to the target driving timing.

[0019] In the implementation, the display latency of the near-eye display device is generally required to be higher in the display mode with the degree of freedom greater than 0, and ghosting is prone to occur. The greater the displacement of the near-eye display device in a frame time, the more serious the ghosting. The attitude information of the near-eye display device in the last frame time of the first frame time can be detected through a sensor such as an inertial measurement instrument in the near-eye display device. The displacement of a center pixel point of a video area in the display screen in the last frame time of the first frame time is determined, the speed of the user moving the near-eye display device is determined, and then the target driving timing sequence of the first frame time is determined. The greater the displacement, the smaller the sum of the length of the first period and the length of the second period.

[0020] In the display mode with the degree of freedom greater than 0, the first frame time corresponding to the target driving timing sequence includes three periods. The target driving timing sequence is used to instruct the near-eye display device to receive and process a frame of initial image data to be displayed in the first period of the first frame time to obtain target image data. In the second period of the first frame time, the display screen is controlled to display an image according to the target image data. In the third period of the first frame time, no image is displayed and no data is processed, and the next initial image data is received in the next frame time of the first frame time.

[0021] In a possible implementation of the first aspect, the color depth of the target image data is greater than the color depth of the initial image data.

[0022] For example, the initial image data can be compensated and processed by DeMURA, Gamma, or the like, to eliminate the brightness unevenness in the initial image data, so that the output target image data is adapted to the observation of the human eye. For example, the color depth of the initial image data can be RGB8bit, and the color depth of the target image data can be RGB12bit.

[0023] In a possible implementation of the first aspect, the target image data includes a plurality of sub-frame image data, and the plurality of sub-frame image data is determined according to a plurality of color depths of the target image data. After the target image data is obtained, the method further includes: in the first period of the first frame time, the plurality of sub-frame image data is buffered.

[0024] In the existing image display method, the target image data processed in the current frame time needs to be displayed in the next frame time, so the memory needs to cache the target image data of two continuous frames in one frame time, that is, the cache space occupies twice the size of the target image data. In the display method provided in the basic application, the target image data stored in the first time period of the first frame time can be displayed in the second time period of the first frame time, so the memory only caches one frame of target image data in one frame time, that is, the cache space occupies the size of the target image data. Compared with the existing image display method, the cache space can be effectively saved.

[0025] In a possible implementation manner of the first aspect, in the second time period of the first frame time, the display screen is controlled to display images according to the target image data, including: in the second time period of the first frame time, the plurality of sub-frame image data are sequentially read, and the display screen is controlled to sequentially display images of the plurality of sub-frame image data according to a preset pulse width dimming signal; the pulse width dimming signal is used to indicate the display duration of each sub-frame image data.

[0026] In the second aspect, the present application provides an image display device, which comprises at least one module for implementing the method in any possible implementation manner of the first aspect.

[0027] In the third aspect, the present application provides a near-eye display device, which comprises a processor and a display screen, and the processor is used to run a computer program stored in a memory to implement the method in any possible implementation manner of the first aspect.

[0028] In the fourth aspect, the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the method in any possible implementation manner of the first aspect.

[0029] In the fifth aspect, the present application provides a computer program product, which, when running on an electronic device, enables the electronic device to execute the method in any possible implementation manner of the first aspect.

[0030] The technical effects of the second aspect to the fifth aspect provided in the present application can be referred to the technical effects of the above-mentioned possible implementation manners of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0031] Figure 1 A timing diagram of an existing image display method provided by an embodiment of the present application.

[0032] Figure 2 A structural diagram of an electronic device provided by an embodiment of the present application.

[0033] Figure 3 A flow chart of an image display method provided for an embodiment of the present application.

[0034] Figure 4 A driving timing and a corresponding pulse width dimming signal diagram provided for an embodiment of the present application.

[0035] Figure 5 A flow chart of a method for determining a target driving timing provided for an embodiment of the present application.

[0036] Figure 6 A schematic diagram of a driving timing one provided for an embodiment of the present application.

[0037] Figure 7 A schematic diagram of a driving timing two provided for an embodiment of the present application.

[0038] Figure 8 A schematic diagram of a driving timing three provided for an embodiment of the present application.

[0039] Figure 9 A schematic diagram of a driving timing four provided for an embodiment of the present application.

[0040] Figure 10 A driving timing diagram corresponding to two continuous frame times provided for an embodiment of the present application.

[0041] Figure 11 A flow chart of another method for determining a target driving timing provided for an embodiment of the present application.

[0042] Figure 12 A schematic diagram of a video area movement in a display screen provided for an embodiment of the present application.

[0043] Figure 13 A flow chart of another method for determining a target driving timing provided for an embodiment of the present application.

[0044] Figure 14 Another driving timing diagram corresponding to two continuous frame times provided for an embodiment of the present application.

[0045] Figure 15 A schematic block diagram of an image display device provided for an embodiment of the present application. DETAILED DESCRIPTION

[0046] The technical solutions in the embodiments of the present application will be described below with reference to the drawings and related embodiments in the embodiments of the present application. In the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing the specific embodiments and are not intended to be limiting to the present application. As used in the specification and the appended claims of the present application, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that "at least one" and "one or more" as used in the embodiments herein indicates one or two or more (including two). The term "and / or" is used to describe the association relationship of the associated objects, which means that there can be three relationships; for example, A and / or B can mean that A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects.

[0047] In the present specification, the reference to "one embodiment" or "some embodiments" etc. means that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in other some embodiments", "in yet some embodiments" etc. appearing in different places in the present specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "include", "contain", "have" and their variants mean "including but not limited to", unless otherwise specifically emphasized. The term "connected" includes direct connection and indirect connection, unless otherwise specified. "First", "second" are only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features.

[0048] In the embodiments of the present application, the words "exemplarily" or "for example" are used to mean as an example, illustration or description. Any embodiment or design scheme described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the words "exemplarily" or "for example" are used to present the relevant concept in a specific manner.

[0049] The steps involved in the image display method provided in the embodiments of the present application are only examples, and not all steps are necessarily performed, or the content in each information or message is not necessarily selected. In the use process, it can be appropriately increased or reduced according to the needs. In the embodiments of the present application, the same step or the step or message with the same function can be mutually referenced and learned between different embodiments.

[0050] Different display functions or different applications installed in the near-eye display device have different display modes, and different display modes correspond to different degrees of freedom. For example, the display modes such as air projection mode, auxiliary screen mode, and somersault mode have 0Dof, in which the picture generated by the near-eye display device can rotate following the movement of the human head, and the coordinate of the center pixel point of the video area in the display screen does not change, that is, the image center coordinate displayed in the video area in the display screen does not change; the corresponding degree of freedom of the follow-me mode can be 2Dof, 3Dof or 6Dof, in which the near-eye display device can detect the spatial displacement of the human body driving the device in multiple dimensions, and the coordinate of the center pixel point of the video area in the display screen will move quickly relative to the display screen in the process of movement, and accordingly, the image center coordinate displayed in the video area will move quickly relative to the display screen with the quick movement of the near-eye display device.

[0051] Referring to Figure 1 As shown in a timing diagram of an existing image display mode, the near-eye display device generally receives and processes a frame of image data in the current frame time, buffers the processed image data to the memory at the same time, reads the last frame of image data processed and stored in the memory in the last frame time and displays it.

[0052] The duration of a frame time is determined according to the frame rate of the near-eye display device when displaying the picture. The frame rate is the number of image transmission frames per unit time of the display screen, and the unit time includes a plurality of continuous frame times, and the duration of a frame time is the ratio between the duration of the unit time and the number of image transmission frames per unit time. The frame rate of the display screen of the near-eye display device can be greater than or equal to 60fps, and for example, if the frame rate of the display screen is 72fps, that is, the number of image transmission frames per second of the display screen is 72, then the unit time includes 72 continuous frame times, and the duration of each frame time is 1 / 72 second.

[0053] Based on Figure 1In the existing image display mode, the near-eye display device needs to simultaneously perform the operations of receiving, processing and buffering a frame of image data and reading and displaying a previous frame of image data within one frame time. The process of receiving, processing and buffering a frame of image data and the process of reading and displaying a previous frame of image data each occupies the entire frame time, and the image data processed in the current frame time is the image data displayed in the next frame time of the current frame time. The display time delay of each frame of image data is relatively long and is about 1.5 times of one frame time. The light duty ratio of the display screen of the near-eye display device is about 100%. In the 3Dof or 6Dof display mode, when the human body drives the near-eye display device to move rapidly, the relatively long light duty ratio of the display screen causes serious trailing when the display screen of the near-eye display device switches to the corresponding image during the rapid movement of the human body, thereby affecting the visual effect. The light duty ratio of the display screen can be the ratio of the total time from the start of display of the first pixel point in a frame of image data to the completion of display of the last pixel point to one frame time.

[0054] In addition, based on the above image display mode, two consecutive frames of image data need to be simultaneously stored in the memory, and the size of the occupied cache space is about 2 times the size of one frame of image data, so the occupied cache space is relatively large.

[0055] To solve the above technical problems, the embodiments of the present application provide an image display method and device, a near-eye display device and a readable storage medium. The near-eye display device can complete the reception and processing of one frame of initial image data in a first time period within a first frame time, and control the display screen to complete the image display process according to the target image data obtained after processing in a second time period within the first frame time. At the same time, the proportion of the time length of processing image data in one frame time and the proportion of the time of image display in one frame time are reduced. The target image data processed in the first frame time can be displayed in the first frame time, thereby reducing the display time delay of the image and the prediction time delay of the device. Because the proportion of the second time period for image display of the display screen is reduced, the trailing caused by the rapid movement of the center pixel point of the video area in the display screen relative to the display screen is effectively improved when the device moves rapidly with the human body in the multi-degree-of-freedom display mode such as 3Dof, 6Dof and the like.

[0056] In the embodiments of the present application, the near-eye display device can be an augmented reality (AR), virtual reality (VR), extended reality (XR), mixed reality (MR) or the like head-mounted electronic device.

[0057] Figure 2This is a schematic diagram illustrating the structure of an electronic device according to an embodiment of this application. The near-eye display device involved in this embodiment can... Figure 2 The electronic device 200 shown is used to implement this.

[0058] like Figure 2 As shown, the electronic device 200 may include at least one processor 201, a communication bus 202, a memory 203, and at least one communication interface 204. The following is in conjunction with... Figure 2 A detailed description of each component of the electronic device 200 is provided below:

[0059] Processor 201 is the control center of the electronic device 200. It can be a single processing unit or a collective term for multiple processing units. For example, processor 201 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), a display processing unit (DPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a central processing unit (CPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, other general-purpose processors, and / or a neural network processing unit (NPU), etc. The general-purpose processor can be a microprocessor or any conventional processor. Different processing units can be independent devices or integrated into one or more processors.

[0060] The processor 201 can perform various functions of the electronic device 200 by running or executing software programs stored in the memory 203 and by calling image data stored in the memory 203. For example, Figures 3 to 14 In the illustrated embodiment, the operation of the near-eye display device can be executed by the processor calling the image data in the memory.

[0061] As one embodiment, processor 201 may include one or more CPUs, for example Figure 2CPU0 and CPU1 shown in FIG. 1.

[0062] As an embodiment, the electronic device 200 can include a plurality of processors, such as Figure 2 the processor 201 and the processor 205 shown in FIG. 1. Each of the processors can be a single-CPU processor or a multi-CPU processor. The processor herein can refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0063] The communication bus 202 can include a path for transmitting information between the above components. The communication bus 202 can be an industry standard architecture (ISA) bus, a peripheral component (PCI) bus, an extended industry standard architecture (EISA) bus, or the like. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, Figure 2 only one thick line is used in FIG. 1, but this does not mean that there is only one bus or only one type of bus.

[0064] The memory 203 can be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, a magnetic disk storage or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto. The memory 203 can exist independently and be connected to the processor 201 through the communication bus 202. The memory 203 can also be integrated with the processor 201. The memory 203 is used to store software programs and image data for implementing the schemes provided in the embodiments of the present application, and is controlled by the processor 201 to perform the implementation.

[0065] The communication interface 204 is configured to communicate with other devices or communication networks, such as Ethernet, RAN, wireless local area networks (WLAN), etc. The communication interface 204 can include a receiving unit to implement the receiving function and a sending unit to implement the sending function.

[0066] As an embodiment, the electronic device 200 can further include an output device 206 and an input device 207.

[0067] The output device 206 is in communication with the processor 201 and can display information in various ways. For example, the output device 206 can be a display configured to display images, videos, etc., such as target image data in embodiments of the present application. The display can include a display screen and a pixel circuit. The display screen can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), etc. The pixel circuit can include a column drive circuit and a row drive circuit configured to control the color and brightness of each pixel in the display screen.

[0068] In some embodiments, the electronic device 200 can include one or N displays, where N is a positive integer greater than 1.

[0069] The input device 207 is in communication with the processor 201 and can receive input in various ways. For example, the input device 207 can be a mouse, a keyboard, a touch screen device, a sensor device, etc. The sensor device can be an inertial measurement unit (IMU) configured to measure three-axis attitude angles (or angular rates) and accelerations of the electronic device 200 in a three-dimensional space to determine the attitude of the electronic device 200 based on the measured data.

[0070] It should be noted that, Figure 2The illustrated device structure does not constitute a limitation on the electronic device 200, which can include more or fewer components than those shown, or combine certain components, or arrange the components differently, and the embodiments of the present application do not limit this.

[0071] The image display method provided by the embodiments of the present application will be described below in conjunction with the drawings and specific application scenarios.

[0072] In a possible implementation, referring to Figure 3 The flowchart of the image display method shown is applied to the near-eye display device described above, mainly involves the process of the near-eye display device processing the received initial image data and controlling the display screen to display images in a frame time, and the method includes steps S310 to S320. Each step will be described in detail below.

[0073] S310, in a first time period of a first frame time, receiving and processing a frame of initial image data to be displayed to obtain target image data, the length of the first frame time being determined based on the image transmission frame number of the display screen in a unit time, the unit time including a plurality of frame times, and the first frame time being any one of the plurality of frame times.

[0074] The image transmission frame number of the display screen in a unit time is the frame rate of the display screen. For example, the frame rate of the display screen of the near-eye display device can be greater than or equal to 60 fps, that is, the image transmission frame number of the image in each second can be greater than or equal to 60. The unit time includes a plurality of consecutive frame times, and the length of a frame time is the ratio between the length of the unit time and the image transmission frame number in the unit time. For example, if the frame rate of the display screen is 72 fps, that is, the image transmission frame number of the display screen in 1 second is 72, then the length of a frame time is 1 / 72 seconds.

[0075] In an example, the initial image data can be image data corresponding to images of virtual space scenes and / or real space scenes acquired by the near-eye display device through an image acquisition device. The image acquisition device can be a camera installed in the near-eye display device or a camera connected to the near-eye display device through a wired or wireless connection.

[0076] In another example, the initial image data can also be image data transmitted to the near-eye display device by other electronic devices through wired or wireless transmission. For example, the other electronic devices can be mobile phones, tablet computers, notebook computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), desktop computers, etc.

[0077] In an embodiment, in order to improve the color richness and brightness of the displayed image, the near-eye display device can perform display compensation processing on the received initial image data through a digital image processing algorithm to obtain target image data.

[0078] For example, the digital image processing algorithm can include, but is not limited to, DeMURA, Gamma, and other compensation algorithms.

[0079] The color depth of the target image data can be greater than the color depth of the initial image data. The color depth is also referred to as the bit depth. If the color depth of the target image data is RGBn bits (binary digits, bits), it means that the number of binary bits occupied by the pixel value of each pixel point in the target image indicated by the target image data is n, and n can be an integer greater than or equal to 3. The larger the value of n, the higher the color richness and the more uniform the brightness of the image.

[0080] For example, the color depth of the initial image data can be RGB3 bits, and the color depth of the corresponding target image data can be RGB5 bits; or the color depth of the initial image data can be RGB8 bits, and the color depth of the corresponding target image data can be RGB12 bits; or the color depth of the initial image data can be RGB8 bits, and the color depth of the corresponding target image data can be RGB16 bits. The embodiments of the present application do not make any limitation on the specific color depth of the initial image data and the target image data.

[0081] In the embodiments of the present application, the target image data can include a plurality of sub-frame image data, and the plurality of sub-frame image data is determined according to a plurality of color depths of the target image data. Specifically, according to the color depth of the target image data, the pixel value of each pixel point in the image can be converted into an n-bit binary number, and different pixel values can be converted into different n-bit binary numbers. The n values in the n-bit binary number correspond to n bits, and the values in the binary numbers corresponding to all the pixel points in the image at the same bit can form a sub-frame image data. Correspondingly, the target image data of RGBn bits can include n sub-frame image data corresponding to n bits, and each sub-frame image data includes the binary values of all the pixel points in the image at the corresponding bit.

[0082] For example, if the color depth of the initial image data is RGB 3 bits, the color depth of the target image data obtained after processing the initial image data can be RGB 5 bits, and the pixel value of each pixel point in the target image indicated by the target image data can be converted into a 5-bit binary number. For example, if the pixel value of a pixel point is 31, the pixel value can be converted into a 5-bit binary number 11111; if the pixel value of another pixel point is 16, the pixel value can be converted into a 5-bit binary number 10000.

[0083] Optionally, in step S310, referring to the driving timing shown in FIG. 3B, after obtaining the target image data, the plurality of sub-frame image data in the target image data can be buffered into the memory in the first period of the first frame time. For example, the near-eye display device can process the initial image data pixel by pixel and line by line, and store each sub-frame image data in the target image data pixel by pixel and line by line into the memory. Figure 4

[0084] S320, in the second period of the first frame time, the display screen is controlled to display images according to the target image data.

[0085] In an implementation, in the second period of the first frame time, the plurality of sub-frame image data can be sequentially read from the memory, and the display screen is controlled to sequentially display images of the plurality of sub-frame image data according to a preset pulse width dimming signal, wherein the pulse width dimming signal is used to indicate whether each sub-frame image data is displayed and the display duration of each sub-frame image data. The target image data stored in the first period of the first frame time can be read and displayed in the second period of the first frame time, so that the memory only buffers one frame of target image data in one frame time, that is, the size of the occupied cache space is equal to the size of the target image data. Compared with the existing image display method which needs to occupy 2 times the cache space of the target image data in one frame time, the cache space can be effectively saved.

[0086] By way of example and not limitation, the pixel circuit in the near-eye display device can sequentially perform data reading and image display on the n sub-frame image data corresponding to n bits in the target image data in the order from high bit to low bit. Specifically, for each sub-frame image data, the binary value corresponding to each pixel point can be read from the memory pixel by pixel and line by line, and the binary value corresponding to each pixel point is 0 or 1. If the binary value corresponding to the pixel point is 1, the pixel point on the display screen is controlled to be in the lighted state, and if the binary value corresponding to the pixel point is 0, the pixel point on the display screen is controlled to be in the extinguished state.

[0087] ​In one embodiment, during the image display process, the near-eye display device can control the display screen to display the n sub-frame image data in the target image data according to the display brightness level of the display screen set by the user.

[0088] Specifically, the n sub-frame image data can correspond to different display durations, and sequentially displaying any one or more of the n sub-frame image data can make the display screen have different brightness levels. Therefore, the corresponding pulse width dimming signal can be determined according to the display brightness level of the display screen set by the user, and the pulse width dimming signal can be used to control whether the multiple sub-frame image data in the target image data is displayed and the display duration, so that the display screen reaches the brightness level set by the user.

[0089] For example, assuming that the color depth of the target image data is RGB5bit, the target image data includes 5 sub-frame image data, and the near-eye display device sequentially reads and displays the 5 sub-frame image data corresponding to the 5 bit positions in the target image data in the order from the high bit position to the low bit position within the second period of the first frame time. If the preset display brightness level of the display screen is the highest, referring to the driving timing and the corresponding pulse width dimming signal diagram shown in Figure 4 the driving timing is used to indicate the durations of the first period and the second period within one frame time, and the corresponding pulse width dimming signal is high within the second period. The near-eye device can sequentially read and display the 5 sub-frame image data from the high bit position to the low bit position within the second period according to the pulse width dimming signal, and the higher the bit position, the longer the display duration of the corresponding sub-frame image data. If the preset display brightness level of the display screen is the lowest, the pulse width dimming signal is low within the duration range corresponding to the data reading and image display processes of the first 4 sub-frame image data within the second period; the pulse width dimming signal is high within the duration range corresponding to the data reading and image display processes of the 5th sub-frame image data corresponding to the lowest bit position, and the duration of the high level of the pulse width dimming signal within the second period is equal to the display duration of the sub-frame image data corresponding to the lowest bit position.

[0090] Alternatively, the duration of the second period within the first frame time can be less than or equal to half of the duration of the first frame time, which can effectively reduce the display delay of the near-eye display device and alleviate the ghosting problem. At the same time, the duration of the second period is positively correlated with the display delay of the near-eye display device, and the shorter the duration of displaying the target image data within the second period of the first frame time, the more significant the ghosting alleviation effect of the near-eye display device.

[0091] Based on the image display method provided in the embodiments of the present application, the processing of one frame of initial image data, the caching process of target image data, and the process of reading multiple sub-frame image data in the target image data in a row by row and pixel by pixel manner and performing image display can be completed in different time periods in the first frame time, thereby effectively shortening the time length of data processing, caching, reading, and image display, reducing the image display time delay of the near-eye display device and alleviating the ghosting phenomenon. In addition, the target image data stored in the first time period can be read and displayed in the second time period, thereby effectively saving the cache space occupied by the storage of image data.

[0092] Generally, a near-eye display device has different display modes. The near-eye display device has different requirements for image display time delay in different display modes, and the requirements for the first time period and the second time period in each frame time are also different. For example, in the 0Dof display modes such as static viewing, air screen projection mode, auxiliary screen mode, and somersault mode, the coordinates of the center pixel point of the video area in the display screen do not change, that is, the image center coordinates displayed in the video area in the display screen do not change, the display time delay has a relatively low influence on the image display effect and is not easy to cause the ghosting phenomenon. For another example, in the multi-degree-of-freedom display modes such as the follow-up mode, the center pixel point of the video area in the display screen moves relatively fast with the movement of the device, the display time delay has a relatively large influence on the image display effect and is easy to cause the ghosting phenomenon. Therefore, the near-eye display device needs to have a relatively low image display time delay and ghosting length in the multi-degree-of-freedom display mode.

[0093] As can be seen from the above, the corresponding driving timing can be matched for each frame time in the image display process based on different display modes, and then the driving timing is used to perform the operations of data processing, caching, reading, and display on the obtained initial image data in each frame time by the image display method in steps S310 to S320. The driving timing can be used to indicate the time length of the first time period and the second time period in the corresponding frame time in the process of image display of the near-eye display device in the corresponding display mode.

[0094] Figure 5 The flowchart of the method for determining the target driving timing provided in the embodiments of the present application mainly relates to the process of how to determine the time length of the first time period and the second time period in each frame time in the process of image display of the near-eye display device in the target display mode. The method includes steps S510 to S520. Each step will be described in detail below.

[0095] S510, a trigger instruction of a target display mode of a near-eye display device is received, and the trigger instruction includes the degree of freedom of the target display mode.

[0096] Specifically, the near-eye display device can have one or more different display modes, each display mode can display according to the corresponding degree of freedom. In one example, one or more application software can be installed in the near-eye display device, and different application software corresponds to different display modes. When the user starts one of the target application software in the plurality of application software, the trigger instruction corresponding to the target display mode of the target application software can be triggered, and the processor in the near-eye display device can display the image in the target display mode according to the degree of freedom corresponding to the target display mode in the trigger instruction.

[0097] The degree of freedom of the target display mode can be used to indicate the direction of the degree of freedom in which the display content moves with the movement of the near-eye display device in the target display mode. The target display mode can have 0Dof or multiple degrees of freedom, and the multiple degrees of freedom can be 2Dof, 3Dof, 6Dof or others. The degree of freedom direction corresponding to each degree of freedom can be any one or more of the roll direction, the pitch direction, the heading direction, the vertical direction, the left-right direction and the front-back direction. Among them, the roll direction is the direction of the near-eye display device rotating around the X axis in the preset space coordinate system, the pitch direction is the direction of the near-eye display device rotating around the Y axis in the preset space coordinate system, the heading direction is the direction of the near-eye display device rotating around the Z axis in the preset space coordinate system, the vertical direction is the direction of the near-eye display device translating along the Z axis in the preset space coordinate system, the left-right direction is the direction of the near-eye display device translating along the Y axis in the preset space coordinate system, and the front-back direction is the direction of the near-eye display device translating along the X axis in the preset space coordinate system.

[0098] For example, the target display mode of the screen projection application software can be a 0Dof air projection mode, that is, the coordinates of the center pixel point of the video area in the display screen do not move with the movement of the device during the movement of the near-eye display device. For another example, the target display mode of the video software can be a 3Dof VR viewing mode, and the corresponding degree of freedom direction can include the roll direction, the pitch direction and the heading direction, so that the coordinates of the center pixel point of the video area in the display screen move relative to the display screen with the movement of the device during the movement of the near-eye display device in the three degrees of freedom directions of roll, pitch and heading.

[0099] S520, according to the degree of freedom, determine the target driving time sequence of the plurality of frame times from the plurality of different driving time sequences pre-stored, the target driving time sequence is used to indicate the time length of the first period and the time length of the second period in the corresponding frame time, and the time length of the first period and / or the time length of the second period corresponding to different driving time sequences are different.

[0100] It should be noted that the near-eye display device includes a plurality of continuous unit times in the running time range of the target display mode, and each unit time includes a plurality of continuous frame times. When the target display mode has a 0Dof, the display content moves with the movement of the device, the display delay has a low influence on the display effect of the image and is not easy to cause a trailing phenomenon, and therefore, for the target display mode of the 0Dof, the processor can determine a target driving timing corresponding to the target display mode before receiving the first initial image data, and the target driving timing corresponding to all frame times in the running time range of the target display mode is the same.

[0101] However, when the degree of freedom of the target display mode is greater than 0, the display delay has a great influence on the display effect of the image and is easy to cause a trailing phenomenon when the human body moves the near-eye display device, and the speed of the movement of the near-eye display device is different in the requirement for the image display delay and the influence degree on the trailing. Therefore, for the target display mode of the degree of freedom greater than the 0Dof, the processor can adjust the target driving timing of the next frame time according to the movement speed or displacement of the near-eye display device in one frame time.

[0102] Therefore, the plurality of different driving timings pre-stored above can be based on the data processing performance of the processor of the near-eye display device, and different driving timings are pre-set corresponding to different display modes and different displacement amounts of the near-eye display device in one frame time. The length of the first period in the corresponding frame time indicated by the driving timing should be adapted to the data processing performance of the processor. Specifically, the shorter the length of the first period, the higher the requirement for the data processing performance of the processor, and the greater the power consumption of the processor.

[0103] In one embodiment, the plurality of driving timings pre-stored in the near-eye display device can include one or more different driving timings corresponding to the 0Dof.

[0104] For example, it is assumed that the length of one frame time is T, and on this basis, the plurality of pre-stored driving timings includes two different driving timings corresponding to the 0Dof. The length of the first period in one frame time indicated by one of the driving timings can be 2T / 3, and the length of the second period is T / 3. The schematic diagram of the other driving timing is as shown in FIG. 2B. Figure 6 Figure 6 The length of the first period in one frame time indicated by the driving timing one is T / 2, and the length of the second period is T / 2.

[0105] It should be noted that the embodiments of the present application do not make any limitation on the specific lengths of the first period and the second period indicated by the driving timing corresponding to the 0Dof in the above examples.

[0106] ​In another embodiment, the near-eye display device can further include a plurality of different driving time sequences corresponding to the plurality of degrees of freedom. The plurality of driving time sequences correspond to different movement ranges of the near-eye display device within a frame time, and the displacement amount of the near-eye display device within the frame time is negatively correlated with the length of the first period and / or the length of the second period corresponding to the driving time sequence, i.e., the greater the displacement amount, the shorter the total length of the first period and the second period within a frame time indicated by the corresponding driving time sequence.

[0107] In addition, the total length of the first period and the second period within a frame time indicated by the driving time sequence corresponding to the plurality of degrees of freedom is less than the length of a frame time, i.e., a frame time can include three periods, the three periods being the first period, the second period, and the third period, respectively. The driving time sequence can be used to indicate that, within the first period of the first frame time, after receiving and processing a frame of initial image data to be displayed, the near-eye display device stores the target image data obtained; within the second period of the first frame time, the target image data is read frame by frame and line by line, and the display screen is controlled to display images according to the target image data; and within the third period of the first frame time, no image data is displayed and no image data is processed, and the next initial image data to be processed is received until the next frame time of the first frame time.

[0108] For example, assuming that the length of a frame time is T, on this basis, a plurality of pre-stored driving time sequences include three different driving time sequences corresponding to the plurality of degrees of freedom, the three different driving time sequences being driving time sequence two, driving time sequence three, and driving time sequence four, respectively. The schematic diagram of the driving time sequence two is as shown in Figure 7 The displacement range corresponding to the driving time sequence two is that the displacement amount of the near-eye display device within a frame time is less than or equal to a first threshold value, the length of the first period within a frame time indicated by the driving time sequence two can be 5T / 12, the length of the second period can be 5T / 12, and the length of the third period is T / 6. The timing diagram of the driving time sequence three is as shown in Figure 8 The displacement range corresponding to the driving time sequence three is that the displacement amount of the near-eye display device within a frame time is greater than the first threshold value and less than a second threshold value, the length of the first period within a frame time indicated by the driving time sequence three can be T / 3, the length of the second period can be T / 3, and the length of the third period is T / 3. The timing diagram of the driving time sequence four is as shown in Figure 9 The displacement range corresponding to the driving time sequence four is that the displacement amount of the near-eye display device within a frame time is greater than or equal to the second threshold value, the length of the first period within a frame time indicated by the driving time sequence four can be T / 4, the length of the second period can be T / 4, and the length of the third period is T / 2. The first threshold value is less than the second threshold value.

[0109] It should be noted that the number of thresholds corresponding to different moving ranges, the value of each threshold, and the specific duration of the first period and the second period indicated by the driving timing corresponding to the display mode with multiple degrees of freedom in the embodiments of the present application are not limited in any way.

[0110] In an implementation manner, after receiving the trigger request of the target display mode, if the degree of freedom of the target display mode in the trigger request is 0, the processor of the near-eye display device can determine that all frame time corresponding to the target driving timing in the running duration of the near-eye display device in the target display mode are the same, and the sum of the duration of the first period and the duration of the second period corresponding to the target driving timing is equal to the duration of the frame time.

[0111] By way of example and not limitation, if the target display mode has 0Dof, it is determined that the target driving timing corresponding to all frame times in the running process of the near-eye display device in the target display mode can be the driving timing one shown in FIG. 1. On this basis, if the preset pulse width dimming signal indicates that all sub-frame image data in each target image data is displayed, and the duration of each frame time is T, the driving timing corresponding to the two consecutive frame times of the near-eye display device can be as shown in FIG. 2, wherein in any two consecutive frame times (i.e. the first frame time and the second frame time, the second frame time is the next frame time of the first frame time) in all frame times in the running duration of the target display mode, the target driving timing is used to indicate that when the near-eye display device runs in the target display mode with 0Dof, in the first period with a duration of T / 2 of the first frame time, after receiving and processing a frame of initial image data to be displayed, the obtained target image data is cached, in the second period with a duration of T / 2 of the first frame time, all sub-frame image data in the target image data is read and displayed on the display screen in turn row by row and frame by frame. After the first frame time ends, there is no image data stored in the memory. In the first period with a duration of T / 2 of the second frame time, after receiving and processing another frame of initial image data to be displayed, another target image data obtained is cached, in the second period with a duration of T / 2 of the second frame time, all sub-frame image data in the target image data cached in the first period of the second frame time is read and displayed on the display screen in turn row by row and frame by frame. Figure 6 Figure 10

[0112] ​​In another implementation, after receiving the trigger request of the target display mode, if the target display mode has multiple degrees of freedom in the trigger request, the processor of the near-eye display device can determine the target driving timing of the first frame time according to the pose information of the near-eye display device in the last frame time of the first frame time during the image display process in the target display mode from the pre-stored multiple different driving timings. Specifically, referring to the method flowchart shown in Figure 11 The target driving timing can be determined by the method in steps S1110 to S1120. Each step is described in detail below.

[0113] S1110, determining the displacement amount of the center pixel point of the video area in the display screen in the last frame time of the first frame time according to the pose information of the near-eye display device in the last frame time of the first frame time.

[0114] The pose information is used to indicate the position and pose of the near-eye display device in space, and can specifically include the three-axis acceleration and three-axis angular velocity of the device. For example, the pose information of the device can be detected in real time by the inertial measurement unit or other sensing devices arranged in the near-eye display device.

[0115] The video area in the video screen of the near-eye display device is used to display the target image data. When the target display mode of the near-eye display device has multiple degrees of freedom, the size of the video area in the display screen can remain unchanged during the movement of the near-eye display device driven by the human body, but the center pixel point of the video area in the display screen will move with the movement of the device, and correspondingly, the center pixel point of the target image data displayed in the video area will also move. Therefore, in the embodiments of the present application, the spatial movement direction and the spatial displacement amount of the near-eye display device in the world coordinate system in the last frame time of the first frame time can be determined by detecting the pose information of the near-eye display device in the last frame time of the first frame time, and then the displacement amount of the center pixel point of the video area in the display screen in the last frame time of the first frame time, the movement direction of the center pixel point of the video area in the display screen corresponding to the first frame time relative to the center pixel point of the video area in the display screen corresponding to the last frame time of the first frame time can be determined according to the mapping relationship between the world coordinate system and the display screen coordinate system, the spatial movement direction and the spatial displacement amount.

[0116] Specifically, the displacement of the center pixel point of the video area in the display screen in the last frame time of the first frame time can be: the number of pixel points that the center pixel point of the video area in the display screen corresponding to the first frame time moves in the display screen coordinate system relative to the center pixel point of the video area in the display screen corresponding to the last frame time of the first frame time. Wherein, the video area in the display screen in the first frame time is used to display the target image data cached in the first time period of the first frame time, and the video area in the display screen in the last frame time of the first frame time is used to display the target image data cached in the first time period of the last frame time of the first frame time.

[0117] For example, referring to Figure 12 the schematic diagram of the movement of the video area in the display screen, it is assumed that the near-eye display device moves rapidly with the human body in the process of image display in the multi-degree-of-freedom target display mode in the last frame time of the first frame time, and the video area in the display screen corresponding to the last frame time of the first frame time is the first video area shown in Figure 12 , the coordinates of the first center pixel point of the first video area in the display screen coordinate system can be represented as (x1, y1), then according to the posture information of the near-eye display device in the last frame time of the first frame time, the displacement and the moving direction of the center pixel point of the video area in the display screen in the last frame time of the first frame time can be determined, and then the position of the center pixel point of the video area in the display screen corresponding to the first frame time can be determined, wherein the video area in the display screen corresponding to the first frame time is the second video area shown in Figure 12 , the coordinates of the second center pixel point of the second video area in the display screen coordinate system can be represented as (x2, y2), then the displacement of the second center pixel point relative to the first center pixel point can be represented as , the size of the first video area and the size of the second video area are the same.

[0118] S1120, according to the displacement and at least one preset threshold, determine the target driving timing corresponding to the first frame time from the pre-stored plurality of different driving timings, wherein the sum of the time length of the first time period and the time length of the second time period corresponding to the target driving timing is less than the frame time, and the displacement is negatively related to the time length of the first time period and / or the time length of the second time period corresponding to the target driving timing.

[0119] Specifically, by comparing the displacement of the near-eye display device in the previous frame time with one or more preset thresholds corresponding to multiple different driving timing sequences for multiple degrees of freedom, the displacement range to which the displacement belongs can be determined. This allows the target driving timing sequence for the first frame time to be determined as the preset driving timing sequence corresponding to the displacement range to which the displacement belongs. Furthermore, the larger the displacement in the previous frame time, the shorter the duration of the first time period and / or the shorter the duration of the second time period corresponding to the target driving timing sequence for the first frame time.

[0120] In one example, suppose the pre-stored multiple drive timing sequences include three different drive timing sequences corresponding to multiple degrees of freedom, and the three different drive timing sequences are as follows: Figures 7 to 9 The driving timing sequences 2, 3, and 4 are shown below. See also... Figure 13 The flowchart shown illustrates the determination of the target driving timing for the first frame time. If the displacement of the center pixel of the video area on the display screen in the previous frame time is less than or equal to a first threshold, then the target driving timing for the first frame time can be determined as follows: Figure 7 The driving timing shown is as follows: If the displacement of the center pixel of the video area in the display screen is greater than the first threshold and less than the second threshold in the previous frame time of the first frame time, then the target driving timing for the first frame time can be determined as follows. Figure 8 The driving timing shown is as follows: If the displacement of the center pixel of the video area in the display screen is greater than or equal to the second threshold in the previous frame time of the first frame time, then the target driving timing for the first frame time can be determined as follows. Figure 9 The driving timing diagram shown is shown in Figure 4. In this figure, the first threshold is less than the second threshold.

[0121] It should be noted that during the operation of the near-eye display device in a multi-degree-of-freedom display mode, the processor can repeatedly execute the method in steps S1110 to S1120 based on the different requirements for image display latency and the different impacts on ghosting caused by the different movement speeds of the near-eye display device. This allows the processor to determine the target driving timing for each frame time other than the first frame time within the runtime, i.e., to determine the target driving timing for the current frame time by the displacement of the previous frame time. This enables real-time adjustment of the target driving timing for each frame time, reducing image display latency and prediction latency, improving ghosting, and enhancing the visual display effect of the near-eye display device.

[0122] See, as an example rather than a limitation. Figure 13 The flowchart shown illustrates the determination of the target driving timing corresponding to the first frame time, and Figure 14Another driving timing diagram corresponding to two continuous frame times is shown. It is assumed that the target display mode has a 3Dof, the preset pulse width dimming signal is used to indicate that all sub-frame image data in each target image data is displayed in turn, the preset threshold includes a first threshold and a second threshold, and the first threshold is 10 and the second threshold is 20. Figure 14 The two continuous frame times shown in the first frame time and the second frame time, wherein the second frame time is the next frame time of the first frame time, and the time length of the first frame time and the second frame time is T. If the displacement of the center pixel point of the video area in the display screen in the last frame time of the first frame time is 15, which is greater than the first threshold and less than the second threshold, the target driving timing of the first frame time can be Figure 8 The preset driving timing three shown in the near-eye display device running in the target display mode of 3Dof can receive and process one frame of initial image data to be displayed in the first period of T / 3 of the first frame time, cache the obtained target image data, read all sub-frame image data in the target image data in turn in the second period of T / 3 of the first frame time, and control the display screen to display images, and in the third period of T / 3 of the first frame time, neither process image data nor display images, wait until the second frame time receives new initial image data, and then perform image display according to the target driving timing corresponding to the second frame time.

[0123] If it is detected that the displacement of the center pixel point of the video area in the display screen in the last frame time of the second frame time (i.e. the first frame time) is 30, which is greater than the second threshold, the target driving timing of the second frame time can be Figure 9 The preset driving timing four shown in the near-eye display device running in the target display mode of 3Dof can receive and process a new frame of initial image data to be displayed in the first period of T / 4 of the second frame time, cache the obtained new target image data, read all sub-frame image data in the new target image data in turn in the second period of T / 4 of the second frame time, and control the display screen to display images, and in the third period of T / 2 of the second frame time, neither process image data nor display images, wait until the next frame time of the second frame time receives a new initial image data, and then perform image display according to the target driving timing corresponding to the next frame time of the second frame time.

[0124] In another implementation, after receiving the trigger request of the target display mode, if the target display mode has multiple degrees of freedom in the trigger request, and the first frame time is the first time frame of the near-eye display device when the target display mode is running, that is, there is no last frame time of the first frame time, the processor of the near-eye display device determines that any one of the plurality of different driving time sequences that meet the condition that the length of the first time period and the length of the second time period are less than the length of a frame time is the target driving time sequence of the first frame time. And from the next frame time of the first frame time, the target driving time sequence of each frame time can be determined by the method in steps S1110 to S1120.

[0125] Based on the image display method provided in the embodiments of the present application, the corresponding target driving time sequence can be matched for different display modes of the near-eye display device, so that the near-eye display device can complete the processing and storage process of the initial image data and the process of reading and displaying the target image data obtained after the processing in different time periods at the current time, while reducing the proportion of the time length of the device processing image data in a frame time and the proportion of the image display time in a frame time. The processed image data in the first frame time can be displayed in the first frame time, thereby reducing the display delay of the image, reducing the cache space occupied by the target image data, and improving the problem of ghosting. In addition, in the target display mode of 3Dof, 6Dof and the like, the corresponding target driving time sequence can also be matched for each frame time according to the speed of movement of the near-eye display device during the image display process, further improving the image display effect of the device when running in the target display mode of multiple degrees of freedom.

[0126] The above describes the method embodiments provided by the present application, and the device embodiments provided by the present application will be described below. It should be understood that the description of the device embodiments corresponds to the description of the method embodiments, and therefore, the content not described in detail can be referred to the method embodiments described above, and for brevity, will not be described here.

[0127] Figure 15 is a schematic block diagram of the image display device provided by the embodiments of the present application, which can be deployed in the cloud server in the foregoing embodiments. As shown in Figure 15 the image display device 1500 can include a processing unit 1510 and a display unit 1520. The processing unit 1510 can implement the corresponding processing function.

[0128] Optionally, the image display device 1500 can also include a storage unit, which can be used to store instructions and image data, and the processing unit 1510 can read the instructions and image data in the storage unit to enable the device to implement the foregoing method embodiments.

[0129] Specifically, the processing unit 1510 is configured to receive and process initial image data of a frame to be displayed to obtain target image data in a first time period of a first frame time, a length of the first frame time being determined based on a number of image transmission frames per unit time of the display screen, the unit time including a plurality of frame times, and the first frame time being any one of the plurality of frame times. The display unit 1520 is configured to control the display screen to display images according to the target image data in a second time period of the first frame time.

[0130] Optionally, a length of the second time period is less than or equal to half of a length of the first frame time.

[0131] Optionally, the processing unit 1510 is further configured to receive a trigger instruction of a target display mode of the near-eye display device, the trigger instruction including a degree of freedom of the target display mode; determine a target driving time sequence of the plurality of frame times from a plurality of different driving time sequences according to the degree of freedom, wherein the target driving time sequence is used to indicate a length of the first time period and a length of the second time period in the corresponding frame time, and the different driving time sequences correspond to different lengths of the first time period and / or the second time period.

[0132] Optionally, if the degree of freedom is 0, the target driving time sequence of the plurality of frame times is the same, and a sum of the length of the first time period and the length of the second time period corresponding to the target driving time sequence is equal to the length of the frame time.

[0133] Optionally, if the degree of freedom is greater than 0, the processing unit 1510 is further configured to determine the target driving time sequence of the first frame time from the plurality of different driving time sequences according to pose information of the near-eye display device in a last frame time of the first frame time.

[0134] Optionally, the processing unit 1510 determines the target driving time sequence of the first frame time from the plurality of different driving time sequences according to the pose information of the near-eye display device in the last frame time of the first frame time, and specifically includes: the processing unit 1510 determines a displacement amount of a center pixel point of a video area in the display screen in the last frame time of the first frame time according to the pose information of the near-eye display device in the last frame time of the first frame time, the video area being used to display the target image data; determines the target driving time sequence corresponding to the first frame time from the plurality of different driving time sequences according to the displacement amount and at least one preset threshold; wherein a sum of the length of the first time period and the length of the second time period corresponding to the target driving time sequence is less than the frame time, and the displacement amount is negatively correlated with the length of the first time period and / or the length of the second time period corresponding to the target driving time sequence.

[0135] Optionally, a color depth of the target image data is greater than a color depth of the initial image data.

[0136] Optionally, the target image data comprises a plurality of sub-frame image data, and the plurality of sub-frame image data is determined according to a plurality of color depths of the target image data. After obtaining the target image data, the processing unit 1510 is further configured to cache the plurality of sub-frame image data in a first time period of the first frame time.

[0137] Optionally, the display unit 1520 controls the display screen to display images according to the target image data in a second time period of the first frame time, specifically including: the display unit 1520 sequentially reads the plurality of sub-frame image data in the second time period of the first frame time, and controls the display screen to sequentially display images of the plurality of sub-frame image data according to a preset pulse width dimming signal; the pulse width dimming signal is used to indicate a display duration of each sub-frame image data.

[0138] It should be understood that the description of the device embodiment can refer to the related description of the above-mentioned image display method embodiments, and the implementation principle and technical effects are similar to those of the above-mentioned method embodiments, which will not be described here.

[0139] Based on the image display method provided in each of the above embodiments, the embodiments of the present application further provide the following content:

[0140] The embodiments of the present application provide a computer program product, which includes a program. When the program is run on an electronic device, the electronic device implements the image display method shown in each of the above embodiments.

[0141] The embodiments of the present application provide a computer readable storage medium, which stores a computer program. When the computer program is executed by a processor, the image display method shown in each of the above embodiments is implemented.

[0142] The embodiments of the present application provide a chip, which includes a memory and a processor. The processor executes a computer program stored in the memory to control the electronic device to implement the image display method shown in each of the above embodiments.

[0143] It should be understood that the processor mentioned in the embodiments of the present application can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0144] It should also be understood that the memory mentioned in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically EPROM (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM) and direct rambus RAM (DR RAM).

[0145] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the above division of each functional unit and module is exemplified, and in actual application, the above functions can be completed by different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit, and the integrated unit can be realized in the form of hardware or in the form of software functional unit. In addition, the specific name of each functional unit and module is only for convenient distinction, and does not limit the protection scope of the present application. In the above embodiments, the description of each embodiment is focused on, and the parts not described in detail or recorded in a certain embodiment can be referred to the relevant description of other embodiments.

[0146] Those skilled in the art can understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0147] In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented by other ways. For example, the system embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and there can be another division way in actual implementation, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection between the units can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0148] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.

[0149] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically independently, or two or more units can be integrated into one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0150] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the present application can implement all or part of the processes in the above-mentioned embodiment methods through a computer program to instruct related hardware to complete, and the computer program can be stored in a computer readable storage medium. When the computer program is executed by a processor, the steps of the above-mentioned various method embodiments can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable files or some intermediate forms, etc. The computer readable medium at least includes any entity or device capable of carrying the computer program code to the large screen device, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium. For example, U disk, mobile hard disk, magnetic disk or optical disk, etc. In some jurisdictions, according to legislation and patent practice, the computer readable medium cannot be an electrical carrier signal and a telecommunication signal.

[0151] Finally, it should be noted that: the above is only a specific implementation of the present application, but the protection scope of the present application is not limited to this, any change or replacement within the technical scope disclosed in the present application should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An image display method characterized by, The method is applied to a near-eye display device including a display screen, and comprises the following steps: receiving a trigger instruction of a target display mode of the near-eye display device, the trigger instruction including a degree of freedom of the target display mode; determining, according to the degree of freedom, a target driving time sequence corresponding to each frame time in a unit time from a plurality of different pre-stored driving time sequences, the target driving time sequence being used to indicate a time length of a first time period and a time length of a second time period in the corresponding frame time, the time length of the first time period and / or the time length of the second time period corresponding to different driving time sequences being different, the unit time including a plurality of frame times; in the first time period of the first frame time, receiving and processing a frame of initial image data to be displayed to obtain target image data, the time length of the first frame time being determined based on the number of image transmission frames of the display screen in the unit time, the first frame time being any one of the frame times in the unit time; in the second time period of the first frame time, controlling the display screen to display images according to the target image data.

2. The method of claim 1, wherein, The time length of the second time period is less than or equal to half of the time length of the first frame time.

3. The method according to claim 1 or 2, characterized in that, If the degree of freedom is 0, the target driving time sequences of the plurality of frame times are the same, and the sum of the time length of the first time period and the time length of the second time period corresponding to the target driving time sequence is equal to the time length of the frame time.

4. The method according to claim 1 or 2, characterized in that, The determination of the target driving time sequence corresponding to each frame time in the unit time from the plurality of different pre-stored driving time sequences according to the degree of freedom comprises: If the degree of freedom is greater than 0, the target driving time sequence of the first frame time is determined from the plurality of different pre-stored driving time sequences according to the posture information of the near-eye display device in the last frame time of the first frame time.

5. The method of claim 4, wherein, The determination of the target driving time sequence of the first frame time from the plurality of different pre-stored driving time sequences according to the posture information of the near-eye display device in the last frame time of the first frame time comprises: determining, according to the posture information of the near-eye display device in the last frame time of the first frame time, a displacement amount of a center pixel point of a video area in the display screen in the last frame time of the first frame time, the video area being used to display target image data; determining, according to the displacement amount and at least one preset threshold, the target driving time sequence of the first frame time from the plurality of different pre-stored driving time sequences; wherein the sum of the time length of the first time period and the time length of the second time period corresponding to the target driving time sequence is less than the frame time, and the displacement amount is negatively correlated with the time length of the first time period and / or the time length of the second time period corresponding to the target driving time sequence.

6. The method according to any one of claims 1 to 5, characterized in that, The color depth of the target image data is greater than the color depth of the initial image data.

7. The method according to any one of claims 1 to 6, characterized in that, The target image data includes a plurality of sub-frame image data, the plurality of sub-frame image data being determined according to a plurality of color depths of the target image data. After obtaining the target image data, the method further comprises: in the first time period of the first frame time, buffering the plurality of sub-frame image data.

8. The method of claim 7, wherein, The second time period in the first frame time, according to the target image data control display screen for image display, comprising: In the second time period in the first frame time, the plurality of sub-frame image data is read in turn, and according to the preset pulse width dimming signal, the display screen is controlled to display image data in turn to the plurality of sub-frame image data; The pulse width dimming signal is used to indicate the display duration of each sub-frame image data.

9. An image display device, characterized by comprising: Comprising: At least one module, the at least one module is used to realize the method as claimed in any one of claims 1 to 8.

10. A near-eye display device, comprising: Comprising: Processor and display screen, the processor is used to run the computer program stored in the memory, to realize the method as claimed in any one of claims 1 to 8.

11. A computer readable storage medium, characterized in that, The computer readable storage medium stores computer programs, and the computer programs are executed by the processor to realize the method as claimed in any one of claims 1 to 8.

Images