Display device, display system and display driving method

Abstract

The present application relates to a display device, a display system and a display driving method. The display device includes: a data reorganization module, which is used to obtain the initial image data of the image to be displayed and the focus area of ​​the eyeball on the display panel corresponding to the display device, and determine the reorganized image data of the image to be displayed according to the initial image data and the focus area; a pixel array module, which is used to receive the reorganized image data from the data processing module, and control the focus area and the peripheral area outside the focus area to display the image to be displayed with different resolutions according to the reorganized image data; wherein the resolution of the focus area is greater than the resolution of the peripheral area. The above-mentioned display device can provide high-resolution display for the area that needs to be paid attention to according to the user's line of sight focus, and low-resolution display for the remaining areas, thereby reducing unnecessary power consumption and improving the energy efficiency of the device.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a display device, a display system and a display driving method. Background Art

[0002] With the rapid development of display technology, micro-display devices such as liquid crystal displays (LCD) and organic light emitting diode displays (OLED) have been widely used in virtual reality (VR), augmented reality (AR) and high-resolution terminal devices due to their excellent image quality and energy efficiency.

[0003] However, in order to meet users' demand for high-definition and detailed display, the resolution of display devices continues to increase, requiring a large amount of pixel driving and data transmission, which leads to a sharp increase in the load of the driving circuit and a significant increase in device power consumption. Summary of the invention

[0004] Based on this, it is necessary to provide a display device, a display system and a display driving method that can reduce device load and power consumption in order to address the above technical problems.

[0005] In a first aspect, the present application provides a display device. The display device includes:

[0006] a data reorganization module, used to obtain initial image data of an image to be displayed and a focus area of ​​an eyeball on a display panel corresponding to the display device, and determine reorganized image data of the image to be displayed according to the initial image data and the focus area;

[0007] a pixel array module, connected to the data reorganization module, receiving the reorganized image data and controlling the focus area and the peripheral area outside the focus area to display the image to be displayed with different resolutions according to the reorganized image data; wherein the resolution of the focus area is greater than the resolution of the peripheral area.

[0008] In one of the embodiments, the pixel array module includes a plurality of regional pixel units, and the regional pixel units include full-drive pixels and optional pixels;

[0009] Wherein, when displaying the image to be displayed, the full-drive pixels are all in a working state, the optional pixels in the peripheral area are all in a non-working state, and at least some of the optional pixels in the focus area are in a working state.

[0010] In one embodiment, when the data reorganization module determines the reorganized image data of the image to be displayed according to the initial image data and the focus area, it is used to:

[0011] Determining full-drive pixel information of the full-drive pixel from the initial image data according to the arrangement position of the full-drive pixel;

[0012] Determining a pixel working state of the optional pixel according to an arrangement position of the optional pixel and the focusing area;

[0013] The reconstructed image data is determined by combining the full-drive pixel information of the full-drive pixel and the pixel working state of the optional pixel.

[0014] In one of the embodiments, the reconstructed image data further includes optional pixel information of optional pixels in a working state, and the optional pixel information is determined according to full-drive pixel information of full-drive pixels in pixel units in a region where the optional pixels are located;

[0015] The full drive pixel is used to receive and store full drive pixel information of the full drive pixel, and drive the physical pixel display according to the full drive pixel information;

[0016] Some of the full-drive pixels in the full-drive pixels are further used to receive and store the pixel working states of adjacent optional pixels, or are further used to receive and store the pixel working states of adjacent optional pixels and optional pixel information of the optional pixels; the adjacent optional pixels are used to represent the optional pixels in the regional pixel unit where the full-drive pixels are located;

[0017] The optional pixel is connected to some full-drive pixels and is used to configure whether the optional pixel is working according to the pixel working status stored in some full-drive pixels, and to drive the physical pixel display according to the optional pixel information stored in some full-drive pixels when the optional pixel is working.

[0018] In one of the embodiments, the full drive pixel is used to receive and store full drive pixel information of the full drive pixel, and drive the physical pixel display according to the full drive pixel information;

[0019] Some of the full-drive pixels are further used to receive and store pixel working states of adjacent optional pixels, where the adjacent optional pixels are used to represent optional pixels within the regional pixel unit where the full-drive pixels are located;

[0020] The optional pixel is connected to some full-drive pixels and is used to configure whether the optional pixel is working according to the pixel working status stored in some full-drive pixels, and, when the optional pixel is working, drive the physical pixel display according to the full-drive pixel information stored in the adjacent full-drive pixels.

[0021] In one of the embodiments, the area of ​​the optional pixel is smaller than the area of ​​the full-drive pixel.

[0022] In one of the embodiments, when the resolution of the original image data of the image to be displayed is greater than a preset resolution threshold, the initial image data is obtained by compressing the original image data according to the arrangement position of the full-drive pixels; and the preset resolution threshold is determined based on the resolution of the display panel when only the full-drive pixels are working.

[0023] In one embodiment, the display device further comprises a row and column driving module, and the row and column driving module is respectively connected to the data reorganization module and the pixel array module;

[0024] The row and column driving module is used to receive the reorganized image data from the data reorganization module and send the reorganized image data to the pixel array module.

[0025] In a second aspect, the present application further provides a display system, which includes the display device provided in the first aspect of the present application.

[0026] In a third aspect, the present application also provides a display driving method. The method comprises:

[0027] The data reassembly module acquires initial image data of an image to be displayed and a focus area of ​​an eyeball on a display panel corresponding to the display device, and determines reassembled image data of the image to be displayed according to the initial image data and the focus area;

[0028] The pixel array module receives the reconstructed image data and controls the focus area and the peripheral area outside the focus area to display the image to be displayed with different resolutions according to the reconstructed image data; wherein the resolution of the focus area is greater than the resolution of the peripheral area.

[0029] The display device, display system and display driving method described above acquire the initial image data of the image to be displayed and the focus area of ​​the eyeball on the display panel corresponding to the display device through the data reorganization module, and determine the reorganized image data of the image to be displayed according to the initial image data and the focus area. The pixel array module receives the reorganized image data from the data processing module, and controls the focus area and the peripheral area outside the focus area to display the image to be displayed with different resolutions according to the reorganized image data; wherein the resolution of the focus area is greater than the resolution of the peripheral area. The present application captures the focus area of ​​the user's eyeball on the screen, generates reorganized image data according to the focus area and the initial image data, so that in the reorganized image data, the focus area has a higher resolution to ensure visual clarity, while the non-focused peripheral area has a lower resolution, thereby reducing unnecessary calculation and driving circuit loads, and sends the reorganized image data to the pixel array module. After receiving the reorganized image data, the pixel array module can dynamically adjust the resolution of the display area according to the image data corresponding to the focus area and the image data corresponding to the peripheral area in the reorganized image data, so as to reduce the display cost of the non-focused area. Current display devices provide uniform high resolution for the entire screen, even if the human eye is not focusing on all areas, which results in a waste of power consumption. According to the visual characteristics of the human eye, the focused area is the focus of user attention, and reducing the resolution of other areas will not significantly affect the user experience. According to the focus of the user's line of sight, high-resolution display is only provided for the areas that need attention, and low-resolution display is provided for the remaining areas, thereby reducing unnecessary power consumption and improving the energy efficiency of the device. In scenarios such as AR / VR devices or smart glasses that require high-resolution and low-power display, the display device of the present application can provide a clear visual center image while reducing resource consumption in the peripheral areas. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 A diagram showing an application environment of a display device in an embodiment;

[0031] Figure 2 is a structural block diagram of a display device in one embodiment;

[0032] Figure 3 is a schematic diagram of a conventional pixel array module in one embodiment;

[0033] Figure 4 is a schematic diagram of a pixel array module in one embodiment;

[0034] Figure 5 is a schematic diagram of a regional pixel unit in one embodiment;

[0035] Figure 6 A schematic diagram of the division of regional location information in one embodiment;

[0036] Figure 7 A schematic diagram of the division of regional location information in one embodiment;

[0037] Figure 8 A schematic diagram of dividing regional location information in another embodiment;

[0038] Fig. 9 A schematic diagram of dividing regional location information in another embodiment;

[0039] Fig.10 A schematic diagram of a conventional pixel array module and row and column drivers in one embodiment;

[0040] Fig.11 A schematic diagram of a pixel array module and row and column drivers in one embodiment;

[0041] Fig.12 A schematic diagram of a display device displaying an image to be displayed in an embodiment;

[0042] Fig.13 It is a schematic diagram of a display device displaying an image to be displayed in another embodiment;

[0043] Fig.14 The layout and array of conventional pixels in one embodiment;

[0044] Fig.15 The layout and array of pixels in one embodiment;

[0045] Fig.16 FIG. 4 is a flow chart of a display driving method in an embodiment. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0047] Generally speaking, microdisplay devices are devices that use electrical and optical properties to display images on a display panel, including liquid crystal displays (LCD), organic light-emitting diodes (OLED) displays, etc. These display devices have a structure in which multiple pixels are arranged in a two-dimensional matrix of rows and columns.

[0048] With the continuous development of micro-display fields, such as augmented reality (AR) and virtual reality (VR), the market has put forward higher requirements on the display quality, size and power consumption of the display screens used. Generally speaking, in order to improve the display effect, the most direct way is to increase the number of pixels of the display screen to display higher resolution videos or images. However, doing so will greatly increase the size and power consumption of the display screen, which is not suitable for application scenarios in the micro-display field.

[0049] Current microdisplay devices usually use a uniform resolution to display images. Even in areas outside the user's visual focus, the pixel array is still driven to display at a high resolution. This design not only increases the power consumption of the device, but also significantly increases the load and manufacturing cost of the driving circuit, while causing a waste of hardware resources. In addition, high-resolution display may also cause heat dissipation problems, especially in portable devices, which poses challenges to the performance, stability and user experience of the display device.

[0050] In order to reduce the device load and power consumption, the present application provides a display device, which can be applied to Figure 1 In the application environment shown. Among them, the display device 100 is connected to the data processing device 200 and the position acquisition device 300 respectively. The data processing device 200 is used to receive the original image data from the signal source (such as a camera, a video stream, a computer), and convert it into a signal format that the display device 100 can recognize to obtain the initial image data. The data processing device 200 can be specifically a field programmable gate array (FPGA) or other processing hardware with high-performance parallel computing capabilities. The position acquisition device 300 is used to collect the position information of the point where the user's eyeball is focused, and send the position information to the display device 100. The position acquisition device 300 can be an eye tracking sensor based on infrared optics, an eye positioning sensor, or a high-precision camera module. The display device 100 can be integrated into a micro display chip, especially in AR / VR devices, smart glasses, wearable devices, smart projection, drone displays, and other scenes that require dynamic resolution adjustment, which can give full play to the miniaturization, low power consumption and high-precision display capabilities of the micro display chip.

[0051] In one embodiment, Figure 2 As shown, a display device is provided. The display device includes a data reorganization module 102 and a pixel array module 106.

[0052] The data reconstruction module 102 of the embodiment of the present application is used to obtain the initial image data of the image to be displayed and the focus area of ​​the eye on the display panel corresponding to the display device, and determine the reconstructed image data of the image to be displayed according to the initial image data and the focus area.

[0053] Since the size and shape of the human visual field are related to the distribution of photoreceptor cells in the retina, the center of the human retina is very sensitive to color and can clearly distinguish objects, which is generally called central vision. The edge of the retina is less sensitive to color and has poorer ability to distinguish objects, which is generally called peripheral vision. Based on the theory of human eye visual effects, the micro display panel can be divided into different areas, such as the focus area and the peripheral area.

[0054] Exemplarily, the position acquisition device 300 acquires the position information of the point on which the user's eye is focused and sends the position information to the data reconstruction module 102. The data reconstruction module 102 receives the position information of the point on which the eye is focused, obtains the focus area on the display panel corresponding to the display device according to the position information of the point on which the eye is focused, and determines the reconstructed image data of the image to be displayed according to the initial image data and the focus area. The reconstructed image data is used to indicate that the focus area and the surrounding area display the image to be displayed with different resolutions.

[0055] The pixel array module 106 of the embodiment of the present application is used to connect to the data reorganization module 102. The pixel array module 106 receives the reorganized image data and controls the focus area and the peripheral area outside the focus area to display the image to be displayed with different resolutions according to the reorganized image data; wherein the resolution of the focus area is greater than the resolution of the peripheral area.

[0056] In the above display device, the initial image data of the image to be displayed and the focus area of ​​the eyeball on the display panel corresponding to the display device are obtained by the data reorganization module, and the reorganized image data of the image to be displayed is determined according to the initial image data and the focus area. The reorganized image data from the data processing module is received by the pixel array module, and the focus area and the peripheral area outside the focus area are controlled to display the image to be displayed with different resolutions according to the reorganized image data; wherein the resolution of the focus area is greater than the resolution of the peripheral area. In the embodiment of the present application, the focus area of ​​the user's eyeball on the screen is captured, and the reorganized image data is generated according to the focus area and the initial image data, so that in the reorganized image data, the focus area has a higher resolution to ensure visual clarity, while the non-focused peripheral area has a lower resolution, thereby reducing unnecessary calculation and driving circuit loads, and the above reorganized image data is sent to the pixel array module. After receiving the reorganized image data, the pixel array module can dynamically adjust the resolution of the display area according to the image data corresponding to the focus area and the image data corresponding to the peripheral area in the reorganized image data, so as to reduce the display cost of the non-focused area. The current display device provides uniform high resolution for the entire screen, even if the human eye does not focus on all areas, which will lead to waste of power consumption. According to the visual characteristics of the human eye, the focus area is the focus of the user's attention. Reducing the resolution of other areas will not significantly affect the user experience. According to the focus of the user's line of sight, only the area that needs to be paid attention to is provided with high-resolution display, and the remaining areas are displayed at low resolution, thereby reducing unnecessary power consumption and improving the energy efficiency of the device. In scenarios such as AR / VR devices or smart glasses that require high-resolution and low-power display, the display device of the embodiment of the present application can provide a clear visual center image while reducing resource consumption in the peripheral area.

[0057] In one embodiment, the pixel array module includes a plurality of regional pixel units, and the regional pixel units include full-drive pixels and optional pixels. When displaying the image to be displayed, the full-drive pixels are all in a working state, the optional pixels in the peripheral area are all in a non-working state, and at least some of the optional pixels in the focus area are in a working state.

[0058] The traditional pixel array module has a structure in which multiple pixels are arranged in a two-dimensional matrix of rows and columns. Figure 3 , the pixels in the traditional pixel array module can be understood as full-drive pixels (FP, Full-drivepixel), that is, all pixels have the same driving capability and display function, and are displayed according to the content of the original image.

[0059] The pixel array module of the embodiment of the present application can be divided into a plurality of identical regional pixel units, and the plurality of regional pixel units are arranged in an array. Each regional pixel unit includes full-drive pixels and optional pixels arranged in a two-dimensional matrix of rows / columns. The embodiment of the present application does not specifically limit the number of full-drive pixels and optional pixels and their specific positional relationship in the regional pixel unit, and can be flexibly configured according to specific application requirements.

[0060] As an example, see Figure 4 and Figure 5 In the embodiment of the present application, the pixel array can be divided into regional pixel units including a 3×3 pixel matrix, and the plurality of regional pixel units are arranged in an array as a whole. For each regional pixel unit, the regional pixel unit includes 4 full-drive pixels FP and 5 optional pixels SP, and the 4 full-drive pixels FP are respectively located at the first row and first column, the first row and third column, the third row and first column, and the third row and third column of the 3×3 pixel matrix, and the other positions are set as optional pixels.

[0061] In the embodiment of the present application, during the process of displaying the image to be displayed, all the full-drive pixels FP are in a working state, all the optional pixels SP in the peripheral area are in a non-working state, and at least some of the optional pixels SP in the focus area are in a working state. In this way, the display device can display in a manner in which the resolution of the focus area is greater than the resolution of the peripheral area.

[0062] In an optional embodiment, if Figure 6 As shown, the data reorganization module divides the display panel into a focus area and a peripheral area according to the position information of the point where the eyeball is focused, the full-drive pixels FP are all in a working state, the optional pixels SP in the focus area are all in a working state, and the optional pixels SP in the peripheral area are all in a non-working state. The focus area of ​​the embodiment of the present application is displayed at a first resolution, and the peripheral area is displayed at a second resolution, and the first resolution is greater than the second resolution.

[0063] As an example, see Figure 7 , regional pixel unit 6 and regional pixel unit 7 belong to the focus area, and the remaining regional pixel units belong to the peripheral area. During the display of the image to be displayed, all pixels in regional pixel unit 6 and regional pixel unit 7 are working, while the optional pixels SP of the regional pixel units in the peripheral area do not work.

[0064] In another optional embodiment, if Figure 8As shown, the data reorganization module divides the display panel into a focus area and a peripheral area according to the position information of the point focused by the eyeball, wherein the focus area may include a main focus area and a secondary focus area, and the secondary focus area may surround the periphery of the main focus area, and be adjacent to the main focus area and the peripheral area respectively, forming a transition zone between the main focus area and the peripheral area. All full-drive pixels FP are in a working state, all optional pixels SP in the main focus area are in a working state, a part of the optional pixels SP in the secondary focus area are in a working state, another part of the optional pixels SP in the secondary focus area are in a non-working state, and all the optional pixels SP in the peripheral area are in a non-working state.

[0065] In the embodiment of the present application, the main focus area is displayed at a first resolution, the secondary focus area is displayed at a third resolution, and the peripheral area is displayed at a second resolution, the first resolution is greater than the third resolution, and the third resolution is greater than the second resolution. In this way, the secondary focus area can play a transition effect from the focus area to the peripheral area, reducing the abruptness of the resolution difference, and by gradually reducing the working state of the pixels, a smooth transition of the resolution is achieved, thereby improving the user's visual experience. The human eye is more sensitive to image details near the focus point, while the sensitivity of the area away from the focus point gradually decreases. Setting a secondary focus area can better meet the natural needs of the human eye for image clarity.

[0066] As an example, see Fig. 9 , regional pixel units 15 and 16 belong to the main focus area, regional pixel units 8, 9, 10, 11, 14, 17, 20, 21, 22, and 23 belong to the secondary focus area, and the remaining regional pixel units belong to the peripheral area. In the process of displaying the image to be displayed, all pixels in the regional pixel units 15 and 16 are working, some SPs in the secondary focus area are working and some SPs are not working, and the SPs in the regional pixel units in the peripheral area are not working.

[0067] In one embodiment, please continue to refer to Figure 2 The display device further includes a row-column driving module 104, which is respectively connected to the data reorganization module 102 and the pixel array module 106. The row-column driving module 104 is used to receive the reorganized image data from the data reorganization module 102 and send the reorganized image data to the pixel array module 106.

[0068] The row-column driving module includes a row driving unit and a column driving unit. The row driving unit outputs a row selection signal according to the received reconstructed image data, and the column driving unit outputs the reconstructed image data.

[0069] It can be understood that the reconstructed image data may include pixel information of full-drive pixels, and the pixel information of full-drive pixels includes full-drive pixel positions of full-drive pixels and pixel values ​​corresponding to each full-drive pixel position. The reconstructed image data may also include optional pixel positions of optional pixels and pixel working states corresponding to each optional pixel position, or the reconstructed image data may also include optional pixel positions of optional pixels, pixel working states corresponding to each optional pixel position, and optional pixel information of optional pixels in working state.

[0070] In a preferred implementation, the row lines corresponding to the row driving units and / or the column lines corresponding to the column driving units of the embodiment of the present application are arranged in a sparse layout manner, and the sparse layout manner is used to indicate a method different from arranging the row lines row by row or a method different from arranging the column lines column by column.

[0071] In traditional display systems, row lines and column lines are evenly arranged row by row and column by column. Each row of pixels corresponds to a row line, and each column of pixels corresponds to a column line. All pixels are located at the intersection of row lines and column lines. The intersection of row lines and column lines constitutes a two-dimensional drive matrix, which is used to provide row selection signals and column drive signals for all pixels.

[0072] Please refer to Fig.10 , display devices usually store the required data in pixel circuits through crossed column lines and row lines, and drive pixels through pixel circuits. In order to achieve m×n resolution, it must be composed of m column drive lines and drive circuits, n row drive lines and drive circuits, and m×n pixel circuits.

[0073] In the embodiment of the present application, at least one of the row lines and column lines is arranged in a manner different from the uniform row-by-row and column-by-column arrangement, and the positions of the row lines and column lines of pixel units in different regions are arranged at the same position.

[0074] Please refer to Fig.11 , the first row of a certain regional pixel unit in an embodiment of the present application is provided with a row line n, the third row is provided with a row line n+1, the first column is provided with a column line m, and the third column is provided with a column line m+1. For other regional pixel units, the first and third rows are also provided with row lines, and the first and third columns are provided with column lines. Then, for each row of regional pixel units, the second row of pixels of the regional pixel units is not provided with a row line, and the row lines are arranged in a sparse layout manner; for each column of regional pixel units, the second column of pixels of the regional pixel units is not provided with a column line, and the column lines are also arranged in a sparse layout manner.

[0075] In the embodiment of the present application, in combination with the sparse layout of the row lines and / or column lines, the row and column drive intersections are all set as full-drive pixels FP, and the points other than the row and column drive intersections are all set as optional pixels SP, wherein the reconstructed image data are all stored in the full-drive pixels FP, and the optional pixels SP do not store data.

[0076] Exemplarily, each full-drive pixel FP stores pixel information of its corresponding full-drive pixel. For each optional pixel SP, the pixel working state of the optional pixel, or the pixel working state of the optional pixel and the optional pixel information, can be stored in the full-drive pixel FP in the same regional pixel unit as the optional pixel SP. The optional pixel SP is connected to the full-drive pixel FP storing its state and / or information, and whether the optional pixel SP is working is configured according to the pixel working state stored in the full-drive pixel FP. If the optional pixel is working, the corresponding physical pixel is displayed according to the optional pixel information stored in the full-drive pixel FP, or if the optional pixel is working, at least one full-drive pixel FP is selected to send its full-drive pixel information to the optional pixel SP in proportion, so that the optional pixel SP drives the corresponding physical pixel to display.

[0077] In this embodiment, through the sparse layout of row lines and / or column lines, the full-drive pixels are located at the intersection of row and column drives and receive and store reconstructed image data through the row and column drive module, and the optional pixels are located at points other than the intersection of rows and columns and do not store data. Compared with the traditional micro display system, the number of row and column drives is reduced, which reduces the area and power consumption of the system

[0078] The present application is further described below in conjunction with the determination process of the reconstructed image data and the driving display of the full-drive pixels and the optional pixels.

[0079] In one embodiment, when the data recombining module determines the recombined image data of the image to be displayed according to the initial image data and the focus area, it is used to: determine the full-drive pixel information of the full-drive pixel from the initial image data according to the arrangement position of the full-drive pixel; determine the pixel working state of the optional pixel according to the arrangement position of the optional pixel and the focus area; and determine the recombined image data in combination with the full-drive pixel information of the full-drive pixel and the pixel working state of the optional pixel.

[0080] Exemplarily, the data reconstruction module may pre-store the arrangement of the full-drive pixels FP and the optional pixels SP. The full-drive pixel information of each full-drive pixel FP may directly adopt the image data corresponding to the arrangement position of each full-drive pixel FP in the initial image data. The data reconstruction module also determines, based on the arrangement position of the optional pixels and the focus area, that the optional pixels SP located in the focus area are all in a working state, and the optional pixels SP located in the peripheral area outside the focus area are all in a non-working state. For example, 1 (selected) is used to indicate that the optional pixel is working, and 0 (unselected) is used to indicate that the optional pixel is not working or is ignored.

[0081] It should be noted that, in the embodiment of the present application, the optional pixel information of the optional pixel SP in a working state may be directly determined without using the initial image data, and the data reconstruction module may determine the optional pixel information of the optional pixel SP in a working state through the full-drive pixel information, and obtain the reconstructed image data by combining the full-drive pixel information, the pixel working state of the optional pixel and the optional pixel information.

[0082] For example, the data reorganization module determines the optional pixel information according to the full-drive pixel information of the full-drive pixels in the pixel unit in the area where the optional pixel is located. Figure 7 , the SPs in the focus area are all in working state. Taking the SP in the first row and second column in the regional pixel unit 6 as an example, the optional pixel information of the SP can be determined according to the full-drive pixel information of the first row and first column FP and the first row and third column FP in the regional pixel unit 6; taking the SP in the second row and second column in the regional pixel unit 6 as an example, the optional pixel information of the SP can be determined in combination with the full-drive pixel information of all 4 FPs in the regional pixel unit 6.

[0083] The full-drive pixel of the embodiment of the present application is used to receive and store full-drive pixel information of a corresponding full-drive pixel, and drive a physical pixel display according to the full-drive pixel information.

[0084] Exemplarily, the full-drive pixel FP includes a first switch unit, a storage unit, and a first drive unit. The first switch unit is used to select the reconstructed image data output by the corresponding column drive unit according to the row selection signal output by the row drive unit, such as selecting the full-drive pixel information corresponding to the FP pixel position from the reconstructed image data; the storage unit is used to store the sampled full-drive pixel information, and the first drive unit drives the pixel according to the pixel data in the full-drive pixel information.

[0085] Some full-drive pixels of the embodiment of the present application are also used to receive and store the pixel working state of adjacent optional pixels, or to receive and store the pixel working state of adjacent optional pixels and optional pixel information of the optional pixels. The adjacent optional pixels are used to represent the optional pixels in the regional pixel unit where the full-drive pixels are located.

[0086] The optional pixels of the embodiment of the present application are connected to some full-drive pixels. The optional pixels are used to configure whether the optional pixels are working according to the pixel working states stored in some full-drive pixels, and, when the optional pixels are working, drive the physical pixel display according to the optional pixel information stored in some full-drive pixels.

[0087] Exemplarily, the optional pixel SP includes a second switch unit and a second drive unit. The second switch unit is used to configure whether the optional pixel SP works according to the pixel working state stored in the partial full-drive pixel; if the optional pixel works, the second drive unit is used to drive the physical pixel to display according to the optional pixel information stored in the partial full-drive pixel.

[0088] For example, see Figure 7 , the full-drive pixel FP of the first row and the first column in the regional pixel unit 1 selects the pixel working state (0) corresponding to the pixel position of the first row and the second column SP in the regional pixel unit 1 from the reconstructed image data, and stores the sampled pixel working state in its storage unit, that is, the pixel working state of the first row and the second column SP is stored in the adjacent first row and the first column FP. The first row and the second column SP is connected to the full-drive pixel FP of the first row and the first column, and the second switch of the first row and the second column SP configures the first row and the second column SP to be non-operating according to the pixel working state (0) stored in the full-drive pixel FP of the first row and the first column.

[0089] For another example, please refer to Figure 7 , the full-drive pixel FP of the first row and the first column in the regional pixel unit 6 selects the pixel working state (1) and the optional pixel information corresponding to the pixel position of the first row and the second column SP in the regional pixel unit 6 from the reconstructed image data, and stores the sampled pixel working state and the optional pixel information in its storage unit, that is, the pixel working state and the optional pixel information corresponding to the pixel position of the first row and the second column SP are stored in the adjacent first row and the first column FP. The first row and the second column SP are connected to the full-drive pixel FP of the first row and the first column, and the second switch of the first row and the second column SP configures the first row and the second column SP to work according to the pixel working state (1) stored in the full-drive pixel FP of the first row and the first column, and the second driving unit of the first row and the second column SP drives the physical pixel display according to the optional pixel information sent by the full-drive pixel FP of the first row and the first column.

[0090] In one embodiment, when the optional pixel is in a working state, the physical pixel corresponding to the optional pixel can be driven to display according to the full-drive pixel information stored in the adjacent full-drive pixel.

[0091] In the embodiment of the present application, reconstructed image data is obtained by combining full-drive pixel information and the pixel working state of the optional pixel. The data reconstruction module does not need to determine the optional pixel information of the optional pixel SP in the working state through the full-drive pixel information, but can adopt a current mirror method to proportionally transmit the full-drive pixel information of the full-drive pixel to the optional pixel when the optional pixel is in the working state, so that the optional pixel can drive and display its own physical pixel in combination with the full-drive pixel information.

[0092] Exemplarily, the optional pixel SP is connected to at least one adjacent full-drive pixel FP in a current mirror manner, and the ratio of the current mirror is preset. The second switch unit of the optional pixel configures the optional pixel SP to work according to the pixel working states stored in some full-drive pixels, and at least one full-drive pixel adjacent to the optional pixel sends its full-drive pixel information to the optional pixel in proportion, so that the second drive unit of the optional pixel drives the corresponding physical pixel of the optional pixel to display in combination with the full-drive pixel information.

[0093] For example, see Figure 7 , the first row and second column SP in the regional pixel unit 6 are respectively connected to the first row and first column FP and the first row and third column FP, and the first row and first column FP and the first row and third column FP respectively include an independent current output path for driving the current mirror, and each path outputs, for example, one-half of the reference current to the first row and second column SP through the current mirror, and the reference current is determined by its full-drive pixel information. The first row and second column SP receives the current information of the left and right FP full-drive pixels, and can aggregate the received current into a total current through a current addition circuit and drive the pixel display of the control SP.

[0094] For another example, please refer to Figure 7 The second row and second column SP in the regional pixel unit 6 can receive a quarter of the reference current of the first row and first column FP, the first row and third column FP, the third row and first column FP, and the third row and third column FP respectively through the current mirror.

[0095] In one embodiment, Fig.12 As shown, when the resolution of the original image data of the image to be displayed is greater than the preset resolution threshold, the initial image data is obtained by compressing the original image data according to the arrangement positions of the full-drive pixels.

[0096] The preset resolution threshold is determined according to the resolution of the display panel when only full-drive pixels are working.

[0097] Exemplarily, a data processing device receives raw image data from a signal source. When the resolution of the raw image data is greater than a preset resolution threshold, the data processing device samples from the raw image data according to the arrangement position of the full-drive pixels, determines the pixel data corresponding to each full-drive pixel, discards other parts of the image data, and obtains initial image data.

[0098] For example, the resolution of the micro display panel corresponding to the display device is 4K (such as 3840×2160), please refer to Figure 7 The arrangement mode, when only the full-drive pixels are working, the resolution of the micro display panel is 2K (2560×1440), and the preset resolution threshold is 2K. The data processing device FPGA receives a 4K video stream from the signal source. The FPGA screens the pixel data of the corresponding position in the original image data according to the arrangement position of the full-drive pixels. The FPGA compresses it into 2K data and transmits it to the micro display chip. The micro display chip determines the pixel information of each FP through the 2K data, and then determines the focus area in combination with the position information of the point where the user's eyeball is focused. The pixel information of each SP in the focus area is determined by the pixel information of the FP, and the focus area data is reorganized into 4K data, that is, the focus area FP pixels display the original data, the focus area SP displays the reconstructed data, the peripheral area SP does not work, the focus area is displayed in 4K, and the peripheral area is displayed in 2K.

[0099] In this embodiment, when the original data is of high resolution, the pressure of data transmission is greatly reduced by compressing the original data; at the same time, by collecting the position information of the point where the user's eyes are focused and reorganizing the data, it can be achieved that the picture at the point where the user's eyes are focused is still of high resolution, and the surrounding area is reduced to low resolution.

[0100] In one embodiment, Fig.13 As shown, when the resolution of the original image data of the image to be displayed is less than or equal to the preset resolution threshold, the initial image data can retain the data information in the original image data.

[0101] For example, the resolution of the micro display panel corresponding to the display device is 1080p (such as 1920×1080), please refer to Figure 7When only full-drive pixels are working, the resolution of the micro display panel is 720p (1280×720‌), and the preset resolution threshold is 720p. The data processing device FPGA receives a 720p video stream from the signal source, and then the FPGA directly transmits the 720p data to the micro display chip. The micro display chip determines the pixel information of each FP through the 720p data, and then determines the focus area in combination with the position information of the point where the user's eyeball is focused, and determines the pixel information of each SP in the focus area through the pixel information of the FP, and reorganizes the focus area data into 1080p data, that is, the focus area FP pixels display the original data, the focus area SP displays the reconstructed data, the peripheral area SP does not work, the focus area is displayed at 1080p, and the peripheral area is displayed at 720p.

[0102] In this embodiment, when the original data is of low resolution, by collecting the position information of the point where the user's eyes are focused and reorganizing the data, the image at the point where the user's eyes are focused can be upgraded to high resolution, while the surrounding area remains at low resolution.

[0103] In one embodiment, the area of ​​the selectable pixel is smaller than the area of ​​the full-drive pixel.

[0104] Please combine Fig.14 and Fig.15 , the pixel driving circuit of the traditional pixel or full-drive pixel FP includes a switch unit (S), a storage unit (M) and a drive unit (D), while the optional pixel SP of the embodiment of the present application only includes a switch unit and a drive unit, and the optional pixel SP does not include a storage unit. In this case, the embodiment of the present application can set the area of ​​the optional pixel SP to be smaller than the area of ​​the full-drive pixel or the traditional pixel, that is, smaller than the area of ​​the standard pixel with a complete switch unit, storage unit and drive unit. Fig.15 The middle dotted box indicates the size of the regional pixel unit before the area of ​​the optional pixel is reduced, and the implementation box indicates the size of the regional pixel unit after the area of ​​the optional pixel is reduced.

[0105] In order to achieve an m×n resolution, a traditional pixel array must consist of m column drive lines and drive circuits, n row drive lines and drive circuits, and m×n pixel circuits. In order to improve the resolution, the values ​​corresponding to m and n must be increased to the required resolution. Therefore, if the size of the driven pixel remains unchanged, the area of ​​the display device will increase as the resolution increases, and the load and complexity of the drive circuit will also increase.

[0106] In this embodiment, compared with the traditional pixel array module, by reducing the area of ​​the optional pixels, the space utilization of the pixel array can be significantly optimized, and the overall area of ​​the pixels is also reduced, which helps to achieve higher resolution in the same area.

[0107] Each module in the above display device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0108] Based on the same inventive concept, an embodiment of the present application also provides a display system. The implementation solution for solving the problem provided by the system is similar to the implementation solution recorded in the above-mentioned device. Therefore, the specific limitations in one or more display system embodiments provided below can refer to the limitations on the display device above and will not be repeated here.

[0109] In one embodiment, the display system includes the display device provided in the above-mentioned embodiment of the present application.

[0110] In one embodiment, please continue to refer to Figure 1 The display system includes a display device 100, a data processing device 200 and a position acquisition device 300, and the display device 100 is connected to the data processing device 200 and the position acquisition device 300 respectively.

[0111] The display device 100 includes: a data reorganization module, used to obtain initial image data of an image to be displayed and a focus area of ​​an eyeball on a display panel corresponding to the display device, and determine reorganized image data of the image to be displayed according to the initial image data and the focus area; a pixel array module, used to be connected to the data reorganization module, receive the reorganized image data and control the focus area and the peripheral area outside the focus area to display the image to be displayed with different resolutions according to the reorganized image data; wherein the resolution of the focus area is greater than the resolution of the peripheral area.

[0112] The data processing device 200 is used to receive raw image data from a signal source, determine initial image data according to the raw image data, and then transmit the initial image data to the display device 100 .

[0113] The position acquisition device 300 is used to acquire the position information of the point where the user's eyeball is focused, and send the position information to the display device 100 .

[0114] Based on the same inventive concept, the embodiment of the present application also provides a display driving method for driving the above-mentioned display device. The implementation solution provided by the display driving method to solve the problem is similar to the implementation solution recorded in the above-mentioned device, so the specific limitations in one or more display driving method embodiments provided below can refer to the above-mentioned limitations on the display device, and will not be repeated here.

[0115] In one embodiment, Fig.16 As shown, a display driving method is provided, the method comprising the following steps:

[0116] Step 1602: a data reassembly module obtains initial image data of an image to be displayed and a focus area of ​​an eye on a display panel corresponding to the display device, and determines reassembled image data of the image to be displayed according to the initial image data and the focus area.

[0117] Step 1604: The pixel array module receives the reconstructed image data and controls the focus area and the peripheral area outside the focus area to display the image to be displayed with different resolutions according to the reconstructed image data; wherein the resolution of the focus area is greater than the resolution of the peripheral area.

[0118] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0119] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0120] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0121] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A display device, characterized in that: include: a data reorganization module, used to obtain initial image data of an image to be displayed and a focus area of ​​an eyeball on a display panel corresponding to the display device, and determine reorganized image data of the image to be displayed according to the initial image data and the focus area; a pixel array module, connected to the data reorganization module, receiving the reorganized image data and controlling the focus area and the peripheral area outside the focus area to display the image to be displayed with different resolutions according to the reorganized image data; wherein the resolution of the focus area is greater than the resolution of the peripheral area.

2. The display device according to claim 1, characterized in that The pixel array module includes a plurality of regional pixel units, and the regional pixel units include full-drive pixels and optional pixels; Wherein, when displaying the image to be displayed, the full-drive pixels are all in a working state, the optional pixels in the peripheral area are all in a non-working state, and at least some of the optional pixels in the focus area are in a working state.

3. The display device according to claim 2, characterized in that When the data reorganization module determines the reorganized image data of the image to be displayed according to the initial image data and the focus area, the data reorganization module is used to: Determining full-drive pixel information of the full-drive pixel from the initial image data according to the arrangement position of the full-drive pixel; Determining a pixel working state of the optional pixel according to an arrangement position of the optional pixel and the focusing area; The reconstructed image data is determined by combining the full-drive pixel information of the full-drive pixel and the pixel working state of the optional pixel.

4. The display device according to claim 3, characterized in that: The reconstructed image data further includes optional pixel information of optional pixels in a working state, wherein the optional pixel information is determined according to full-drive pixel information of full-drive pixels in pixel units in a region where the optional pixels are located; The full drive pixel is used to receive and store full drive pixel information of the full drive pixel, and drive the physical pixel display according to the full drive pixel information; Some of the full-drive pixels in the full-drive pixels are further used to receive and store the pixel working states of adjacent optional pixels, or are further used to receive and store the pixel working states of adjacent optional pixels and optional pixel information of the optional pixels; the adjacent optional pixels are used to represent the optional pixels in the regional pixel unit where the full-drive pixels are located; The optional pixel is connected to some full-drive pixels and is used to configure whether the optional pixel is working according to the pixel working status stored in some full-drive pixels, and to drive the physical pixel display according to the optional pixel information stored in some full-drive pixels when the optional pixel is working.

5. The display device according to claim 3, characterized in that: The full drive pixel is used to receive and store full drive pixel information of the full drive pixel, and drive the physical pixel display according to the full drive pixel information; Some of the full-drive pixels are further used to receive and store pixel working states of adjacent optional pixels, where the adjacent optional pixels are used to represent optional pixels within the regional pixel unit where the full-drive pixels are located; The optional pixel is connected to some full-drive pixels and is used to configure whether the optional pixel is working according to the pixel working status stored in some full-drive pixels, and, when the optional pixel is working, drive the physical pixel display according to the full-drive pixel information stored in the adjacent full-drive pixels.

6. The display device according to claim 4 or 5, characterized in that: The area of ​​the optional pixel is smaller than the area of ​​the full-drive pixel.

7. The display device according to claim 3, characterized in that: In the case where the resolution of the original image data of the image to be displayed is greater than a preset resolution threshold, the initial image data is obtained by compressing the original image data according to the arrangement positions of the full-drive pixels; The preset resolution threshold is determined according to the resolution of the display panel when only full-drive pixels are working.

8. The display device according to claim 2, characterized in that: The display device further comprises a row and column driving module, wherein the row and column driving modules are respectively connected to the data reorganization module and the pixel array module; The row and column driving module is used to receive the reorganized image data from the data reorganization module and send the reorganized image data to the pixel array module.

9. A display system, characterized in that: A display device comprising any one of claims 1 to 8.

10. A display driving method, characterized in that: The method comprises: The data reassembly module acquires initial image data of the image to be displayed and a focus area of ​​the eyeball on the display panel corresponding to the display device, and determines reassembled image data of the image to be displayed according to the initial image data and the focus area; The pixel array module receives the reconstructed image data and controls the focus area and the peripheral area outside the focus area to display the image to be displayed with different resolutions according to the reconstructed image data; wherein the resolution of the focus area is greater than that of the peripheral area.

Images