Partition display method and display equipment

Abstract

A partition display method and a display device are used for solving the problems that when human eyes move quickly, the display device is difficult to respond in time, and a display image generates a hysteresis feeling. The method comprises: a display device receiving and displaying a current frame image, and acquiring a fixation point coordinate (100) of a user on a display screen (600) of the display device; according to the coordinates of the fixation point, a display area of the display screen (600) is divided into a plurality of display areas, first controllers corresponding to the plurality of display areas respectively are determined, and the first controllers comprise at least one driving chip (SD # 1, SD # 2, SD # 3, SD # 4, SD # 5, SD # 6, SD # 7 and SD # 8) (101); and receiving a next frame of image, and using each first controller to control the next frame of image to be displayed in a plurality of display areas, where the next frame of image comprises a plurality of sub-images, and one display area is used for displaying one sub-image (102).

Description

A partition display method and display device Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a partition display method and a display device. Background Art

[0002] Compared to traditional interaction methods, human-computer interaction systems designed based on eye tracking technology offer advantages such as greater directness and efficiency, better realizing the "what you see is what you get" principle of human-computer interaction. Furthermore, by leveraging eye tracking technology with display devices and replacing manual operations with gaze points, human-computer interaction can be completed more conveniently.

[0003] In current display solutions that incorporate eye tracking technology, after acquiring the human eye image and extracting the coordinates of the eye's gaze point, the GPU (Graphics Processing Unit) converts the coordinates of the eye's gaze point. Furthermore, the GPU needs to pre-divide the image data to be displayed into multiple grid data, arrange the grid data according to rules, and then send it to the display device for output.

[0004] Affected by the system architecture of the current display solution, when the human eye moves quickly, the display device has difficulty responding in time, causing the displayed image data to have a sense of lag, affecting the viewing effect.

[0005] Summary of the Invention

[0006] The present invention provides a partition display method and a display device, which are used to solve the problem that when the human eye moves quickly, the display device is difficult to respond in time and the displayed image produces a sense of hysteresis.

[0007] In a first aspect, an embodiment of the present invention provides a method for partition display, the method comprising:

[0008] The display device receives and displays the current frame image, and obtains the coordinates of the user's gaze point on the display screen of the display device;

[0009] Dividing a display area of ​​the display screen into a plurality of display zones according to the gaze point coordinates, and determining first controllers corresponding to the plurality of display zones, respectively, wherein the first controller includes at least one driver chip;

[0010] A next frame image is received, and each first controller is used to control the next frame image to be displayed in multiple display areas, wherein the next frame image includes multiple sub-images, and one display area is used to display one sub-image.

[0011] As an optional implementation, the multiple display areas include a gaze area and a non-gaze area;

[0012] The step of dividing the display area of ​​the display screen into a plurality of display areas according to the gaze point coordinates includes:

[0013] The display area is divided into a gaze area and a non-gaze area according to the gaze point coordinates and the user's viewing angle range, wherein the sub-image displayed in the gaze area is within the viewing angle range, and the sub-image displayed in the non-gaze area exceeds the viewing angle range.

[0014] As an optional embodiment, the gaze area includes a boundary area; the boundary area is determined according to the display unit controlled by the driver chip corresponding to the boundary of the gaze area, wherein the display area includes multiple display units, and each display unit is controlled by a driver chip for display.

[0015] As an optional implementation manner, the controlling the display of the next frame image in multiple display areas by using each first controller includes:

[0016] According to the difference between the next frame image and each sub-image in the current frame image, the first controllers are used to control the next frame image to be displayed in multiple display areas.

[0017] As an optional embodiment, controlling the display of the next frame image in multiple display areas by using each first controller according to the difference between each sub-image in the next frame image and the current frame image includes:

[0018] If the difference between the next frame image and the partial sub-images in the current frame image is greater than the image threshold, refreshing and displaying the partial sub-images in the next frame image; or

[0019] If the difference between the next frame image and all sub-images in the current frame image is greater than the image threshold, all sub-images in the next frame image are refreshed and displayed.

[0020] As an optional implementation, the multiple display areas include a gaze area and a non-gaze area;

[0021] If, in the next frame image and the current frame image, the difference between the sub-image located in the gaze area is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the first controller corresponding to the gaze area is used to refresh and display the sub-image located in the gaze area in the next frame image.

[0022] As an optional implementation manner, if the difference between the next frame image and some sub-images in the current frame image is greater than the image threshold, the method further includes:

[0023] Determine a first display area corresponding to the partial sub-image, and turn on an OP of a driver chip in a first controller corresponding to the first display area; and

[0024] A second display area corresponding to the sub-image excluding the partial sub-image is determined, and an OP of a driving chip in the first controller corresponding to the second display area is turned off.

[0025] As an optional implementation, the method further includes:

[0026] Determine a second controller corresponding to each of the plurality of display areas, wherein the second controller includes at least one group of GOA circuits, and each group of GOA circuits is controlled by a separate signal;

[0027] The second controllers are used to scan the multiple display areas, so as to refresh and display the sub-images corresponding to the multiple display areas.

[0028] As an optional implementation manner, the multiple display areas include a gaze area and a non-gaze area; and the scanning of the multiple display areas using each second controller includes:

[0029] If the difference between the sub-images located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-images located in the non-gaze area is less than or equal to the image threshold, the second controller corresponding to the gaze area is used to sequentially scan the gaze area row by row; or

[0030] If the difference between all sub-images in the next frame image and the current frame image is greater than the image threshold, the second controller corresponding to the gaze area is used to scan the gaze area in sequence by row, and the second controller corresponding to the non-gaze area is used to scan the non-gaze area synchronously by multiple rows.

[0031] As an optional implementation manner, if the difference between the sub-images located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-images located in the non-gaze area is less than or equal to the image threshold, the method further includes:

[0032] The control signals of each group of GOA circuits in the second controller corresponding to the gaze area are turned on, and the control signals of each group of GOA circuits in the second controller corresponding to the non-gaze area are turned off.

[0033] As an optional implementation, it also includes:

[0034] In response to a designation operation on any area in the display area, determining a first sub-image corresponding to the any area in the next frame image;

[0035] The first controller corresponding to the arbitrary area is used to control the first sub-image of the next frame image to be refreshed and displayed.

[0036] As an optional implementation, the method further includes:

[0037] Sending the gaze point coordinates to a GPU, so that the GPU determines multiple display areas according to the gaze point coordinates, and compressing sub-images corresponding to different display areas in a next frame of image according to different compression ratios; and / or

[0038] The position information of the multiple display areas and the identification information corresponding to the display areas are sent to the GPU, so that the GPU can compress the sub-images corresponding to different display areas in the next frame image according to different compression ratios, wherein the identification information is used to indicate the driver chip.

[0039] As an optional implementation, the multiple display areas include a gaze area and a non-gaze area;

[0040] The sub-image corresponding to the attention area in the next frame of image is an uncompressed image, and the sub-image corresponding to the non-attention area in the next frame of image is a compressed image; or,

[0041] The compression ratio of the sub-image corresponding to the attention area in the next frame image is lower than that of the sub-image corresponding to the non-attention area in the next frame image.

[0042] As an optional implementation, the gaze area includes a boundary area;

[0043] The sub-image corresponding to the boundary area in the next frame image is an image including compressed image data and uncompressed image data.

[0044] As an optional implementation manner, the display screen is used to display 3D images at different viewing angles, and the 3D images at different viewing angles display different image contents.

[0045] As an optional implementation, it also includes:

[0046] transmitting the gaze point coordinates to the first controller, so that the first controller determines a plurality of display areas according to the gaze point coordinates and uses a driver chip corresponding to each display area to refresh the display; and / or,

[0047] The position information of the plurality of display areas and the identification information corresponding to the display areas are transmitted to the first controller, so that the first controller uses the driving chip corresponding to each display area to refresh the display.

[0048] As an optional implementation manner, obtaining the coordinates of the user's gaze point on the display screen of the display device includes:

[0049] The coordinates of the user's gaze point on the display screen of the display device are acquired by using a camera device, wherein the camera device is integrated on the display device.

[0050] In a second aspect, an embodiment of the present invention provides a display device, including a display screen and a processor, wherein:

[0051] The display screen is used to display content;

[0052] The processor is specifically configured to:

[0053] Receive and display the current frame image, and obtain the coordinates of the user's gaze point on the display screen of the display device;

[0054] Dividing a display area of ​​the display screen into a plurality of display zones according to the gaze point coordinates, and determining first controllers corresponding to the plurality of display zones, respectively, wherein the first controller includes at least one driver chip;

[0055] A next frame image is received, and each first controller is used to control the next frame image to be displayed in multiple display areas, wherein the next frame image includes multiple sub-images, and one display area is used to display one sub-image.

[0056] As an optional implementation, the multiple display areas include a gaze area and a non-gaze area;

[0057] The processor is specifically configured to execute:

[0058] The display area is divided into a gaze area and a non-gaze area according to the gaze point coordinates and the user's viewing angle range, wherein the sub-image displayed in the gaze area is within the viewing angle range, and the sub-image displayed in the non-gaze area exceeds the viewing angle range.

[0059] As an optional embodiment, the gaze area includes a boundary area; the boundary area is determined according to the display unit controlled by the driver chip corresponding to the boundary of the gaze area, wherein the display area includes multiple display units, and each display unit is controlled by a driver chip for display.

[0060] As an optional implementation, the processor is specifically configured to execute:

[0061] According to the difference between the next frame image and each sub-image in the current frame image, the first controllers are used to control the next frame image to be displayed in multiple display areas.

[0062] As an optional implementation, the processor is specifically configured to execute:

[0063] If the difference between the next frame image and the partial sub-images in the current frame image is greater than the image threshold, refreshing and displaying the partial sub-images in the next frame image; or

[0064] If the difference between the next frame image and all sub-images in the current frame image is greater than the image threshold, all sub-images in the next frame image are refreshed and displayed.

[0065] As an optional implementation manner, the multiple display areas include a gaze area and a non-gaze area; and the processor is specifically configured to execute:

[0066] If, in the next frame image and the current frame image, the difference between the sub-image located in the gaze area is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the first controller corresponding to the gaze area is used to refresh and display the sub-image located in the gaze area in the next frame image.

[0067] As an optional implementation manner, if the difference between the next frame image and some sub-images in the current frame image is greater than the image threshold, the processor is further configured to execute:

[0068] Determine a first display area corresponding to the partial sub-image, and turn on an OP of a driver chip in a first controller corresponding to the first display area; and

[0069] A second display area corresponding to the sub-image excluding the partial sub-image is determined, and an OP of a driving chip in the first controller corresponding to the second display area is turned off.

[0070] As an optional implementation manner, the processor is further configured to execute:

[0071] Determine a second controller corresponding to each of the plurality of display areas, wherein the second controller includes at least one group of GOA circuits, and each group of GOA circuits is controlled by a separate signal;

[0072] The second controllers are used to scan the multiple display areas, so as to refresh and display the sub-images corresponding to the multiple display areas.

[0073] As an optional implementation manner, the multiple display areas include a gaze area and a non-gaze area; and the processor is specifically configured to execute:

[0074] If the difference between the sub-images located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-images located in the non-gaze area is less than or equal to the image threshold, the second controller corresponding to the gaze area is used to sequentially scan the gaze area row by row; or

[0075] If the difference between all sub-images in the next frame image and the current frame image is greater than the image threshold, the second controller corresponding to the gaze area is used to scan the gaze area in sequence by row, and the second controller corresponding to the non-gaze area is used to scan the non-gaze area synchronously by multiple rows.

[0076] As an optional implementation manner, if the difference between the sub-image located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the processor is further configured to execute:

[0077] The control signals of each group of GOA circuits in the second controller corresponding to the gaze area are turned on, and the control signals of each group of GOA circuits in the second controller corresponding to the non-gaze area are turned off.

[0078] As an optional implementation manner, the processor is further configured to execute:

[0079] In response to a designation operation on any area in the display area, determining a first sub-image corresponding to the any area in the next frame image;

[0080] The first controller corresponding to the arbitrary area is used to control the first sub-image of the next frame image to be refreshed and displayed.

[0081] As an optional implementation manner, the processor is further configured to execute:

[0082] Sending the gaze point coordinates to a GPU, so that the GPU determines multiple display areas according to the gaze point coordinates, and compressing sub-images corresponding to different display areas in a next frame of image according to different compression ratios; and / or

[0083] The position information of the multiple display areas and the identification information corresponding to the display areas are sent to the GPU, so that the GPU can compress the sub-images corresponding to different display areas in the next frame image according to different compression ratios, wherein the identification information is used to indicate the driver chip.

[0084] As an optional implementation,

[0085] The plurality of display areas include a gaze area and a non-gaze area;

[0086] The sub-image corresponding to the attention area in the next frame of image is an uncompressed image, and the sub-image corresponding to the non-attention area in the next frame of image is a compressed image; or,

[0087] The compression ratio of the sub-image corresponding to the attention area in the next frame image is lower than that of the sub-image corresponding to the non-attention area in the next frame image.

[0088] As an optional implementation, the gaze area includes a boundary area;

[0089] The sub-image corresponding to the boundary area in the next frame image is an image including compressed image data and uncompressed image data.

[0090] As an optional implementation,

[0091] The display screen is used to display 3D images at different viewing angles, and the 3D images at different viewing angles display different image contents.

[0092] As an optional implementation manner, the processor is further configured to execute:

[0093] transmitting the gaze point coordinates to the first controller, so that the first controller determines a plurality of display areas according to the gaze point coordinates and uses a driver chip corresponding to each display area to refresh the display; and / or,

[0094] The position information of the plurality of display areas and the identification information corresponding to the display areas are transmitted to the first controller, so that the first controller uses the driving chip corresponding to each display area to refresh the display.

[0095] As an optional implementation, the processor is specifically configured to execute:

[0096] The coordinates of the user's gaze point on the display screen of the display device are acquired by using a camera device, wherein the camera device is integrated on the display device.

[0097] In a third aspect, an embodiment of the present invention further provides a device for partition display, the device comprising:

[0098] A display acquisition unit is used for the display device to receive and display the current frame image and obtain the coordinates of the user's gaze point on the display screen of the display device;

[0099] an area division unit, configured to divide a display area of ​​the display screen into a plurality of display areas according to the gaze point coordinates, and determine first controllers corresponding to the plurality of display areas, wherein the first controllers include at least one driver chip;

[0100] The partitioned display unit is used to receive the next frame image and use each first controller to control the next frame image to be displayed in multiple display areas, wherein the next frame image includes multiple sub-images, and one display area is used to display one sub-image.

[0101] As an optional implementation, the multiple display areas include a gaze area and a non-gaze area;

[0102] The area division unit is specifically used for:

[0103] The display area is divided into a gaze area and a non-gaze area according to the gaze point coordinates and the user's viewing angle range, wherein the sub-image displayed in the gaze area is within the viewing angle range, and the sub-image displayed in the non-gaze area exceeds the viewing angle range.

[0104] As an optional embodiment, the gaze area includes a boundary area; the boundary area is determined according to the display unit controlled by the driver chip corresponding to the boundary of the gaze area, wherein the display area includes multiple display units, and each display unit is controlled by a driver chip for display.

[0105] As an optional implementation manner, the partition display unit is specifically used for:

[0106] According to the difference between the next frame image and each sub-image in the current frame image, the first controllers are used to control the next frame image to be displayed in multiple display areas.

[0107] As an optional implementation manner, the partition display unit is specifically used for:

[0108] If the difference between the next frame image and the partial sub-images in the current frame image is greater than the image threshold, refreshing and displaying the partial sub-images in the next frame image; or

[0109] If the difference between the next frame image and all sub-images in the current frame image is greater than the image threshold, all sub-images in the next frame image are refreshed and displayed.

[0110] As an optional implementation manner, the multiple display areas include a gaze area and a non-gaze area; and the partitioned display unit is specifically configured to:

[0111] If, in the next frame image and the current frame image, the difference between the sub-image located in the gaze area is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the first controller corresponding to the gaze area is used to refresh and display the sub-image located in the gaze area in the next frame image.

[0112] As an optional implementation manner, if the difference between the next frame image and some sub-images in the current frame image is greater than the image threshold, the partition display unit is further configured to:

[0113] Determine a first display area corresponding to the partial sub-image, and turn on an OP of a driver chip in a first controller corresponding to the first display area; and

[0114] A second display area corresponding to the sub-image excluding the partial sub-image is determined, and an OP of a driving chip in the first controller corresponding to the second display area is turned off.

[0115] As an optional implementation manner, the partition display unit is further used to:

[0116] Determine a second controller corresponding to each of the plurality of display areas, wherein the second controller includes at least one group of GOA circuits, and each group of GOA circuits is controlled by a separate signal;

[0117] The second controllers are used to scan the multiple display areas, so as to refresh and display the sub-images corresponding to the multiple display areas.

[0118] As an optional implementation manner, the multiple display areas include a gaze area and a non-gaze area; and the partitioned display unit is specifically configured to:

[0119] If the difference between the sub-images located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-images located in the non-gaze area is less than or equal to the image threshold, the second controller corresponding to the gaze area is used to sequentially scan the gaze area row by row; or

[0120] If the difference between all sub-images in the next frame image and the current frame image is greater than the image threshold, the second controller corresponding to the gaze area is used to scan the gaze area in sequence by row, and the second controller corresponding to the non-gaze area is used to scan the non-gaze area synchronously by multiple rows.

[0121] As an optional embodiment, if the difference between the sub-image located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the partition display unit is further configured to:

[0122] The control signals of each group of GOA circuits in the second controller corresponding to the gaze area are turned on, and the control signals of each group of GOA circuits in the second controller corresponding to the non-gaze area are turned off.

[0123] As an optional implementation manner, the partition display unit is further used to:

[0124] In response to a designation operation on any area in the display area, determining a first sub-image corresponding to the any area in the next frame image;

[0125] The first controller corresponding to the arbitrary area is used to control the first sub-image of the next frame image to be refreshed and displayed.

[0126] As an optional implementation manner, the apparatus further includes a first sending unit specifically configured to:

[0127] Sending the gaze point coordinates to a GPU, so that the GPU determines multiple display areas according to the gaze point coordinates, and compressing sub-images corresponding to different display areas in a next frame of image according to different compression ratios; and / or

[0128] The position information of the multiple display areas and the identification information corresponding to the display areas are sent to the GPU, so that the GPU can compress the sub-images corresponding to different display areas in the next frame image according to different compression ratios, wherein the identification information is used to indicate the driver chip.

[0129] As an optional implementation, the multiple display areas include a gaze area and a non-gaze area;

[0130] The sub-image corresponding to the attention area in the next frame of image is an uncompressed image, and the sub-image corresponding to the non-attention area in the next frame of image is a compressed image; or,

[0131] The compression ratio of the sub-image corresponding to the attention area in the next frame image is lower than that of the sub-image corresponding to the non-attention area in the next frame image.

[0132] As an optional implementation, the gaze area includes a boundary area;

[0133] The sub-image corresponding to the boundary area in the next frame image is an image including compressed image data and uncompressed image data.

[0134] As an optional implementation manner, the display screen is used to display 3D images at different viewing angles, and the 3D images at different viewing angles display different image contents.

[0135] As an optional implementation manner, the second sending unit is further included to:

[0136] transmitting the gaze point coordinates to the first controller, so that the first controller determines a plurality of display areas according to the gaze point coordinates and uses a driver chip corresponding to each display area to refresh the display; and / or,

[0137] The position information of the plurality of display areas and the identification information corresponding to the display areas are transmitted to the first controller, so that the first controller uses the driving chip corresponding to each display area to refresh the display.

[0138] As an optional implementation manner, the display acquisition unit is specifically configured to:

[0139] The coordinates of the user's gaze point on the display screen of the display device are acquired by using a camera device, wherein the camera device is integrated on the display device.

[0140] In a fourth aspect, an embodiment of the present invention further provides a computer storage medium on which a computer program is stored, and when the program is executed by a processor, it is used to implement the steps of the method described in the first aspect above.

[0141] These and other aspects of the present application will be more clearly understood in the description of the following embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0142] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0143] FIG1 is a flowchart of a method for implementing a partition display according to an embodiment of the present invention;

[0144] FIG2 is a schematic diagram of a human eye gaze area on a display screen provided by an embodiment of the present invention;

[0145] FIG3 is a schematic diagram of refreshing a gaze zone screen according to an embodiment of the present invention;

[0146] FIG4 is a schematic diagram of refreshing an entire frame of an image according to an embodiment of the present invention;

[0147] FIG5 is a system framework diagram of a display device for performing partitioned display according to an embodiment of the present invention;

[0148] FIG6 is a schematic diagram of a display device provided by an embodiment of the present invention;

[0149] FIG7 is a schematic diagram of a partition display device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0150] To make the objectives, technical solutions, and advantages of the present invention more apparent, the present invention will be further described in detail below with reference to the accompanying drawings. It is apparent that the embodiments described are only some, not all, of the present invention. All other embodiments derived by persons of ordinary skill in the art based on the embodiments of the present invention without creative effort are intended to fall within the scope of protection of the present invention.

[0151] In embodiments of the present invention, the term "and / or" describes the association relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0152] The application scenarios described in the embodiments of the present invention are intended to more clearly illustrate the technical solutions of the embodiments of the present invention and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. Persons skilled in the art will appreciate that as new application scenarios emerge, the technical solutions provided by the embodiments of the present invention will also be applicable to similar technical problems. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0153] Compared with traditional interaction methods, the human-computer interaction system designed based on eye tracking technology shows advantages such as being more direct and efficient, thereby better realizing the human-computer interaction concept of "what you see is what you get". On this basis, by using eye tracking technology with the help of display devices, the use of gaze points instead of manual operations can complete human-computer interaction more conveniently. In the current display solution that combines eye tracking technology, after obtaining the human eye image and extracting the coordinates of the human eye gaze point, the GPU (Graphics Processing Unit) converts the coordinates of the human eye gaze point, and the GPU needs to pre-divide the image data to be displayed into multiple grid data, arrange the grid data according to rules, and then send it to the display device for output.

[0154] Current 3D display solutions require the front-end (GPU) to pre-arrange multi-view data before sending it to the display driver chip for output. The driver chip doesn't process or filter the display data, and when combined with eye-tracking technology, it can't quickly update information for different viewing positions, resulting in poor viewing quality. Due to the current display system architecture, when the human eye moves rapidly, the display device struggles to respond in a timely manner, causing a sense of lag in the displayed image data and affecting the viewing experience.

[0155] A partitioned display method provided in this embodiment can be applied to display devices. The core idea is to divide the display area into multiple display areas according to the coordinates of the user's gaze point on the current frame image, and use the first controller corresponding to each display area to refresh and display the sub-images in the next frame image according to a certain rule. Since the display device in this embodiment can directly obtain the gaze point coordinates, when the human eye moves quickly, it can perform partitioning processing based on the gaze point coordinates, thereby responding in time and refreshing and displaying the next frame image in different display areas, reducing the discomfort caused by delays. In addition, by partitioning the display area, different display areas can adopt different refresh display methods, thereby achieving the purpose of combining timely response with power saving.

[0156] As shown in FIG1 , this embodiment provides a method for partition display, and the specific implementation process of the method is as follows:

[0157] Step 100: The display device receives and displays the current frame image, and obtains the coordinates of the user's gaze point on the display screen of the display device;

[0158] In some embodiments, the display device of this embodiment is capable of displaying both 2D and 3D images. When displaying 3D images, the display screen is configured to display 3D images from different perspectives, each displaying different image content. In conjunction with eye tracking technology, as the eye moves, the 3D image can be displayed at a corresponding perspective based on the current eye perspective, thereby enabling the display of 3D objects from different perspectives.

[0159] During implementation, when displaying 3D images, the concept of pixel islands is proposed. Each pixel island (RGB) displayed contains multiple pixels, and each pixel is displayed as a perspective. Each pixel island contains pixels of different perspectives. The data of pixels at different perspectives are different, that is, the image content displayed at different perspectives is different, which is convenient for responding to the gaze point of the human eye and timely refreshing the 3D image at the perspective corresponding to the gaze point.

[0160] In some embodiments, a camera device integrated with a display device is used to obtain the coordinates of the user's gaze point on the display screen. During implementation, the camera device first captures an image of the human eye and then identifies the coordinates of the user's gaze point on the display screen by extracting eye features from the image. This embodiment utilizes the camera device integrated with the display device to obtain the gaze point coordinates, thereby directly converting them to achieve rapid response in eye tracking.

[0161] Step 101: Divide a display area of ​​a display screen into a plurality of display zones according to the gaze point coordinates, and determine first controllers corresponding to the plurality of display zones, wherein the first controller includes at least one driver chip.

[0162] In some embodiments, in this embodiment, the display area is divided into a gaze area and a non-gaze area, and the display area is divided into a gaze area and a non-gaze area according to the gaze point coordinates and the user's viewing angle range, wherein the sub-image displayed in the gaze area is within the viewing angle range, and the sub-image displayed in the non-gaze area exceeds the viewing angle range.

[0163] In practice, after capturing images and extracting eye features, the camera captures the gaze point coordinates (x, y, z) of the user's gaze on the display screen. Combined with the user's viewing angle (the central viewing area is between 5° and 8°), these coordinates are calculated to determine the range of the user's gaze area.

[0164] In some embodiments, the display area includes multiple display units, each display unit is controlled by a driver chip for display; the gaze area includes a boundary area; the boundary area is determined according to the display unit controlled by the driver chip corresponding to the boundary of the gaze area.

[0165] This embodiment identifies (IDs) all driver chips (Source Driver) of the display device. Based on the pixel range occupied by the gaze area on the display screen, the driver chip ID corresponding to the gaze area and the driver chip ID corresponding to the non-gaze area are determined, and the content to be transmitted by different driver chips is marked.

[0166] As shown in Figure 2, this embodiment provides a schematic diagram of the human eye's gaze area on a display screen. The display area is divided into multiple display units along the X-axis. Each display unit corresponds to a driver chip, which controls the display of the corresponding display unit. After the multiple display areas are divided, the corresponding driver chip must be determined. In the figure, driver chips SD#4 and SD#5 correspond to the gaze area, driver chips SD#3 and SD#5 correspond to the boundary of the gaze area, and driver chips SD#1, SD#2, SD#7, and SD#8 correspond to the non-gaze area.

[0167] Step 102: Receive a next frame image, and use each first controller to control the next frame image to be displayed in multiple display areas, wherein the next frame image includes multiple sub-images, and one display area is used to display one sub-image.

[0168] In some embodiments, this embodiment uses each first controller to control the next frame image to be displayed in multiple display areas according to the difference between the next frame image and each sub-image in the current frame image.

[0169] In some embodiments, the display is performed as follows:

[0170] Method 1: Partition display.

[0171] During implementation, if the difference between the next frame image and some sub-images in the current frame image is greater than the image threshold, the part of the sub-images in the next frame image is refreshed and displayed.

[0172] Optionally, the multiple display areas include a gaze area and a non-gaze area;

[0173] If, in the next frame image and the current frame image, the difference between the sub-image located in the gaze area is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the first controller corresponding to the gaze area is used to refresh and display the sub-image located in the gaze area in the next frame image.

[0174] During implementation, if the difference between the sub-image located in the gaze area in the next frame image and the current frame image is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, only the gaze area is refreshed and the non-gaze area is not refreshed. The non-gaze area can retain the sub-image corresponding to the current frame image in the non-gaze area and continue to display it.

[0175] In some embodiments, if the difference between the next frame image and some sub-images in the current frame image is greater than the image threshold, the purpose of saving power consumption can also be achieved by performing the following steps:

[0176] Determine a first display area corresponding to the partial sub-image, and turn on an OP of a driver chip in a first controller corresponding to the first display area; and

[0177] A second display area corresponding to the sub-image excluding the partial sub-image is determined, and an OP of a driving chip in the first controller corresponding to the second display area is turned off.

[0178] Optionally, the first display area in this embodiment is a gaze area, and the second display area in this embodiment is a non-gaze area; or, the first display area in this embodiment is a non-gaze area, and the second display area in this embodiment is a gaze area.

[0179] During implementation, the multiple display areas include a gaze area and a non-gaze area; when the first controller corresponding to the gaze area is used to refresh and display only the sub-image of the gaze area, the OP of the driver chip in the first controller corresponding to the gaze area is turned on, and the OP of the driver chip in the first controller corresponding to the non-gaze area is turned off.

[0180] In some embodiments, when displaying, the embodiment is refreshed by the joint control of the first controller and the second controller. The control method of the second controller is as follows:

[0181] Determine second controllers corresponding to the plurality of display areas, wherein the second controllers include at least one group of GOA (Gate Driver On Array) circuits, each group of GOA circuits being controlled by a separate signal;

[0182] The second controllers are used to scan the multiple display areas, so as to refresh and display the sub-images corresponding to the multiple display areas.

[0183] In some embodiments, the multiple display areas include a gaze area and a non-gaze area. In this embodiment, each second controller scans the multiple display areas through the following steps:

[0184] If, in the next frame image and the current frame image, the difference between the sub-image located in the gaze area is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the second controller corresponding to the gaze area is used to scan the gaze area row by row.

[0185] During implementation, when only the gaze area is refreshed, only the image data in the gaze area in the next frame image is received and the image data is refreshed and displayed, while the image data in the non-gaze area still retains the image data in the non-gaze area in the current frame image, thereby reducing data transmission.

[0186] In some embodiments, if the degree of difference between the sub-image located in the gaze area and the current frame image is greater than the image threshold, and the degree of difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the control signal of each group of GOA circuits in the second controller corresponding to the gaze area is turned on, and the control signal of each group of GOA circuits in the second controller corresponding to the non-gaze area is turned off.

[0187] Optionally, when the display screen is divided into multiple display areas including a gaze area and a non-gaze area, if the difference between the sub-image located in the gaze area in the next frame image and the current frame image is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, then the control signal STV of each group of GOA circuits in the second controller corresponding to the gaze area is turned on, and the control signal STV of each group of GOA circuits in the second controller corresponding to the non-gaze area is turned off.

[0188] As shown in Figure 3, this embodiment provides a schematic diagram for refreshing a focus area image. In the X-direction, the states of eight driver ICs (SD ICs) are defined based on the size of the focus area: SD#1, SD#2, SD#7, and SD#8 correspond to the non-focus area, while SD#4 and SD#5 correspond to the focus area. SD#3 and SD#6 correspond to the border area. In the Y-direction, Z groups of Area partitions are defined. Each group's GOA circuit is independent and controlled by a separate control signal (STV signal). When refreshing only the focus area, each row of Area partitions corresponding to the focus area is enabled sequentially from top to bottom, with the STV signal refreshing from the start of the focus area to the end of the focus area. The STV signal for the Area partitions corresponding to the non-focus area is disabled. Simultaneously, the OP signals of the driver ICs within the X-direction focus area are enabled, transmitting image data using the entire focus area, and updating according to the content of the focus area. The non-focus area retains the content of the current frame image, and the OP (operational amplifier) ​​of the driver ICs within the X-direction non-focus area is disabled.

[0189] It should be noted that when the displayed image is a 3D image, one implementation method is that a pixel island includes 16 sub-pixels corresponding to the 16 views of the 3D picture, and some sub-pixels are turned on according to the gaze range of the human eye; when the displayed image is a 2D image, the image content of the 16 sub-pixels contained in a pixel island is the same.

[0190] Mode 2: Full frame display.

[0191] In implementation, if the difference between the next frame image and all sub-images in the current frame image is greater than the image threshold, all sub-images in the next frame image are refreshed and displayed.

[0192] In some embodiments, the multiple display areas include a gaze area and a non-gaze area; if the difference between the sub-images located in the gaze area and the non-gaze area in the next frame image and the current frame image is greater than an image threshold, the first controller corresponding to the gaze area is used to refresh and display the sub-image located in the gaze area in the next frame image, and the first controller corresponding to the non-gaze area is used to refresh and display the sub-image located in the non-gaze area in the current frame image.

[0193] In some embodiments, second controllers corresponding to multiple display areas are determined, and the second controllers include at least one group of GOA circuits, each group of GOA circuits is controlled by a separate signal; each second controller is used to scan multiple display areas to refresh and display sub-images corresponding to the multiple display areas.

[0194] Optionally, the multiple display areas include a gaze area and a non-gaze area. In this embodiment, each second controller scans the multiple display areas through the following steps:

[0195] If the difference between all sub-images in the next frame image and the current frame image is greater than the image threshold, the second controller corresponding to the gaze area is used to scan the gaze area in sequence by row, and the second controller corresponding to the non-gaze area is used to scan the non-gaze area synchronously by multiple rows.

[0196] During implementation, when refreshing and displaying the sub-image in the non-attention zone of the current frame image, some data may be lost after compression, failing to meet the resolution of the current display screen. Therefore, the pixels in the image data of the next frame image located in the non-attention zone can be copied and transmitted. Specifically, multiple rows use the same image data, and only the image data of the sub-image in the non-attention zone of the next frame image needs to be copied. This reduces the amount of data transmitted while meeting display requirements. Furthermore, the GOA circuits corresponding to multiple rows can be refreshed simultaneously to refresh the display.

[0197] As shown in Figure 4, this embodiment provides a schematic diagram for refreshing an entire frame. In the X direction, the states of eight driver chips (SD ICs) are defined based on the size of the attention zone: SD#1, SD#2, SD#7, and SD#8 correspond to the non-attention zone, while SD#4 and SD#5 correspond to the attention zone. SD#3 and SD#6 correspond to the boundary zone. In the Y direction, Z groups of area partitions are defined. Each group's GOA circuit is independent and controlled by a separate control signal (STV signal). When refreshing an entire frame, the area partitions are enabled sequentially from top to bottom. For the attention zone, each row of area partitions is enabled sequentially, while for the non-attention zone, multiple rows of area partitions are enabled simultaneously to reduce the amount of data transmitted. Simultaneously, image data is transmitted in the entire attention zone in the X direction, while the non-attention zone is transmitted through pixel replication.

[0198] Method 3: Refresh the display of any area.

[0199] In response to a designated operation on any area in the display area, a first sub-image corresponding to the arbitrary area in the next frame image is determined; and a first controller corresponding to the arbitrary area is used to control the first sub-image of the next frame image to be refreshed and displayed.

[0200] In this embodiment, the implementation principle of refreshing any area is similar to the implementation principle of refreshing the gaze area. For the specific implementation method, reference may be made to the above-mentioned method 1, which will not be described in detail here.

[0201] During implementation, if the difference between the next frame image and the first sub-image in the current frame image located in the arbitrary region is greater than an image threshold, the first sub-image in the next frame image is refreshed and displayed. In the non-arbitrary region, the sub-image corresponding to the current frame image in the non-arbitrary region may be retained and continued to be displayed.

[0202] During implementation, the first sub-image is refreshed and displayed using the first controller corresponding to the arbitrary area, the OP of the driver chip in the first controller corresponding to the arbitrary area is turned on, and the OP of the driver chip in the first controller corresponding to areas other than the arbitrary area is turned off.

[0203] During implementation, if the degree of difference between the first sub-image located in the arbitrary area in the next frame image and the current frame image is greater than the image threshold, the second controller corresponding to the arbitrary area is used to scan the arbitrary area row by row, turn on the control signal of each group of GOA circuits in the second controller corresponding to the arbitrary area, and turn off the control signal of each group of GOA circuits in the second controller corresponding to the area other than the arbitrary area.

[0204] One implementation method is that, in certain scenarios, this embodiment may only refresh the display of the area where the cursor is located.

[0205] In some embodiments, the present embodiment further performs any one or more of the following:

[0206] Item 1: Sending the gaze point coordinates to a GPU, whereby the GPU determines multiple display areas based on the gaze point coordinates, and compressing sub-images corresponding to different display areas in a next frame of image according to different compression ratios;

[0207] Item 2: Send the position information of the multiple display areas and the identification information corresponding to the display areas to the GPU, so that the GPU can compress the sub-images corresponding to different display areas in the next frame image according to different compression ratios, wherein the identification information is used to indicate the driver chip.

[0208] In practice, the position information of the gaze area and the identification information of the driver chip corresponding to the gaze area can be sent to the GPU, or only the gaze point coordinates can be sent to the GPU.

[0209] In some embodiments, after the gaze point coordinates and / or the location information of the gaze area and the identification information of the driver chip corresponding to the gaze area are sent to the GPU, the GPU compresses the images corresponding to the gaze area and the non-gaze area at different compression ratios. The specific compression method is as follows:

[0210] (1) The sub-image corresponding to the gaze area in the next frame of image is an uncompressed image, and the sub-image corresponding to the non-gaze area in the next frame of image is a compressed image;

[0211] In this mode, the sub-image in the attention area is not compressed, and the sub-image in the non-attention area is compressed.

[0212] (2) The compression ratio of the sub-image corresponding to the gaze area in the next frame image is lower than that of the sub-image corresponding to the non-gaze area in the next frame image.

[0213] During implementation, after the TCON module of the display device obtains the coordinate information of the gaze area, the coordinate information of the gaze area is fed back to the GPU, and the next frame of image data to be transmitted is compressed at different ratios according to the gaze area / non-gaze area. Because the human eye is relatively insensitive to the content of the non-gaze area, a high compression ratio DSC (display stream compression) can be used for data compression. Even if the decompressed data is distorted compared to the original data, it will not be recognized by the human eye, which can greatly reduce the amount of data transmitted. For the content in the gaze area, lossless compression / no compression can be used to ensure the display effect of the area that the human eye focuses on. Before compression, the image is divided into a multi-piece grid. Each fragment is encoded and decoded independently to ensure that transmission errors do not affect other fragments.

[0214] Optionally, the gaze area includes a boundary area; the sub-image corresponding to the boundary area in the next frame image is an image including compressed image data and uncompressed image data. In implementation, the image data in the boundary area is partially compressed.

[0215] In some embodiments, the gaze point coordinates may be further transmitted to the first controller, so that the first controller determines multiple display areas according to the gaze point coordinates and uses a driver chip corresponding to each display area to refresh the display; and / or,

[0216] The position information of the plurality of display areas and the identification information corresponding to the display areas are transmitted to the first controller, so that the first controller uses the driving chip corresponding to each display area to refresh the display.

[0217] As shown in Figure 5, this embodiment also provides a system framework diagram for a display device to perform partitioned display, wherein the display device includes a TCON (Timing controller) module, a GOA module and a driver module, and also includes an integrated camera. During implementation, the camera performs image acquisition (including human eye images), and the TCON module performs feature extraction on the acquired human eye images, identifies the coordinates of the gaze point of the human eye on the display screen, determines the gaze area and the non-gaze area based on the gaze point coordinates, further determines the identifier of the driver chip corresponding to the gaze area, and the identifier of the driver chip corresponding to the non-gaze area, and sends the coordinate information of the gaze area to the GPU and the driver chip. The GPU performs lossless compression or non-compression on the sub-image corresponding to the gaze area in the next frame image to be transmitted to the TCON module, performs DSC compression on the sub-image corresponding to the non-gaze area, and transmits it to the TCON module. After the TCON module decompresses the received next frame image, it determines the degree of difference between the sub-images of the gaze area and the non-gaze area in the next frame image and the current frame image, specifically including the following refresh modes:

[0218] Mode 1, only refresh the gaze area;

[0219] If the difference between the sub-image located in the watch area in the next frame image and the current frame image is greater than the image threshold, and the difference between the sub-image located in the non-watch area is less than or equal to the image threshold, only the watch area is refreshed, the OP of the driver chip corresponding to the watch area and the STV signal of each group of GOA circuits corresponding to the watch area are turned on, and the OP of the driver chip corresponding to the non-watch area and the STV signal of each group of GOA circuits corresponding to the non-watch area are turned off.

[0220] Mode 2, refresh the entire frame.

[0221] If the difference between all sub-images in the next frame image and the current frame image is greater than the image threshold, the sub-image in the next frame image located in the watch area is refreshed and displayed using the first controller corresponding to the watch area, and the sub-image in the non-watch area is refreshed and displayed using the first controller corresponding to the non-watch area. Specifically, the image data of the sub-image in the watch area of ​​the next frame image is transmitted to the driver chip, while the non-watch area is transmitted using pixel replication, that is, partial pixel data of the next frame image located in the non-watch area is transmitted to reduce the amount of data transmitted. The watch area is scanned sequentially row by row using the GOA circuit corresponding to the watch area, and the non-watch area is scanned synchronously across multiple rows using the GOA circuit corresponding to the non-watch area. The driver chips are distributed along the X-axis, and the groups of GOA circuits are distributed along the Y-axis.

[0222] Mode 3: Refresh any frame.

[0223] If the degree of difference between the sub-image located in the arbitrary area in the next frame image and the current frame image is greater than the image threshold, and the degree of difference between the sub-image located in the non-arbitrary area is less than or equal to the image threshold, only the arbitrary area is refreshed, and the image data of the non-arbitrary area still retains the pixel data of the current frame image in the non-arbitrary area, turns on the OP of the driving chip corresponding to the arbitrary area and the STV signal of each group of GOA circuits corresponding to the arbitrary area, and turns off the OP of the driving chip corresponding to the non-arbitrary area and the STV signal of each group of GOA circuits corresponding to the non-arbitrary area.

[0224] In this embodiment, based on the gaze point coordinates fed back by eye tracking, the GPU, TCON, and driver IC (Source Driver IC) work together to intelligently partition the display mode (including 3D, 2D, and light field 3D) and refresh mode (refreshing the entire frame, refreshing only the gaze area, or refreshing any area) in the current state. The gaze point coordinates collected by the external camera are processed, the center point coordinates are converted within the TCON, and combined with the identification information ID of the Source Driver IC. The sub-image data corresponding to different driver chips is compressed / decompressed by the front-end GPU. The image data sent by the front-end is then filtered based on the image data of the previous and next frames and the corresponding usage scenario. If refreshing the entire frame, all the data sent by the front-end is directly arranged according to the driver chip requirements and output according to the gaze area / non-gaze area corresponding to each driver chip. When refreshing only the gaze area, the non-gaze area retains the data of the previous frame. The TCON is required to filter the image data sent by the front-end and send the filtered image data to the corresponding driver chip (the driver chip corresponding to the gaze area is matched with the number of rows). Transmission is carried out according to the pre-set display mode, which can accelerate the response speed of the data corresponding to the gaze area. When the human eye moves quickly, the driver chip directly receives the coordinate information of the gaze area and outputs it, reducing the discomfort caused by delays. When refreshing any area, certain special scenes, such as the cursor position, are refreshed, and the rest maintain the previous frame data to reduce power consumption. The filtered data is sent to the corresponding driver chip and combined with the corresponding GOA partition for specific partition data transmission.

[0225] This embodiment uses intelligent zoning to divide the display area into multiple display zones. Based on the image data of the previous frame and eye tracking, it intelligently determines the rules for updating the data for the next / current frame, achieving a combination of timely response and power saving. When the eye moves rapidly, the driver chip directly receives and outputs the coordinates, reducing the discomfort caused by delays. Furthermore, to reduce the difference between the gaze area and the non-gaze area, the concept of a transition zone (border zone) is introduced. This allows data in the non-gaze area to be compressed while still maintaining a good overall display quality. Data formats are classified based on the display blocks corresponding to different driver chips, allowing multiple driver chips to process display data with fewer instructions. When only the gaze area or specific areas need to be refreshed, the output of irrelevant areas is disabled, reducing power consumption. An eye-tracking camera is integrated into the panel. The display end processes the coordinate data and sends it to the front-end GPU for appropriate compression, reducing the amount of transmitted data.

[0226] Based on the same inventive concept, an embodiment of the present invention further provides a display device. Since the display device is the display device in the method in the embodiment of the present invention, and the principle of solving the problem by the display device is similar to that of the method, the implementation of the display device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0227] As shown in FIG6 , the display device includes a display screen 600 and a processor 601 , wherein:

[0228] The display screen 600 is used to display content;

[0229] The processor 601 is specifically configured to perform the following steps:

[0230] The display device receives and displays the current frame image, and obtains the coordinates of the user's gaze point on the display screen of the display device;

[0231] Dividing a display area of ​​the display screen into a plurality of display zones according to the gaze point coordinates, and determining first controllers corresponding to the plurality of display zones, respectively, wherein the first controller includes at least one driver chip;

[0232] A next frame image is received, and each first controller is used to control the next frame image to be displayed in multiple display areas, wherein the next frame image includes multiple sub-images, and one display area is used to display one sub-image.

[0233] As an optional implementation, the multiple display areas include a gaze area and a non-gaze area;

[0234] The processor 601 is specifically configured to execute:

[0235] The display area is divided into a gaze area and a non-gaze area according to the gaze point coordinates and the user's viewing angle range, wherein the sub-image displayed in the gaze area is within the viewing angle range, and the sub-image displayed in the non-gaze area exceeds the viewing angle range.

[0236] As an optional embodiment, the gaze area includes a boundary area; the boundary area is determined according to the display unit controlled by the driver chip corresponding to the boundary of the gaze area, wherein the display area includes multiple display units, and each display unit is controlled by a driver chip for display.

[0237] As an optional implementation manner, the processor 601 is specifically configured to execute:

[0238] According to the difference between the next frame image and each sub-image in the current frame image, the first controllers are used to control the next frame image to be displayed in multiple display areas.

[0239] As an optional implementation manner, the processor 601 is specifically configured to execute:

[0240] If the difference between the next frame image and the partial sub-images in the current frame image is greater than the image threshold, refreshing and displaying the partial sub-images in the next frame image; or

[0241] If the difference between the next frame image and all sub-images in the current frame image is greater than the image threshold, all sub-images in the next frame image are refreshed and displayed.

[0242] As an optional implementation manner, the multiple display areas include a gaze area and a non-gaze area; the processor 601 is specifically configured to execute:

[0243] If, in the next frame image and the current frame image, the difference between the sub-image located in the gaze area is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the first controller corresponding to the gaze area is used to refresh and display the sub-image located in the gaze area in the next frame image.

[0244] As an optional implementation manner, if the difference between the next frame image and some sub-images in the current frame image is greater than the image threshold, the processor 601 is further configured to execute:

[0245] Determine a first display area corresponding to the partial sub-image, and turn on an OP of a driver chip in a first controller corresponding to the first display area; and

[0246] A second display area corresponding to the sub-image excluding the partial sub-image is determined, and an OP of a driving chip in the first controller corresponding to the second display area is turned off.

[0247] As an optional implementation manner, the processor 601 is further configured to execute:

[0248] Determine a second controller corresponding to each of the plurality of display areas, wherein the second controller includes at least one group of GOA circuits, and each group of GOA circuits is controlled by a separate signal;

[0249] The second controllers are used to scan the multiple display areas, so as to refresh and display the sub-images corresponding to the multiple display areas.

[0250] As an optional implementation manner, the multiple display areas include a gaze area and a non-gaze area; the processor 601 is specifically configured to execute:

[0251] If the difference between the sub-images located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-images located in the non-gaze area is less than or equal to the image threshold, the second controller corresponding to the gaze area is used to sequentially scan the gaze area row by row; or

[0252] If the difference between all sub-images in the next frame image and the current frame image is greater than the image threshold, the second controller corresponding to the gaze area is used to scan the gaze area in sequence by row, and the second controller corresponding to the non-gaze area is used to scan the non-gaze area synchronously by multiple rows.

[0253] As an optional implementation manner, if the difference between the sub-image located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the processor 601 is further configured to execute:

[0254] The control signals of each group of GOA circuits in the second controller corresponding to the gaze area are turned on, and the control signals of each group of GOA circuits in the second controller corresponding to the non-gaze area are turned off.

[0255] As an optional implementation manner, the processor 601 is further configured to execute:

[0256] In response to a designation operation on any area in the display area, determining a first sub-image corresponding to the any area in the next frame image;

[0257] The first controller corresponding to the arbitrary area is used to control the first sub-image of the next frame image to be refreshed and displayed.

[0258] As an optional implementation manner, the processor 601 is further configured to execute:

[0259] Sending the gaze point coordinates to a GPU, so that the GPU determines multiple display areas according to the gaze point coordinates, and compressing sub-images corresponding to different display areas in a next frame of image according to different compression ratios; and / or

[0260] The position information of the multiple display areas and the identification information corresponding to the display areas are sent to the GPU, so that the GPU can compress the sub-images corresponding to different display areas in the next frame image according to different compression ratios, wherein the identification information is used to indicate the driver chip.

[0261] As an optional implementation,

[0262] The plurality of display areas include a gaze area and a non-gaze area;

[0263] The sub-image corresponding to the attention area in the next frame of image is an uncompressed image, and the sub-image corresponding to the non-attention area in the next frame of image is a compressed image; or,

[0264] The compression ratio of the sub-image corresponding to the attention area in the next frame image is lower than that of the sub-image corresponding to the non-attention area in the next frame image.

[0265] As an optional implementation, the gaze area includes a boundary area;

[0266] The sub-image corresponding to the boundary area in the next frame image is an image including compressed image data and uncompressed image data.

[0267] As an optional implementation,

[0268] The display screen is used to display 3D images at different viewing angles, and the 3D images at different viewing angles display different image contents.

[0269] As an optional implementation manner, the processor 601 is further configured to execute:

[0270] transmitting the gaze point coordinates to the first controller, so that the first controller determines a plurality of display areas according to the gaze point coordinates and uses a driver chip corresponding to each display area to refresh the display; and / or,

[0271] The position information of the plurality of display areas and the identification information corresponding to the display areas are transmitted to the first controller, so that the first controller uses the driving chip corresponding to each display area to refresh the display.

[0272] As an optional implementation manner, the processor 601 is specifically configured to execute:

[0273] The coordinates of the user's gaze point on the display screen of the display device are acquired by using a camera device, wherein the camera device is integrated on the display device.

[0274] Based on the same inventive concept, an embodiment of the present invention also provides a partition display device. Since the device is the device in the method in the embodiment of the present invention, and the principle of solving the problem by the device is similar to that of the method, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0275] As shown in FIG7 , the device includes:

[0276] The display acquisition unit 700 is used for the display device to receive and display the current frame image and obtain the coordinates of the user's gaze point on the display screen of the display device;

[0277] an area division unit 701 for dividing a display area of ​​the display screen into a plurality of display areas according to the gaze point coordinates, and determining first controllers corresponding to the plurality of display areas, wherein the first controllers include at least one driver chip;

[0278] The partition display unit 702 is used to receive the next frame image and use each first controller to control the next frame image to be displayed in multiple display areas, where the next frame image includes multiple sub-images, and one display area is used to display one sub-image.

[0279] As an optional implementation, the multiple display areas include a gaze area and a non-gaze area;

[0280] The area division unit 701 is specifically used for:

[0281] The display area is divided into a gaze area and a non-gaze area according to the gaze point coordinates and the user's viewing angle range, wherein the sub-image displayed in the gaze area is within the viewing angle range, and the sub-image displayed in the non-gaze area exceeds the viewing angle range.

[0282] As an optional embodiment, the gaze area includes a boundary area; the boundary area is determined according to the display unit controlled by the driver chip corresponding to the boundary of the gaze area, wherein the display area includes multiple display units, and each display unit is controlled by a driver chip for display.

[0283] As an optional implementation, the partition display unit 702 is specifically configured to:

[0284] According to the difference between the next frame image and each sub-image in the current frame image, the first controllers are used to control the next frame image to be displayed in multiple display areas.

[0285] As an optional implementation, the partition display unit 702 is specifically configured to:

[0286] If the difference between the next frame image and the partial sub-images in the current frame image is greater than the image threshold, refreshing and displaying the partial sub-images in the next frame image; or

[0287] If the difference between the next frame image and all sub-images in the current frame image is greater than the image threshold, all sub-images in the next frame image are refreshed and displayed.

[0288] As an optional implementation manner, the multiple display areas include a gaze area and a non-gaze area; the partitioned display unit 702 is specifically configured to:

[0289] If, in the next frame image and the current frame image, the difference between the sub-image located in the gaze area is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the first controller corresponding to the gaze area is used to refresh and display the sub-image located in the gaze area in the next frame image.

[0290] As an optional implementation manner, if the difference between the next frame image and some sub-images in the current frame image is greater than the image threshold, the partition display unit 702 is further configured to:

[0291] Determine a first display area corresponding to the partial sub-image, and turn on an OP of a driver chip in a first controller corresponding to the first display area; and

[0292] A second display area corresponding to the sub-image excluding the partial sub-image is determined, and an OP of a driving chip in the first controller corresponding to the second display area is turned off.

[0293] As an optional implementation manner, the partition display unit 702 is further configured to:

[0294] Determine a second controller corresponding to each of the plurality of display areas, wherein the second controller includes at least one group of GOA circuits, and each group of GOA circuits is controlled by a separate signal;

[0295] The second controllers are used to scan the multiple display areas, so as to refresh and display the sub-images corresponding to the multiple display areas.

[0296] As an optional implementation manner, the multiple display areas include a gaze area and a non-gaze area; the partitioned display unit 702 is specifically configured to:

[0297] If the difference between the sub-images located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-images located in the non-gaze area is less than or equal to the image threshold, the second controller corresponding to the gaze area is used to sequentially scan the gaze area row by row; or

[0298] If the difference between all sub-images in the next frame image and the current frame image is greater than the image threshold, the second controller corresponding to the gaze area is used to scan the gaze area in sequence by row, and the second controller corresponding to the non-gaze area is used to scan the non-gaze area synchronously by multiple rows.

[0299] As an optional implementation manner, if the difference between the sub-image located in the gaze area and the current frame image is greater than the image threshold, and the difference between the sub-image located in the non-gaze area is less than or equal to the image threshold, the partition display unit 702 is further configured to:

[0300] The control signals of each group of GOA circuits in the second controller corresponding to the gaze area are turned on, and the control signals of each group of GOA circuits in the second controller corresponding to the non-gaze area are turned off.

[0301] As an optional implementation manner, the partition display unit 702 is further configured to:

[0302] In response to a designation operation on any area in the display area, determining a first sub-image corresponding to the any area in the next frame image;

[0303] The first controller corresponding to the arbitrary area is used to control the first sub-image of the next frame image to be refreshed and displayed.

[0304] As an optional implementation manner, the apparatus further includes a first sending unit specifically configured to:

[0305] Sending the gaze point coordinates to a GPU, so that the GPU determines multiple display areas according to the gaze point coordinates, and compressing sub-images corresponding to different display areas in a next frame of image according to different compression ratios; and / or

[0306] The position information of the multiple display areas and the identification information corresponding to the display areas are sent to the GPU, so that the GPU can compress the sub-images corresponding to different display areas in the next frame image according to different compression ratios, wherein the identification information is used to indicate the driver chip.

[0307] As an optional implementation, the multiple display areas include a gaze area and a non-gaze area;

[0308] The sub-image corresponding to the attention area in the next frame of image is an uncompressed image, and the sub-image corresponding to the non-attention area in the next frame of image is a compressed image; or,

[0309] The compression ratio of the sub-image corresponding to the attention area in the next frame image is lower than that of the sub-image corresponding to the non-attention area in the next frame image.

[0310] As an optional implementation, the gaze area includes a boundary area;

[0311] The sub-image corresponding to the boundary area in the next frame image is an image including compressed image data and uncompressed image data.

[0312] As an optional implementation manner, the display screen is used to display 3D images at different viewing angles, and the 3D images at different viewing angles display different image contents.

[0313] As an optional implementation manner, the second sending unit is further included to:

[0314] transmitting the gaze point coordinates to the first controller, so that the first controller determines a plurality of display areas according to the gaze point coordinates and uses a driver chip corresponding to each display area to refresh the display; and / or,

[0315] The position information of the plurality of display areas and the identification information corresponding to the display areas are transmitted to the first controller, so that the first controller uses the driving chip corresponding to each display area to refresh the display.

[0316] As an optional implementation manner, the display acquisition unit 700 is specifically configured to:

[0317] The coordinates of the user's gaze point on the display screen of the display device are acquired by using a camera device, wherein the camera device is integrated on the display device.

[0318] Based on the same inventive concept, embodiments of the present disclosure provide a computer storage medium comprising computer program code. When executed on a computer, the computer program code causes the computer to execute any of the partition display methods discussed above. Because the principles underlying the problems solved by the computer storage medium are similar to those of the partition display method, the implementation of the computer storage medium can be referenced to the implementation of the method, and any repetitions will not be repeated here.

[0319] In a specific implementation process, computer storage media may include: Universal Serial Bus Flash Drive (USB), mobile hard disk, Read-Only Memory (ROM), Random Access Memory (RAM), magnetic disk or optical disk, and other storage media that can store program code.

[0320] Based on the same inventive concept, embodiments of the present disclosure further provide a computer program product comprising computer program code that, when executed on a computer, causes the computer to perform any of the aforementioned partition display methods. Because the principles underlying the aforementioned computer program products are similar to those of the aforementioned partition display methods, the implementation of the aforementioned computer program products can be referenced to the implementation of the aforementioned methods, and any repetitive details will not be repeated.

[0321] The computer program product can employ any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0322] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage and optical storage, etc.) containing computer-usable program code.

[0323] The present invention is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0324] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0325] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0326] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

Claims

1. A partition display method, It is characterized in that The method includes: The display device receives and displays the current frame image, and obtains the coordinates of the user's gaze point on the display screen of the display device; According to the gaze point coordinates, a display area of ​​the display screen is divided into a plurality of display areas, and first controllers corresponding to the plurality of display areas are determined, wherein the first controller includes at least one driver chip; A next frame of image is received, and each first controller is used to control the next frame of image to be displayed in a plurality of display areas, wherein the next frame of image includes a plurality of sub-images, and one display area is used to display one sub-image.

2. The method according to claim 1, It is characterized in that The plurality of display areas include a gaze area and a non-gaze area; The step of dividing the display area of ​​the display screen into a plurality of display areas according to the gaze point coordinates comprises: The display area is divided into a gaze area and a non-gaze area according to the gaze point coordinates and the user's viewing angle range, wherein the sub-image displayed in the gaze area is within the viewing angle range, and the sub-image displayed in the non-gaze area exceeds the viewing angle range.

3. The method according to claim 2, It is characterized in that The gaze area includes a boundary area; the boundary area is determined according to a display unit controlled by a driver chip corresponding to a boundary of the gaze area, wherein the display area includes a plurality of display units, and each display unit is controlled and displayed by a driver chip.

4. The method according to claim 1, It is characterized in that The using of the first controllers to control the next frame of image to be displayed in a plurality of display areas comprises: According to the difference between the next frame image and each sub-image in the current frame image, each first controller is used to control the next frame image to be displayed in multiple display areas.

5. The method according to claim 4, It is characterized in that The method of controlling the next frame image to be displayed in a plurality of display areas by using each first controller according to the difference between each sub-image in the next frame image and the current frame image comprises: If the difference between the next frame image and the partial sub-image in the current frame image is greater than the image threshold, refreshing and displaying the partial sub-image in the next frame image; or, If the difference between the next frame image and all sub-images in the current frame image is greater than the image threshold, all sub-images in the next frame image are refreshed and displayed.

6. The method according to claim 5, It is characterized in that The plurality of display areas include a gaze area and a non-gaze area; If, in the next frame image and the current frame image, the difference degree of the sub-image located in the gaze area is greater than the image threshold, and the difference degree of the sub-image located in the non-gaze area is less than or equal to the image threshold, the first controller corresponding to the gaze area is used to refresh and display the sub-image located in the gaze area in the next frame image.

7. The method according to claim 5, It is characterized in that If the difference between the next frame image and some sub-images in the current frame image is greater than the image threshold, the method further includes: Determine a first display area corresponding to the partial sub-image, and turn on an OP of a driving chip in a first controller corresponding to the first display area; and A second display area corresponding to the sub-images other than the part of the sub-images is determined, and an OP of a driving chip in the first controller corresponding to the second display area is turned off.

8. The method according to any one of claims 1 to 7, It is characterized in that The method further includes: Determine a second controller corresponding to each of the plurality of display areas, wherein the second controller includes at least one group of GOA circuits, and each group of GOA circuits is controlled by a separate signal; The second controllers are used to scan the multiple display areas, so as to refresh and display the sub-images corresponding to the multiple display areas.

9. The method according to claim 8, It is characterized in that The plurality of display areas include a fixation area and a non-fixation area; and the scanning of the plurality of display areas by using each second controller includes: If the difference between the sub-images in the next frame image and the current frame image, located in the attention area, is greater than the image threshold, and the difference between the sub-images in the non-attention area is less than or equal to the image threshold, then using the second controller corresponding to the attention area to sequentially scan the attention area row by row; or, If the difference between all sub-images in the next frame image and the current frame image is greater than the image threshold, the second controller corresponding to the gaze area is used to scan the gaze area row by row, and the second controller corresponding to the non-gaze area is used to scan the non-gaze area synchronously in multiple rows.

10. The method according to claim 8, It is characterized in that If, in the next frame image and the current frame image, the difference degree of the sub-image located in the attention area is greater than the image threshold, and the difference degree of the sub-image located in the non-attention area is less than or equal to the image threshold, the method further includes: The control signals of each group of GOA circuits in the second controller corresponding to the attention zone are turned on, and the control signals of each group of GOA circuits in the second controller corresponding to the non-attention zone are turned off.

11. The method according to any one of claims 1 to 7, It is characterized in that Also includes: In response to a designation operation on any area in the display area, determining a first sub-image corresponding to the any area in the next frame image; The first controller corresponding to the arbitrary area is used to control the first sub-image of the next frame image to be refreshed and displayed.

12. The method according to any one of claims 1 to 7, It is characterized in that The method further comprises: Sending the gaze point coordinates to a GPU, so that the GPU determines a plurality of display areas according to the gaze point coordinates, and compresses sub-images corresponding to different display areas in a next frame of image according to different compression ratios; and / or, The position information of the multiple display areas and the identification information corresponding to the display areas are sent to the GPU, so that the GPU compresses the sub-images corresponding to different display areas in the next frame image according to different compression ratios, wherein the identification information is used to indicate the driver chip.

13. The method according to claim 12, It is characterized in that The plurality of display areas include a gaze area and a non-gaze area; The sub-image corresponding to the attention area in the next frame of image is an uncompressed image, and the sub-image corresponding to the non-attention area in the next frame of image is a compressed image; or, The compression ratio of the sub-image corresponding to the attention area in the next frame of image is lower than that of the sub-image corresponding to the non-attention area in the next frame of image.

14. The method according to claim 13, It is characterized in that The fixation area includes a boundary area; The sub-image corresponding to the boundary area in the next frame image is an image including compressed image data and uncompressed image data.

15. The method according to claim 1, It is characterized in that The display screen is used to display 3D images at different viewing angles, and the 3D images at different viewing angles display different image contents.

16. The method according to any one of claims 1 to 7, It is characterized in that Also includes: The gaze point coordinates are transmitted to the first controller, so that the first controller determines a plurality of display areas according to the gaze point coordinates, and uses a driving chip corresponding to each display area to refresh the display; and / or, The position information of the plurality of display areas and the identification information corresponding to the display areas are transmitted to the first controller, so that the first controller can refresh the display by using the driving chip corresponding to each display area.

17. The method according to claim 1, It is characterized in that The obtaining of the coordinates of the gaze point of the user on the display screen of the display device comprises: The coordinates of the gaze point of the user on the display screen of the display device are obtained by using a camera device, and the camera device is integrated on the display device.

18. A display device, It is characterized in that Includes a display and a processor, including: The display screen is used to display content; The processor is specifically configured to execute the steps of any one of the methods of claims 1 to 17.

19. A computer storage medium having a computer program stored thereon, It is characterized in that When the program is executed by a processor, the steps of the method according to any one of claims 1 to 17 are implemented.

Images