Display device and display control method

Abstract

The invention provides a display device and a display control method. The device comprises a communication interface used for being connected with an electronic device to obtain an image signal output by the electronic device; an image output unit that outputs an image; the eye movement sensor is used for obtaining eye movement data of the target object; the eye movement data processing unit is used for processing the eye movement data to obtain target fixation point data of the target object on the display equipment; the display control unit is used for outputting a control signal based on the image signal so as to control the image output unit to output an image corresponding to the image signal, and the display control unit is further used for determining first area information, corresponding to the image signal, of the target fixation point data; the first area information is controlled to output a first image area corresponding to the first area information through the first display parameter, the second area information is controlled to output a second image area corresponding to the second area information through the second display parameter, and the second area information is information except the first area information in the image signal.

Description

Technical Field

[0001] The present application relates to display control technology, and in particular to a display device and a display control method. Background Art

[0002] During use, current display devices can only simply display the images output by the host device to which they are connected, and are unable to adjust the image effects outputted by themselves based solely on the user's interaction needs. Summary of the Invention

[0003] Embodiments of the present application provide a display device and a display control method.

[0004] According to a first aspect of the present application, a display device is provided, comprising: a communication interface for connecting to an electronic device to obtain an image signal output by the electronic device; an image output unit capable of outputting an image; an eye movement sensor for obtaining eye movement data of a target object; an eye movement data processing unit for processing the eye movement data to obtain target gaze point data of the target object on the display device; a display control unit for outputting a control signal based on the image signal to control the image output unit to output an image corresponding to the image signal, wherein, when obtaining the target gaze point data, the display control unit is further used to: determine first area information corresponding to the target gaze point data and the image signal; control the first area information to output a first image area corresponding to the first area information with a first display parameter, and control the second area information to output a second image area corresponding to the second area information with a second display parameter, wherein the second area information is information in the image signal other than the first area information.

[0005] According to a second aspect of the present application, a display control method is provided, comprising: obtaining an image signal output by an electronic device; obtaining eye movement data of a target object; performing data processing on the eye movement data to obtain target gaze point data of the target object on a display device; outputting a control signal based on the image signal to output an image corresponding to the image signal; the outputting of the image corresponding to the image signal comprising: determining first area information corresponding to the target gaze point data and the image signal; controlling the first area information to output a first image area corresponding to the first area information with a first display parameter, and controlling the second area information to output a second image area corresponding to the second area information with a second display parameter, wherein the second area information is information in the image signal other than the first area information.

[0006] According to one embodiment of the present application, determining the first area information corresponding to the target gaze point data and the image signal includes: obtaining display setting parameters related to the eye movement interaction of the display device; the display setting parameters include at least the correspondence between the display control area and the gaze point coordinates; based on the display setting parameters and the target gaze point data, determining the first area information.

[0007] According to one embodiment of the present application, the outputting of a control signal based on the image signal to output an image corresponding to the image signal includes at least one of the following: adjusting the scaling ratio of the image data in the first area information based on the first display parameter, and outputting a first target control instruction to control the first area information to output the first image area with the first display parameter; adjusting the clarity of the image data in the second area information based on the second display parameter, and outputting a second target control instruction to control the second area information to output the second image area with the second display parameter.

[0008] According to one embodiment of the present application, the step of adjusting the scaling ratio of the image data in the first area information based on the first display parameter and outputting a first target control instruction to control the first area information to output the first image area with the first display parameter includes: adjusting the first display parameter based on the scaling ratio parameter included in the display setting parameter to obtain the adjusted first display parameter; scaling the image data in the first area information based on the adjusted first display parameter to obtain a scaled image signal; generating a first target control instruction based on the scaled image signal; and controlling the first area information to output the first image area with the adjusted first display parameter based on the target control instruction; the scaling ratio of the first image area is different from the scaling ratio of the second image area.

[0009] According to one embodiment of the present application, the method further includes: adjusting the transparency of the first image area based on the transparency parameter included in the display setting parameters to obtain a first image area with adjusted transparency; the transparency of the first image area with adjusted transparency is different from that of the second image area.

[0010] According to one embodiment of the present application, outputting the first image area includes: outputting the first image area to the first layer of the display device; the first layer is displayed on top of the display device; the center coordinates of the first image area are the same as the gaze point coordinates corresponding to the target gaze point data.

[0011] According to one embodiment of the present application, the method also includes: determining boundary position information between the first area information and the second area information based on the first area information and the second area information; and outputting a first control signal based on the boundary position information to output an image corresponding to the boundary between the first image area and the second image area.

[0012] According to one embodiment of the present application, the clarity of the image data in the second area information is adjusted based on the second display parameter, and a second target control instruction is output to control the second area information to output the second image area with the second display parameter, including: adjusting the second display parameter based on the clarity parameter included in the display setting parameter to obtain the adjusted second display parameter; based on the adjusted second display parameter, performing image blurring processing on the image data in the second area information to obtain an image signal after image blurring processing; generating a second target control instruction based on the image signal after image blurring processing; based on the second target control instruction, controlling the second area information to output the second image area with the adjusted second display parameter; the clarity of the second image area is less than that of the first image area.

[0013] According to one embodiment of the present application, the eye movement data is processed to obtain the target gaze point data of the target object on the display device, including: establishing a corresponding display device coordinate system based on the display device; in response to the gaze point included in the eye movement data being within the display device coordinate system, and the gaze duration corresponding to the gaze point meeting the set gaze condition, mapping the gaze point to the display device coordinate system to obtain the target gaze point data of the target object on the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above and other objects, features and advantages of the exemplary embodiments of the present application will become readily understood by reading the detailed description below with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present application are shown in an illustrative and non-limiting manner, in which:

[0015] In the drawings, the same or corresponding reference numerals denote the same or corresponding parts.

[0016] Figure 1 A schematic diagram of the structure of a display device provided in an embodiment of the present application is shown;

[0017] Figure 2 The processing flow diagram of the display control method provided by the embodiment of the present application is shown as follows Figure 1 ;

[0018] Figure 3The processing flow diagram of the display control method provided by the embodiment of the present application is shown as follows Figure 2 ;

[0019] Figure 4 The processing flow diagram of the display control method provided by the embodiment of the present application is shown as follows Figure 3 ;

[0020] Figure 5 The processing flow diagram of the display control method provided by the embodiment of the present application is shown as follows Figure 4 ;

[0021] Figure 6 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 1 ;

[0022] Figure 7 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 2 ;

[0023] Figure 8 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 3 ;

[0024] Figure 9 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 4 ;

[0025] Figure 10 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 5 . DETAILED DESCRIPTION

[0026] In order to make the purpose, features, and advantages of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of this application.

[0027] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0028] In the following description, the terms "first\second" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first\second" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0029] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.

[0030] The structure of the display device provided in the embodiment of the present application is described. Figure 1 , Figure 1 It is a schematic diagram of the composition structure of the display device provided in an embodiment of the present application.

[0031] The display device may include: a communication interface A1, used to connect to an electronic device to obtain an image signal output by the electronic device; an image output unit A2, capable of outputting an image; an eye movement sensor A3, used to obtain eye movement data of a target object; an eye movement data processing unit A4, used to process the eye movement data to obtain target gaze point data of the target object on the display device; a display control unit A5, used to output a control signal based on the image signal to control the image output unit A2 to output an image corresponding to the image signal, wherein, when obtaining the target gaze point data, the display control unit A5 is further used to: determine first area information corresponding to the target gaze point data and the image signal; control the first area information to output a first image area corresponding to the first area information with a first display parameter, and control the second area information to output a second image area corresponding to the second area information with a second display parameter, where the second area information is information in the image signal other than the first area information.

[0032] In some embodiments, the electronic device may include a computer, a tablet computer, a television, and other devices. The embodiments of this application are not limited to specific electronic devices. The electronic device may be configured to generate and output an image signal for display on a display device. The image output unit A2 may be configured to convert the image signal into an image for output. The eye movement sensor A3 may be configured to capture eye movement data of a target subject. The eye movement data may include eye position and eye movement trajectory. The eye movement data processing unit A4 may be configured to process the eye movement data acquired by the eye movement sensor A3 to determine target gaze point data of the target subject on the display device. Specifically, the target gaze point data may include gaze point position and gaze duration. The display control unit A5 generates a control signal based on the image signal and target gaze point data to adjust the display effect of the image output unit A2. The display control unit A5 applies different display parameters to different regions. Specifically, the display control unit A5 determines first region information and second region information in the image signal based on the target gaze point data. The first region information is information surrounding the target gaze point in the image signal, and the second region information is information in the image signal other than the first region information. The display control unit A5 can apply a first display parameter to the first region information according to a preset display parameter, and apply a second display parameter to the second region information. Finally, the image output unit A2 outputs a first image region corresponding to the first region information according to the first display parameter, and outputs a second image region corresponding to the second region information according to the second display parameter, based on the control signal. The image output unit A2 can specifically include an LCD (Liquid Crystal Display) display panel and an OLED (Organic Light-Emitting Diode) display panel. The image output unit A2 can also include other image output units, which are not limited in the embodiments of the present application.

[0033] The display device of an embodiment of the present application, by combining a communication interface, an image output unit, an eye movement sensor, an eye movement data processing unit, and a display control unit, implements dynamic display control of the display device based on gaze point data. Based on the gaze point data, information about a first region is determined, and that region is displayed using first display parameters, while the remaining regions are displayed using second display parameters. The display effect of the image on the display device can be adjusted in real time based on the gaze point data, improving the user experience. Furthermore, the ability to independently process local display content within an image enhances the flexibility of the display control of the display device.

[0034] The processing flow of the display control method provided in the embodiment of the present application is described. Figure 2 , Figure 2 This is a schematic diagram of the processing flow of the display control method provided in the embodiment of the present application. Figure 1 , will combine Figure 1 Steps S101-S104 are shown for explanation.

[0035] Step S101: obtaining an image signal output by an electronic device.

[0036] Step S102: obtaining eye movement data of the target object.

[0037] In some embodiments, an image signal may include a signal generated and output by an electronic device. Specifically, the image signal may include information such as image pixels, color, and refresh rate. Eye movement data may include information such as the movement trajectory and gaze direction of a target subject's eyes, as captured by an eye movement sensor. The eye movement sensor may specifically include a camera. The embodiments of this application are not limited to a specific eye movement sensor.

[0038] Step S103: Process the eye movement data to obtain target gaze point data of the target object on the display device.

[0039] In some embodiments, data processing may include analyzing eye movement data via an ARM SOC (ARM data processing module) to determine target gaze point data of the target subject on the display device. The target gaze point data may include gaze point location and gaze duration. The target gaze point data may be used by the display device to determine the screen area that the target subject is focusing on.

[0040] Step S104, outputting a control signal based on the image signal to output an image corresponding to the image signal; outputting the image corresponding to the image signal includes: determining the first area information corresponding to the target gaze point data and the image signal; controlling the first area information to output a first image area corresponding to the first area information with a first display parameter, and controlling the second area information to output a second image area corresponding to the second area information with a second display parameter, where the second area information is information in the image signal other than the first area information.

[0041] In some embodiments, the first region information may include: region information corresponding to the target gaze point in the image signal, determined based on the target gaze point data, typically the portion the target subject is focusing on. The first region information is information surrounding the target gaze point in the corresponding image signal, while the second region information is information in the image signal other than the first region information. Based on preset display parameters, the first display parameters are applied to the first region information, while the second display parameters are applied to the second region information. Finally, based on a control signal, the first image region corresponding to the first region information is output according to the first display parameters, and the second image region corresponding to the second region information is output according to the second display parameters. The first display parameters may include: parameters for controlling the display effect of the first region information. Specifically, the first display parameters may include: resolution, refresh rate, color mode, brightness, contrast, clarity, transparency, and scaling. The embodiments of this application do not limit the specific first display parameters. The second display parameters may include: parameters for controlling the display effect of the second region information. The second display parameters may be different from the first display parameters.

[0042] The method of the embodiment of the present application obtains the image signal output by the electronic device and the eye movement data of the target object, processes the eye movement data to obtain the target gaze point data, and then outputs a control signal based on the image signal to display the image. The method can determine the first area information based on the target gaze point data, and display the area with the first display parameter, while displaying the remaining areas with the second display parameter. Dynamic control of image display is achieved, and the display effect of the image can be adjusted in real time according to the gaze point of the target object, thereby improving the user experience. It can also perform separate processing on the local display content in the image, such as magnification, sharpening or blurring, thereby improving the display control flexibility of the display device.

[0043] In some embodiments, the processing flow of the display control method is as follows: Figure 2 ,like Figure 3 As shown, determining the first region information corresponding to the target gaze point data and the image signal in step S104 may include:

[0044] Step S201: Obtain display setting parameters related to eye movement interaction of a display device.

[0045] In this embodiment, the display setting parameters may include parameters that can be set in the display device's On-Screen Display (OSD). The display setting parameters can be used to control parameters of the eye movement interaction function. Specific display setting parameters may include position parameters, size parameters, and shape parameters. For example, parameters such as the magnification area radius, magnification factor, magnification position, and privacy protection area size. The embodiments of this application do not limit the specific display setting parameters.

[0046] Step S202: Determine first region information based on display setting parameters and target gaze point data.

[0047] As an example, first, the display setting parameters related to the eye movement interaction function are set through the setting options in the display device OSD. For example, the setting options in the display device OSD can set the gaze point area magnification mode, including turning the control function on or off, selecting the magnification area radius, and setting the gaze point area magnification factor. The setting options in the display device OSD can also set the dynamic anti-peeping mode, including turning the control function on or off, the clarity parameters, and selecting the anti-peeping area size. The eye movement data of the target object is monitored in real time by the eye movement sensor, and the data is processed to obtain the target gaze point data. In response to the setting options in the display device OSD, the gaze point area magnification mode is set to the on state, and the dynamic anti-peeping mode is set to the off state. The display setting parameters corresponding to the gaze point area magnification mode are obtained, including the magnification area radius and the gaze point area magnification factor. Then, based on the acquired display setting parameters and the target gaze point data, the first area information in the image signal is determined.

[0048] The method of the embodiment of the present application obtains display setting parameters related to eye movement interaction with the display device and determines the corresponding image signal based on the display setting parameters and the target gaze point data. This method ensures the accuracy and reliability of the first region information, realizes dynamic control of image display, and can adjust the image display effect in real time according to the target object's gaze point, improving the user experience. It also allows for independent processing of local displayed content in the image, such as amplification, sharpening, or blurring, thereby increasing the display control flexibility of the display device.

[0049] In some embodiments, the processing flow of the display control method is as follows: Figure 3 ,like Figure 4 As shown, the display control method may further include:

[0050] Step S301: obtaining an image signal output by an electronic device.

[0051] Step S302: Obtain eye movement data of the target object.

[0052] Step S303: Process the eye movement data to obtain target gaze point data of the target object on the display device.

[0053] The detailed explanation of steps S301-S303 is the same as that of steps S101-S103 and will not be repeated here.

[0054] Step S304a: adjusting the scaling ratio of the image data in the first region information based on the first display parameter, and outputting a first target control instruction to control the first region information to output the first image region with the first display parameter.

[0055] In this embodiment, the first region information can be determined based on the target gaze point data. The region information corresponding to the target gaze point in the image signal is generally the portion that the target object is focusing on. Based on the scaling ratio in the preset first display parameter, the image data in the first region information is amplified, and a corresponding first target control instruction is generated. The first target control instruction can be used to display the first image region corresponding to the first region information in an enlarged form. The first target control instruction is finally output to the image output unit of the display device. After receiving the first target control instruction, the image output unit performs display according to the first target control instruction.

[0056] In some embodiments, step S304a may include: adjusting the first display parameter based on the scaling parameter included in the display setting parameter to obtain the adjusted first display parameter; scaling the image data in the first area information based on the adjusted first display parameter to obtain the scaled image signal; generating a first target control instruction based on the scaled image signal; and controlling the first area information to output the first image area with the adjusted first display parameter based on the target control instruction.

[0057] As an example, the first area information can be a circular area with a diameter of 100 pixels in the image signal. The setting option in the display device OSD sets the gaze point area magnification mode to be on. Obtain the scaling parameters included in the display setting parameters corresponding to the gaze point area magnification mode. According to the scaling parameters in the display setting parameters (for example, set to 2x magnification), the first display parameters are adjusted to obtain the adjusted first display parameters. The adjustment here is to adjust the scaling ratio in the original first display parameter from 1x to 2x, that is, to enlarge the circular area originally with a diameter of 100 pixels to a diameter of 200 pixels.

[0058] Based on the adjusted first display parameters, the image data in the first region information is scaled. Upon receiving the command to enable foveation region magnification, the scaler IC (scaling integrated circuit) within the display control unit begins scaling the image data in the first region information. The resulting scaled image signal represents a circular region with a diameter of 200 pixels. During the scaling process, the scaler IC uses an internal algorithm to interpolate pixels generated by the magnification process. Specifically, for each newly inserted pixel, the algorithm examines the brightness values of its two adjacent pixels, calculates the average of these two adjacent pixels, and assigns this average to the newly inserted pixel. This allows the newly inserted pixel to blend naturally with the surrounding pixels, resulting in a smoother appearance for the entire magnified image data. After completing the interpolation and averaging calculations, the scaler IC also performs sharpening and smoothing operations. Sharpening enhances edge contrast in the magnified image, while smoothing reduces jagged edges caused by magnification. Based on the scaled image signal, a corresponding first target control instruction is generated. The first target control instruction includes the adjusted first display parameters and the image data corresponding to the scaled image signal. Finally, the image output unit outputs the first image area with the adjusted first display parameters based on the first target control instruction.

[0059] In some embodiments, the display control method may further include: adjusting the transparency of the first image region based on a transparency parameter included in the display setting parameters to obtain the first image region after transparency adjustment.

[0060] As an example, the transparency of the first image area is adjusted based on the transparency parameter in the display setting parameters. This adjustment may include adjusting the original transparency of the first image area from 1 to 0.5. Based on a transparency of 0.5, the transparency of each pixel in the first image area is modified to obtain the first image area after transparency adjustment. The modified first image area can be integrated with the original image at the corresponding position, presenting a semi-transparent effect. The transparency of the first image area after transparency adjustment is different from that of the second image area.

[0061] In some embodiments, outputting the first image area in step S304a includes outputting the first image area to a first layer of a display device. The first layer is displayed at the top of the display device, and the center coordinates of the first image area are the same as the gaze point coordinates corresponding to the target gaze point data. The first layer may be one of multiple layers for layered display on the display device. The gaze point coordinates may include specific coordinate values extracted from the target gaze point data. The gaze point coordinates may represent the location of the target object's gaze point on the display device.

[0062] As an example, the gaze point coordinates on the display device may be (1000, 1500). Based on the target control instruction, the first region information is controlled to output the first image region using the adjusted first display parameters. Outputting the first image region to the first layer may display the first image region at the top of the display device, and adjusting the position of the first image region in the first layer so that the center coordinates of the first image region are the same as the gaze point coordinates (1000, 1500).

[0063] In some embodiments, the display control method may further include: determining boundary position information between the first area information and the second area information based on the first area information and the second area information; and outputting a first control signal based on the boundary position information to output an image corresponding to the boundary between the first image area and the second image area.

[0064] As an example, based on the position information included in the first region information and the position information included in the second region information, the boundary position information between the first region information and the second region information is determined, and a first control signal is generated to output an image corresponding to the boundary between the first image region and the second image region. The first control signal is used to control the image output unit to output the image corresponding to the boundary between the first image region and the second image region. The image output unit can output the first image region with the adjusted first display parameters based on the first target control instruction. The image output unit can also output the image corresponding to the boundary between the first image region and the second image region outside the first image region based on the first control signal.

[0065] Step S304b: adjusting the clarity of the image data in the second region information based on the second display parameter, and outputting a second target control instruction to control the second region information to output a second image region with the second display parameter.

[0066] In this embodiment, the information in the image signal other than the first region information is used to adjust the clarity of the image data in the second region information based on the clarity in the preset second display parameter, and generate a corresponding second target control instruction. The second target control instruction can be used to display the second image region corresponding to the second region information in a blurred form. The second target control instruction is ultimately output to the image output unit of the display device. After receiving the second target control instruction, the image output unit performs display according to the second target control instruction.

[0067] In some embodiments, step S304b may include: adjusting the second display parameter based on the clarity parameter included in the display setting parameter to obtain the adjusted second display parameter; performing image blurring processing on the image data in the second area information based on the adjusted second display parameter to obtain an image signal after image blurring processing; generating a second target control instruction based on the image signal after image blurring processing; based on the second target control instruction, controlling the second area information to output a second image area with the adjusted second display parameter; the clarity of the second image area is less than the clarity of the first image area.

[0068] As an example, the first area information may be a rectangular area with a diameter of 300 pixels in the image signal. The second area information may be information in the image signal other than the first area information. The setting option in the display device OSD sets the dynamic anti-peeping mode to be on. Obtain the clarity parameter included in the display setting parameters corresponding to the dynamic anti-peeping mode. According to the clarity parameter in the display setting parameters (for example, set to 0.3, indicating lower clarity), adjust the second display parameter to obtain the adjusted second display parameter. The adjustment here is to adjust the clarity in the original second display parameter from 1 to 0.3.

[0069] Based on the adjusted second display parameters, the image data in the second area information is blurred. After the display control unit receives the instruction corresponding to the dynamic anti-peeping function being turned on, it starts to blur the image data in the second area information. The image signal obtained after the image blurring process includes the second area information with a clarity of 0.3. In the process of image blurring, the display control unit blurs the image data in the second area information through a blurring algorithm such as Gaussian blur. Based on the image signal after the image blurring process, a corresponding second target control instruction is generated. The second target control instruction includes the adjusted second display parameters and the image data corresponding to the image signal after the image blurring process. Finally, the image output unit outputs the second image area with the adjusted second display parameters based on the second target control instruction. The clarity of the output second image area is less than that of the first image area.

[0070] The method of an embodiment of the present application adjusts a first display parameter based on a display setting parameter, scales the first region information, generates a control instruction to control the display of the first image region, and simultaneously adjusts the transparency to enhance the display effect. Furthermore, the method includes determining the boundary position information between the two regions, outputting a control signal to display the boundary image, and adjusting a second display parameter to blur the second region information. This achieves dynamic control of image display, enabling real-time adjustment of the image display effect based on the target object's gaze point, improving the user experience. Furthermore, the method enables individual processing of local displayed content in the image, such as magnification, sharpening, or blurring, enabling the display device to magnify the gaze point region and dynamically prevent peeping, thereby enhancing the display control flexibility of the display device.

[0071] In some embodiments, the processing flow of the display control method is as follows: Figure 4 ,like Figure 5 As shown, the display control method may further include:

[0072] Step S401: establishing a corresponding display device coordinate system based on the display device.

[0073] Step S402, in response to the gaze point included in the eye movement data being within the display device coordinate system and the gaze duration corresponding to the gaze point meeting the set gaze condition, the gaze point is mapped to the display device coordinate system to obtain the target gaze point data of the target object on the display device.

[0074] As an example, the eye movement sensor records the movement trajectory, gaze position and gaze direction of the target object's eyes at a frequency of 60 frames per second. Based on the display device, a two-dimensional rectangular coordinate system matching the screen size and resolution of the display device is established with the center point of the display device's screen as the origin, that is, the display device coordinate system, with the horizontal axis being the X axis and the vertical axis being the Y axis. Then, it is determined whether the gaze point included in the eye movement data is within the display device coordinate system. If the gaze point is not within the display device coordinate system, it is regarded as an invalid position and no specific coordinates are established. If the gaze point is within the display device coordinate system, the gaze duration of the gaze point is calculated. The set gaze condition can be that the gaze duration reaches 500 milliseconds. In response to the gaze duration corresponding to the gaze point meeting the set gaze condition, the gaze point is mapped and converted according to the encoding rules of the display device coordinate system to obtain the target gaze point data of the target object on the display device.

[0075] The method of the embodiment of the present application can accurately determine the gaze position of the target object by establishing a unified coordinate system and setting gaze conditions, so that the display device can more realistically reflect the gaze intention of the target object, and can adjust the display effect of the image in real time according to the gaze point of the target object, thereby improving the user experience, and can separately process the local display content in the image, such as magnification, sharpening or blurring, thereby improving the display control flexibility of the display device.

[0076] Figure 6 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 1 .

[0077] refer to Figure 6 The application scenario of the display control method provided in the embodiment of the present application is applied to the composition structure of the display device.

[0078] Camera is used to monitor the target object's eye movement in real time, collect the target object's eye movement data, and transmit the collected eye movement data to the ARM SOC for processing.

[0079] The ARM SoC receives eye movement data from the camera. It processes the data to determine the target subject's gaze point. It encodes the location of the knowledge point and establishes the gaze point coordinates on the display screen, based on the display screen. It then outputs the gaze point coordinates to the monitor scaler.

[0080] Monitor OSD control provides OSD settings, which are used to set parameters for eye interaction. These settings include: gaze area magnification mode, dynamic privacy protection mode, fatigue reminder mode, and power reduction mode.

[0081] A monitor scaler is used to process and adjust the image on the monitor screen according to the received gaze point coordinates and control instructions.

[0082] Processing modes can include:

[0083] Dual scaling mode: amplifying the focus area and desensitizing the area outside the focus area.

[0084] Fatigue reminder mode: provides fatigue reminder function when the target object looks at the monitor screen for a long time.

[0085] Automatic standby mode: Automatically enters standby mode when the target object does not look at the monitor screen for a long time.

[0086] Figure 7 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 2 .

[0087] refer to Figure 7 The application scenario of the display control method provided in the embodiment of the present application is applied to the display control process of zooming in on the fixation area. The display control process may include:

[0088] The foveation area magnification mode in the OSD includes display setting parameters: OSD control to turn this function on or off (On / Off), the magnification area radius (1000 / 800 / 500 pixels), and the control of the foveation area magnification factor (×1.5 / ×2 / ×3 / ×4).

[0089] After enabling gaze area magnification mode via the OSD, the subject gazes at a specific location on the display screen for two seconds. The camera generates eye movement data and transmits it to the ARM SOC. The ARM SOC receives the eye movement data, determines the gaze point coordinates (m, n), and transmits them to the scaler. The scaler creates a circular region centered on the gaze point coordinates and uses the radius specified in the OSD display settings to divide the display screen into a gaze area and a non-gaze area. The circular region is the gaze area. The image data in the circular region is magnified and its brightness is adjusted to be lower than that of the rest of the screen. A white outline separates the circular region from the rest of the screen, while the rest of the screen remains displayed normally. If the subject's gaze moves away from the original location for two seconds, the ARM SOC determines that the subject is no longer looking at that location. The ARM SOC sends a command to the scaler to disable gaze area magnification mode. Upon receiving this command, the scaler stops magnifying the previous gaze area and resumes normal display of the circular region. The ARM SOC continues monitoring the subject's eye movement data, waiting for the next time the subject meets the required gaze criteria.

[0090] Figure 8 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 3 .

[0091] refer to Figure 8 The application scenario of the display control method provided in the embodiment of the present application is applied to the display control process for dynamic anti-peeping. The display control process may include:

[0092] The dynamic privacy protection mode in the OSD includes display setting parameters: OSD controls whether this function is on or off (On / Off) and the privacy protection area size selection (1000 / 800 / 500 pixels)

[0093] After enabling dynamic privacy protection mode via the OSD, the subject gazes at a specific point on the display screen for two seconds. The camera generates eye movement data and transmits it to the ARM SOC. The ARM SOC receives the eye movement data, determines the gaze point coordinates (m, n), and transmits them to the scaler. The scaler creates a square area centered on the gaze point coordinates, according to the privacy protection zone dimensions specified in the OSD display settings. This divides the display screen into a gaze area and a non-gaze area. The square area represents the gaze area, and the image in the square area is displayed normally, while the image in the non-gaze area is deactivated. If the subject's gaze point leaves the screen, the ARM SOC determines that the subject is no longer looking at the display screen. The ARM SOC sends a command to deactivate the entire screen. Upon receiving this command, the scaler deactivates the entire screen. When the subject's gaze point returns to the screen, the scaler is notified to adjust the display, restoring normal display to the gaze area and deactivating the image outside the area.

[0094] Figure 9 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 4 .

[0095] refer to Figure 9 The application scenario of the display control method provided in the embodiment of the present application is applied to the display control process for fatigue reminder. The display control process may include:

[0096] The fatigue reminder mode in the OSD includes display setting parameters: OSD controls whether this function is turned on or off (On / Off).

[0097] After enabling fatigue alert mode via the OSD, the subject gazes at a specific point on the monitor screen for two seconds. The camera generates eye movement data and transmits it to the ARM SOC. The ARM SOC receives the eye movement data, determines the gaze point coordinates (m, n), and transmits them to the scaler. If the gaze point remains within the screen for more than 30 minutes, the scaler controls a pop-up notification box in the upper left corner of the monitor screen. The notification box may read "Please have a rest."

[0098] Figure 10 The application scenario of the display control method provided by the embodiment of the present application is shown Figure 5 .

[0099] refer to Figure 10 The application scenario of the display control method provided in the embodiment of the present application is applied to the display control process for reducing power consumption. The display control process may include:

[0100] The reduced power consumption mode in the OSD includes display setting parameters: OSD controls whether this function is turned on or off (On / Off).

[0101] After the reduced power consumption mode is enabled through the OSD, if the target object's gaze point exceeds the screen range, the ARM SOC determines that the target object is no longer looking at the display screen. If it exceeds 30 seconds, the scaler controls the display screen to reduce the brightness; if it exceeds 60 seconds, the scaler controls the display screen to enter standby mode.

[0102] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this application can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this application can be achieved. This is not a limitation herein.

[0103] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. Throughout the description of this application, "plurality" means two or more, unless otherwise specifically defined.

[0104] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A display device, comprising: A communication interface, used to connect to an electronic device to obtain an image signal output by the electronic device; an image output unit capable of outputting images; An eye movement sensor, used to obtain eye movement data of a target object; an eye movement data processing unit, configured to process the eye movement data to obtain target gaze point data of the target object on the display device; a display control unit configured to output a control signal based on the image signal to control the image output unit to output an image corresponding to the image signal; Wherein, when obtaining the target gaze point data, the display control unit is further configured to: Determining first area information corresponding to the target gaze point data and the image signal; The first area information is controlled to output a first image area corresponding to the first area information with a first display parameter, and the second area information is controlled to output a second image area corresponding to the second area information with a second display parameter, where the second area information is information in the image signal other than the first area information.

2. A display control method, comprising: Obtaining an image signal output by an electronic device; Obtain eye movement data of the target object; Processing the eye movement data to obtain target gaze point data of the target object on the display device; outputting a control signal based on the image signal to output an image corresponding to the image signal; The outputting an image corresponding to the image signal comprises: Determining first area information corresponding to the target gaze point data and the image signal; The first area information is controlled to output a first image area corresponding to the first area information with a first display parameter, and the second area information is controlled to output a second image area corresponding to the second area information with a second display parameter, where the second area information is information in the image signal other than the first area information.

3. The method according to claim 2, wherein determining the first region information corresponding to the target gaze point data and the image signal comprises: Obtaining display setting parameters related to eye movement interaction of the display device; The display setting parameters at least include a correspondence between the display control area and the gaze point coordinates; The first area information is determined based on the display setting parameters and the target gaze point data.

4. The method according to claim 2, wherein the outputting of a control signal based on the image signal to output an image corresponding to the image signal comprises at least one of the following: adjusting a scaling ratio of image data in the first region information based on the first display parameter, and outputting a first target control instruction to control the first region information to output the first image region with the first display parameter; The definition of the image data in the second region information is adjusted based on the second display parameter, and a second target control instruction is output to control the second region information to output the second image region with the second display parameter.

5. The method according to claim 4, wherein adjusting the scaling ratio of the image data in the first region information based on the first display parameter and outputting a first target control instruction to control the first region information to output the first image region with the first display parameter comprises: Adjusting the first display parameter based on the scaling parameter included in the display setting parameters to obtain an adjusted first display parameter; performing scaling processing on the image data in the first region information based on the adjusted first display parameter to obtain a scaled image signal; generating a first target control instruction based on the scaled image signal; Based on the target control instruction, the first region information is controlled to output the first image region with the adjusted first display parameter; and a scaling ratio of the first image region is different from a scaling ratio of the second image region.

6. The method according to claim 5, further comprising: Adjusting the transparency of the first image area based on the transparency parameter included in the display setting parameters to obtain a first image area with adjusted transparency; The transparency of the first image area after transparency adjustment is different from that of the second image area.

7. The method according to claim 5, wherein outputting the first image region comprises: outputting the first image area to a first layer of the display device; The first layer is displayed on top of the display device; The center coordinates of the first image area are the same as the gaze point coordinates corresponding to the target gaze point data.

8. The method according to claim 5, further comprising: determining, based on the first area information and the second area information, boundary position information between the first area information and the second area information; A first control signal is output based on the boundary position information to output an image corresponding to the boundary between the first image area and the second image area.

9. The method according to claim 4, wherein adjusting the clarity of the image data in the second region information based on the second display parameter and outputting a second target control instruction to control the second region information to output the second image region with the second display parameter comprises: Adjusting the second display parameter based on the clarity parameter included in the display setting parameters to obtain an adjusted second display parameter; performing image blurring processing on the image data in the second region information based on the adjusted second display parameter to obtain an image signal after image blurring processing; generating a second target control instruction based on the image signal after the image blurring process; Based on the second target control instruction, the second area information is controlled to output the second image area with the adjusted second display parameter; the clarity of the second image area is smaller than the clarity of the first image area.

10. The method according to claim 2, wherein processing the eye movement data to obtain target gaze point data of the target object on the display device comprises: Based on the display device, establishing a corresponding display device coordinate system; In response to the fact that the gaze point included in the eye movement data is within the display device coordinate system and the gaze duration corresponding to the gaze point meets the set gaze condition, the gaze point is mapped to the display device coordinate system to obtain the target gaze point data of the target object on the display device.

Images