Display device and display method

Abstract

A display device and display method are disclosed. The display device includes a display panel, an image capturing element, and a processor. The display panel displays a display screen and a menu on the display screen. The image capturing element captures an image. The processor analyzes the image to obtain the operator's position information in the image and performs a face recognition operation corresponding to the operator, and performs an eye recognition operation corresponding to the operator to obtain the operator's eye information. Based on the operator's position information and eye information, the processor determines the display position and display size of the menu on the display screen. The display panel displays the menu on the display screen according to the display position and display size. This embodiment makes it more intuitive for the operator to operate the menu on the display screen.

Description

Technical Field

[0001] The embodiments described in this disclosure relate to a display device and display method, and more particularly to a display device and display method for displaying an OSD (On-Screen Display) on a display screen. Background Technology

[0002] With the advancement of technology, the user interfaces of various devices are becoming more user-friendly. For example, as technology has developed, desktop displays have become increasingly larger. Because desktop displays are much larger than typical human-machine interface monitors, the on-screen menus for controlling the display's functions are usually not displayed in full screen, but rather at a ratio smaller than 1 / 6 or 1 / 8 of the screen size. Typical monitors place the on-screen menus in the center or lower right corner of the display panel. However, users must turn their necks and eyes to focus on the on-screen menus to operate the monitor, which is inconvenient. Summary of the Invention

[0003] This disclosure relates to a display device comprising a display panel, an image capturing element, and a processor. The display panel displays a screen and an on-screen menu (OSD) on the screen. The image capturing element captures images. The processor is coupled to the display panel and the image capturing element. The processor analyzes the images to obtain operator position information in the images and performs face recognition operations corresponding to the operator, and performs eye recognition operations corresponding to the operator to obtain operator eye information, and uses this information to determine the display position and size of the on-screen menu on the screen based on the operator position information and the operator eye information. The display panel displays the on-screen menu on the screen according to the display position and size.

[0004] In some embodiments, the operator position information includes a distance and a direction of the operator relative to the display panel, and the operator eye information includes a focusing direction and a focusing angle of the operator.

[0005] In some embodiments, the processor determines whether the image contains an identifiable operator. If the image contains an identifiable operator, the processor performs the face recognition operation and the eye recognition operation.

[0006] In some embodiments, when the image does not contain an identifiable operator, the processor determines the display position based on an operator's tool. When the tool is a remote control, the display position is the center of the display screen. When the tool is a button on the display panel, the display position is the position on the display screen adjacent to the button.

[0007] In some implementations, the processor determines that the image contains a number of people, and when the number of people is 1, it performs the face recognition operation and the eye recognition operation.

[0008] In some implementations, when the number of people is greater than 1, the processor performs a human posture and distance detection operation on the image to determine the operator.

[0009] In some implementations, the processor determines the display size based on the distance.

[0010] In some embodiments, the operator's eye information further includes a focal point, the processor calculates a change in the focal point, and adjusts the display position and the display size when the change is greater than a change threshold.

[0011] In some embodiments, when the processor performs the face recognition operation, it acquires multiple facial features and obtains the operator's location information based on the multiple facial features.

[0012] In some embodiments, when the processor performs the human eye recognition operation, it acquires multiple human eye features and obtains the operator's eye information based on the multiple human eye features.

[0013] Some embodiments disclosed herein relate to a display method comprising the following steps: capturing an image by an image capturing element; analyzing the image by a processor to obtain operator position information of an operator in the image and performing a face recognition operation corresponding to the operator; performing an eye recognition operation corresponding to the operator by the processor to obtain operator eye information; determining, based on the operator position information and operator eye information, the display position and size of a menu on the display screen on the display screen; and displaying the menu on the display screen on the display screen by a display panel according to the display position and display size.

[0014] In some embodiments, the operator position information includes a distance and a direction of the operator relative to the display panel, and the operator eye information includes a focusing direction and a focusing angle of the operator.

[0015] In some embodiments, the display method further includes: determining whether the image contains an identifiable operator; and when the image contains an identifiable operator, performing the face recognition operation and the eye recognition operation.

[0016] In some embodiments, the display method further includes, when the image does not contain an identifiable operator, the processor determines the display position based on an operating tool of the operator; when the operating tool is a remote control, the display position is the center of the display screen; and when the operating tool is a button located on the display panel, the display position is the position on the display screen adjacent to the button.

[0017] In some embodiments, the display method further includes determining a person in the image; and when the number of people is 1, performing the face recognition operation and the eye recognition operation.

[0018] In some embodiments, the display method further includes, when the number of people is greater than 1, the processor performing a human posture and distance detection operation on the image to determine the operator.

[0019] In some embodiments, the display method further includes determining the display size based on the distance.

[0020] In some embodiments, the display method further includes calculating a change in the focal point; and adjusting the display position and the display size when the change is greater than a change threshold.

[0021] In some embodiments, the display method further includes obtaining multiple facial features when performing the face recognition operation; and obtaining the operator's location information based on the multiple facial features.

[0022] In some embodiments, the display method further includes acquiring multiple eye features when performing the human eye recognition operation; and acquiring the operator's eye information based on the multiple eye features. Attached Figure Description

[0023] To make the above and other objects, features, advantages and embodiments disclosed herein more apparent and understandable, the accompanying drawings are described below:

[0024] Figure 1 These are schematic diagrams of display devices illustrated in accordance with some embodiments of this disclosure;

[0025] Figure 2 This is a flowchart illustrating a display method according to some embodiments of this disclosure;

[0026] Figure 3 This is a schematic diagram illustrating examples of display size adjustment according to some embodiments of this disclosure;

[0027] Figure 4 These are schematic diagrams illustrating operational scenarios according to some embodiments of this disclosure;

[0028] Figure 5 These are schematic diagrams illustrating operational scenarios according to some embodiments of this disclosure;

[0029] Figure 6 These are schematic diagrams illustrating display methods according to some embodiments of this disclosure; and

[0030] Figure 7 This is a schematic diagram illustrating a display method according to some embodiments of this disclosure.

[0031] [Symbol Explanation]

[0032] 100: Display device

[0033] 110: Processor

[0034] 130: Display panel

[0035] 150: Image capturing element

[0036] 200: Display Method

[0037] S210, S230, S250, S270, S290: Steps

[0038] S220: Steps

[0039] S221, S222, S224, S225: Steps

[0040] 300: Adjustment Example

[0041] 400: Operating Scenario

[0042] 500: Operating Context

[0043] 700: Display Method

[0044] S710, S720, S730, S740: Steps

[0045] P1, P2: Position

[0046] θ1: Angle

[0047] OSD: Menu displayed on screen Detailed Implementation

[0048] The term "coupled" as used in this article can also refer to "electrical coupling," and the term "connection" can also refer to "electrical connection." "Coupled" and "connection" can also refer to two or more components cooperating or interacting with each other.

[0049] refer to Figure 1 . Figure 1 This is a schematic diagram of a display device 100 illustrated in accordance with some embodiments of the present disclosure.

[0050] by Figure 1 For example, display device 100 includes processor 110, display panel 130, and image capturing element 150. In terms of connectivity, processor 110 is coupled to display panel 130 and image capturing element 150. In some embodiments, image capturing element 150 is an element within display device 100; in other embodiments, image capturing element 150 is an additional element externally connected to display device 100.

[0051] The above-described configuration of the display device 100 is for illustrative purposes only, and all configurations of the display device 100 are within the scope of this disclosure. Detailed operation of the display device 100 will be explained below. Figure 2 process Figure 1 And execute the instructions.

[0052] Please see Figure 2 . Figure 2 This is a flowchart illustrating a display method 200 according to some embodiments of this disclosure. The display method 200 can be applied to, for example... Figure 1 The display device 100. Please refer to the following as well. Figure 1 and Figure 2 .

[0053] In step S210, an image is captured. In some embodiments, step S210 is performed by... Figure 1 The image capturing element 150 performs this function. In some embodiments, the image capturing element 150 is a camera or video camera that captures images of the environment in front of the display panel.

[0054] In step S230, the image is analyzed to obtain the operator's location information in the image and a face recognition operation corresponding to the operator is performed. In some embodiments, step S230 is performed by... Figure 1 The processor 110 executes the operation. In some embodiments, when performing face recognition, the processor 110 obtains facial features from the image and then obtains the operator's position information based on the facial features. Facial features include the center of the pupils, the nostrils, and the mouth. The operator's position information includes the distance and orientation of the operator relative to the display panel 130.

[0055] In step S250, an eye recognition operation corresponding to the operator is performed to obtain the operator's eye information. In some embodiments, step S250 is performed by... Figure 1The processor 110 executes the operation. In some embodiments, when performing the human eye recognition operation, the processor 110 obtains human eye features from the image and then obtains the operator's eye information based on the human eye features. Human eye features include features around the eyes such as the inner corner of the eye, the outer corner of the eye, and the pupil. The operator's eye information includes the operator's focusing direction and focusing angle, and the focal point of the operator's eyes on the display screen.

[0056] In step S270, the display position and size of the menu on the screen are determined based on the operator's position information and eye information. In some embodiments, step S270 is performed by... Figure 1 The processor 110 executes the operation. In some embodiments, the processor 110 determines the display size of the menu on the screen based on the distance between the operator and the display device in the operator position information. In some embodiments, the processor 110 determines the display position of the menu on the screen based on the operator's orientation relative to the display device, the operator's focusing direction, and the focusing angle.

[0057] In some embodiments, the processor 110 determines the distance between the operator and the display device based on the proportion of the operator's face occupying the display screen, thereby determining the display size of the menu on the screen. In other embodiments, the processor 110 can directly determine the display size of the menu on the screen based on the proportion of the operator's face occupying the display screen. For example, please refer to... Figure 3 . Figure 3 This is a schematic diagram illustrating a display size adjustment example 300 according to some embodiments of this disclosure. It is assumed that the menu displayed on the screen has a preset display size. In some embodiments, the processor 110 adjusts the ratio of the menu displayed on the screen relative to the preset display size based on the proportion of the face occupying the display screen.

[0058] Depend on Figure 3 It can be seen that when the proportion of the face on the display screen is larger, it means the operator is closer to the display panel 130, and the processor 110 reduces the size of the menu displayed on the screen. Conversely, when the proportion of the face on the display screen is smaller, it means the operator is farther from the display panel 130, and the processor 110 enlarges the size of the menu displayed on the screen. This provides the operator with a better user experience. Furthermore, as... Figure 3 As shown, when the operator is far from the display panel 130 (for example, when the face occupies less than 20% of the display screen), the display size of the menu on the screen will be enlarged to a size larger than the preset display size of the menu on the screen.

[0059] Please refer to the following: Figure 4 and Figure 5 . Figure 4 This is a schematic diagram illustrating an operating scenario 400 according to some embodiments of this disclosure. Figure 5 This is a schematic diagram illustrating an operating scenario 500 according to some embodiments of this disclosure. Figure 4 In this scenario, processor 110 determines that the operator's position relative to the display panel is the center of the display panel, and that the operator's focusing direction is to the left, with an angle of θ1 and a focal point at position P1. At this time, processor 110 determines the display position to be position P1 and moves the OSD (On-Screen Display) menu on the screen from position P2 to position P1, as follows: Figure 5 As shown. This allows the user to have a better operating experience.

[0060] Please refer back to this. Figure 2 In step S290, a display screen and a menu are displayed on the screen according to the display position and display size. In some embodiments, step S290 is performed by... Figure 1 The display panel 130 is executed. The display panel 130 displays the display screen and the menu on the screen according to the display position and display size determined in step S270.

[0061] Please see Figure 6 . Figure 6 This is a schematic diagram illustrating a display method 600 according to some embodiments of this disclosure. For example... Figure 6 As illustrated, in some embodiments, step S220 is further included between steps S210 and S230. Step S220 includes steps S221 to S225.

[0062] In step S221, it is determined whether the image contains an identifiable operator. In some embodiments, step S221 is performed by... Figure 1 The processor 110 executes the process. If it is determined that the image does not contain an identifiable operator, step S222 is executed. If it is determined that the image contains an identifiable operator, step S224 is executed. For example, if the processor 110 determines that the image does not contain a face image, that is, it determines that the image does not contain an identifiable operator.

[0063] In step S222, the display position of the menu on the screen is determined based on the operator's operating tool. In some embodiments, step S222 is performed by... Figure 1 The processor 110 executes the operation. In some embodiments, when the operating tool is a remote control operated remotely, the display position is the center of the display screen. In other embodiments, when the operating tool is a button located on the display panel 130, the display position is the position on the display screen adjacent to the button. For example, if the button is located on the right side of the display panel 130, the display position is the right side of the display screen.

[0064] In step S224, it is determined whether the number of people in the image is greater than 1. In some embodiments, step S224 is performed by... Figure 1 Processor 110 executes the procedure. If the number of participants is greater than 1, proceed to step S225. If the number of participants is less than or equal to 1, proceed to step S230.

[0065] In step S225, human posture and distance detection operations are performed on the image to determine the operator. In some embodiments, step S225 is performed by... Figure 1 The processor 110 executes the operation. For example, in some embodiments, when the operating tool is a remote control operated remotely, the processor 110 determines, based on the results of human posture and distance detection, that the person whose human posture is closest to that of holding the remote control and pointing it at the display panel 130 is the operator. In other embodiments, when the operating tool is a button on the display panel 130, the processor 110 determines, based on the results of human posture and distance detection, that the person whose distance is closest to the display panel 130 and whose human posture is closest to that of operating the button on the display panel 130 is the operator.

[0066] Please see Figure 7 . Figure 7 This is a schematic diagram illustrating a display method 700 according to some embodiments of this disclosure.

[0067] In step S710, an image is captured. In some embodiments, step S710 is performed by... Figure 1 The image capturing element 150 in the middle is executed.

[0068] In step S720, the change in the focal point is calculated. In some embodiments, step S720 is performed by... Figure 1 The processor 110 executes the calculation. For example, suppose the image capturing element 150 acquires a first image at time point T1, and the processor 110 acquires a first focal point based on the first image. The image capturing element 150 acquires a second image at time point T2, and the processor 110 acquires a second focal point based on the second image. The processor 110 calculates the change in the second focal point relative to the first focal point. In this embodiment, the first and second focal points are represented by coordinate positions, and the change is calculated by calculating the change in coordinate position between the first and second focal points.

[0069] In step S730, it is determined whether the change amount is greater than a change amount threshold. In some embodiments, step S730 is performed by... Figure 1 The processor 110 executes the process. If the change is greater than the change threshold, step S740 is executed. If the change is not greater than the change threshold, step S710 is executed to continue acquiring images at different time points until the operator closes the menu displayed on the screen.

[0070] In step S740, the display position and size of the menu on the screen are adjusted. In some embodiments, step S740 is performed by... Figure 1 The processor 110 in the middle executes. Regarding the adjustment methods for the display position and size of the menu on the screen, as follows... Figure 2 What has been revealed will not be described in detail here.

[0071] In summary, this disclosure provides a display device and display method that, when an operator displays a menu on an operating screen, allows the display device to capture images through image capturing elements on the display device and calculate the distance and orientation of the operator relative to the display panel, as well as the focusing direction and angle of the operator's eyes, through related algorithms of face recognition and eye recognition. This enables the display of the menu on the screen to be positioned at the operator's eye's focal point. When the operator operates the menu on the screen, there is no need to move back and forth between the original focal point of looking at the screen and the fixed position where the menu is displayed, nor is there a need to turn the neck and eyes back and forth, making the operation of the menu on the operating screen more intuitive.

[0072] Various functional components have been disclosed herein. To those skilled in the art, functional components can be implemented by circuits (whether dedicated circuits or general-purpose circuits operating under the control of one or more processors and coded instructions).

[0073] Although this disclosure has been presented above with reference to embodiments, it is not intended to limit this disclosure. Any person skilled in the art may make various modifications and alterations without departing from the spirit and scope of this disclosure. Therefore, the scope of protection of this disclosure shall be determined by the scope defined in the appended claims.

Claims

1. A display device, characterized in that, Include: A display panel that displays a screen and an on-screen menu (OSD) on the screen; An image capturing element, which captures an image; and A processor is coupled to the display panel and the image capturing element. The processor analyzes the image to obtain the operator's position information and performs a face recognition operation corresponding to the operator. It also performs an eye recognition operation corresponding to the operator to obtain the operator's eye information. Based on the operator's position information and the operator's eye information, the processor determines the display position and display size of the menu on the display screen. The display panel displays the on-screen menu on the display screen according to the display position and the display size. The operator position information includes the distance and direction of the operator relative to the display panel. The operator eye information includes the operator's focusing direction and focusing angle.

2. The display device as claimed in claim 1, characterized in that, The processor determines whether the image contains an identifiable operator. If it does, the processor performs face recognition and eye recognition operations.

3. The display device as claimed in claim 2, characterized in that, When the image does not contain an identifiable operator, the processor determines the display position based on an operator's tool. When the tool is a remote control, the display position is the center of the display screen. When the tool is a button on the display panel, the display position is the position on the display screen adjacent to the button.

4. The display device as claimed in claim 1, characterized in that, The processor determines the number of people in the image. When the number of people is 1, it performs the face recognition operation and the eye recognition operation.

5. The display device as claimed in claim 4, characterized in that, When the number of people is greater than 1, the processor performs a human posture and distance detection operation on the image to determine the operator.

6. The display device as claimed in claim 1, characterized in that, The processor determines the display size based on this distance.

7. The display device as claimed in claim 1, characterized in that, The operator's eye information also includes a focal point. The processor calculates a change in the focal point and adjusts the display position and display size when the change exceeds a threshold.

8. The display device as claimed in claim 1, characterized in that, When performing the face recognition operation, the processor obtains multiple facial features and obtains the operator's location information based on the multiple facial features.

9. The display device as claimed in claim 1, characterized in that, When performing the human eye recognition operation, the processor acquires multiple human eye features and obtains the operator's eye information based on the multiple human eye features.

10. A display method, characterized in that, Include: An image is captured by an image capturing element; A processor analyzes the image to obtain the location information of an operator in the image and performs a face recognition operation corresponding to the operator. The processor performs an eye recognition operation corresponding to the operator to obtain the operator's eye information; The processor determines the display position and size of a menu on a display screen based on the operator's position information and eye information; and A display panel displays the on-screen menu on the display screen according to the display position and the display size. The operator position information includes a distance and direction of the operator relative to the display panel. The operator eye information includes a focusing direction and a focusing angle of the operator.

11. The display method as described in claim 10, characterized in that, Also includes: Determine whether the image contains an identifiable operator; and When the operator is identifiable, the face recognition operation and the eye recognition operation are performed.

12. The display method as described in claim 11, characterized in that, Also includes: When the image does not contain an identifiable operator, the processor determines the display position based on one of the operator's operating tools; When the operating tool is a remote control, the display position is the center of the display screen; and When the operating tool is a button on the display panel, the display position is the position on the display screen adjacent to the button.

13. The display method as described in claim 10, characterized in that, Also includes: Determine the number of people contained in the image; and When the number of people is 1, perform the face recognition operation and the eye recognition operation.

14. The display method as described in claim 13, characterized in that, Also includes: When the number of people is greater than 1, the processor performs a human posture and distance detection operation on the image to determine the operator.

15. The display method as described in claim 10, characterized in that, Also includes: The display size is determined based on this distance.

16. The display method as described in claim 10, characterized in that, The operator's eye information also includes a focal point, and the display method further includes: Calculate a change at the focal point; and When the change exceeds a certain threshold, adjust the display position and the display size.

17. The display method as described in claim 10, characterized in that, Also includes: During the facial recognition operation, multiple facial features are obtained; and The operator's location information is obtained based on the multiple facial features.

18. The display method as described in claim 10, characterized in that, Also includes: During the execution of the human eye recognition operation, multiple human eye features were acquired; and The operator's eye information is obtained based on the aforementioned multiple human eye features.

Images