Display device adjustment method and apparatus, terminal, and storage medium

Abstract

The embodiment of the application discloses a display device adjustment method and device, a terminal and a storage medium, and belongs to the technical field of computers. The method comprises the following steps: determining the intersection point of the line of sight of a target object and the display screen of a display device based on the multiple face key points of the target object; adjusting the height of the display device based on the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point are located at the same horizontal height; and adjusting the orientation of the display device based on the included angle between the line of sight and the median line of the display screen at the center point, so that the included angle between the line of sight and the median line is less than an angle threshold. The method can automatically adjust the position and angle of the display device according to the line of sight of the user, without manual adjustment by the user, and the efficiency of adjustment is improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a display device adjustment method, apparatus, terminal and storage medium. Background Technology

[0002] With the development of computer technology, various electronic devices have become increasingly common. When using desktop computers, laptops, and other terminals with display devices, users often need to maintain the same posture for extended periods. If the display device is not placed appropriately, users can easily experience fatigue. Therefore, how to alleviate user fatigue is a problem that needs to be addressed.

[0003] Currently, display devices are typically equipped with a height-adjustable stand. Users can manually adjust the stand to position the display at their optimal eye level, reducing eye strain from prolonged viewing. However, this method requires manual adjustment, which is cumbersome and inefficient. Summary of the Invention

[0004] This application provides a method, apparatus, terminal, and storage medium for adjusting a display device, which can automatically adjust the position and angle of the display device according to the user's line of sight. The technical solution is as follows:

[0005] On one hand, a method for adjusting a display device is provided, the method comprising:

[0006] Based on multiple facial key points of the target object, determine the intersection point between the target object's line of sight and the display screen of the display device;

[0007] Based on the vertical distance between the intersection point and the center point of the display screen, adjust the height of the display device so that the center point of the display screen and the intersection point are at the same horizontal level.

[0008] Based on the angle between the line of sight and the perpendicular bisector of the display screen at the center point, the orientation of the display device is adjusted so that the angle between the line of sight and the perpendicular bisector is less than an angle threshold.

[0009] In some embodiments, adjusting the height of the display device based on the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point are at the same horizontal level, includes:

[0010] If the vertical distance is not greater than a distance threshold, the display device is adjusted using a first adjustment method, wherein the first adjustment method is used to indicate that the height of the display device is adjusted using a first speed.

[0011] In some embodiments, the method further includes:

[0012] If the vertical distance is greater than the distance threshold, a prompt message is displayed on the display screen. The prompt message is used to prompt the target object to stop using the display device and to adjust the height of the display device for the target object.

[0013] In response to the target object's confirmation of the prompt information, the display device is adjusted using a second adjustment method. The second adjustment method is used to indicate that when the target object stops using the display device, the height of the display device is adjusted by a second speed, which is greater than the first speed.

[0014] In some embodiments, the method further includes:

[0015] Based on the horizontal distance between the intersection point and the center point of the display screen, the display device is adjusted horizontally so that the intersection point is located at the center point of the display screen.

[0016] In some embodiments, the method further includes:

[0017] Based on multiple facial key points of the target object, determine the angle between the line of sight of the target object and the plane where the display screen is located;

[0018] Based on the angle between the line of sight of the target object and the plane where the display screen is located, adjust the pitch angle of the display device so that the line of sight of the target object is perpendicular to the plane where the display screen is located.

[0019] In some embodiments, before determining the intersection of the target object's line of sight and the display screen of the display device based on multiple facial key points of the target object, the method further includes: performing face recognition on the target object to determine multiple facial key points of the target object.

[0020] In some embodiments, the method further includes:

[0021] The target object is subjected to pose recognition to determine multiple skeletal key points of the target object;

[0022] The distance between the target object and the display device is determined based on the ratio of the size of the skeletal key point to the size of the standard skeletal key point, wherein the size of the standard skeletal key point is used to indicate the preset distance between the target object and the display device;

[0023] Based on the distance between the target object and the display device, at least one of the following is adjusted: display brightness, display content size, and screen resolution of the display screen.

[0024] On the other hand, a display device adjustment apparatus is provided, the apparatus comprising:

[0025] The first determining module is used to determine the intersection point between the line of sight of the target object and the display screen of the display device based on multiple facial key points of the target object;

[0026] The first adjustment module is used to adjust the height of the display device based on the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point are at the same horizontal height;

[0027] The second adjustment module is used to adjust the orientation of the display device based on the angle between the line of sight and the perpendicular bisector of the display screen at the center point, so that the angle between the line of sight and the perpendicular bisector is less than an angle threshold.

[0028] In some embodiments, the first adjustment module is configured to adjust the display device using a first adjustment method when the vertical distance is not greater than a distance threshold, wherein the first adjustment method is configured to indicate adjusting the height of the display device using a first speed.

[0029] In some embodiments, the first adjustment module is configured to display a prompt message on the display screen when the vertical distance is greater than the distance threshold, the prompt message being used to prompt the target object to pause using the display device and to adjust the height of the display device for the target object; in response to the target object's confirmation operation of the prompt message, the display device is adjusted using a second adjustment method, the second adjustment method being used to instruct that when the target object pauses using the display device, the height of the display device is adjusted by a second speed, the second speed being greater than the first speed.

[0030] In some embodiments, the first adjustment module is used to horizontally adjust the display device based on the horizontal distance between the intersection point and the center point of the display screen, so that the intersection point is located at the center point of the display screen.

[0031] In some embodiments, the second adjustment module is used to determine the angle between the line of sight of the target object and the plane where the display screen is located based on multiple facial key points of the target object; and to adjust the pitch angle of the display device based on the angle between the line of sight of the target object and the plane where the display screen is located, so that the line of sight of the target object is perpendicular to the plane where the display screen is located.

[0032] In some embodiments, the apparatus further includes:

[0033] The second determining module is used to perform face recognition on the target object and determine multiple facial key points of the target object.

[0034] In some embodiments, the apparatus further includes:

[0035] The third determining module is used to perform pose recognition on the target object and determine multiple skeletal key points of the target object;

[0036] The fourth determining module is used to determine the distance between the target object and the display device based on the ratio of the size of the skeletal key point to the size of the standard skeletal key point, wherein the size of the standard skeletal key point is used to indicate a preset distance between the target object and the display device;

[0037] The third adjustment module is used to adjust at least one of the display brightness, display content size, and screen resolution of the display screen based on the distance between the target object and the display device.

[0038] On the other hand, a terminal is provided, the terminal including a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to implement the display device adjustment method as described above.

[0039] On the other hand, a computer-readable storage medium is provided that stores at least one computer program, which is loaded and executed by a processor to implement the display device adjustment method as described above.

[0040] On the other hand, a computer program product is provided, including a computer program loaded and executed by a processor to implement the display device adjustment method as described above.

[0041] This application provides a display device adjustment scheme. By using multiple facial key points of the target object, the direction of the target object's gaze and the intersection point between the target object's gaze and the display screen of the display device can be determined. Based on the vertical distance between this intersection point and the center point of the display screen, the height of the display device is adjusted so that the center point of the display screen and the intersection point of the gaze on the display screen are at the same horizontal level. When the display screen is not directly facing the target object, the perpendicular bisector of the display screen at the center point forms a certain angle with the target object's gaze. Adjusting the orientation of the display device based on this angle ensures that the angle between the gaze and the perpendicular bisector is less than an angle threshold, thereby adjusting the display screen to face the target object. Therefore, by adjusting the height and orientation of the display device using multiple facial key points of the target object, the position and angle of the display device can be automatically adjusted according to the user's gaze, eliminating the need for manual adjustment and improving adjustment efficiency. Attached Figure Description

[0042] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0043] Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application;

[0044] Figure 2 This is a flowchart of a display device adjustment method provided in an embodiment of this application;

[0045] Figure 3 This is a flowchart of another display device adjustment method provided in an embodiment of this application;

[0046] Figure 4 This is a schematic diagram of a display device provided in an embodiment of this application;

[0047] Figure 5 This is a schematic diagram of the structure of a display device adjustment device provided in an embodiment of this application;

[0048] Figure 6 This is a schematic diagram of another display device adjustment device provided in an embodiment of this application;

[0049] Figure 7 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application. Detailed Implementation

[0050] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0051] In this application, the terms "first," "second," etc., are used to distinguish identical or similar items with essentially the same function. It should be understood that there is no logical or temporal dependency between "first," "second," and "nth," nor are there any restrictions on quantity or execution order.

[0052] In this application, the term "at least one" means one or more, and "multiple" means two or more.

[0053] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, multiple facial key points of the target object involved in this application were obtained with full authorization.

[0054] Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application. See also... Figure 1 The implementation environment includes: display device 101, shooting device 102 and three-axis rotating bracket 103.

[0055] The display device 101 and the shooting device 102 can be connected directly or indirectly via wired or wireless communication, and this application does not impose any restrictions on this.

[0056] In some embodiments, the display device 101 is a desktop computer, laptop computer, tablet computer, smartphone, smart voice interaction device, and virtual reality devices such as VR (Virtual Reality) and AR (Augmented Reality), but is not limited to these. The display device 101 has an application installed and running that supports adjusting the height of the display device 101. Illustratively, by using this application, the height of the display device 101 can be automatically adjusted based on the user's line of sight.

[0057] In some embodiments, the display device 101 is configured with a three-axis rotating bracket 103. The adjustment directions of the three-axis rotating bracket 103 include three axes: X-axis, Y-axis, and Z-axis, which can provide multi-dimensional adjustment of the display device 101 in terms of height, orientation, and pitch.

[0058] In some embodiments, the capturing device 102 is a device with capturing capabilities, such as a camera, video camera, camcorder, or 3D motion-sensing camera. The capturing device 102 is used to perform facial and posture recognition on the user, determining multiple facial key points and multiple skeletal key points of the user, thereby determining the user's line of sight and the distance between the user and the display device 101. Illustratively, an application installed on the display device 101 can determine the height, orientation, and pitch angle that the display device 101 needs to adjust based on the user's line of sight determined by the capturing device 102, thereby controlling the three-axis rotation bracket 103 to make corresponding adjustments to the display device 101.

[0059] In some embodiments, the implementation environment further includes a server. The server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The server provides backend services for the application. In some embodiments, the server undertakes the primary computing work, and the display device 101 undertakes the secondary computing work; or, the server undertakes the secondary computing work, and the display device 101 undertakes the primary computing work; or, the server and display device 101 collaborate on computing using a distributed computing architecture.

[0060] Those skilled in the art will understand that the number of the aforementioned display devices can be more or less. For example, there may be only one display device, or there may be dozens or hundreds, or even more, display devices. This application does not limit the number or type of display devices.

[0061] Figure 2 This is a flowchart illustrating a display device adjustment method provided in an embodiment of this application. This embodiment is executed by a display device, which can be a terminal or an external device connected to the terminal for displaying images. See also... Figure 2 The method includes:

[0062] 201. Based on multiple facial key points of the target object, determine the intersection point between the target object's line of sight and the display screen of the display device.

[0063] In this embodiment, the target object is a user using a display device. The display device is equipped with a display screen and a camera. While the target object is viewing the display screen, the camera can capture the target object's facial information in real time to determine multiple facial key points. These facial key points include key points such as eyebrows, eyes, pupils, nose, and mouth.

[0064] Based on multiple facial key points captured by the camera, the movement direction of the pupil key point relative to other facial key points can be determined, that is, the movement direction of the target's eyes can be determined, and thus the direction of the target's gaze can be determined. If the target views a certain position on the display screen for an extended period, the pixel on the display screen corresponding to that gaze direction can be determined based on the target's gaze direction, and this pixel can be used as the intersection point of the target's gaze and the display screen.

[0065] 202. Based on the vertical distance between the intersection point and the center point of the display screen, adjust the height of the display device so that the center point of the display screen and the intersection point are at the same horizontal level.

[0066] In this embodiment, based on the size of the display screen, a pixel located at the exact center of the display screen can be determined and used as the center point of the display screen. If the pixel corresponding to the center point of the display screen and the pixel corresponding to the intersection point have a certain distance in the vertical direction, then the height of the display device does not meet the optimal viewing height for the target object, and the height of the display device needs to be adjusted. The optimal viewing height is the height at which the user is unlikely to experience fatigue when viewing the display screen. The optimal viewing height can be set at the factory based on experience, or it can be set by the user according to their needs.

[0067] In this embodiment, the display device is equipped with a three-axis rotating bracket. This bracket supports adjustment along three different axes, providing multi-dimensional adjustment of the display device's height, orientation, and tilt. The vertical distance between the pixel corresponding to the center point of the display screen and the pixel corresponding to the intersection point is used as the vertical distance between the intersection point and the center point of the display screen. Based on this vertical distance, the display device adjusts its height vertically by controlling the three-axis rotating bracket until the center point and the intersection point are at the same horizontal level. At this point, the vertical distance is 0, and the height of the display device matches the optimal viewing height for the target object.

[0068] 203. Based on the angle between the line of sight and the perpendicular bisector of the display screen at the center point, adjust the orientation of the display device so that the angle between the line of sight and the perpendicular bisector is less than the angle threshold.

[0069] In this embodiment, the perpendicular bisector of the display screen at its center point is perpendicular to the plane in which the display screen is located and reflects the orientation of the display screen. When there is an angle between the target object's line of sight and the perpendicular bisector, the display screen is not facing the target object directly. Based on the angle between the target object's line of sight and the perpendicular bisector, the display device adjusts its orientation by controlling a three-axis rotating bracket until the angle is less than an angle threshold; at this point, the display screen faces the target object directly. The angle threshold can be a preset angle, such as 5°, 7°, or 10°; this embodiment does not limit the angle threshold.

[0070] This application provides a display device adjustment method. By using multiple facial key points of a target object, the direction of the target object's gaze and the intersection point between the target object's gaze and the display screen of the display device can be determined. The height of the display device is adjusted based on the vertical distance between this intersection point and the center point of the display screen, ensuring that the center point of the display screen and the intersection point of the gaze on the display screen are at the same horizontal level. When the display screen is not directly facing the target object, the perpendicular bisector of the display screen at its center point forms an angle with the target object's gaze. Adjusting the orientation of the display device based on this angle ensures that the angle between the gaze and the perpendicular bisector is less than an angle threshold, thereby adjusting the display screen to face the target object. Therefore, by adjusting the height and orientation of the display device using multiple facial key points of the target object, the position and angle of the display device can be automatically adjusted according to the user's gaze, eliminating the need for manual adjustment and improving adjustment efficiency.

[0071] Figure 3 This is a flowchart of another display device adjustment method provided in this application embodiment. This application embodiment is executed by a display device, which can be a terminal or an external device connected to the terminal for displaying images. See also... Figure 3 The method includes:

[0072] 301. Perform facial recognition on the target object to determine multiple facial key points of the target object.

[0073] In this embodiment, the target object is a user using a display device. The display device is equipped with a display screen and a camera. While the target object is viewing the display screen, the camera can capture the target object's facial information in real time to determine multiple facial key points. These facial key points include key points such as eyebrows, eyes, pupils, nose, and mouth.

[0074] In some embodiments, the display device can determine multiple facial key points of a target object based on its facial information using a face recognition model. Accordingly, based on the face recognition model, facial key point recognition is performed on the facial information of the target object captured by the camera device to determine multiple facial key points such as the target object's eyebrows, eyes, pupils, nose, and mouth. The face recognition model is used to determine multiple facial key points of the target object and the location of each facial key point based on the input facial information. Because this face recognition model has self-learning capabilities—that is, the more times the model performs face recognition, the stronger its self-learning ability—the more accurate the facial key points obtained based on the facial information become, thus enabling a more accurate determination of the multiple facial key points of the target object and the location of each facial key point.

[0075] 302. Based on multiple facial key points of the target object, determine the intersection point between the target object's line of sight and the display screen of the display device.

[0076] In this embodiment, based on multiple facial key points of the target object and the position of each facial key point, the movement direction of the target object's pupil key point relative to other facial key points can be determined, that is, the eye movement direction of the target object can be determined, and thus the gaze direction of the target object can be determined. When the target object views a certain position on the display screen for a prolonged period, the pixel on the display screen corresponding to that gaze direction can be determined based on the target object's gaze direction, and this pixel can be used as the intersection point of the target object's gaze and the display screen.

[0077] In some embodiments, the capturing device is an infrared-enabled camera. The capturing device can project controllable infrared light spots, infrared rays, or infrared light surfaces onto the target object using an infrared light source to capture the reflection image of the projected infrared light from the target object. Then, based on the captured reflection image and the positions of multiple facial key points, the reflection of infrared light at the pupil key point of the target object is identified to determine the target object's eye movement direction. Based on the target object's eye movement direction relative to the movement direction of other facial key points, the target object's gaze direction can be determined.

[0078] 303. Based on the vertical distance between the intersection point and the center point of the display screen, adjust the height of the display device so that the center point of the display screen and the intersection point are at the same horizontal level.

[0079] In this embodiment, based on the size of the display screen, a pixel located at the exact center of the display screen can be determined and used as the center point of the display screen. If the pixel corresponding to the center point of the display screen and the pixel corresponding to the intersection point have a certain distance in the vertical direction, then the height of the display device does not meet the optimal viewing height for the target object, and the height of the display device needs to be adjusted. The optimal viewing height refers to the height at which a user is less likely to experience eye strain when viewing the display screen. The optimal viewing height can be set at the factory based on experience, or it can be set by the user according to their needs.

[0080] In this embodiment, the display device is equipped with a three-axis rotating bracket. This bracket supports adjustment along three different axes, providing multi-dimensional adjustment of the display device's height, orientation, and tilt. The vertical distance between the pixel corresponding to the center point of the display screen and the pixel corresponding to the intersection point is used as the vertical distance between the intersection point and the center point of the display screen. Based on this vertical distance, the display device adjusts its height vertically by controlling the three-axis rotating bracket until the center point and the intersection point are at the same horizontal level. At this point, the vertical distance is 0, and the height of the display device matches the optimal viewing height for the target object.

[0081] In some embodiments, the display device is equipped with a telescopic and adjustable joystick. For example... Figure 4 As shown, the display device 401 can determine the intersection point between the target object's line of sight and the display screen based on the facial information of the target object collected by the shooting device 402, and adjust the height of the display device by controlling the retractable and adjustable joystick 403 according to the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point are at the same horizontal height.

[0082] It should be noted that the display device can be adjusted using the following two methods based on the vertical distance between the intersection point and the center point of the display screen.

[0083] Method 1: When the vertical distance is no greater than a distance threshold, the adjustment range required for the display device is small. Therefore, the first adjustment method is used to adjust the display device. The distance threshold can be a preset distance, such as 3 cm, 5 cm, or 7 cm; this embodiment does not limit the distance threshold. The first adjustment method indicates that the height of the display device is adjusted at a first speed. The first speed is a relatively slow speed. Accordingly, the display device controls the three-axis rotating bracket to slowly fine-tune the height of the display device using the first adjustment method. This allows the center point of the display screen to be adjusted to the same horizontal level as the intersection point without affecting the target user's use of the display device. At this point, the vertical distance is 0, and the height of the display device matches the optimal viewing height for the target object.

[0084] Method 2: When the vertical distance exceeds a distance threshold, the adjustment range of the display device needs to be larger. Therefore, it is necessary to adjust the height of the display device at a faster speed while the target object is not using it, in order to improve the efficiency of the adjustment. Accordingly, when the vertical distance exceeds the distance threshold, a prompt message is displayed on the display screen. This prompt message instructs the target object to pause using the display device and for the height of the display device to be adjusted at a faster speed. In response to the target object's confirmation of the prompt message, the display device controls the three-axis rotating bracket to adjust the display device using a second adjustment method. This second adjustment method instructs that, while the target object is not using the display device, the height of the display device be adjusted at a second speed until the center point and the intersection point of the display screen are at the same horizontal level. At this point, the vertical distance is 0, and the height of the display device meets the optimal viewing height for the target object. The second speed is a faster speed, greater than the first speed.

[0085] In some embodiments, the display device can also be horizontally adjusted. If the pixel corresponding to the center point of the display screen and the pixel corresponding to the intersection point are a certain distance apart in the horizontal direction, the target object's line of sight is not directly facing the center point of the display screen. Therefore, the display device is adjusted horizontally. The display device uses the horizontal distance between the pixel corresponding to the center point of the display screen and the pixel corresponding to the intersection point as the horizontal distance between the intersection point and the center point of the display screen. Based on the horizontal distance between the intersection point and the center point of the display screen, the display device controls the three-axis rotating bracket to horizontally adjust the display device until the intersection point is located at the center point of the display screen. At this point, the horizontal distance is 0, and the center point of the display device is directly facing the target object's line of sight. The target object is less likely to experience fatigue even after prolonged viewing of the display screen.

[0086] 304. Based on the angle between the line of sight and the perpendicular bisector of the display screen at the center point, adjust the orientation of the display device so that the angle between the line of sight and the perpendicular bisector is less than the angle threshold.

[0087] In this embodiment, the perpendicular bisector of the display screen at its center point is perpendicular to the plane in which the display screen is located and reflects the orientation of the display screen. When there is an angle between the target object's line of sight and the perpendicular bisector, the display screen is not facing the target object directly. Based on the angle between the target object's line of sight and the perpendicular bisector, the display device adjusts its orientation by controlling a three-axis rotating bracket until the angle is less than an angle threshold; at this point, the display screen faces the target object directly. The angle threshold can be a preset angle, such as 5°, 7°, or 10°; this embodiment does not limit the angle threshold.

[0088] In some embodiments, the tilt angle of the display device can be adjusted based on the target object's line of sight. The display device determines the target object's line of sight direction based on multiple facial key points of the target object. When the target object is viewing a certain position on the display screen, the angle between the target object's line of sight and the plane on which the display screen is located can be determined based on the target object's line of sight direction and the plane on which the display screen is located. If this angle is not 90°, the tilt angle of the display screen does not conform to the user's optimal viewing angle, and the user is prone to fatigue when viewing the display screen at a non-optimal viewing angle. Therefore, it is necessary to adjust the tilt angle of the display device based on the angle between the target object's line of sight and the plane on which the display screen is located so that the target object's line of sight is perpendicular to the plane on which the display screen is located. At this time, the tilt angle of the display screen conforms to the user's optimal viewing angle, and the user is less likely to experience fatigue when viewing the display screen from this optimal viewing angle.

[0089] In some embodiments, parameters of the display screen can be adjusted based on the distance between the target object and the display device. The capturing device identifies multiple skeletal keypoints of the target object through pose recognition. The display device determines the distance between the target object and the display device based on the ratio of the size of the target object's skeletal keypoints to the size of a standard skeletal keypoint, where the size of the standard skeletal keypoint indicates a preset distance between the target object and the display device. This preset distance is one at which the user is less likely to experience eye strain when viewing the display screen. The preset distance can be set empirically at the factory or by the user according to their needs. Based on the distance between the target object and the display device, at least one of the following parameters of the display screen is adjusted: display brightness, display content size, and screen resolution.

[0090] For example, if the distance between the target object and the display device is greater than the preset distance, the content displayed on the screen will be enlarged; if the distance between the target object and the display device is less than the preset distance, the brightness of the display screen will be reduced to avoid visual fatigue caused by prolonged viewing of a bright screen.

[0091] In some embodiments, the display device can detect the fatigue level of the target object based on facial key points or skeletal key points captured by the imaging device. Then, based on the fatigue level of the target object, the display device is adjusted to reduce the target object's fatigue. For example, if the size of the target object's eye key points is smaller than a preset size, or if the similarity between the target object's skeletal key points and those corresponding to a fatigued state is high, the target object's fatigue level is considered high. The preset size is the size of the eye key points when the target object is in a non-fatigued state. Accordingly, the display device may enlarge the content displayed on the screen, increase the brightness of the screen, or decrease the distance between the display device and the target object. This allows the target object to view the content on the screen more clearly, thereby alleviating the target object's fatigue to some extent.

[0092] This application provides a display device adjustment method. By using multiple facial key points of a target object, the direction of the target object's gaze and the intersection point between the target object's gaze and the display screen of the display device can be determined. The height of the display device is adjusted based on the vertical distance between this intersection point and the center point of the display screen, ensuring that the center point of the display screen and the intersection point of the gaze on the display screen are at the same horizontal level. When the display screen is not directly facing the target object, the perpendicular bisector of the display screen at its center point forms an angle with the target object's gaze. Adjusting the orientation of the display device based on this angle ensures that the angle between the gaze and the perpendicular bisector is less than an angle threshold, thereby adjusting the display screen to face the target object. Therefore, by adjusting the height and orientation of the display device using multiple facial key points of the target object, the position and angle of the display device can be automatically adjusted according to the user's gaze, eliminating the need for manual adjustment and improving adjustment efficiency.

[0093] Figure 5 This is a schematic diagram of a display device adjustment apparatus provided in an embodiment of this application. See also... Figure 5 The device includes: a first determining module 501, a first adjusting module 502, and a second adjusting module 503.

[0094] The first determining module 501 is used to determine the intersection point between the line of sight of the target object and the display screen of the display device based on multiple facial key points of the target object;

[0095] The first adjustment module 502 is used to adjust the height of the display device based on the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point are at the same horizontal height.

[0096] The second adjustment module 503 is used to adjust the orientation of the display device based on the angle between the line of sight and the perpendicular bisector of the display screen at the center point, so that the angle between the line of sight and the perpendicular bisector is less than an angle threshold.

[0097] In some embodiments, the first adjustment module 502 is used to adjust the display device using a first adjustment method when the vertical distance is not greater than a distance threshold. The first adjustment method is used to indicate that the height of the display device is adjusted using a first speed.

[0098] In some embodiments, the first adjustment module 502 is configured to display a prompt message on the display screen when the vertical distance is greater than a distance threshold. The prompt message is used to prompt the target object to pause using the display device and to adjust the height of the display device for the target object. In response to the target object's confirmation operation of the prompt message, the display device is adjusted using a second adjustment method. The second adjustment method is used to indicate that when the target object pauses using the display device, the height of the display device is adjusted by a second speed, which is greater than the first speed.

[0099] In some embodiments, the first adjustment module 502 is used to horizontally adjust the display device based on the horizontal distance between the intersection point and the center point of the display screen, so that the intersection point is located at the center point of the display screen.

[0100] In some embodiments, the second adjustment module 503 is used to determine the angle between the line of sight of the target object and the plane where the display screen is located based on multiple facial key points of the target object; and to adjust the pitch angle of the display device based on the angle between the line of sight of the target object and the plane where the display screen is located, so that the line of sight of the target object is perpendicular to the plane where the display screen is located.

[0101] In some embodiments, Figure 6 This is a schematic diagram of another display device adjustment device provided in an embodiment of this application, as shown below. Figure 6 As shown, the device also includes:

[0102] The second determining module 504 is used to perform face recognition on the target object and determine multiple facial key points of the target object.

[0103] In some embodiments, such as Figure 6 As shown, the device also includes:

[0104] The third determining module 505 is used to perform pose recognition on the target object and determine multiple skeletal key points of the target object;

[0105] The fourth determining module 506 is used to determine the distance between the target object and the display device based on the ratio of the size of the skeletal key point to the size of the standard skeletal key point. The size of the standard skeletal key point is used to indicate the preset distance between the target object and the display device.

[0106] The third adjustment module 507 is used to adjust at least one of the following: display brightness, display content size, and screen resolution of the display screen based on the distance between the target object and the display device.

[0107] This application provides a display device adjustment apparatus. By using multiple facial key points of a target object, the direction of the target object's gaze and the intersection point between the target object's gaze and the display screen of the display device can be determined. The height of the display device is adjusted based on the vertical distance between this intersection point and the center point of the display screen, ensuring that the center point of the display screen and the intersection point of the gaze on the display screen are at the same horizontal level. When the display screen is not directly facing the target object, the perpendicular bisector of the display screen at its center point forms an angle with the target object's gaze. Adjusting the orientation of the display device based on this angle ensures that the angle between the gaze and the perpendicular bisector is less than an angle threshold, thereby adjusting the display screen to face the target object. Therefore, by adjusting the height and orientation of the display device using multiple facial key points of the target object, the position and angle of the display device can be automatically adjusted according to the user's gaze, eliminating the need for manual adjustment and improving adjustment efficiency.

[0108] It should be noted that the display device adjustment device provided in the above embodiments is only an example of the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the terminal can be divided into different functional modules to complete all or part of the functions described above. In addition, the display device adjustment device and the display device adjustment method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0109] This application also provides a terminal, which includes a processor and a memory. The memory stores at least one computer program, which is loaded and executed by the processor to implement the display device adjustment method of the above embodiments.

[0110] Figure 7 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application.

[0111] Terminal 700 includes a processor 701 and a memory 702.

[0112] Processor 701 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 701 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). Processor 701 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 701 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 701 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0113] The memory 702 may include one or more computer-readable storage media, which may be non-transitory. The memory 702 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 702 are used to store at least one computer program, which is used by the processor 701 to implement the display device adjustment method provided in the method embodiments of this application.

[0114] In some embodiments, the terminal 700 may also optionally include a peripheral device interface 703 and at least one peripheral device. The processor 701, memory 702, and peripheral device interface 703 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 703 via a bus, signal line, or circuit board. Optionally, the peripheral device includes at least one of a radio frequency circuit 704, a display screen 705, a camera assembly 706, an audio circuit 707, and a power supply 708.

[0115] Peripheral device interface 703 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 701 and memory 702. In some embodiments, processor 701, memory 702 and peripheral device interface 703 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 701, memory 702 and peripheral device interface 703 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0116] The radio frequency (RF) circuit 704 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 704 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 704 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 704 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 704 can communicate with other devices through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: metropolitan area networks (MANs), various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks (WLANs), and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 704 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0117] Display screen 705 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 705 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 701 for processing. In this case, display screen 705 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 705, disposed on the front panel of terminal 700; in other embodiments, there may be at least two display screens 705, disposed on different surfaces of terminal 700 or in a folded design; in other embodiments, display screen 705 may be a flexible display screen, disposed on a curved or folded surface of terminal 700. Furthermore, display screen 705 may be configured as a non-rectangular irregular shape, i.e., a non-rectangular screen. Display screen 705 may be made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0118] The camera assembly 706 is used to acquire images or videos. Optionally, the camera assembly 706 includes a front-facing camera and a rear-facing camera. The front-facing camera is disposed on the front panel of the terminal 700, and the rear-facing camera is disposed on the back of the terminal 700. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 706 may also include a flash. The flash may be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cool light flash, which can be used for light compensation at different color temperatures.

[0119] The audio circuit 707 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 701 for processing, or input to the radio frequency circuit 704 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each located at a different part of the terminal 700. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert the electrical signals from the processor 701 or the radio frequency circuit 704 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 707 may also include a headphone jack.

[0120] Power supply 708 is used to power the various components in terminal 700. Power supply 708 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 708 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0121] In some embodiments, the terminal 700 further includes one or more sensors 709. The one or more sensors 709 include, but are not limited to: an accelerometer 710, a gyroscope 711, a pressure sensor 712, an optical sensor 713, and a proximity sensor 714.

[0122] Accelerometer 710 can detect the magnitude of acceleration along the three coordinate axes of a coordinate system established by terminal 700. For example, accelerometer 710 can be used to detect the components of gravitational acceleration along the three coordinate axes. Processor 701 can control display screen 705 to display the user interface in either a landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 710. Accelerometer 710 can also be used for games or for acquiring user motion data.

[0123] The gyroscope sensor 711 can detect the orientation and rotation angle of the terminal 700. The gyroscope sensor 711, in conjunction with the accelerometer sensor 710, can collect 3D motion data from the user on the terminal 700. Based on the data collected by the gyroscope sensor 711, the processor 701 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0124] The pressure sensor 712 can be disposed on the side bezel of the terminal 700 and / or the lower layer of the display screen 705. When the pressure sensor 712 is disposed on the side bezel of the terminal 700, it can detect the user's grip signal on the terminal 700, and the processor 701 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 712. When the pressure sensor 712 is disposed on the lower layer of the display screen 705, the processor 701 can control the operable controls on the UI interface based on the user's pressure operation on the display screen 705. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0125] An optical sensor 713 is used to collect ambient light intensity. In one embodiment, the processor 701 can control the display brightness of the display screen 705 based on the ambient light intensity collected by the optical sensor 713. Optionally, when the ambient light intensity is high, the display brightness of the display screen 705 is increased; when the ambient light intensity is low, the display brightness of the display screen 705 is decreased. In another embodiment, the processor 701 can also dynamically adjust the shooting parameters of the camera assembly 706 based on the ambient light intensity collected by the optical sensor 713.

[0126] A proximity sensor 714, also known as a distance sensor, is installed on the front panel of the terminal 700. The proximity sensor 714 is used to detect the distance between the user and the front of the terminal 700. In one embodiment, when the proximity sensor 714 detects that the distance between the user and the front of the terminal 700 is gradually decreasing, the processor 701 controls the display screen 705 to switch from a screen-on state to a screen-off state; when the proximity sensor 714 detects that the distance between the user and the front of the terminal 700 is gradually increasing, the processor 701 controls the display screen 705 to switch from a screen-off state to a screen-on state.

[0127] Those skilled in the art will understand that Figure 7 The structure shown does not constitute a limitation on terminal 700, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0128] This application also provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor to implement the display device adjustment method provided in the above embodiments.

[0129] This application also provides a computer program product, including a computer program loaded and executed by a processor to implement the display device adjustment method provided in the above embodiments.

[0130] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0131] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present application should be included within the protection scope of the present application.

Claims

1. A method for adjusting a display device, characterized in that, The method includes: Based on multiple facial key points of the target object, the intersection point of the target object's line of sight and the display screen of the display device is determined; if the vertical distance between the intersection point and the center point of the display screen is not greater than a distance threshold, the display device is adjusted using a first adjustment method, which indicates that the height of the display device is adjusted at a first speed so that the center point of the display screen and the intersection point are at the same horizontal level; if the vertical distance is greater than the distance threshold, a prompt message is displayed on the display screen, which prompts the target object to pause using the display device and that the height of the display device will be adjusted for the target object so that the center point of the display screen and the intersection point are at the same horizontal level; in response to the target object's confirmation of the prompt message, the display device is adjusted using a second adjustment method, which indicates that if the target object pauses using the display device, the height of the display device is adjusted at a second speed, which is greater than the first speed; based on the angle between the line of sight and the perpendicular bisector of the display screen at the center point, the orientation of the display device is adjusted so that the angle between the line of sight and the perpendicular bisector is less than an angle threshold; and... The target object undergoes pose recognition to determine multiple skeletal key points. Based on the ratio of the size of each skeletal key point to the size of a standard skeletal key point, the distance between the target object and the display device is determined, where the size of the standard skeletal key point indicates a preset distance between the target object and the display device. If the distance between the target object and the display device is greater than the preset distance, the content displayed on the display screen is enlarged. If the distance between the target object and the display device is less than the preset distance, the display brightness of the display screen is reduced. If the size of the key eye point of the target object is smaller than a preset size, or if the similarity between the key skeletal point of the target object and the key skeletal point corresponding to the fatigue state is higher than a preset level, the content displayed on the display screen is enlarged, or the brightness of the display screen is increased, or the distance between the display device and the target object is reduced. The preset size is the size of the key eye point of the target object when it is in a non-fatigue state.

2. The method according to claim 1, characterized in that, The method further includes: Based on the horizontal distance between the intersection point and the center point of the display screen, the display device is adjusted horizontally so that the intersection point is located at the center point of the display screen.

3. The method according to claim 1, characterized in that, The method further includes: Based on multiple facial key points of the target object, determine the angle between the line of sight of the target object and the plane where the display screen is located; Based on the angle between the line of sight of the target object and the plane where the display screen is located, adjust the pitch angle of the display device so that the line of sight of the target object is perpendicular to the plane where the display screen is located.

4. The method according to claim 1, characterized in that, The method further includes: The screen resolution of the display screen is adjusted based on the distance between the target object and the display device.

5. A display device adjustment device, characterized in that, The device includes: The first determining module is used to determine the intersection point between the line of sight of the target object and the display screen of the display device based on multiple facial key points of the target object; A first adjustment module is configured to adjust the display device using a first adjustment method when the vertical distance between the intersection point and the center point of the display screen is not greater than a distance threshold. The first adjustment method indicates that the height of the display device is adjusted at a first speed so that the center point of the display screen and the intersection point are at the same horizontal level. If the vertical distance is greater than the distance threshold, a prompt message is displayed on the display screen, indicating that the target object should suspend use of the display device and that the height of the display device will be adjusted for the target object so that the center point of the display screen and the intersection point are at the same horizontal level. In response to the target object's confirmation of the prompt message, a second adjustment method is used to adjust the display device. The second adjustment method indicates that if the target object suspends use of the display device, the height of the display device is adjusted at a second speed, where the second speed is greater than the first speed. The second adjustment module is used to adjust the orientation of the display device based on the angle between the line of sight and the perpendicular bisector of the display screen at the center point, so that the angle between the line of sight and the perpendicular bisector is less than an angle threshold. The third determining module is used to perform pose recognition on the target object and determine multiple skeletal key points of the target object; The fourth determining module is used to determine the distance between the target object and the display device based on the ratio of the size of the skeletal key point to the size of the standard skeletal key point, wherein the size of the standard skeletal key point is used to indicate a preset distance between the target object and the display device; The third adjustment module is used to increase the content displayed on the display screen when the distance between the target object and the display device is greater than the preset distance, and to decrease the display brightness of the display screen when the distance between the target object and the display device is less than the preset distance. The module for performing the following steps: when the size of the eye key point of the target object is smaller than a preset size, or when the similarity between the skeletal key point of the target object and the skeletal key point corresponding to the fatigue state is higher than a preset level, the module increases the content displayed on the display screen, increases the brightness of the display screen, or decreases the distance between the display device and the target object. The preset size is the size of the eye key point of the target object when it is in a non-fatigue state.

6. A terminal, characterized in that, The terminal includes a processor and a memory, the memory storing at least one computer program, which is loaded and executed by the processor to implement the display device adjustment method as described in any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one computer program, which is loaded and executed by a processor to implement the display device adjustment method as described in any one of claims 1 to 4.

8. A computer program product, comprising a computer program, characterized in that, The computer program is loaded and executed by a processor to implement the display device adjustment method as described in any one of claims 1 to 4.

Images