Angle adjusting method, device, equipment, system, medium and program product

Abstract

The embodiment of the invention provides an angle adjusting method, device, equipment, system, medium and program product, and relates to the field of financial science and technology or other related fields. The method comprises the following steps: identifying a current user after the terminal equipment is awakened; if the historical operation record of the current user does not exist, detecting the distance between the current user and the terminal equipment and the current environment brightness; determining a first display angle according to the distance between the current user and the terminal equipment; wherein the first display angle is an angle where a connecting line between eyes of the current user and a central point of a display of the terminal equipment is perpendicular to the display of the terminal equipment; and if the current ambient brightness is smaller than the preset brightness threshold, controlling the angle of the display of the terminal equipment to be the first display angle. According to the method, by dynamically adjusting the angle of the display of the terminal equipment, the problem of poor visual angle or light reflection of the current user is avoided, and the comfort degree of interaction between the current user and the terminal equipment is improved.

Description

Technical Field

[0001] This application relates to the field of financial technology or other related fields, and in particular to an angle adjustment method, device, equipment, system, medium and program product. Background Technology

[0002] In the banking and financial industry, intelligent terminal devices, such as self-service terminals (STMs) and automated teller machines (ATMs), are core infrastructure for financial services, providing users with various services. A good user experience can improve operational efficiency when using these devices.

[0003] Currently, the screen angle of terminal devices is fixed. Terminal devices with fixed screen angles are difficult to adapt to the personalized needs of different users. This may cause some users to encounter problems such as reflection and poor viewing angle when using terminal devices, which affects the user experience and requires users to change their posture, thus affecting the convenience of use. Summary of the Invention

[0004] This application provides an angle adjustment method, device, equipment, system, medium, and program product. By identifying the relative position between the current user and the terminal device, the angle of the terminal device's display is adjusted to achieve dynamic adjustment, avoiding problems such as glare and poor viewing angle, and improving the comfort of user interaction with the terminal device.

[0005] In a first aspect, this application provides an angle adjustment method, comprising: after the terminal device is woken up, identifying the current user; if there is no historical operation record of the current user, detecting the distance between the current user and the terminal device and the current ambient brightness; determining a first display angle based on the distance between the current user and the terminal device; wherein, the first display angle is the angle between the line connecting the current user's eye and the center point of the terminal device's display and the display of the terminal device; if the current ambient brightness is less than a preset brightness threshold, controlling the angle of the terminal device's display to be the first display angle.

[0006] Secondly, this application provides an angle adjustment device, comprising: a current user identification module for identifying the current user after the terminal device is woken up; a parameter acquisition module for detecting the distance between the current user and the terminal device and the current ambient brightness if there is no historical operation record of the current user; a first display angle determination module for determining a first display angle based on the distance between the current user and the terminal device; wherein the first display angle is the angle between the line connecting the current user's eye and the center point of the terminal device's display and the display of the terminal device; and an angle control module for controlling the angle of the terminal device's display to the first display angle if the current ambient brightness is less than a preset brightness threshold.

[0007] Thirdly, this application provides an electronic device, including: a processor and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement the method provided in the first aspect above.

[0008] Fourthly, this application provides an angle adjustment system, including: a support mechanism and a control module; the support mechanism is used to support the display of a terminal device and to adjust the angle of the display of the terminal device under control; the control module is used to execute the method provided in the first aspect above, and to realize the angle adjustment of the terminal device by controlling the support mechanism.

[0009] Fifthly, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the method provided in the first aspect above.

[0010] In a sixth aspect, this application provides a computer program product, including a computer program that, when executed by a processor, implements the method provided in the first aspect above.

[0011] The angle adjustment method, apparatus, device, system, medium, and program products provided in this application realize the dynamic adjustment of the display angle of a terminal device. Specifically, when the terminal device is woken up, it identifies whether the user operating the terminal device has a historical operation record. If not, it detects the distance between the user and the terminal device and the ambient brightness in real time. Then, based on the distance between the user and the terminal device, it determines the angle of the display when the line connecting the user's eye and the center point of the terminal device's display is perpendicular to the display surface. When the ambient brightness is lower than a preset brightness threshold, it adjusts the angle of the terminal device's display to this angle. This achieves a more comfortable visual experience for the user when the ambient brightness is low, i.e., the probability of glare is low, avoiding the problem of poor viewing angle caused by an unsuitable display angle, and improving the comfort of user interaction with the terminal device. Attached Figure Description

[0012] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0013] Figure 1 A schematic diagram illustrating an application scenario provided in an embodiment of this application;

[0014] Figure 2 This is a schematic diagram of the structure of an angle adjustment system provided in an embodiment of this application;

[0015] Figure 3 For this application Figure 2 A schematic diagram of the angle adjustment system 200 when the retracting guide rod 212 retracts in the embodiment;

[0016] Figure 4 A flowchart illustrating an angle adjustment method provided in an embodiment of this application;

[0017] Figure 5 This application provides a schematic diagram of a current user operation terminal device scenario.

[0018] Figure 6 A flowchart illustrating an angle adjustment method provided in an embodiment of this application;

[0019] Figure 7 A flowchart illustrating another angle adjustment method provided in this application embodiment;

[0020] Figure 8 A flowchart illustrating another angle adjustment method provided in an embodiment of this application;

[0021] Figure 9 This is a schematic diagram of the structure of an angle adjustment device provided in an embodiment of this application;

[0022] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0023] Figure label:

[0024] 200 - Angle adjustment system; 220 - Control module;

[0025] 210-Support mechanism; 211-Fixed guide rod; 212-Retractable guide rod; 2121-Push rod; 2122-Guide rod sleeve; 213-Rotating shaft.

[0026] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0027] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0028] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, storage, use, processing, transmission, provision, disclosure, and application of the relevant data all comply with the relevant laws, regulations, and standards of the relevant countries and regions, have taken necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation access points for users to choose to authorize or refuse.

[0029] Furthermore, the technical solution involved in this application, which involves big data analysis of user information (including but not limited to personal biometrics, identity data, consumption data, asset data, electronic terminal operation data, etc.) and the use of artificial intelligence technology for automated decision-making, and makes decisions that have a significant impact on personal rights based on the results of automated decision-making, provides users with corresponding operation entry points for users to choose to agree to or reject the results of automated decision-making; if the user chooses to reject, the process will proceed to the expert decision-making process.

[0030] It should be noted that the angle adjustment method, device, equipment, system, medium and program products provided in this application can be used in the financial technology field, or in any field other than the financial technology field. The application field of the angle adjustment method, device, equipment, system, medium and program products in this application is not limited.

[0031] The specific application scenarios of this application are user-terminal device interaction scenarios. It can be applied to the financial field, in scenarios where users use terminal devices to conduct business, such as using ATMs for deposits and withdrawals, using STMs for services, etc. It can also be applied to other fields where terminal devices are needed, such as self-service shopping machines. Figure 1 This is a schematic diagram illustrating an application scenario provided by an embodiment of this application. For example... Figure 1As shown, when a user conducts business, they need to move in front of the terminal device, view the content displayed on the screen at a certain angle, and complete the operation according to the instructions displayed on the screen. If the terminal device's screen is not at a suitable angle, it will result in a poor viewing angle for the user, and there is a risk of glare, affecting the efficiency of the user's business transactions, and may also cause visual fatigue. For example, Figure 1 The user in the image (represented by the solid line) has a poor viewing angle when operating the display of the terminal device represented by the solid line. The user needs to adjust their posture to the position of the user represented by the dashed line or adjust the display to the position of the display represented by the dashed line.

[0032] Currently, the angle of the monitor on terminal devices (the angle between the screen plane and the horizontal direction) is mostly fixed. When the monitor angle is unsuitable, resulting in poor viewing angle or glare, the only way to adjust it is by the user adjusting their standing or sitting posture, or leaning forward. This not only affects the efficiency of handling business but also the user experience. For example, if the angle between the user's line of sight and the normal of the monitor at a lower position is too large, and the monitor angle is fixed, the user needs to move away from the terminal device or lower their height by bending their legs, which is inconvenient and results in a poor user experience.

[0033] The angle adjustment method provided in this application, for terminal devices with adjustable display angles, offers a strategy for dynamically adjusting the display angle based on the user's position. Specifically, it obtains the distance between the user operating the terminal device and the device itself, calculates the optimal display angle for the user at their viewing angle, and adjusts the display to this angle when the ambient brightness is low (i.e., the probability of glare is low). This dynamic adjustment of the display angle avoids unfavorable viewing angles and improves user comfort when interacting with the terminal device.

[0034] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will be described below with reference to the accompanying drawings.

[0035] Figure 2 This is a schematic diagram of the structure of an angle adjustment system provided in an embodiment of this application. Figure 2 As shown, the angle adjustment system 200 includes a support mechanism 210 and a control module 220.

[0036] The support mechanism 210 is used to support the display of the terminal device and to adjust the angle of the display of the terminal device under control; the control module 220 is used to execute the angle adjustment method provided in the embodiments of this application, and to realize the angle adjustment of the terminal device by controlling the support mechanism 210.

[0037] The terminal device is an angle-adjustable display device, such as an ATM or STM with an adjustable display angle. The terminal device may include a display and a stand. An angle adjustment system 200 is disposed between the display and the stand, and the display angle is adjustable by controlling the support mechanism 210.

[0038] Specifically, the support mechanism 210 may include a fixed guide rod 211 and a retractable guide rod 212. The fixed guide rod 211 has a fixed length and is used to fix the first end of the display. The retractable guide rod 212 has an adjustable length and is used to fix the second end of the display. The first end and the second end of the display are two points on the vertical axis of the display. In one example, the first end may be lower than the second end, and preferably the first end and the second end are symmetrical about the center of the display.

[0039] The fixed guide rod 211 and the retractable guide rod 212 can be movably connected to the display via the pivot 213; the other end of the fixed guide rod 211 and the retractable guide rod 212 is fixed to the base of the terminal device.

[0040] The fixed guide rod 211 and the retractable guide rod 212 can be made of lightweight, high-strength materials to ensure that the control module 220 reduces energy consumption and noise while controlling the support mechanism 210 to achieve stable support.

[0041] In one example, the retractable guide rod 212 may include a push rod 2121 and a guide rod sleeve 2122. The guide rod sleeve 2122 is used to accommodate the push rod 2121, which can move axially within the guide rod sleeve 2122 to achieve length changes. Specifically, the surface of the push rod 2121 and the guide rod sleeve 2122 may be respectively provided with precision-engaging threads. Under the control of the control module 220, the guide rod sleeve 2122 rotates in a fixed direction, converting the rotational motion into axial displacement of the push rod 2121, thereby enabling the push rod 2121 to move axially. For example, if the push rod 2121 is provided with a right-hand thread, the push rod 2121 can be controlled to rotate clockwise to extend the push rod 2121 out of the guide rod sleeve 2122; the push rod 2121 can be controlled to rotate counterclockwise to retract into the guide rod sleeve 2122.

[0042] The angle of the display can be adjusted by controlling the length of the retractable guide rod 212. Figure 3 For this application Figure 2 A schematic diagram of the angle adjustment system 200 during the retraction of the retractable guide rod 212 in the embodiment. Figure 3As shown, since the length of the fixed guide rod 211 is fixed, the height of the first end of the display is fixed. When the length of the retractable guide rod 212 is retracted, the height of the second end of the display decreases, thereby causing the angle of the display (the angle between the display plane and the horizontal direction) to decrease.

[0043] In some embodiments, the angle adjustment system 200 further includes a data acquisition module, which is used to acquire data that needs to be detected or acquired by the angle adjustment method provided in this application, such as distance, ambient brightness, and face images. The data acquisition module may include at least one camera and at least one sensor. The sensor may include a brightness sensor, an infrared rangefinder, a TOF (Time of Flight) sensor, etc.

[0044] Figure 4 This is a flowchart illustrating an angle adjustment method provided in an embodiment of this application. Figure 4 As shown, this application can be executed by the aforementioned control module 220. (As indicated...) Figure 4 As shown, the angle adjustment method provided in this embodiment includes the following steps:

[0045] Step S401: After the terminal device is woken up, identify the current user.

[0046] In this embodiment, the terminal device is a terminal device with an adjustable display angle, which can be the terminal device described in the above embodiments. Wake-up refers to the terminal device, which is in an inactive state such as low power consumption, sleep, or standby, responding to a user's operation and resuming its working state. The user's operation can be touching the display, inserting an ID card, clicking a button, or speaking a wake-up word. The user performing the operation on the terminal device is the current user.

[0047] Specifically, after the terminal device is woken up by the current user, the identity of the current user is identified.

[0048] The current user identification method can involve placing a camera on or within the terminal device's location to capture the user's facial image. This image is then analyzed in a database to determine the user's identity. This database is authorized by the user to store their information, including personal details and historical activity records.

[0049] In one example, if the camera does not capture the current user's face image, the camera pose can be changed until the current user's face image is captured, and then the following steps can be performed.

[0050] In some embodiments, the current user's identity can also be identified by detecting the information entered by the current user. For example, when using a bank's smart terminal, specific information of the document inserted by the user, such as an ID card or debit card, can be read to identify the current user's identity; or the current user's identity can be identified by the account number and password entered by the user in the terminal device.

[0051] After identifying the current user, the system can retrieve the current user's historical operation records from the database. Historical operation records refer to the current user's past operations on this terminal device or other terminal devices of the same model or size. These records include historical display angle data and the current user's information.

[0052] In step S402, if there is no historical operation record of the current user, the distance between the current user and the terminal device and the current ambient brightness are detected.

[0053] The distance between the current user and the terminal device refers to the distance between the current user's current location and the terminal device. This includes one or more of the following: horizontal distance, vertical distance, and eye distance. Horizontal distance refers to the horizontal distance between the current user and the terminal device; vertical distance refers to the vertical distance between a specific part of the current user's body (such as the eyes) and the terminal device; eye distance refers to the distance between the current user's eyes and the center of the display screen.

[0054] Current ambient brightness refers to the average ambient brightness of the space where the terminal device is located. When using a terminal device, if the ambient brightness is high, the monitor is prone to glare, affecting the clarity of the screen content for the user. By detecting the ambient brightness, the probability of glare can be determined.

[0055] Specifically, if there are no historical operation records, the distance between the current user and the terminal device, as well as the current ambient brightness, can be collected through the aforementioned data collection module.

[0056] In some embodiments, if there is a historical operation record of the current user, the angle of the terminal device's display can be adjusted according to the historically adjusted display angle.

[0057] The distance between the current user and the terminal device can be detected by the distance sensor in the acquisition module. The sensor can be an infrared sensor and / or a Time-of-Flight (TOF) sensor. Alternatively, multiple cameras can be placed at different locations within the terminal device's space to acquire images of the current user and the terminal device from these different positions. Based on the acquired images, a spatial model is constructed, thereby determining the distance between the current user and the terminal device.

[0058] For example, for horizontal distance, a distance sensor, such as an infrared sensor, can be installed on the base of the terminal device. The distance sensor sends a signal in the horizontal direction, and the distance parameter detected by the infrared sensor is the horizontal distance between the current user and the terminal device. For vertical distance, an image captured by the camera of the acquisition module can be used. This image includes the current user and spatial reference objects (such as walls). The vertical distance is calculated based on the spatial reference objects and the current user. For eye distance, an image captured by the camera of the acquisition module can be used to calculate the eye distance based on computer vision algorithms.

[0059] The current ambient brightness can be detected by the sensors in the acquisition module. These sensors can be optical sensors, such as photodiodes or photoresistors. Alternatively, it can be detected by the camera in the acquisition module. By analyzing the image captured by the camera, the average pixel brightness or the grayscale value of a specific area (such as the environment) can be determined to ascertain the current ambient brightness.

[0060] Step S403: Determine the angle of the first display based on the current distance between the user and the terminal device.

[0061] The first display angle is the angle of the display when the user is at a comfortable viewing angle, which is the angle between the line connecting the user's eye and the center point of the terminal device's display and the display of the terminal device.

[0062] Specifically, the angle of the first display is determined based on the current distance between the user and the terminal device and on spatial geometric relationships.

[0063] Figure 5 This is a schematic diagram illustrating a current user operation terminal device scenario provided in an embodiment of this application. For example... Figure 5 As shown, Figure 5 In this equation, h represents the vertical distance, l represents the distance to the human eye, and d represents the horizontal distance. Based on spatial geometry, the first display angle θ1 can be expressed as: θ1 = arcsin(d / l), or θ1 can be expressed as: θ1 = arctan(d / h).

[0064] In some embodiments, the angle of the first display can be adjusted according to factors such as age group and body shape. For example, the angle of the first display can be appropriately reduced for users who are leaning forward.

[0065] Step S404: If the current ambient brightness is less than the preset brightness threshold, then the angle of the display of the control terminal device is the first display angle.

[0066] The preset brightness threshold is a pre-set parameter. When the current ambient brightness is greater than or equal to the preset brightness threshold, obvious glare may occur. Because the reflective characteristics of terminal device display screens vary greatly—for example, glass screens are generally more reflective than plastic screens—the preset brightness threshold is a configurable parameter and is not limited here.

[0067] If the current ambient brightness is less than the preset brightness threshold, the angle of the terminal device's display can be adjusted to a better user experience angle, i.e., the first display angle.

[0068] For example, continue to refer to Figure 2 and Figure 3 The length of the retraction guide rod 212 can be adjusted to adjust the angle of the display to the first display angle.

[0069] Research has found that reading efficiency decreases by 40% when the angle between the user's line of sight and the monitor's normal exceeds 18°. Therefore, controlling the monitor angle to the primary display angle can significantly improve the comfort and efficiency of user interaction with terminal devices.

[0070] If the current ambient brightness is greater than or equal to the preset brightness threshold, the probability of glare should be reduced before or after adjusting the angle of the terminal device's display to a better user experience.

[0071] Specifically, the monitor's brightness can be increased based on the current ambient brightness, and the contrast ratio can be adjusted accordingly. For example, in an ambient brightness of 300 lux, a monitor with a brightness of 300 nits may have noticeable reflections, while the reflections on a screen with a brightness of 500 nits may be less noticeable.

[0072] In some embodiments, after adjusting the display angle to a first display angle, the current user's information, the terminal device's information, and the first display angle can be stored so that the current user can directly control the display angle to that angle the next time they use the device. When the current user has multiple historical operation records, some data, such as the first display angle, can be statistically analyzed to obtain statistical values, such as an average value. The next time the current user uses this type of terminal device, the display angle can be controlled based on the statistical value.

[0073] For example, the model of the terminal device currently operated by the user, the number of the current customer, the name of the current customer, the distance between the current customer and the terminal device, the angle of the first display, and the operation time can be stored in the system to generate the current user's historical operation record.

[0074] The angle adjustment method provided in this embodiment enables dynamic adjustment of the display angle of a terminal device. When the terminal device is woken up, it identifies whether the user has a history of operation. If not, it detects the distance between the user and the terminal device, as well as the ambient brightness, in real time. Then, based on the distance between the user and the terminal device, it determines the display angle when the line connecting the user's eye and the center point of the terminal device's display is perpendicular to the display plane. When the ambient brightness is lower than a preset brightness threshold, the display angle is adjusted to this angle. This achieves a more comfortable visual experience for the user in low-brightness environments (i.e., when the probability of glare is low), avoiding poor viewing angles caused by unsuitable display angles and improving the comfort of user interaction with the terminal device.

[0075] Figure 6 This is a flowchart illustrating an angle adjustment method provided in an embodiment of this application. This embodiment... Figure 4 Based on the illustrated embodiment, the step of detecting the distance between the current user and the terminal device in step S403 is refined. At the same time, an implementation method is added for scenarios where there are historical operation records of the current user and the current ambient brightness is greater than or equal to a preset brightness threshold.

[0076] like Figure 6 As shown, the angle adjustment method provided in this embodiment specifically includes the following steps:

[0077] Step S601: After the terminal device is woken up, identify the current user.

[0078] Step S602: If there is an operation record of the current user, then determine the angle of the third display based on the historical operation record, and control the angle of the terminal device's display to be the angle of the third display.

[0079] In this embodiment, the historical operation record includes the angle data of the adjusted display recorded when the current user operates a terminal device of the same model or size, i.e., the third display angle.

[0080] By adjusting the monitor angle to the third monitor angle from the historical operation record, the time required to calculate the first monitor angle is greatly reduced, thus improving the efficiency of angle adjustment.

[0081] After controlling the monitor angle to the third monitor angle, the monitor angle can be fine-tuned to the monitor angle when the user is at a comfortable viewing angle, i.e., the first monitor angle.

[0082] In some embodiments, since the vertical distance between the current user and the terminal device changes little, the vertical distance in the historical operation record can be directly determined as the current vertical distance. Only the horizontal distance needs to be detected. Based on the horizontal distance and the vertical distance in the historical operation record, the angle of the display when the user is at a comfortable viewing angle is calculated, i.e., the first display angle.

[0083] After the angle of the monitor on the control terminal device is set to the third monitor angle, the angle of the monitor can be adjusted to the fourth monitor angle, which is the angle of the monitor when the user is at a more comfortable viewing angle and the probability of glare is low.

[0084] Optionally, the method further includes: determining the angle of the fourth display based on the current distance between the user and the terminal device and the current ambient brightness; if the difference between the angle of the third display and the angle of the fourth display is greater than or equal to a difference threshold, then controlling the angle of the terminal device's display to be the angle of the fourth display; if the difference is less than the difference threshold, then not adjusting the angle of the terminal device's display.

[0085] In this embodiment, the distance between the current user and the terminal device, as well as the current ambient brightness, are also detected. The detection method is the same as that provided in this embodiment for detecting the distance between the current user and the terminal device and the current ambient brightness, and will not be described in detail here.

[0086] The method for determining the angle of the fourth display is the same as the method for determining the angle of the second display provided in this embodiment, and will not be described again here.

[0087] The difference threshold is a configurable parameter, for example, 18°. When the monitor angle is within the range of [θ4-Δθ, θ4+Δθ], the current user is in a relatively comfortable viewing range. Here, θ4 represents the fourth monitor angle, and Δθ represents the difference threshold.

[0088] Specifically, if the difference between the current display angle (i.e., the third display angle and the fourth display angle) is greater than or equal to the difference threshold, it indicates that the current user is not in a comfortable viewing angle range, and the display angle of the control terminal device is the fourth display angle; if the difference is less than the difference threshold, the display angle is kept at the third display angle.

[0089] In this embodiment, after adjusting the display angle to the third display angle in the historical operation record, the display angle is adjusted again according to the distance and the current ambient brightness. This improves operational efficiency and places the current user in a visually comfortable observation range, further enhancing the user's comfort in interacting with the terminal device.

[0090] Step S603: If there is no historical operation record for the current user, then detect the current ambient brightness.

[0091] Step S604: Detect the horizontal distance using a distance sensor.

[0092] Step S605: Determine the eye distance based on the current user's face image captured by the camera.

[0093] The current distance between the user and the terminal device includes eye distance and horizontal distance. Eye distance is the distance between the user's eyes and the terminal device, and horizontal distance is the distance between the user and the terminal device in the horizontal direction.

[0094] The camera can be placed on a terminal device capable of acquiring an image of the current user's face, or within the space where the terminal device is located. The proximity sensor can be placed on the terminal device, such as on a base. The proximity sensor can be an infrared sensor or a Time-of-Flight (TOF) sensor.

[0095] The eye distance can be obtained by using computer vision algorithms to capture the current user's facial image from a camera.

[0096] The horizontal distance can be obtained by controlling a distance sensor located on the base of the terminal device to emit a horizontal signal, and then calculating the horizontal distance by receiving the signal reflected by the current user.

[0097] It should be noted that after determining that there is no historical operation record of the current user, steps S603, S604, and S605 can be executed in any order. The order of the numbers does not indicate the execution order. For example, they can be executed in parallel. This application does not limit whether steps S603, S604, or S605 are executed first.

[0098] Optionally, determining the eye distance based on the current user's facial image captured by the camera includes: determining the current user's eye position based on the current user's facial image captured by the camera; determining the signal transmission direction of the first sensor based on the current user's eye position; the first sensor acquiring a first distance value based on the signal transmission direction; and calculating the eye distance based on the first distance value.

[0099] The first sensor can be a distance sensor, such as a Time-of-Flight (TOF) sensor. Taking a TOF sensor as an example, the principle is to continuously emit light pulse signals in a certain direction (i.e., the signal emission direction), then receive the light pulse signals reflected back by the current user, and calculate the distance by calculating the time of flight of the light pulse signals. That is, distance l = c ΔT / 2, where c is the speed of light and ΔT is the time of flight.

[0100] Based on multiple frames of facial images of the current user captured by the camera, feature point recognition is performed on these frames. Using the recognition information of the face and facial feature points in these frames, the position of the user's eyes in the image is identified, thus determining the direction of the user's eyes in space. Feature point recognition can be implemented using the MTCNN (Multi-task Cascaded Convolutional Networks) algorithm, which can simultaneously perform tasks such as face detection, facial landmark localization, and pose estimation.

[0101] For example, multiple frames of face images can be face images captured by a camera in different poses. Feature point recognition is performed on the multiple frames of face images. Using the recognition information of the face and facial feature points in the multiple frames of face images, the orientation of the camera when the current user's eyes are at the center point of the face image is determined. This orientation is the direction of the current user's eyes.

[0102] In one example, if no face image is detected or no eye feature points are recognized, the camera pose can be controlled until a face image is detected or eye feature points are recognized.

[0103] The first sensor can be placed near the camera, and the direction of the current user's eye is the direction of the first sensor's signal transmission.

[0104] In one example, the first sensor may also be located in other locations. The signal transmission direction of the first sensor is determined based on spatial geometry, taking into account the location of the first sensor, the location of the camera, and the direction of the current user's eye.

[0105] The first sensor emits a light pulse signal in the signal transmission direction and detects a first distance value based on the flight time of the light pulse signal. Based on the first distance value and spatial geometry, the distance between the current user's eye and the center point of the display is calculated, and this distance is determined as the human eye distance.

[0106] By using a camera and a first sensor to obtain the distance to the human eye, the logic is simple and the amount of calculation is small. While ensuring high accuracy in determining the distance to the human eye, the efficiency of determining the distance to the human eye is improved.

[0107] Optionally, multiple cameras can be included, meaning multiple cameras can be set up in the space where the terminal device is located to construct a three-dimensional spatial environment. Determining the eye distance based on the current user's facial image captured by the cameras includes: establishing a three-dimensional coordinate system including the current user and the terminal device based on the facial images of the current user captured by multiple cameras; and determining the current user's eye distance based on the three-dimensional coordinate system.

[0108] Specifically, multiple cameras simultaneously capture the current user's facial images and perform feature point recognition to determine the position of the eyes in each facial image. Based on this position, a three-dimensional coordinate system is established using the center point of the display as the origin, combined with computer vision and geometric modeling techniques. The distance from the current user's eyes to the origin in the three-dimensional coordinate system is calculated, and this distance is the current user's eye distance.

[0109] By establishing a three-dimensional coordinate system, the distance to the human eye can be determined more accurately, and only a camera is needed, reducing the use of the primary sensor and lowering system maintenance costs.

[0110] Step S606: Determine the angle of the first display based on the current distance between the user and the terminal device.

[0111] The distance between the current user and the terminal device includes eye distance and horizontal distance. Eye distance is the distance between the current user's eyes and the terminal device, and horizontal distance is the distance between the current user and the terminal device in the horizontal direction. The first display angle is the angle at which the line connecting the current user's eyes and the center point of the terminal device's display is perpendicular to the display of the terminal device.

[0112] Specifically, the first display angle can be expressed as: θ1 = arcsin(d / l), where θ1 is the first display angle, d is the horizontal distance, and l is the distance to the human eye.

[0113] Step S607: If the current ambient brightness is less than the preset brightness threshold, then the angle of the display of the control terminal device is the first display angle.

[0114] Step S608: If the current ambient brightness is greater than or equal to a preset brightness threshold, then obtain the relative position of the light source and the terminal device.

[0115] Light sources include objects such as lamps used for lighting and the sun. The relative position of the light source and the terminal device refers to the spatial arrangement of the light source relative to the terminal device, and can represent the path of light rays to the terminal device.

[0116] The relative positions of the light source and the terminal device can be pre-stored in the system. For example, if the light source is a lamp, the relative positions of the lamp and the terminal device can be stored in the system, such as the lamp being located at a vertical angle of 60° in front of the terminal device; if the light source is the sun, the relative positions of the windows in the space and the terminal device, as well as the direction of the light at different times, can be stored in the system.

[0117] If the current ambient brightness is greater than or equal to the preset brightness threshold, the relative position of the light source and the terminal device stored in the system is read.

[0118] In some embodiments, multiple wide-angle cameras can be arranged around the terminal device to calculate the direction of light using stereo vision. Based on the direction of light, the relative position of the light source and the terminal device is determined.

[0119] Step S609: Determine the angle range of the terminal device based on the relative position of the light source and the terminal device.

[0120] The direction of light incident on the display can be determined based on the relative position of the light source and the terminal device. Reflection is prone to occur when the display is within a certain range. Research has found that when this direction is within ±10° of the display's normal, direct light is more likely to undergo specular reflection and enter the user's eyes.

[0121] Specifically, based on the relative position of the light source and the terminal device, the direction of light incident on the display is determined, and then the angle range of the terminal device is determined. This angle range is the angle range of the display that is less prone to reflection according to this direction.

[0122] In some embodiments, if the angle of the first display is within the angle range, then the angle of the display of the control terminal device is the angle of the first display.

[0123] Step S610: If the angle of the first display is not within the angle range, then determine the angle of the second display based on the angle range.

[0124] Step S611: Control the angle of the display of the terminal device to the second display angle.

[0125] The second monitor angle is the angle of the monitor when the user is at a relatively comfortable viewing angle and the probability of glare is low.

[0126] If the angle of the first display is not within the specified range, it indicates a probability of glare. The angle of the current display can be deviated from the angle of the first display to reduce the probability of glare. Specifically, the angle of the second display is determined based on the angle range and the angle of the first display.

[0127] After determining the angle of the second display, the angle of the display is adjusted to match the angle of the second display.

[0128] The angle of the second display can be the angle with the smallest deviation from the angle of the first display within the angle range; or it can be the average of the angle with the smallest deviation from the angle of the first display within the angle range and the angle of the first display.

[0129] Optionally, the angle of the second display is the angle with the smallest difference from the angle of the first display within the angle range.

[0130] Specifically, if the angle of the first display is lower than the minimum value of the angle range, then the angle of the second display is determined to be the minimum value; if the angle of the first display is higher than the maximum value of the angle range, then the angle of the second display is determined to be the maximum value.

[0131] By determining the angle with the smallest difference as the angle of the second display, the problem of poor viewing angle is avoided as much as possible while minimizing the occurrence of reflections. At the same time, the method of determining the angle of the second display is simple and the calculation speed is fast.

[0132] By adjusting the display range based on the angle range and the angle of the first display when the current ambient brightness is less than a preset brightness threshold, a dynamic compensation mechanism is implemented. This mechanism takes into account the current user's viewing angle and the risk of glare, and precisely adjusts the display angle to further improve the user's comfort in interacting with the terminal device. At the same time, by calculating the distance between the human eye and the horizontal distance, and combining simple geometric relationships, the angle of the first display is determined relatively easily, which improves the speed of determining the angle of the first display and thus improves the efficiency of angle adjustment.

[0133] Figure 7 This is a flowchart illustrating another angle adjustment method provided in an embodiment of this application. In this embodiment, the angle of the display to be adjusted can be determined solely based on the current distance between the user and the terminal device, without considering the current ambient brightness.

[0134] like Figure 7 As shown, in order to better understand the angle adjustment method provided in this embodiment, this embodiment will provide a detailed description of the method.

[0135] Step S701: After the terminal device is woken up, identify the current user.

[0136] Step S702: Determine if historical operation data exists. If it exists, proceed to step S703; otherwise, proceed to step S704.

[0137] Step S703: Determine the angle of the third display based on the historical operation record, and control the angle of the display of the terminal device to be the angle of the third display.

[0138] In this step, after the angle of the control terminal device's display is set to the third display angle, the angle of the display can be finely adjusted, i.e., step S704 can be continued.

[0139] Step S704: Detect the distance between the current user and the terminal device.

[0140] Step S705: Determine the angle of the first display based on the current distance between the user and the terminal device.

[0141] Step S706: Control the display angle of the terminal device to the first display angle.

[0142] The angle adjustment method provided in this application has similar technical effects to the method provided in any of the above embodiments of this application, and will not be described again here.

[0143] Figure 8 This is a flowchart illustrating another angle adjustment method provided in an embodiment of this application. Figure 8 As shown, this embodiment is... Figure 7 Based on the embodiment shown, in step S703, after determining the angle of the third display based on the historical operation record and controlling the angle of the terminal device's display to be the angle of the third display, step S704 is not executed directly, but step S707 is executed to detect the horizontal distance. After executing step S707, step S708 is executed to determine the angle of the first display based on the horizontal distance and the historical operation record, and after executing step S708, step S706 is executed.

[0144] Specifically, the historical operation record includes the angle of the third display and the current user's vertical distance. Since the vertical distance changes little, it can be regarded as the current user's vertical distance at the time of the current operation. Based on the detected horizontal and vertical distances, the angle of the first display can be calculated according to geometric relationships.

[0145] The remaining steps and Figure 7 The embodiments shown are consistent and will not be described again here. The angle adjustment method provided in this application has similar technical effects to the methods provided in any of the above embodiments of this application, and will not be described again here.

[0146] Figure 9 This is a schematic diagram of the structure of an angle adjustment device provided in an embodiment of this application. Figure 9 As shown, the angle adjustment device provided in this embodiment includes: a current user identification module 901, a parameter acquisition module 902, a first display angle determination module 903, and an angle control module 904.

[0147] The current user identification module 901 is used to identify the current user after the terminal device is woken up; the parameter acquisition module 902 is used to detect the distance between the current user and the terminal device and the current ambient brightness if there is no historical operation record of the current user; the first display angle determination module 903 is used to determine the first display angle based on the distance between the current user and the terminal device; wherein, the first display angle is the angle between the line connecting the current user's eye and the center point of the terminal device's display and the display of the terminal device; the angle control module 904 is used to control the angle of the terminal device's display to the first display angle if the current ambient brightness is less than a preset brightness threshold.

[0148] Optionally, the angle adjustment device further includes a second display angle determining module, which is used for:

[0149] If the current ambient brightness is greater than or equal to a preset brightness threshold, the relative position of the light source and the terminal device is obtained; based on the relative position of the light source and the terminal device, the angle range of the terminal device is determined; if the angle of the first display is not within the angle range, the angle of the second display is determined based on the angle range; the angle of the display of the terminal device is controlled to be the angle of the second display.

[0150] Optionally, the angle of the second display is the angle with the smallest difference from the angle of the first display within the angle range.

[0151] Optionally, the current distance between the user and the terminal device includes eye distance and horizontal distance. Eye distance is the distance between the user's eyes and the terminal device, and horizontal distance is the distance between the user and the terminal device in the horizontal direction. The parameter acquisition module 902 includes an ambient brightness detection unit, an eye distance detection unit, and a horizontal distance detection unit, wherein:

[0152] The environmental detection unit is used to detect the current ambient brightness; the human eye distance detection unit is used to determine the human eye distance based on the current user's face image captured by the camera; and the horizontal distance detection unit is used to detect the horizontal distance using a distance sensor.

[0153] Optionally, this eye distance detection unit is specifically used for:

[0154] Based on the current user's facial image captured by the camera, the position of the current user's eyes is determined; based on the current user's eye position, the signal transmission direction of the first sensor is determined; based on the signal transmission direction, the first sensor collects a first distance value; and based on the first distance value, the distance to the human eye is calculated.

[0155] Optionally, the camera includes multiple eye distance detection units, specifically used for:

[0156] Based on the facial images of the current user captured by multiple cameras, a three-dimensional coordinate system including the current user and the terminal device is established; based on the three-dimensional coordinate system, the eye distance of the current user is determined.

[0157] Optionally, the angle adjustment device further includes a third display angle determining module, wherein the third display angle determining module is used for:

[0158] If the current user's operation record exists, the angle of the third display is determined based on the operation record, and the angle of the terminal device's display is controlled to be the angle of the third display.

[0159] Optionally, the angle adjustment device further includes a fourth display angle determining module, wherein the fourth display angle determining module is used for:

[0160] The angle of the fourth display is determined based on the current distance between the user and the terminal device, as well as the current ambient brightness.

[0161] If the difference between the angle of the third display and the angle of the fourth display is greater than or equal to the difference threshold, then the angle of the display of the control terminal device is the angle of the fourth display; if the difference is less than the difference threshold, then the angle of the display of the terminal device is not adjusted.

[0162] The angle adjustment device provided in this application embodiment can be used to execute the technical solution of the angle adjustment method provided in any of the above embodiments of this application. Its implementation principle and technical effect are similar, and will not be described again here.

[0163] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 10 As shown, the electronic device of this embodiment may include: at least one processor 1001; and a memory 1002 communicatively connected to the at least one processor; wherein the memory 1002 stores instructions that can be executed by the at least one processor 1001, and the instructions are executed by the at least one processor 1001 to cause the electronic device to perform the method as described in any of the above embodiments.

[0164] Optionally, the memory 1002 can be either standalone or integrated with the processor 1001. When the memory 1002 is set up independently, the device also includes a bus for connecting the memory 1002 and the processor 1001.

[0165] The implementation principle and technical effects of the electronic device provided in this embodiment can be found in the foregoing embodiments, and will not be repeated here.

[0166] This application also provides a computer-readable storage medium storing computer-executable instructions. When the computer-executable instructions are executed by a processor, the methods provided in any of the foregoing embodiments can be implemented.

[0167] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the method provided in any of the foregoing embodiments.

[0168] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to this application.

[0169] It should be further noted that although the steps in the flowchart are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowchart may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0170] It should be understood that the above-described device embodiments are merely illustrative, and the device of this application can also be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units, modules, or components may be combined, or integrated into another system, or some features may be ignored or not executed.

[0171] Furthermore, unless otherwise specified, the functional units / modules in the various embodiments of this application can be integrated into one unit / module, or each unit / module can exist physically separately, or two or more units / modules can be integrated together. The integrated units / modules described above can be implemented in hardware or as software program modules.

[0172] When integrated units / modules are implemented in hardware, the hardware can be digital circuits, analog circuits, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor can be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit can be any suitable magnetic or magneto-optical storage medium, such as Resistive Random Access Memory (RRAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), Enhanced Dynamic Random Access Memory (EDRAM), High-Bandwidth Memory (HBM), Hybrid Memory Cube (HMC), etc.

[0173] If the integrated unit / module is implemented as a software program module and sold or used as an independent product, it can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0174] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combination of these technical features does not contradict each other, it should be considered within the scope of this specification.

[0175] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0176] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. An angle adjustment method, characterized in that, include: After the terminal device is woken up, the current user is identified; If there is no historical operation record of the current user, then the distance between the current user and the terminal device and the current ambient brightness are detected; A first display angle is determined based on the distance between the current user and the terminal device; wherein, the first display angle is the angle at which the line connecting the current user's eye and the center point of the terminal device's display is perpendicular to the display of the terminal device. If the current ambient brightness is less than a preset brightness threshold, then the angle of the terminal device's display is controlled to be the first display angle.

2. The method according to claim 1, characterized in that, The method further includes: If the current ambient brightness is greater than or equal to the preset brightness threshold, then the relative position of the light source and the terminal device is obtained; The angle range of the terminal device is determined based on the relative position of the light source and the terminal device; If the angle of the first display is not within the angle range, then the angle of the second display is determined based on the angle range; The angle of the display of the terminal device is controlled to be the angle of the second display.

3. The method according to claim 2, characterized in that, The angle of the second display is the angle with the smallest difference from the angle of the first display within the specified angle range.

4. The method according to claim 1, characterized in that, The distance between the current user and the terminal device includes eye distance and horizontal distance. The eye distance is the distance between the current user's eyes and the terminal device, and the horizontal distance is the distance between the current user and the terminal device in the horizontal direction. The detection of the distance between the current user and the terminal device includes: The horizontal distance is detected by a distance sensor; The eye distance is determined based on the facial image of the current user captured by the camera.

5. The method according to claim 4, characterized in that, Determining the eye distance based on the current user's facial image captured by the camera includes: Based on the facial image of the current user captured by the camera, determine the position of the current user's eyes; Based on the current eye position of the user, the signal transmission direction of the first sensor is determined; The first sensor acquires a first distance value based on the signal emission direction; and calculates the human eye distance based on the first distance value.

6. The method according to claim 4, characterized in that, The camera includes multiple cameras, and determining the eye distance based on the current user's facial image captured by the camera includes: Based on the facial images of the current user captured by the multiple cameras, a three-dimensional coordinate system including the current user and the terminal device is established; The eye distance of the current user is determined based on the three-dimensional coordinate system.

7. The method according to any one of claims 1 to 6, characterized in that, The method further includes: If the current user's historical operation record exists, the third display angle is determined based on the historical operation record, and the angle of the terminal device's display is controlled to be the third display angle.

8. The method according to claim 7, characterized in that, After the angle of the display of the terminal device is controlled to be the third display angle, the method further includes: The angle of the fourth display is determined based on the distance between the current user and the terminal device and the current ambient brightness; If the difference between the angle of the third display and the angle of the fourth display is greater than or equal to the difference threshold, then the angle of the display of the terminal device is controlled to be the angle of the fourth display. If the difference is less than the difference threshold, the angle of the terminal device's display will not be adjusted.

9. An angle adjustment device, characterized in that, include: The current user identification module is used to identify the current user after the terminal device is woken up; The parameter acquisition module is used to detect the distance between the current user and the terminal device and the current ambient brightness if there is no historical operation record of the current user. The first display angle determination module is used to determine the first display angle based on the distance between the current user and the terminal device; wherein, the first display angle is the angle at which the line connecting the current user's eye and the center point of the terminal device's display is perpendicular to the display of the terminal device; An angle control module is used to control the angle of the terminal device's display to the first display angle if the current ambient brightness is less than a preset brightness threshold.

10. An electronic device, characterized in that, include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1 to 8.

11. An angle adjustment system, characterized in that, include: Support structure and control module; The support mechanism is used to support the display of the terminal device and to adjust the angle of the display of the terminal device under control. The control module is used to execute the method according to any one of claims 1 to 8, and to adjust the angle of the terminal device by controlling the support mechanism.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1 to 8.

13. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method of any one of claims 1 to 8.

Images