Screen control method of wrist device and electronic device
By detecting the user's wrist lifting and wrist dropping movements, and combining face direction information and screen angles, accurately controlling the screen light and turn-off of wrist-type devices, the problem of low screen control accuracy in the existing technology is solved and the equipment is improved Battery life and screen life.
Patent Information
- Application Number
- CN202411432073.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-14
- Publication Date
- 2025-02-14
AI Technical Summary
The screen control methods of existing wrist-type devices are relatively low in accuracy, and it is impossible to accurately determine whether the user needs to view the screen, resulting in unnecessary screen light and screen out.
By detecting the user's wrist lifting and wrist dropping movements, the face direction information and horizontal angle of the user wearing the head-mounted device are obtained, and combined with the horizontal angle of the screen of the wrist-type device, the angle between the screen and the face is determined. The screen is controlled to be in a illuminated state only if the angle does not exceed the user's visible angle.
Improves the accuracy of screen control, reduces unnecessary screen light and screen out times, reduces device power consumption, and extends the screen service life.
Smart Images

Figure CN119440447A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of electronic devices, and in particular relates to a screen control method for a wrist device and an electronic device. Background Art
[0002] With the continuous development of smart wearable devices, wearable devices are becoming more and more diverse. Wearable devices can include wrist devices worn on the wrist, head-mounted devices worn on the head, etc. For wrist devices, screen control of wrist devices is performed to improve device life.
[0003] In the related art, when the user is detected to be raising his wrist, it is directly determined that the user needs to check the screen at this time, and the screen is directly controlled to turn on. When the user is detected to be lowering his wrist, it is directly determined that the user does not need to check the screen at this time, and the screen is directly controlled to turn off. However, sometimes the user may not need to check the screen when raising his wrist, and may need to continue to check the screen when lowering his wrist. Therefore, the accuracy of screen control in this way is low. Summary of the invention
[0004] The purpose of the embodiments of the present application is to provide a screen control method and electronic device for a wrist device, which can solve the problem of low screen control accuracy.
[0005] In a first aspect, an embodiment of the present application provides a screen control method for a wrist device, the method comprising:
[0006] When detecting that the user performs a wrist-raising action or a wrist-dropping action, acquiring the face direction information and the face horizontal angle of the user detected by the target device; the target device is a head-mounted device currently worn by the user;
[0007] Based on the facial direction information, the horizontal angle of the face, and the horizontal angle of the screen of the wrist device, determine the angle between the screen and the face to obtain a target angle;
[0008] When the target angle does not exceed the visual angle of the user, the screen is controlled to be in a bright screen state.
[0009] In a second aspect, an embodiment of the present application provides a screen control device for a wrist device, the device comprising:
[0010] an acquisition module, configured to acquire, when detecting that the user performs a wrist-raising action or a wrist-dropping action, the user's face direction information and the face horizontal angle detected by a target device; the target device is a head-mounted device currently worn by the user;
[0011] A first determination module, configured to determine an angle between the screen and the face based on the face direction information, the face horizontal angle, and the screen horizontal angle of the wrist device, to obtain a target angle;
[0012] The first control module is used to control the screen to be in a bright screen state when the target angle does not exceed the visual angle of the user.
[0013] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the screen control method of the wrist device as described in the first aspect are implemented.
[0014] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the screen control method of the wrist device as described in the first aspect are implemented.
[0015] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the screen control method of the wrist device as described in the first aspect.
[0016] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the screen control method of a wrist device as described in the first aspect.
[0017] In an embodiment of the present application, when it is detected that the user performs a wrist-raising or wrist-dropping action, the face direction information and the horizontal angle of the face detected by the target device are obtained; the target device is the head-mounted device currently worn by the user. Based on the face direction information, the horizontal angle of the face, and the horizontal angle of the screen of the wrist device, the angle between the screen and the face is determined to obtain the target angle. When the target angle does not exceed the user's visual angle, the screen is controlled to be in a bright screen state. In this way, the wrist device is linked with the head-mounted device, and when it is detected that the user performs a wrist-raising or wrist-dropping action, the face direction information and the horizontal angle of the face detected by the target device are further obtained, and the target angle between the screen of the wrist device and the user's face is determined based on the face direction information, the horizontal angle of the face, and the horizontal angle of the screen of the wrist device. In this way, in the case of the user performing a wrist-raising action, the screen is controlled to be in a bright screen state only when the target angle does not exceed the user's visual angle, so as to avoid controlling the screen to be bright when the user does not need to view the screen. When the user performs a wrist drop action, the screen is controlled to be in a light state when the target angle does not exceed the user's visual angle, so as to avoid turning off the screen when the user still needs to view the screen. Therefore, the accuracy of screen control can be improved.
[0018] Furthermore, by avoiding controlling the screen to light up when the user does not need to view the screen, the number of unnecessary screen lighting of the wrist device can be reduced, and the rate of false screen lighting can be reduced. By avoiding controlling the screen to turn off when the user still needs to view the screen, the number of unnecessary screen turning off of the wrist device can be reduced, and the rate of false screen turning off can be reduced, thereby reducing device power consumption, improving device battery life, increasing standby time, and extending screen life. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 is a flowchart of the steps of the screen control method of the wrist device provided by an embodiment of the present application;
[0020] Figure 2 It is a control flow diagram provided by an embodiment of the present application;
[0021] Figure 3 is a schematic diagram of the maximum viewing angle of the human eye provided by an embodiment of the present application;
[0022] Figure 4 is a schematic diagram of a first target angle provided in an embodiment of the present application;
[0023] Figure 5 This is an angle schematic diagram provided in an embodiment of the present application;
[0024] Figure 6 is a block diagram of a screen control device for a wrist device provided in an embodiment of the present application;
[0025] Figure 7 It is one of the structural schematic diagrams of the electronic device provided in the embodiment of the present application;
[0026] Figure 8 This is the second structural schematic diagram of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION
[0027] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0028] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0029] An embodiment of the present application provides a screen control method for a wrist device, which can be applied to a wrist device. The wrist device can be a wearable device with a display screen worn on the wrist, such as a smart watch, a smart bracelet, etc. With the continuous development of smart wearable devices, wrist devices are becoming more and more popular. In order to save device power consumption and increase device usage time, the wrist device controls the screen to be in an off state most of the time. In the off state, no information is displayed on the screen or only basic information such as time and date is displayed. However, in this state, the user cannot obtain enough information from the wrist device. Therefore, wrist devices often add the functions of raising the wrist to light up the screen and lowering the wrist to turn off the screen.
[0030] Raise the wrist to light up the screen and drop the wrist to turn off the screen. The sensor on the wrist device detects the user's wrist movement trajectory, identifies the wrist raising movement or the wrist dropping movement, and directly performs the corresponding operation when the sensor detects that the user is raising the wrist or dropping the wrist. Specifically, when the wrist raising movement is detected, the screen is directly controlled to light up. When the wrist dropping movement is detected, the screen is directly controlled to turn off the screen. However, the essence of controlling the screen to light up is to enable the user to view the content displayed on the screen, but the user may not need to view the screen when the wrist raising movement is detected. For example, when the user raises his hand to touch the top of his head, the wrist device will detect the wrist raising movement, but the user does not need to view the screen at this time. The essence of controlling the screen to turn off the screen is to avoid unnecessary display when the user does not need to view the content displayed on the screen, but the user may still need to view the screen when the wrist dropping movement is detected. Therefore, in this control method, unnecessary screen lighting and screen turning off will be performed, and the accuracy of screen control is low. To this end, the embodiment of the present application provides a screen control method for a wrist device to improve the accuracy of screen control.
[0031] The screen control method of the wrist device provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.
[0032] Figure 1 is a flowchart of the steps of the screen control method of the wrist device provided in the embodiment of the present application, such as Figure 1 As shown, the method includes:
[0033] Step 101, when it is detected that the user performs a wrist raising action or a wrist lowering action, obtain the face direction information and the horizontal angle of the face of the user detected by a target device; the target device is a head-mounted device currently worn by the user.
[0034] Step 102: Based on the facial direction information, the horizontal angle of the face, and the horizontal angle of the screen of the wrist device, determine the angle between the screen and the face to obtain a target angle.
[0035] Step 103, when the target angle does not exceed the visual angle of the user, control the screen to be in a bright screen state.
[0036] In the embodiment of the present application, the wrist device can detect the user's wrist movement trajectory, and when the detected wrist movement trajectory meets the preset wrist raising trajectory feature, it is determined that the user is detected to perform a wrist raising action. When the detected wrist movement trajectory meets the preset wrist dropping trajectory feature, it is determined that the user is detected to perform a wrist dropping action. Of course, other detection methods can also be used for detection, and the embodiment of the present application is not limited to this. The target device can be a head-mounted device worn by the user wearing the wrist device. The target device can be specifically a head-mounted device worn on the head and capable of detecting facial direction information and facial horizontal angle. Exemplarily, the target device can be headphones, smart glasses, etc. When the user uses the target device, the target device can detect facial direction information and facial horizontal angle based on internal sensors. Among them, the facial direction information can represent the direction viewed by the user's eyes, and the facial horizontal angle can represent the angle formed between the user's face and the horizontal plane, representing the horizontal state of the face. When the user looks at different positions, the facial direction information and the facial horizontal angle will change, and accordingly, the angle between the screen and the face will be affected. The size of the angle between the screen and the face determines whether the user's eyes can see the screen. In actual application scenarios, users often move their heads and wrists so that their eyes can see the screen when they need to view the screen. When there is no need to view the screen, move the head and wrist so that the eyes cannot see the screen. Therefore, by obtaining facial direction information and the horizontal angle of the face, it can be used to determine whether the user needs to view the wrist device. In an embodiment of the present application, when it is detected that the user is raising or lowering his wrist, the screen may not be controlled to turn on or off first, but the facial direction information and the horizontal angle of the face may be obtained first to further determine whether the user currently needs to view the screen of the wrist device.
[0037] In an embodiment of the present application, the horizontal angle of the screen of the wrist device can be detected by the wrist device, and the horizontal angle of the screen of the wrist device can represent the angle formed between the screen of the wrist device and the horizontal plane. When the user's wrist is in different positions, the horizontal angle of the screen of the wrist device may change, which will accordingly affect the angle between the screen and the face. Therefore, the angle between the screen and the face can be determined as the target angle in combination with the facial direction information, the horizontal angle of the face, and the horizontal angle of the screen of the wrist device. Based on the target angle, it is further determined whether the user needs to view the wrist device.
[0038] Specifically, the target angle can be compared with the user's visual angle to determine whether the user needs to view the wrist device. The visual angle can be the visual angle of the human eye, that is, the degree of the visual angle of the naked eye of the human. Accordingly, if the target angle exceeds the user's visual angle, it means that the angle between the screen and the face is not appropriate, and the wrist device is not within the visible range of the user's human eyes. At this time, it can be considered that the user does not need to view the screen. If the target angle does not exceed the user's visual angle, it means that the angle between the screen and the face is appropriate, and the wrist device is within the visible range of the user's human eyes. At this time, it can be considered that the user needs to view the screen. Therefore, the screen can be controlled to be in a bright screen state when the target angle does not exceed the user's visual angle. Specifically, if a wrist-raising action is detected, the screen is controlled to be in a bright screen state when the target angle does not exceed the user's visual angle. To a certain extent, it can be ensured that the screen is bright when the user needs to view the screen, avoiding unnecessary bright screen execution. If a wrist-dropping action is detected, the screen is controlled to be in a bright screen state when the target angle does not exceed the user's visual angle, which is equivalent to avoiding unnecessary screen off.
[0039] In summary, in the embodiment of the present application, when it is detected that the user performs a wrist-raising or wrist-dropping action, the face direction information and the horizontal angle of the face detected by the target device are obtained; the target device is the head-mounted device currently worn by the user. Based on the face direction information, the horizontal angle of the face, and the horizontal angle of the screen of the wrist device, the angle between the screen and the face is determined to obtain the target angle. When the target angle does not exceed the user's visual angle, the screen is controlled to be in a bright screen state. In this way, the wrist device is linked with the head-mounted device, and when it is detected that the user performs a wrist-raising or wrist-dropping action, the face direction information and the horizontal angle of the face detected by the target device are further obtained, and the target angle between the screen of the wrist device and the user's face is determined based on the face direction information, the horizontal angle of the face, and the horizontal angle of the screen of the wrist device. In this way, in the case of the user performing a wrist-raising action, the screen is controlled to be in a bright screen state only when the target angle does not exceed the user's visual angle, so as to avoid controlling the screen to be bright when the user does not need to view the screen. When the user performs a wrist drop action, the screen is controlled to be in a light state when the target angle does not exceed the user's visual angle, so as to avoid turning off the screen when the user still needs to view the screen. Therefore, the accuracy of screen control can be improved.
[0040] Furthermore, by avoiding controlling the screen to light up when the user does not need to view the screen, the number of unnecessary screen lighting of the wrist device can be reduced, and the rate of false screen lighting can be reduced. By avoiding controlling the screen to turn off when the user still needs to view the screen, the number of unnecessary screen turning off of the wrist device can be reduced, and the rate of false screen turning off can be reduced, thereby reducing device power consumption, improving device battery life, increasing standby time, and extending screen life.
[0041] Optionally, the embodiment of the present application may further include the following steps:
[0042] Step S21: establishing a communication connection with the target device, and receiving face direction information and face horizontal angle synchronized by the target device based on the communication connection.
[0043] Accordingly, the step of obtaining the face direction information and the face horizontal angle of the user detected by the target device may specifically include:
[0044] Step 1011, reading the most recently received face direction information and the most recently received face horizontal angle from the received face direction information and face horizontal angle.
[0045] In an embodiment of the present application, the step of establishing a communication connection may be performed before the above-mentioned step 101, and the communication connection with the target device may be a wireless connection, and the facial direction information and the horizontal angle of the face may be synchronized based on the wireless signal. Specifically, the communication connection between the wrist device and the target device may be a direct connection. For example, a Bluetooth connection or an Ultra Wide Band (UWB) connection may be directly established between the wrist device and the target device. Accordingly, the target device may send the detected facial direction information and the horizontal angle of the face directly to the wrist device to achieve synchronization. Alternatively, the communication connection between the wrist device and the target device may be an indirect connection. For example, the wrist device and the target device may be connected to the same terminal device, for example, the wrist device and the target device are connected to the same mobile phone. Accordingly, the target device may first send the detected facial direction information and the horizontal angle of the face to the terminal device, which is then forwarded to the wrist device by the terminal device to achieve synchronization.
[0046] For example, the wrist device and head mounted device of the same user are often connected to the same terminal device, for example, the user's mobile phone. Therefore, the mobile phone will include the connection information of the wrist device and the head mounted device. The connection information may include a device identification (Identity, ID), a media access control (MAC) address, a security key, device parameters, and the like. Accordingly, the mobile phone may send the connection information of the head-mounted device to the wrist device, and send the connection information of the wrist device to the head-mounted device. Alternatively, the wrist device and the target device may also request a device list corresponding to the user account from a preset server. For example, a request may be made from a preset server when the same terminal device is not connected. The device list includes the connection information of the wrist device and the head-mounted device. Accordingly, the wrist device may send a connection request based on the connection information of the target device, and the target device may directly establish a connection based on the connection information of the wrist device in response to the connection request, thereby establishing a communication connection with the target device. Furthermore, if the connection information of the target device is not obtained, a connection interface may be displayed, and the user may first manually select a head-mounted device that he or she is wearing as the target device, and manually control the connection. Accordingly, a connection may be automatically established with the target device later.
[0047] After establishing the communication connection, the target device can synchronize the facial direction information and the facial horizontal angle in real time. Exemplarily, the target device can detect the facial direction information and the facial horizontal angle once every preset time interval, and send the detected facial direction information and the facial horizontal angle through the established communication connection. Accordingly, when it is detected that the user performs a wrist raising or wrist lowering action, the facial direction information and the facial horizontal angle received most recently can be read. Exemplarily, each time the facial direction information and the facial horizontal angle are received, the facial direction information and the facial horizontal angle received most recently can be used to overwrite the previous facial direction information and the facial horizontal angle. Accordingly, the currently stored facial direction information and the facial horizontal angle can be directly read to obtain the facial direction information and the facial horizontal angle received most recently.
[0048] Alternatively, the face direction information and the face horizontal angle received multiple times may be stored. Accordingly, the face direction information and the face horizontal angle whose receiving time is closest to the current time may be read according to the receiving time of each received face direction information and face horizontal angle. For example, there are currently stored three face direction information: face direction information 1, face direction information 2 and face direction information 3, and three face horizontal angles: face horizontal angle 1, face horizontal angle 2 and face horizontal angle 3. Among them, the receiving time of face direction information 1 and face horizontal angle 1 is 1 second from the current time, the receiving time of face direction information 2 and face horizontal angle 2 is 2 seconds from the current time, and the receiving time of face direction information 3 and face horizontal angle 3 is 3 seconds from the current time. Then the face direction information 1 and the face horizontal angle 1 may be read, and the face direction information 1 and the face horizontal angle 1 may be used to calculate the target angle later.
[0049] In the embodiment of the present application, a communication connection is first established with the target device, and the face direction information and the face horizontal angle synchronized by the target device based on the communication connection are received. In this way, by reading the face direction information and the face horizontal angle received the most recently from the received face direction information and the face horizontal angle, the face direction information and the face horizontal angle of the user detected by the target device can be obtained, and the acquisition efficiency is high. And by reading the face direction information and the face horizontal angle received the most recently, the timeliness of the information used in the subsequent processing can be ensured.
[0050] Optionally, the embodiment of the present application may further include the following steps:
[0051] Step S31, determining the distance between the wrist device and the face.
[0052] When the target angle does not exceed the visual angle of the user, controlling the screen to be in a bright screen state may specifically include:
[0053] Step 1031, when the target angle does not exceed the viewing angle and the distance does not exceed the preset distance threshold, if the wrist raising action is detected, the screen is controlled to switch to the bright screen state; and if the wrist lowering action is detected, the screen is controlled to continue to maintain the bright screen state.
[0054] In an embodiment of the present application, the operation of determining the distance between the wrist device and the face can be specifically performed when it is detected that the target angle does not exceed the visual angle. In this way, it is possible to avoid performing unnecessary distance determination operations when the target angle exceeds the visual angle. Of course, the operation of determining the distance can also be performed first, or the operation of determining the distance can be performed synchronously, and the embodiment of the present application is not limited to this. Specifically, the distance between the wrist device and the target device can be detected based on Bluetooth ranging technology or UWB ranging technology as the device distance. Since the target device is worn on the user's head, the device distance can represent the distance between the wrist device and the face. Of course, in order to improve the accuracy of the distance, the device distance can also be corrected as the distance between the wrist device and the face. Exemplarily, the distance correction value corresponding to the target device can be obtained, wherein the distance correction value can be set in advance according to the distance between the wearing position of the device on the head and the user's eye position. The distance correction value corresponding to the target device is added to the device distance. Alternatively, the distance between the wrist device and the face can also be calculated based on the relative position coordinates of the face relative to the wrist device. Exemplarily, the sum of the squares of the coordinate values in the relative position coordinates may be calculated, and then a square root operation may be performed on the sum of the squares to obtain the distance between the wrist device and the face.
[0055] Further, the preset distance threshold may be pre-set, and the preset distance threshold may represent the maximum distance between the wrist device and the face when the face is viewing the screen. In actual application scenarios, users often move their heads and wrists to bring the wrist device closer to the face when they need to view the screen, so that the position of the face is suitable for viewing the screen of the wrist device. When the screen does not need to be viewed, the head and wrist are moved to bring the wrist device closer to the face, so that the position of the face is not suitable for viewing the screen of the wrist device. Accordingly, if the distance between the wrist device and the face is too large, that is, the distance between the wrist device and the face exceeds the preset distance threshold, it means that the position of the face is not suitable for viewing the screen of the wrist device. If the distance between the wrist device and the face is appropriate, that is, the distance between the wrist device and the face does not exceed the preset distance threshold, it means that the position of the face is suitable for viewing the screen of the wrist device. Therefore, the screen can be controlled to be in a bright screen state when the target angle does not exceed the viewing angle and the distance does not exceed the preset distance threshold. Among them, for the two cases of wrist raising action and wrist dropping action, the implementation method of controlling the screen to be in a bright screen state can be specifically as follows:
[0056] Regarding the wrist-raising action, that is, in step 101, the user is detected to be raising his wrist. In this case, the screen itself is often in an off state, and controlling the screen to be in a bright state can specifically be controlling the screen to switch to a bright state. Exemplarily, a screen-lighting instruction can be generated to control the screen to switch from an off state to a bright state. In the related art, when a user is detected to be raising his wrist, a screen-lighting instruction is often directly generated to control the screen to light up. In the embodiment of the present application, a screen-lighting instruction is generated only when the user is detected to be raising his wrist, and the target angle does not exceed the viewing angle, and the distance does not exceed the preset distance threshold. Taking the wrist-raising action as an example, Figure 2 is a control flow diagram provided in an embodiment of the present application, such as Figure 2 As shown, after detecting the wrist-raising action, it can be determined whether the target angle exceeds the user's visual angle. If it exceeds, the screen will not be lit, that is, the screen will continue to be in the off state. If it does not exceed, it is further determined whether the distance between the wrist device and the face exceeds the preset distance threshold. If not, the screen will be lit, that is, the screen will be controlled to enter the screen-on state. If yes, the screen will not be lit, that is, the screen will continue to be in the off state.
[0057] For the wrist drop action, that is, in step 101, the user is detected to be performing a wrist drop action. In this case, the screen itself is often in a bright screen state. In the related technology, a screen-off instruction is often directly generated to control the screen to be dimmed. In the embodiment of the present application, when the user is detected to be performing a wrist drop action, and the target angle does not exceed the visual angle, and the distance does not exceed the preset distance threshold, the screen can be controlled to continue to remain in a bright screen state by not generating a screen-off instruction. In this way, the screen can be controlled to be in a bright screen state by not generating a screen-off instruction, which can save the processing resources of the device.
[0058] In the embodiment of the present application, by further determining the distance between the wrist device and the face, the screen is controlled to be in the on state only when the target angle does not exceed the viewing angle and the distance does not exceed the preset distance threshold. In this way, it is possible to avoid controlling the screen to be on when the user does not need to view the screen, and to avoid controlling the screen to be off when the user still needs to view the screen, which can further improve the accuracy of screen control.
[0059] Optionally, in the embodiment of the present application, when the target angle exceeds the user's visual angle, the screen can be controlled to be in a screen-off state. Specifically, the embodiment of the present application can also include the following steps:
[0060] Step S41, when the target angle exceeds the viewing angle or the distance exceeds the preset distance threshold, if the wrist raising action is detected, the screen is controlled to continue to remain in the screen-off state; and, if the wrist lowering action is detected, the screen is controlled to switch to the screen-off state.
[0061] In an embodiment of the present application, as long as the target angle exceeds the viewing angle, or the distance exceeds the preset distance threshold, the screen will not be turned on. That is to say, if only the target angle is detected to exceed the viewing angle, or only the distance is detected to exceed the preset distance threshold, or if the target angle is detected to exceed the viewing angle and the distance exceeds the preset distance threshold, the screen will be controlled to be in an off-screen state. Specifically, for the wrist-raising action, that is, step 101 detects that the user is raising his wrist. In this case, the screen itself is often in an off-screen state, and the related technology often directly generates a screen-lighting instruction to control the screen to light up. In an embodiment of the present application, when it is detected that the user is raising his wrist, and the target angle exceeds the viewing angle or the distance exceeds the preset distance threshold, the screen can be controlled to continue to remain in an off-screen state by not generating a screen-lighting instruction. In this way, the screen can be controlled to turn off by not generating a screen-lighting instruction, which can save the processing resources of the device. Regarding the wrist drop action, that is, in step 101, the user is detected to perform a wrist drop action. In this case, the screen itself is often in a bright screen state. In the embodiment of the present application, when the user is detected to perform a wrist drop action and the target angle exceeds the visual angle or the distance exceeds the preset distance threshold, controlling the screen to turn off the screen can specifically control the screen to switch to a bright screen state. Exemplarily, a screen-off instruction can be generated to control the screen to switch from a bright screen state to a bright screen state.
[0062] In this way, when the user raises his wrist, if the target angle exceeds the user's visual angle or the distance exceeds the preset distance threshold, the screen is controlled to remain in the off state, which can avoid controlling the screen to light up when the user does not need to view the screen. When the user lowers his wrist, the screen is controlled to be in the off state only when the target angle exceeds the user's visual angle or the distance exceeds the preset distance threshold. To a certain extent, it can ensure that the screen is turned off when the user does not need to view the screen, which can further improve the accuracy of screen control.
[0063] Optionally, in the embodiment of the present application, the target angle may include a first target angle and a second target angle. The above-mentioned determination of the angle between the screen and the face based on the face direction information, the face horizontal angle and the screen horizontal angle of the wrist device to obtain the target angle may specifically include:
[0064] Step 1021: Acquire device location information of the target device, and determine facial location information of the face based on the device location information.
[0065] Step 1022: Based on the face direction information and the face position information, determine the angle between the screen and the face in the horizontal direction of the human eye to obtain the first target angle.
[0066] Step 1023: Based on the horizontal angle of the face and the horizontal angle of the screen, determine the angle between the screen and the face in the vertical direction of the human eye to obtain the second target angle.
[0067] Among them, the device location information of the target device can be the location coordinates of the target device. The wrist device can use the internal antenna array to obtain the relative location coordinates of the target device based on the wireless positioning technology. Exemplarily, in the case of Bluetooth connection with the target device, positioning can be performed based on the angle of arrival (AOA) / angle of emission (AOD) positioning technology supported by Bluetooth, or, in the case of UWB connection with the target device, positioning can be performed based on the positioning technology supported by UWB. During specific positioning, the coordinate position of the target device in the instruction coordinate system can be located according to the specified coordinate system as a reference. Among them, the specified coordinate system uses the screen center of the wrist device as the coordinate origin, and the direction of each coordinate axis can be set as required. Exemplarily, the horizontal direction along the screen surface can be the X-axis, the vertical direction along the screen surface can be the Y-axis, and the direction perpendicular to the screen surface can be the Z-axis. The embodiment of the present application does not limit this. Accordingly, the location coordinates of the target device obtained by positioning can characterize the orientation of the target device relative to the wrist device. Alternatively, the target device can also locate the center of the screen, determine its own coordinate value in the specified coordinate system according to the specified coordinate system, as the device location information, and synchronize the determined device location information. Accordingly, the device location information of the target device may be acquired by receiving the synchronized device location information.
[0068] Furthermore, the facial position information is used to characterize the relative position of the face relative to the wrist device, and can be corrected based on the position coordinates of the target device to obtain the facial position information. Exemplarily, the preset coordinate correction value corresponding to the target device can be added to the position coordinates of the target device to obtain the facial position information. Among them, the preset coordinate correction value is set according to the wearing position of the head-mounted device, and the wearing position of the head-mounted device is often fixed. For example, for headphones, the wearing position is often the ear, and for smart glasses, the wearing position is often the eye. Exemplarily, the preset coordinate correction value can be set in advance based on the relative distance between the wearing position and the center of the face.
[0069] The horizontal direction of the human eye refers to the direction corresponding to the cross section of the head, and the vertical direction of the human eye refers to the direction corresponding to the longitudinal section of the head. When the human eye is viewing, the viewing angle in the horizontal direction is limited, the viewing angle in the vertical direction is limited, and the viewing angle in the horizontal direction is different from the viewing angle in the vertical direction. Therefore, in the embodiment of the present application, the angle between the screen and the face in the horizontal direction of the human eye and the vertical direction of the human eye is determined as the target angle, which can facilitate the subsequent more accurate determination of whether the target angle exceeds the user's viewing angle.
[0070] Optionally, the embodiment of the present application may further include the following steps:
[0071] Step S51, comparing the first target angle with a first preset angle, and comparing the second target angle with a second preset angle; the first preset angle is used to characterize the maximum viewing angle of the human eye in the horizontal direction of the human eye, and the second preset angle is used to characterize the maximum viewing angle of the human eye in the vertical direction of the human eye.
[0072] Step S52: If the first target angle does not exceed the first preset angle, and the second target angle does not exceed the second preset angle, it is determined that the target angle does not exceed the user's visual angle.
[0073] Specifically, Figure 3 is a schematic diagram of the maximum viewing angle of the human eye provided by an embodiment of the present application, such as Figure 3 As shown, when the human eye views an object, there are 94° viewing angles on both sides of the center of the human eye in the horizontal direction of the human eye, and 30° viewing angles on both sides of the upper and lower sides of the human eye line of sight in the vertical direction of the human eye, that is, the maximum horizontal effective viewing angle of both eyes in the horizontal direction of the human eye is 188°, and the maximum vertical effective viewing angle of both eyes in the vertical direction of the human eye is 60°. Accordingly, the first preset angle can be 94°, and the second preset angle can be 30°.
[0074] After obtaining the first target angle, the first target angle can be compared with the first preset angle. If the first target angle is not greater than the first preset angle, it can be determined that the first target angle does not exceed the first preset angle. On the contrary, if the first target angle is greater than the first preset angle, it can be determined that the first target angle exceeds the first preset angle. After obtaining the second target angle, the second target angle can be compared with the second preset angle. If the second target angle is not greater than the second preset angle, it can be determined that the second target angle does not exceed the second preset angle. On the contrary, if the second target angle is greater than the second preset angle, it can be determined that the second target angle exceeds the second preset angle. Correspondingly, if the first target angle exceeds the first preset angle, or the second target angle exceeds the second preset angle, it is determined that the target angle exceeds the user's visual angle. In specific implementation, the first target angle can be determined first, and if the first target angle is not greater than the first preset angle, the second target angle is determined and compared based on the second target angle. Alternatively, the second target angle may be determined first, and if the second target angle is not greater than the second preset angle, the first target angle may be determined and compared based on the first target angle. In this way, unnecessary operations may be avoided and processing resources may be saved.
[0075] In the embodiment of the present application, by comparing the first target angle with the first preset angle, and comparing the second target angle with the second preset angle. If the first target angle does not exceed the first preset angle, and the second target angle does not exceed the second preset angle, it can be determined that the target angle does not exceed the user's visual angle. In this way, the efficiency of determining whether the target angle exceeds the visual angle is high.
[0076] Optionally, in the embodiment of the present application, the facial position information includes the relative position coordinates of the face relative to the wrist device, and the facial direction information includes the orientation coordinates of the face. The above-mentioned determination of the angle between the screen and the face in the horizontal direction of the human eye based on the facial direction information and the facial position information may specifically include:
[0077] Step 1022a: constructing a face position vector and a face orientation vector of the user based on the relative position coordinates and the orientation coordinates respectively; the face position vector represents a vector pointing from the screen to the face.
[0078] Step 1022b: Determine the angle between the screen and the face in the horizontal direction of the human eye based on the vector angle between the face position vector and the face orientation vector.
[0079] In the embodiment of the present application, the relative position coordinates may represent the position coordinates of the face in a specified coordinate system. Accordingly, the center of the screen is used as the origin, and the center of the screen is connected to the position represented by the relative position coordinates to obtain the face position vector. Assuming that the relative position coordinates are (x1, y1, z1), the face position vector may be vector A(x1, y1, z1).
[0080] The orientation coordinates can be obtained by the target device in the following manner: the target device calculates the attitude angle based on the data collected by the built-in geomagnetic sensor. Then, a rotation matrix is constructed based on the attitude angle, and then the product of the rotation matrix and the unit vector is calculated to obtain the orientation coordinates relative to the specified coordinate system. Among them, the direction of the coordinate axis corresponding to the unit vector is the face orientation. Correspondingly, the orientation coordinates can be the orientation coordinates relative to the specified coordinate system, so that the face orientation vector can represent the unit vector pointing from the screen to the face orientation. Assuming the orientation coordinates are (x2, y2, z2), the orientation coordinates can be marked as the face orientation vector, and B represents the face orientation vector, and the vector B(x2, y2, z2) can be obtained.
[0081] Furthermore, the vector values of the face position vector and the face orientation vector can be substituted into a preset vector calculation formula to calculate the cosine value of the vector angle. For example, D represents the vector angle, Among them, ‖A‖ represents the sum of the squares of the coordinate values in (x1, y1, z1) (i.e. x12 +y1 2 +z1 2 ) is squared, and ‖B‖ represents the sum of the squares of the coordinate values in (x2, y2, z2) (i.e. x2 2 +y2 2 +z2 2 ) is squared. D is calculated based on the cosine value, D=arccos(D). Next, the complementary angle of the vector angle can be calculated to obtain the first target angle. Specifically, 180-D can be calculated as the first target angle. Figure 4 Schematic diagram of a first target angle provided in an embodiment of the present application. Figure 4 As shown, the vector angle D between the face position vector A and the face orientation vector B can be calculated first. Then, the supplementary angle of the vector angle D is calculated to obtain the first target angle C.
[0082] In the embodiment of the present application, the user's face position vector and face orientation vector are constructed based on the relative position coordinates and the orientation coordinates. Based on the vector angle between the face position vector and the face orientation vector, the angle between the screen and the face in the horizontal direction of the human eye can be calculated, so that the efficiency of determining the first target angle can be ensured to a certain extent.
[0083] Optionally, in the embodiment of the present application, determining the angle between the screen and the face in the vertical direction of the human eye based on the horizontal angle of the face and the horizontal angle of the screen may specifically include:
[0084] Step 1023a, determining the angle between the plane normal of the screen and the horizontal plane as the horizontal angle of the screen.
[0085] Step 1023b, determining the angle between the screen and the face in the direction perpendicular to the human eye based on the sum of the horizontal angle of the screen and the horizontal angle of the face; the horizontal angle of the face represents the angle between the plane normal of the face and the horizontal plane.
[0086] Specifically, the horizontal angle of the device detected by the sensor in the wrist device can be read. The sensor can be a sensor such as a gyroscope or a spirit level that can detect angles. The data detected by the sensor can be processed to obtain the horizontal angle of the device. The horizontal angle of the device can characterize the angle between the sensor that detects the angle in the wrist device and the horizontal plane. In order to ensure accuracy, the horizontal angle of the device can be corrected based on preset angle correction parameters to obtain the horizontal angle of the screen. The angle correction parameter is pre-set based on the setting position of the sensor in the wrist device and the relative deviation between it and the plane normal of the screen. The angle correction parameter can be preset when the device leaves the factory. Exemplarily, the sum of the horizontal angle of the device and the angle correction parameter can be calculated to obtain the horizontal angle of the screen.
[0087] The horizontal angle of the face can be obtained by the target device reading the horizontal angle of the device detected by the sensor in the target device, and correcting the horizontal angle of the device based on the angle correction parameters preset in the target device. Among them, the sensor can be a sensor that can detect the angle, such as a gyroscope or a level meter. The data detected by the sensor can be processed to obtain the horizontal angle of the device of the target device. The horizontal angle of the device of the target device can represent the angle between the sensor that detects the angle in the target device and the horizontal plane. In order to ensure accuracy, the horizontal angle of the device can be corrected based on the angle correction parameters preset in the target device to obtain the horizontal angle of the face. Among them, the angle correction parameters preset in the target device are pre-set according to the setting position of the sensor in the target device and the relative deviation between it and the plane normal of the face. The angle correction parameters can be preset when the device leaves the factory. Exemplarily, the sum of the horizontal angle of the device of the target device and the angle correction parameter can be calculated to obtain the horizontal angle of the face.
[0088] Since the horizontal angle of the screen and the horizontal angle of the face are both angles relative to the same horizontal plane, the two have a common reference system. Therefore, the absolute value of the sum of the horizontal angle of the screen and the horizontal angle of the face can represent the angle between the screen and the face. Specifically, the absolute value of the sum of the horizontal angle of the screen and the horizontal angle of the face can represent the angle between the plane normal of the screen and the plane normal of the face, and accordingly, the absolute value of the sum of the two can reflect the angle between the screen and the face in the vertical direction of the human eye. Take the wrist device as a smart watch as an example. Figure 5 This is a schematic diagram of an angle provided in an embodiment of the present application, such as Figure 5 As shown in FIG. 1 , the X1 axis and the X2 axis correspond to the horizontal orientation of the face and the horizontal orientation of the watch, respectively, and the Y1 axis and the Y2 axis correspond to the vertical orientation of the face and the vertical orientation of the watch, respectively. The plane corresponding to the horizontal orientation of the X1 axis and the X2 axis is the aforementioned horizontal plane. Accordingly, the horizontal angle of the face can be Figure 5 In A1, the horizontal angle of the screen can be Figure 5 In A2, the second target angle can be │A1+A2│. Assuming that it has been determined that the first target angle does not exceed the first preset angle, then if │A1+A2│ is greater than 30 degrees, the human eye will not be able to see the watch screen clearly, and accordingly, the screen can be controlled to be in an off state. If │A1+A2│ is not greater than 30 degrees, the screen can be controlled to be in an on state. Specifically, A2 can be a positive value when the screen is horizontally facing upward, and a negative value when the screen is horizontally facing downward. A1 can be a positive value when the face is horizontally facing upward, and A1 can be a negative value when the face is horizontally facing downward.
[0089] In one application scenario, it is assumed that the user sits with his face perpendicular to the horizontal plane, and adjusts the watch screen perpendicular to the horizontal plane. At this time, the user is facing the watch screen. Accordingly, in this scenario, A1 and A2 are both 0 degrees, and |A1+A2| is not greater than 30 degrees, and the screen can be controlled to be in the screen-on state. Assuming that the watch screen is still perpendicular to the horizontal plane, and the user's face turns to a horizontal state (for example, the user lies flat), the user cannot see the screen clearly at this time. In this scenario, A1 is 90 degrees, A2 is 0 degrees, and |A1+A2| is greater than 30 degrees. Accordingly, the screen will be controlled to be in the screen-off state. In another application scenario, it is assumed that the user lies flat, the user's wrist rotates, and the watch screen is horizontally facing upward when the rotation stops. In this scenario, A1 and A2 are both 90 degrees, and |A1+A2| is greater than 30 degrees. Accordingly, the screen will be controlled to be in the screen-off state. Conversely, if the watch screen is horizontally facing downward when the rotation stops, A2 is -90 degrees at this time, and accordingly, the screen will be controlled to be in the screen-on state.
[0090] In the embodiment of the present application, the angle between the plane normal of the screen and the horizontal plane is determined as the horizontal angle of the screen. Based on the sum of the horizontal angle of the screen and the horizontal angle of the face, the angle between the screen and the face in the vertical direction of the human eye can be determined, so that the efficiency of determining the second target angle can be ensured to a certain extent.
[0091] It should be noted that in the embodiment of the present application, the execution subject may also be a terminal device connected to the wrist device and the target device. Accordingly, when a non-wrist device is used as the execution subject, the wrist device may notify the non-wrist device when detecting that the user is performing a wrist-raising or wrist-dropping action, so that the non-wrist device starts to execute the screen control method. The facial direction information, device position information, and horizontal facial angle synchronized by the target device may be specifically synchronized to the non-wrist device, and the horizontal screen angle of the wrist device may be synchronized to the non-wrist device by the wrist device. When the screen needs to be controlled to be in a light-on state, a first prompt message representing the light-on state may be sent to the wrist device, and the wrist device controls the screen to be in a light-on state in response to the first prompt message. When the screen needs to be controlled to be in a dark-off state, a second prompt message representing the dark-off state may be sent to the wrist device, and the wrist device controls the screen to be in a dark-off state in response to the second prompt message.
[0092] See also Figure 6 , an embodiment of the present application provides a screen control device for a wrist device, the device comprising:
[0093] The acquisition module 201 is used to acquire the face direction information and the face horizontal angle of the user detected by the target device when the user is detected to have performed a wrist raising action or a wrist lowering action; the target device is a head mounted device currently worn by the user;
[0094] A first determination module 202 is used to determine the angle between the screen and the face based on the face direction information, the face horizontal angle and the screen horizontal angle of the wrist device to obtain a target angle;
[0095] The first control module 203 is used to control the screen to be in a bright screen state when the target angle does not exceed the visual angle of the user.
[0096] Optionally, the target angle includes a first target angle and a second target angle; the first determining module 202 is specifically configured to:
[0097] Acquire device location information of the target device, and determine facial location information of the face based on the device location information;
[0098] Based on the face direction information and the face position information, determine the angle between the screen and the face in the horizontal direction of the human eye to obtain the first target angle;
[0099] Based on the horizontal angle of the face and the horizontal angle of the screen, the angle between the screen and the face in the direction perpendicular to the human eye is determined to obtain the second target angle.
[0100] Optionally, the facial position information includes relative position coordinates of the face relative to the wrist device, and the facial direction information includes orientation coordinates of the face; the first determining module 202 is further configured to:
[0101] constructing a face position vector and a face orientation vector of the user based on the relative position coordinates and the orientation coordinates respectively; the face position vector represents a vector pointing from the screen to the face;
[0102] Based on the vector angle between the face position vector and the face orientation vector, an angle between the screen and the face in a direction horizontal to the human eye is determined.
[0103] Optionally, the first determining module 202 is further configured to:
[0104] Determine the angle between the plane normal of the screen and the horizontal plane as the horizontal angle of the screen;
[0105] Based on the sum of the horizontal angle of the screen and the horizontal angle of the face, the angle between the screen and the face in the vertical direction of the human eye is determined; the horizontal angle of the face represents the angle between the plane normal of the face and the horizontal plane.
[0106] Optionally, the device further comprises:
[0107] a comparison module, configured to compare the first target angle with a first preset angle, and to compare the second target angle with a second preset angle; the first preset angle is used to represent the maximum visual angle of the human eye in the horizontal direction of the human eye, and the second preset angle is used to represent the maximum visual angle of the human eye in the vertical direction of the human eye;
[0108] The second determination module is used to determine that the target angle does not exceed the user's visual angle if the first target angle does not exceed the first preset angle and the second target angle does not exceed the second preset angle.
[0109] Optionally, the device further comprises:
[0110] An establishing module, used for establishing a communication connection with the target device, and a receiving module, used for receiving the face direction information and the face horizontal angle synchronized by the target device based on the communication connection;
[0111] The acquisition module 201 is specifically configured to read the most recently received face direction information and the most recently received face horizontal angle from the received face direction information and face horizontal angle.
[0112] Optionally, the apparatus further comprises: a second determination module, configured to determine a distance between the wrist device and the face;
[0113] The first control module 203 is specifically used for:
[0114] When the target angle does not exceed the viewing angle and the distance does not exceed the preset distance threshold, if the wrist raising action is detected, the screen is controlled to switch to the bright screen state; and if the wrist lowering action is detected, the screen is controlled to continue to maintain the bright screen state.
[0115] Optionally, the device further comprises:
[0116] The second control module is used to control the screen to remain in the off state if the wrist raising action is detected when the target angle exceeds the viewing angle or the distance exceeds the preset distance threshold, and to control the screen to switch to the off state if the wrist lowering action is detected.
[0117] The screen control device for the wrist device has the same advantages as the screen control method for the wrist device described in the aforementioned embodiment over the related art, which will not be described in detail here.
[0118] The screen control device of the wrist device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (Augmented Reality, AR) / virtual reality (Virtual Reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (Ultra-Mobile Personal Computer, UMPC), a netbook or a personal digital assistant (Personal Digital Assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (Personal Computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application. The screen control device of the wrist device in the embodiment of the present application can be a device with an operating system. The operating system can be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application. The screen control device of the wrist device provided in the embodiment of the present application can realize Figure 1 The various processes implemented in the method embodiment achieve the same technical effect and will not be described again here to avoid repetition.
[0119] In some embodiments, Figure 7 As shown, the embodiment of the present application further provides an electronic device M40, including a processor M401 and a memory M402, the memory M402 stores a program or instruction that can be run on the processor M401, and when the program or instruction is executed by the processor M401, each step of the screen control method embodiment of the wrist device is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
[0120] Figure 8A schematic diagram of the hardware structure of another electronic device for implementing an embodiment of the present application. The electronic device 500 includes, but is not limited to, components such as a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, and a processor 510. It can be understood by those skilled in the art that the electronic device 500 may also include a power supply (such as a battery) for supplying power to each component, and the power supply may be logically connected to the processor 510 through a power management system, thereby realizing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0121] Among them, the processor 510 is used to obtain the facial direction information and the horizontal facial angle of the user detected by the target device when it is detected that the user is raising his wrist or lowering his wrist; the target device is a head-mounted device currently worn by the user; based on the facial direction information, the horizontal facial angle and the horizontal angle of the screen of the wrist device, the angle between the screen and the face is determined to obtain the target angle; when the target angle does not exceed the visual angle of the user, the screen is controlled to be in a bright screen state.
[0122] The target angle includes a first target angle and a second target angle. The processor 510 is further configured to obtain device location information of the target device, and determine the facial location information of the face based on the device location information; determine the angle between the screen and the face in the horizontal direction of the human eye based on the facial direction information and the facial location information, and obtain the first target angle; determine the angle between the screen and the face in the vertical direction of the human eye based on the horizontal facial angle and the horizontal screen angle, and obtain the second target angle.
[0123] The facial position information includes the relative position coordinates of the face relative to the wrist device, and the facial direction information includes the orientation coordinates of the face. The processor 510 is further configured to construct the facial position vector and facial orientation vector of the user based on the relative position coordinates and the orientation coordinates, respectively; the facial position vector represents a vector pointing from the screen to the face; and based on the vector angle between the facial position vector and the facial orientation vector, determine the angle between the screen and the face in the horizontal direction of the human eye.
[0124] Processor 510 is further used to determine the angle between the plane normal of the screen and the horizontal plane as the horizontal angle of the screen; based on the sum of the horizontal angle of the screen and the horizontal angle of the face, determine the angle between the screen and the face in the vertical direction of the human eye; the horizontal angle of the face represents the angle between the plane normal of the face and the horizontal plane.
[0125] Processor 510 is also used to compare the first target angle with a first preset angle, and to compare the second target angle with a second preset angle; the first preset angle is used to characterize the maximum viewing angle of the human eye in the horizontal direction of the human eye, and the second preset angle is used to characterize the maximum viewing angle of the human eye in the vertical direction of the human eye; if the first target angle does not exceed the first preset angle, and the second target angle does not exceed the second preset angle, it is determined that the target angle does not exceed the user's viewing angle.
[0126] The processor 510 is further configured to establish a communication connection with the target device, and receive facial direction information and facial horizontal angle synchronized by the target device based on the communication connection; the acquiring facial direction information and facial horizontal angle of the user detected by the target device comprises: reading the facial direction information and facial horizontal angle most recently received from the received facial direction information and facial horizontal angle most recently received.
[0127] Processor 510 is also used to control the screen to switch to the bright screen state if the wrist raising action is detected, and to control the screen to continue to maintain the bright screen state if the wrist lowering action is detected, when the target angle does not exceed the viewing angle and the distance does not exceed the preset distance threshold.
[0128] Processor 510 is also used to control the screen to remain in the off state if the wrist raising action is detected when the target angle exceeds the viewing angle or the distance exceeds the preset distance threshold, and to control the screen to switch to the off state if the wrist lowering action is detected.
[0129] The advantages of the electronic device and the screen control method of the wrist device described in the aforementioned embodiment over the related art are the same, which will not be repeated here.
[0130] It should be understood that in the embodiment of the present application, the input unit 504 may include a graphics processor (GPU) 5041 and a microphone 5042, and the graphics processor 5041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 507 includes a touch panel 5071 and at least one of other input devices 5072. The touch panel 5071 is also called a touch screen. The touch panel 5071 may include two parts: a touch detection device and a touch controller. Other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0131] The memory 509 can be used to store software programs and various data. The memory 509 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 509 may include a volatile memory or a non-volatile memory, or the memory 509 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 509 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0132] The processor 510 may include one or more processing units; in some embodiments, the processor 510 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 510.
[0133] The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the screen control method embodiment of the wrist device is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. Among them, the processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a disk or an optical disk. The embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement each process of the screen control method embodiment of the wrist device, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. It should be understood that the chip mentioned in the embodiment of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip. The embodiment of the present application provides a computer program product, which is stored in a storage medium, and the program product is executed by at least one processor to implement each process of the screen control method embodiment of the wrist device, and the same technical effect can be achieved. To avoid repetition, it is not repeated here.
[0134] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0135] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0136] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. A screen control method for a wrist device, characterized in that: The method comprises: When detecting that the user performs a wrist-raising action or a wrist-dropping action, acquiring the face direction information and the face horizontal angle of the user detected by the target device; the target device is a head-mounted device currently worn by the user; Based on the facial direction information, the horizontal angle of the face, and the horizontal angle of the screen of the wrist device, determine the angle between the screen and the face to obtain a target angle; When the target angle does not exceed the visual angle of the user, the screen is controlled to be in a bright screen state.
2. The method according to claim 1, characterized in that The target angle includes a first target angle and a second target angle; determining the angle between the screen and the face based on the face direction information, the face horizontal angle, and the screen horizontal angle of the wrist device to obtain the target angle includes: Acquire device location information of the target device, and determine facial location information of the face based on the device location information; Based on the face direction information and the face position information, determine the angle between the screen and the face in the horizontal direction of the human eye to obtain the first target angle; Based on the horizontal angle of the face and the horizontal angle of the screen, the angle between the screen and the face in the direction perpendicular to the human eye is determined to obtain the second target angle.
3. The method according to claim 2, characterized in that The facial position information includes the relative position coordinates of the face relative to the wrist device, and the facial direction information includes the orientation coordinates of the face; and determining the angle between the screen and the face in the horizontal direction of the human eye based on the facial direction information and the facial position information includes: constructing a face position vector and a face orientation vector of the user based on the relative position coordinates and the orientation coordinates respectively; the face position vector represents a vector pointing from the screen to the face; Based on the vector angle between the face position vector and the face orientation vector, an angle between the screen and the face in a direction horizontal to the human eye is determined.
4. The method according to claim 2, characterized in that: The determining, based on the horizontal angle of the face and the horizontal angle of the screen, the angle between the screen and the face in a direction perpendicular to the human eye includes: Determine the angle between the plane normal of the screen and the horizontal plane as the horizontal angle of the screen; Based on the sum of the horizontal angle of the screen and the horizontal angle of the face, the angle between the screen and the face in the vertical direction of the human eye is determined; the horizontal angle of the face represents the angle between the plane normal of the face and the horizontal plane.
5. The method according to claim 2, characterized in that: The method further comprises: Comparing the first target angle with a first preset angle, and comparing the second target angle with a second preset angle; the first preset angle is used to represent the maximum visual angle of the human eye in the horizontal direction of the human eye, and the second preset angle is used to represent the maximum visual angle of the human eye in the vertical direction of the human eye; If the first target angle does not exceed the first preset angle, and the second target angle does not exceed the second preset angle, it is determined that the target angle does not exceed the visual angle of the user.
6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Establishing a communication connection with the target device, and receiving face direction information and face horizontal angle synchronized by the target device based on the communication connection; The acquiring the face direction information and the face horizontal angle of the user detected by the target device includes: reading the face direction information and the face horizontal angle received most recently from the received face direction information and the face horizontal angle.
7. The method according to any one of claims 1 to 5, characterized in that: The method further includes: determining a distance between the wrist device and the face; When the target angle does not exceed the visual angle of the user, controlling the screen to be in a bright screen state includes: When the target angle does not exceed the viewing angle and the distance does not exceed the preset distance threshold, if the wrist raising action is detected, the screen is controlled to switch to the bright screen state; and if the wrist lowering action is detected, the screen is controlled to continue to maintain the bright screen state.
8. The method according to claim 7, characterized in that The method further comprises: When the target angle exceeds the viewing angle or the distance exceeds the preset distance threshold, if the wrist raising action is detected, the screen is controlled to continue to remain in the screen-off state; and if the wrist lowering action is detected, the screen is controlled to switch to the screen-off state.
9. A screen control device for a wrist device, characterized in that: The device comprises: an acquisition module, configured to acquire, when detecting that the user performs a wrist-raising action or a wrist-dropping action, the user's face direction information and the face horizontal angle detected by a target device; the target device is a head-mounted device currently worn by the user; A first determination module, configured to determine an angle between the screen and the face based on the face direction information, the face horizontal angle, and the screen horizontal angle of the wrist device, to obtain a target angle; The first control module is used to control the screen to be in a bright screen state when the target angle does not exceed the visual angle of the user.
10. An electronic device, characterized in that: The device comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the screen control method of the wrist device as described in any one of claims 1 to 8 are implemented.
Citation Information
Cited By
Head-mounted device, wrist device, and bright screen identification method and system
CN121578873A