Control method and device
By interacting with the first and second devices, user activity is sensed, and the device automatically switches to a more energy-efficient state, solving the energy-saving problem of screen-off or screen-locking control methods and improving the device's adaptability and user experience.
Patent Information
- Application Number
- CN202411482483.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-22
- Publication Date
- 2026-04-24
AI Technical Summary
Existing screen-off or screen-locking control methods need improvement in energy efficiency and cannot be flexibly adjusted according to the user's actual situation, resulting in unnecessary energy consumption and user experience problems.
Through signal interaction between the first and second devices, the presence or absence of the user is sensed, and the device automatically switches to a more energy-efficient state. By utilizing different signals and sensing methods, a flexible control method is achieved, including one-way and two-way sensing, combined with optical detection to improve accuracy.
It enables automatic adjustment of device status based on user activity, reduces energy consumption, improves user experience and device adaptability, and reduces unnecessary energy consumption and frequent state switching.
Smart Images

Figure CN121918685A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of communications, and more particularly to a control method and apparatus. Background Technology
[0002] With the continuous development of communication technology, users are using increasingly diverse electronic devices with display functions, including laptops, desktop computers, and smart display devices. These electronic devices with display functions, such as most laptops, can achieve energy saving through preset screen-off or screen-locking functions.
[0003] However, the energy-saving effect of this screen-off or screen-locking control method needs to be improved. Therefore, reducing energy consumption has become a problem that needs to be solved. Summary of the Invention
[0004] This application provides a control method and apparatus that can reduce energy consumption.
[0005] Firstly, this application provides a control method that can be executed by a second device. Unless otherwise specified, "second device" in this application can refer to a second device (e.g., an electronic device), a component within the second device (e.g., a processor, chip, or chip system), or a logic module or software capable of implementing all or part of the functions of the second device. The method includes: the second device sending a first signal to a first device in a first preset state, the first preset state including at least one of a state with no input signal or a state with no output signal, the first signal triggering the first device to sense the presence of a user; the second device receiving a second signal from the first device; and the second device, upon determining, based on the second signal, that the user has not been sensed, entering a second preset state, which is different from the first preset state.
[0006] In a first preset state of the second device, this application utilizes signal interaction between the first and second devices to detect the presence of a user. If no user is detected, the first preset state is switched to a second preset state, thus changing the current state of the second device. Typically, the second preset state is more energy-efficient than the first preset state; therefore, changing the state of the second device reduces energy consumption. Furthermore, since detection only occurs in the first preset state, it is more energy-efficient than continuous detection; and the ability to switch to the second preset state promptly when no user is detected further reduces energy consumption.
[0007] In one possible implementation, the first signal used to trigger the first device to sense the presence of a user includes: the first signal being a detection signal for sensing, used to trigger the first device to receive the signal and obtain sensing data, which is used to determine whether a user exists. Alternatively, the first signal is a request signal used to trigger the first device to send a detection signal for sensing, and the second device, upon receiving the detection signal, obtains sensing data to determine whether a user exists.
[0008] In one possible implementation, the second signal includes a detection signal for detecting the presence of a user; or, the second signal includes sensing data acquired by the first device or a sensing result obtained based on the sensing data; or, the second signal includes a detection signal for detecting the presence of a user, and sensing data acquired by the first device or a sensing result obtained based on the sensing data.
[0009] The first and second signals in this application have a corresponding relationship. For example, if the first signal is a detection signal, the second signal may include sensing data obtained by the first device based on the detection signal, or a sensing result obtained based on the sensing data, or the second signal may include a detection signal in addition to sensing data or a sensing result for bidirectional sensing. If the first signal triggers the first device to send a detection signal for sensing, the second signal includes the detection signal. Alternatively, in the case of bidirectional sensing, the second signal may also include sensing data obtained by the first device in addition to the detection signal, or a sensing result obtained by the first device based on the sensing data, etc. The first and second signals provided in this application can be applied in different scenarios. For example, if the first device has sensing capability or computing capability, the first device can obtain sensing data and calculate the sensing result. If the first device does not have computing capability, the sensing data can be carried in the second signal and sent to the second device to calculate the sensing result, etc. By setting different first and second signals, the control method provided in this application can be applied to a wider range of scenarios and is more flexible.
[0010] In one possible implementation, the second device is used for sensing, and the first device assists the second device in sensing. The control method includes: the second device, in a first preset state, sending a first signal to the first device, the first signal triggering the first device to send a second signal, the second signal including a detection signal for sensing the presence of a user; the second device receiving the second signal, obtaining sensing data based on the second signal, obtaining a sensing result based on the sensing data, and entering a second preset state if the sensing result includes no user being sensed. This method effectively utilizes the sensing link between the first and second devices, allowing the second device to obtain sensing data based on the detection signal and calculate the sensing result. This enables the second device to promptly enter the second preset state when the sensing result includes no user being sensed, achieving a more timely switching effect and reducing energy consumption.
[0011] In one possible implementation, the second device is used for sensing, and the first device assists the second device in sensing. The control method includes: the second device sending a first signal to the first device in a first preset state, the first signal triggering the first device to send a second signal, the second signal including a detection signal for sensing the presence of a user; the second device receiving the second signal and obtaining sensing data based on the second signal; the second device sending the sensing data to the first device, and the first device obtaining a sensing result based on the sensing data and then instructing the second device; the second device entering a second preset state according to the instruction sent by the first device if the instruction indicates that no user has been sensed. This method broadens the application scenarios of the control method.
[0012] In one possible implementation, a second device assists the first device in sensing. The control method includes: the second device sending a first signal to the first device in a first preset state; the first signal triggering the first device to sense the presence of a user, such as a detection signal for sensing the presence of a user; the second device receiving a second signal from the first device, the second signal including an indication from the first device of the sensing result, which includes no user detected; and the second device obtaining the sensing result of no user detected based on the indication of the second signal and entering a second preset state. This method allows the sensing result to be obtained through the first device, making the control method applicable to a wider range of scenarios.
[0013] In one possible implementation, a second device assists the first device in sensing. The control method includes: the second device sending a first signal to the first device in a first preset state; the first signal triggering the first device to sense the presence of a user, such as a detection signal for sensing user presence; the second device receiving a second signal from the first device, which is derived from sensing data obtained by the first device based on the first signal; the second signal may include the sensing data; and the second device calculating that no user was detected based on the sensing data, and then entering a second preset state. This method allows the first device to obtain sensing data, thereby assisting the second device in obtaining the sensing result, thus broadening the application scenarios of the control method.
[0014] This application utilizes different methods, with either the first or second device performing unidirectional sensing and flexibly employing control methods, thus broadening the application scenarios for the second device to switch from a first preset state to a second preset state. Furthermore, this application also allows for bidirectional sensing by both the first and second devices to obtain sensing data, resulting in better noise resistance and more accurate sensing results. For example, the second signal received by the second device from the first device includes both the sensing data or results obtained by the first device and the detection signal sent by the first device. The second device can then obtain the sensing result based on the sensing data received from the first device and the sensing data it acquires itself based on the detection signal.
[0015] In one possible implementation, the second preset state includes at least one of screen lock or sleep mode. The second preset state can include various states in power-saving mode, and the second device can reduce power consumption after switching from the first preset state to the second preset state.
[0016] In one possible implementation, the method further includes: when the second device senses the user based on the second signal, it maintains the first preset state for a first time period. Maintaining the current state during the first time period ensures that the display and other states required by the user remain unchanged, allowing the user to continue operation at any time without needing to re-wake the screen, thus improving the user experience of the control method.
[0017] In one possible implementation, the method further includes: the second device entering the second preset state after the first time period in order to save energy.
[0018] In one possible implementation, the first device and the second device satisfy at least one of the following: the distance between the first device and the second device is less than or equal to a first preset distance, or the signal strength between the first device and the second device is greater than or equal to a first preset signal strength. The fact that the distance or signal strength between the first device and the second device meets the preset conditions ensures that the first device or the second device accurately acquires the sensing data, effectively preventing the accuracy of sensing from being affected by the movement of the first device or the second device.
[0019] In one possible implementation, the first device is a preset sensing device. The preset sensing device can send signals to the second device after the second device enters a first preset state, thus achieving sensing. This reduces the steps required for the second device to select or determine the first device, saving time and improving efficiency.
[0020] In one possible implementation, the method further includes: the second device obtaining the distance between the first device and the second device using a wireless short-range ranging method, which includes at least one of star-flash ranging, received signal strength indicator (RSSI) measurement, or wireless fidelity (WiFi) ranging. The second device can use different ranging methods to obtain the distance between the second device and the first device based on different scenario requirements, making the control method more flexible and applicable.
[0021] In one possible implementation, the second device acquires the sensing data using at least one of the following methods: by detecting channel state information (CSI) data and determining whether fluctuations exist in the current environment; or by using a static user detection algorithm and acquiring the sensing data based on at least one of respiration detection or heartbeat detection. The second device can use different methods to acquire sensing data in different scenarios. To improve the accuracy of the sensing data, the second device can use multiple ranging methods to acquire the sensing data together, making the sensing data more accurate.
[0022] In one possible implementation, after entering the second preset state, the method further includes: the second device sending a third signal to the first device, the third signal being used to trigger the first device to stop sensing. Based on the third signal, the first device stops sending detection signals or stops sending sensing data or sensing results, which can further save energy.
[0023] In one possible implementation, after entering the second preset state, the method further includes: if the first device and the second device have pre-agreed that the fourth signal is an indication signal for continued sensing, or if the first device defaults to continuing sensing, the second device sends the fourth signal to the first device. This fourth signal instructs the first device to send a fifth signal at a first frequency. Alternatively, in other scenarios, the fourth signal requests the first device to continue sensing the presence of the user and instructs the first device to send the fifth signal at the first frequency. This instructs the first device to continue sensing.
[0024] The fifth signal may include whether the first device senses the user's instruction, or it may include sensing data acquired by the first device, or it may include a detection signal for sensing the presence of the user. The content of the fifth signal can be correlated with the content of the second signal; for example, if the second signal is a detection signal, the fifth signal may also include a detection signal.
[0025] The second device instructs the first device to reduce the transmission frequency. Whether it is reducing the frequency of transmitting detection signals or reducing the frequency of transmitting sensing data or sensing results, energy consumption can be reduced while maintaining sensing.
[0026] In one possible implementation, the method further includes: when the second device senses the user based on the fifth signal, it enters a third preset state, which may be the same as or different from the first preset state. Optionally, the third preset state may include a welcome state, an unlocked screen state, or an unlocked screen-off state. The control method provided by this application continues to detect the current environment even when no user is sensed, and can promptly switch the user's state upon return, such as welcoming the user back, thus providing a better user experience.
[0027] In one possible implementation, the method further includes the second device acquiring an optical detection result, which indicates whether the user has been detected. The second device makes a joint judgment based on the acquired optical detection result and the sensing result. For example, if the optical detection result indicates that no user has been detected, and the sensing result indicates that no user has been sensed, the device enters the second preset state. By combining optical detection and sensing, the control method provided by this application can more accurately identify whether a user exists, thereby controlling the switching of preset states and making the control more accurate.
[0028] Secondly, this application provides a control method that can be executed by a first device. Unless otherwise specified, the "first device" in this application can refer to a first device (e.g., an electronic device), a component in the first device (e.g., a processor, a chip, or a chip system), or a logic module or software that can implement all or part of the functions of the first device. The method includes: the first device receiving a first signal, which triggers the first device to sense whether a user is present; the first device sending a second signal to a second device, which is obtained from the first signal.
[0029] In one possible implementation, the first signal is used to trigger the first device to send the second signal, which includes a detection signal for sensing the presence of the user.
[0030] In one possible implementation, the first signal is used to trigger the first device to sense whether a user exists based on the first signal. The method further includes: the first device acquiring sensing data based on the first signal, the sensing data being used to determine whether the user exists; and the first device obtaining a second signal indicating a sensing result based on the sensing data, the sensing result including not sensing the user.
[0031] In one possible implementation, the first signal is used to trigger the first device to sense the presence of a user based on the first signal. The method further includes: the first device acquiring sensing data based on the first signal; and the first device obtaining the second signal based on the sensing data, the second signal including the sensing data acquired by the first device.
[0032] In one possible implementation, the acquisition of the perception data includes at least one of the following methods: acquiring the perception data based on the presence of fluctuations in the current environment through the detection of CSI data; or acquiring the perception data based on at least one of breathing detection or heartbeat detection through a static user detection algorithm.
[0033] In one possible implementation, the method further includes: the first device receiving a third signal, the third signal being used to trigger the first device to stop sensing the presence of the user. For example, the third signal may be used to instruct the first device to stop sending detection signals, or the third signal may be used to instruct the first device to stop sending sensing data or sensing results.
[0034] In one possible implementation, the method further includes: the first device receiving a fourth signal, the fourth signal being used to instruct the first device to send a fifth signal at a first frequency, or the fourth signal being used to request the first device to continue sensing whether the user exists, and instructing the first device to send the fifth signal at the first frequency, wherein the fifth signal includes an indication of whether the first device senses the user, or includes sensing data acquired by the first device, or includes a detection signal for sensing whether the user exists.
[0035] In one possible implementation, the method further includes: the first device sending the fifth signal to the second device according to the first frequency.
[0036] It should be understood that the second aspect of this application corresponds to the technical solution of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here.
[0037] Thirdly, this application provides a second apparatus, which includes: a transmitting module, a receiving module, and a processing module.
[0038] The sending module is used to send a first signal to the first device in a first preset state. The first preset state includes at least one of a state with no input signal or a state with no output signal. The first signal is used to trigger the first device to sense whether a user is present.
[0039] The receiving module is also used to receive a second signal from the first device;
[0040] The processing module is used to enter a second preset state when the user is not detected according to the second signal. The second preset state is different from the first preset state.
[0041] In one possible implementation, the second preset state includes at least one of screen lock or sleep mode.
[0042] In one possible implementation, the first signal triggering the first device to sense the presence of a user includes: the first signal triggering the first device to send the second signal, the second signal including a detection signal for sensing the presence of the user; the processing module is specifically used to acquire sensing data based on the second signal, the sensing data being used to determine whether the user exists; and based on the sensing data, the user is not sensed.
[0043] In one possible implementation, the first signal triggering the first device to sense the presence of a user includes: the first signal triggering the first device to sense the presence of the user based on the first signal; the second signal includes an indication of the sensing result of the first device, the sensing result including not sensing the user; and the processing module is specifically used to obtain the sensing result of not sensing the user based on the indication of the second signal.
[0044] In one possible implementation, the first signal used to trigger the first device to sense the presence of a user includes: the first signal used to trigger the first device to sense the presence of the user based on the first signal; the second signal includes sensing data acquired by the first device; and the processing module is specifically used to determine, based on the sensing data acquired by the first device, that the user has not been sensed.
[0045] In one possible implementation, the processing module is further configured to maintain the first preset state for a first time period when the user is perceived based on the second signal.
[0046] In one possible implementation, the processing module is also used to enter the second preset state after the first time period.
[0047] In one possible implementation, the first device and the second device satisfy at least one of the following: the distance between the first device and the second device is less than or equal to a first preset distance, or the signal strength of the first device and the second device is greater than or equal to the first preset signal strength.
[0048] In one possible implementation, the first device is a pre-defined sensing device.
[0049] In one possible implementation, the processing module is further configured to obtain the distance between the first device and the second device using a wireless short-range ranging method, which includes at least one of star-flash ranging, RSSI measurement, or WiFi ranging.
[0050] In one possible implementation, the sending module is further configured to send a third signal to the first device, the third signal being used to trigger the first device to stop sensing the presence of the user.
[0051] In one possible implementation, the transmitting module is further configured to transmit a fourth signal to the first device, the fourth signal being used to instruct the first device to transmit a fifth signal at a first frequency, or the fourth signal being used to request the first device to continue sensing whether the user exists, and instructing the first device to transmit the fifth signal at the first frequency, wherein the fifth signal includes an indication of whether the first device senses the user, or includes sensing data acquired by the first device, or includes a detection signal for sensing whether the user exists.
[0052] In one possible implementation, the processing module is further configured to enter a third preset state when the user is sensed according to the fifth signal, the third preset state being the same as or different from the first preset state.
[0053] In one possible implementation, the second device further includes an optical module for acquiring optical detection results, which indicate whether the user is detected; the processing module is specifically used to enter the second preset state when the optical detection results indicate that the user is not detected and the perception results include that the user is not perceived.
[0054] In one possible implementation, the second device further includes a star flash module for transmitting the star flash signal.
[0055] It should be understood that the third aspect of this application is the same as the first aspect of this application in terms of technical solution, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, so they will not be repeated here.
[0056] Fourthly, this application provides a first apparatus, which includes: a receiving module and a transmitting module.
[0057] The receiving module is used to receive a first signal, which is used to trigger the first device to sense whether a user is present.
[0058] The transmitting module is used to send a second signal to the second device, the second signal being derived from the first signal.
[0059] In one possible implementation, the first signal is used to trigger the first device to send the second signal, which includes a detection signal for sensing the presence of the user.
[0060] In one possible implementation, the first signal is used to trigger the first device to sense whether the user exists based on the first signal. The first device further includes a processing module for acquiring sensing data based on the first signal, the sensing data being used to determine whether the user exists; and obtaining a second signal indicating the sensing result based on the sensing data, the sensing result including not sensing the user.
[0061] In one possible implementation, the first signal is used to trigger the first device to sense the presence of the user based on the first signal. The processing module is also used to acquire sensing data based on the first signal and to obtain the second signal based on the sensing data. The second signal includes the sensing data acquired by the first device.
[0062] In one possible implementation, the processing module acquires the sensing data by at least one of the following methods: by detecting Channel State Information (CSI) data and determining whether there are fluctuations in the current environment; or by using a static user detection algorithm and acquiring the sensing data based on at least one of breathing detection or heartbeat detection.
[0063] In one possible implementation, the receiving module is further configured to receive a third signal, which triggers the first device to stop sensing the presence of the user.
[0064] In one possible implementation, the receiving module is further configured to receive a fourth signal, which is used to instruct the first device to send a fifth signal at a first frequency, or the fourth signal is used to request the first device to continue sensing whether the user exists, and instruct the first device to send the fifth signal at the first frequency, wherein the fifth signal includes an indication of whether the first device senses the user, or includes sensing data acquired by the first device, or includes a detection signal for sensing whether the user exists.
[0065] In one possible implementation, the transmitting module is further configured to transmit the fifth signal to the second device according to the first frequency.
[0066] In one possible implementation, the second device further includes a star flash module for transmitting the star flash signal.
[0067] It should be understood that the fourth aspect of this application corresponds to the technical solution of the first aspect of this application and is the same as the technical solution of the second aspect. The beneficial effects obtained by each aspect and the corresponding feasible implementation are similar, and will not be repeated here.
[0068] Fifthly, this application provides a communication device, which may be an electronic device or a device in an electronic device (e.g., a processor, a chip, or a chip system). The communication device includes a transceiver and a processor for performing the methods described in any of the above aspects or any possible implementations of any of the above aspects.
[0069] Optionally, the communication device includes a transceiver, a memory, and a processor for performing the method as described in any of the above aspects or any possible implementations of any of the above aspects. For example, the memory may be disposed in the communication device or may be an external device of the communication device.
[0070] Sixthly, this application provides a communication device, comprising: an input / output interface and a logic circuit, wherein the input / output interface is used to acquire input information and / or output information; and the logic circuit is used to perform the method described in any of the above aspects or any possible implementation thereof, processing the input information and / or generating output information.
[0071] In a seventh aspect, this application provides a communication device including at least one processor and a storage medium. The at least one processor is coupled to the storage medium, which stores instructions that, when executed by the processor, enable the processor to perform the method described in any of the foregoing aspects or any possible implementation thereof. The storage medium may be included in the communication device or disposed outside the communication device.
[0072] Eighthly, this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method as described in any of the foregoing aspects or any possible implementations of any of the foregoing aspects.
[0073] Ninthly, this application provides a computer program product comprising instructions that, when executed on a processor, implement the method as described in any of the foregoing aspects or any possible implementation thereof.
[0074] In a tenth aspect, this application provides a chip comprising: an interface circuit and a processor. The interface circuit is connected to the processor, and the processor is configured to cause the chip to perform some or all of the operations included in any of the methods described in any of the foregoing aspects and any possible implementations of any of the foregoing aspects.
[0075] Eleventhly, embodiments of this application also provide a chip, including: at least one processor, the at least one processor being configured to execute code in the memory, and when the at least one processor executes the code, the chip implementing some or all of the operations included in the method of any of the foregoing aspects and any possible implementation of any of the foregoing aspects.
[0076] Optionally, the chip also includes a memory. The memory can be integrated with the processor or disposed separately from the processor; the memory can be integrated on the same chip as the processor or disposed on different chips.
[0077] Alternatively, the chip described above can also be an integrated circuit.
[0078] In a twelfth aspect, this application provides a system comprising a second means as described in the third aspect and a first means as described in the fourth aspect.
[0079] In a thirteenth aspect, this application provides a system that includes communication devices as provided in any of the third to eleventh aspects.
[0080] It should be understood that the fifth to thirteenth aspects of this application are consistent with or correspond to the technical solutions of the first and second aspects of this application, and the beneficial effects obtained by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description
[0081] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0082] Figure 1 This is a schematic diagram of the structure of a communication system 100 provided in an embodiment of this application;
[0083] Figure 2 This is a structural diagram of a communication scenario provided in an embodiment of this application;
[0084] Figure 3 This is a flowchart illustrating a control method provided in an embodiment of this application;
[0085] Figure 4 This is a flowchart illustrating another control method provided in an embodiment of this application;
[0086] Figure 5 This is a flowchart illustrating another control method provided in an embodiment of this application;
[0087] Figure 6 This is a flowchart illustrating a display control method provided in an embodiment of this application;
[0088] Figure 7a This is a structural diagram of a communication scenario provided in an embodiment of this application;
[0089] Figure 7b This is a schematic diagram of another communication scenario provided in an embodiment of this application;
[0090] Figure 8This is a flowchart illustrating another control display method provided in an embodiment of this application;
[0091] Figure 9 This is a flowchart illustrating another control display method provided in an embodiment of this application;
[0092] Figure 10 This is a flowchart illustrating another control display method provided in an embodiment of this application;
[0093] Figure 11 This is a flowchart illustrating another control display method provided in an embodiment of this application;
[0094] Figure 12 This is a flowchart illustrating another control display method provided in an embodiment of this application;
[0095] Figure 13 This is a flowchart illustrating another control display method provided in an embodiment of this application;
[0096] Figure 14 This is a schematic diagram of the structure of a second device provided in an embodiment of this application;
[0097] Figure 15 This is a schematic diagram of another second device provided in an embodiment of this application;
[0098] Figure 16 This is a schematic diagram of the structure of a first device provided in an embodiment of this application;
[0099] Figure 17 This is a schematic diagram of another first device provided in an embodiment of this application;
[0100] Figure 18 This is a schematic diagram of the structure of another first device provided in the embodiments of this application;
[0101] Figure 19 This is a schematic diagram of the structure of device 50 according to an embodiment of this application;
[0102] Figure 20 This is a schematic diagram of the structure of a device 60 provided in an embodiment of this application. Detailed Implementation
[0103] To enable those skilled in the art to better understand the solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments.
[0104] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Here, A and B can be single or multiple. "At least one of the following" or similar expressions are used to represent any combination of the listed items. For example, at least one of A, B, and / or C can represent: A existing alone, B existing alone, C existing alone, A and B existing simultaneously, B and C existing simultaneously, A and C existing simultaneously, and A, B, and C existing simultaneously. Here, A, B, and C can be single or multiple.
[0105] The terms "first" and "second," etc., used in the specification and claims of this application are used to distinguish different objects, not to describe a specific order of objects. For example, "first target object" and "second target object," etc., are used to distinguish different target objects, not to describe a specific order of target objects.
[0106] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.
[0107] In the description of the embodiments in this application, unless otherwise stated, "multiple" means two or more. For example, multiple processing units means two or more processing units; multiple systems means two or more systems.
[0108] Figure 1 This is a schematic diagram of the structure of a communication system 100 provided in an embodiment of this application, as shown below. Figure 1As shown, the communication system 100 applicable to this application embodiment may include multiple devices, such as a first device 10 and a second device 20. The first device 10 and the second device 20 are devices with sensing capabilities; that is, when the first device 10 performs sensing, the second device 20 can assist the first device 10 in sensing, and vice versa. For example, in a one-way sensing scenario, the first device 10 can send a sensing signal, and the second device 20 can receive the sensing signal and obtain sensing data; or, the second device 20 can send a sensing signal, and the first device 10 can receive the sensing signal and obtain sensing data. In a two-way sensing scenario, the first device 10 can send a sensing signal, and either the first device 10 or the second device 20 can receive the sensing signal and obtain sensing data, and so on. Furthermore, the first device 10 and the second device 20 can be deployed in the same network (or access the same network). The devices (including the first device 10 and the second device 20) in this application embodiment may be processors, chips, or chip systems, or they may be logic modules or software capable of implementing all or part of the functions. This application embodiment does not impose any limitations. In one possible implementation, the first device provided in this application embodiment is an electronic device or a part of an electronic device. For ease of description in this application embodiment, such electronic devices are referred to as the electronic devices corresponding to the first device. The second device provided in this application embodiment is an electronic device or a part of an electronic device. For ease of description in this application embodiment, such electronic devices are referred to as the electronic devices corresponding to the second device.
[0109] The electronic devices provided in this application embodiment (including the electronic devices corresponding to the first device and the electronic devices corresponding to the second device) can be any kind of device with wireless transceiver function, including but not limited to cellular phones, cordless phones, session initiation protocol (SIP) phones, smartphones, wireless local loop (WLL) stations, personal digital assistants (PDAs), handheld devices with wireless communication functions, computing devices, in-vehicle devices, wearable devices, drone devices, electronic devices in the Internet of Things or the Internet of Vehicles, and other devices connected to a wireless modem.
[0110] The electronic device may also include electronic devices in virtual reality (VR), augmented reality (AR), machine type communication (MTC), industrial control (e.g., smart manufacturing), self-driving, remote medical, smart grid, smart city, and smart home.
[0111] The electronic device may also include personal portable electronic devices, computer peripherals, and various household or industrial electrical equipment, including but not limited to terminal devices such as various types of user equipment (UE), mobile phones, tablets, desktop computers, headphones, speakers, etc.
[0112] This electronic device can also include various terminal devices, such as wireless headphones, VR headsets, monitors, televisions, remote controls, network adapters, cameras, controllers, laptops, in-vehicle computers, in-vehicle terminals (such as microphones and speakers), projectors, printers, and high-fidelity (HiFi) speakers. It should be understood that in the Internet of Things (IoT) scenario, terminal devices can be in the form of tags or any other arbitrary terminal form.
[0113] The electronic device may also include machine intelligence devices, such as self-driving devices, transportation safety devices, smartphones, smart screens, smart speakers (such as artificial intelligence (AI) speakers), smart sensors, smart wristbands, smart watches, smart glasses, smart cars, smart lathes, smart monitoring equipment, etc.
[0114] The electronic device may also include wearable devices such as smartwatches, smart bracelets, pedometers, etc.
[0115] The electronic device may also include various in-vehicle devices, such as cockpit domain devices, or a module of a cockpit domain device (such as one or more modules such as a cockpit domain controller (CDC), camera, screen, microphone, audio system, electronic key, keyless entry or start system controller, etc.).
[0116] The electronic device may also include data relay devices, such as routers, repeaters, bridges, or switches.
[0117] The control method provided in this application can be applied to different systems.
[0118] In some possible implementations, the control method can be applied to both short-range wireless communication systems and wireless communication systems supporting longer-range transmission. That is, the technical solutions of this application can be applied to, but are not limited to, short-range wireless communication systems and wireless communication systems supporting longer-range transmission (e.g., 1km-18km, or over 18km) (e.g., next-generation StarSpark wireless communication systems). The short-range wireless communication system can include short-range wireless communication technology (also known as StarSpark 1.0 technology), which has advantages such as ultra-low latency, ultra-high reliability, and precise synchronization, making it suitable for applications in smart cars, smart homes, smart terminals, and smart manufacturing. For example, applications in smart car scenarios include immersive in-vehicle sound field & noise reduction, wireless interactive screen projection, and 360-degree panoramic surround view, enabling immersive interactive experiences and improving vehicle safety. Wireless communication systems supporting longer-range transmission (e.g., 1-18km) mainly include next-generation StarSpark wireless communication systems, such as StarSpark 2.0 and StarSpark 3.0 wireless communication systems. These are not only suitable for communication scenarios with low latency requirements, such as the aforementioned in-vehicle communication and industrial control scenarios, but also for communication scenarios with relatively low latency requirements.
[0119] In some possible implementations, the aforementioned communication system may be used in conjunction with mobile communication systems, such as, but not limited to, fourth-generation (4G) communication systems (e.g., long term evolution (LTE) systems), fifth-generation (5G) communication systems (e.g., new radio (NR) systems), and future mobile communication systems such as sixth-generation (6G) mobile communication systems.
[0120] In some possible implementations, the control method provided in this application embodiment can be applied to wireless local area network (WLAN), narrowband internet of things (NB-IoT), global system for mobile communications (GSM), enhanced data rate for GSM evolution (EDGE), wideband code division multiple access (WCDMA), code division multiple access 2000 (CDMA2000), time division-synchronization code division multiple access (TD-SCDMA), LTE system, satellite communication, 5G communication system, 6th-generation (6G) communication system, or new communication systems that will emerge in the future. This application embodiment does not limit the scope of the application.
[0121] In this embodiment, the provided device has wireless communication capabilities. For example, the device can be configured with multiple antennas (or antenna modules), which may include at least one transmitting antenna for transmitting signals and at least one receiving antenna for receiving signals. Additionally, each communication device further includes a transmitter chain and a receiver chain. Those skilled in the art will understand that these may all include multiple components related to signal transmission and reception (e.g., processors, modulators, multiplexers, demodulators, demultiplexers, or antennas). The communication device can be a network device or a terminal device, without limitation.
[0122] The control method provided in this application embodiment can be applied to, for example, Figure 2 The scenario shown includes a monitor and a mouse connected to the same network as the monitor. The scenario may also include other electronic devices connected to the same network as the monitor, such as a keyboard, a desk lamp, and a smart voice controller. Figure 2 (Not marked in the text) Figure 2 The scenarios described are merely examples and are not intended to be limiting. Figure 1 Combine, Figure 2The mouse can be considered as the first device, and the display device can be considered as the second device. The display device can include the screen of a laptop (hereinafter simply referred to as a laptop) or the screen of a personal computer (PC). This application embodiment uses a laptop screen as an example for illustration. In one possible scenario, a user uses a laptop for business operations. After a period of time, the user leaves the laptop, and the screen may lock or turn off according to a preset time interval. This control method (or screen-off or screen-locking method) is relatively simple and widely used, but it also has some problems, including but not limited to: the time interval between the screen-locking or screen-off operation and the time the user stops operating is fixed and cannot be flexibly adjusted according to the user's actual usage. Furthermore, if the time interval is set too long, the laptop screen will remain unlocked while the user is away, which may pose a security risk; however, if the time interval is set too short, the screen may lock or turn off even when the user is not actively using the device, affecting normal use. That is, the user's page may be frequently locked, impacting the user experience. Furthermore, users have different needs when using laptops in different scenarios. For example, the required time intervals may differ depending on whether they are working, entertaining, or resting. This fixed time interval method for locking or turning off the screen cannot flexibly adapt to different scenarios, requiring frequent adjustments to the time interval setting, which is inconvenient, error-prone, and lacks adaptability. In addition, using a fixed time interval for locking or turning off the screen may cause the laptop to remain running during that interval, leading to unnecessary power consumption. If no time interval is set, users need to manually control the screen lock or turn it off when needed, which could pose a security risk if forgotten. In another possible scenario, the laptop could use an optical camera (or webcam) to determine whether the user is in front of the display (e.g., whether the user is within the camera's detection range) to decide whether to lock or turn off the screen. However, this method of locking or turning off the screen via camera detection also has several problems. For example, continuously detecting whether the user is in front of the screen with the camera could lead to the misuse of the acquired data, posing a security risk. Moreover, detecting whether the user is in front of the screen via the camera may increase power consumption. Furthermore, in low-light or backlit environments, the data acquired by camera-based display control methods may be inaccurate, leading to inaccurate screen-off or screen-locking operations. To address these issues, embodiments of this application provide the following control method, which reduces power consumption and improves security.
[0123] Figure 3This is a flowchart illustrating a control method provided in an embodiment of this application. The method is illustrated using an example where a second device (e.g., a processor, chip, or chip system) is executed. This second device can be a display device, a display screen, or other components within a display device, or it can be the display device itself. This embodiment of the application does not limit the scope of the method. Figure 3 As shown, the method includes S101 to S103.
[0124] S101. The second device sends a first signal to the first device in a first preset state. The first preset state includes at least one of a state with no input signal or a state with no output signal. The first signal is used to trigger the first device to sense whether a user is present.
[0125] Optionally, the first preset state includes a state with no input signal; or, the first preset state includes a state with no output signal; or, the first preset state includes a state with no input signal and no output information.
[0126] The first preset state may include idle time for different display states, or the first preset state may be referred to as the idle time of the second device. For example, suppose the first preset state includes a state with no input signal. The user is watching a video, the second device is displaying the video and has an output signal, but the user is not performing any input operation, such as not operating the mouse or keyboard. This can be considered a state with no input, and in this case, the second device can be considered to be in the first preset state. The first preset state may also include a state with no output signal, which can be referenced to the state with no input signal, only the applicable scenarios differ, and will not be elaborated further. Suppose the first preset state includes a state with no input signal and no output information, such as in a scenario where the user is editing text. When the user stops editing, the text display page remains unchanged, which can be considered as having neither input nor output. In this case, the second device can be considered to be in the first preset state.
[0127] The first signal used to trigger the first device to sense the presence of a user includes: the first signal being a detection signal for sensing, used to trigger the first device to receive the signal and obtain sensing data, which can be used to determine whether a user exists. Alternatively, the first signal is a request signal, used to trigger the first device to send a detection signal for sensing. After receiving the detection signal, the first device can send its own detection signal. In other words, the second signal sent by the first device includes a detection signal, which can be used to detect whether a user exists.
[0128] Optionally, the first device can function as a sensing device or as an auxiliary device for the second device's sensing. Similarly, the second device can function as either a sensing device or an auxiliary device for the second device's sensing. For example, one possible scenario is that the second device is the sensing device, and the first device assists the second device in its sensing. The first signal sent by the second device can trigger the first device to send a detection signal for sensing, such as triggering the first device to send a second signal. This second signal is a detection signal used to sense the presence of a user (i.e., whether a user exists in the current network (or the current scene, or the current location)). Upon receiving the second signal, the second device obtains sensing data. One possibility is that the second device obtains a sensing result based on this data; another possibility is that the second device sends the sensing data to the first device, which then obtains a sensing result and feeds it back to the second device.
[0129] Another possibility is that the first device is a sensing device, and the second device is a device that assists the first device in sensing. The first signal sent by the second device may include a detection signal for sensing whether a user is present. The first device obtains sensing data based on the received detection signal and feeds back the sensing data or a sensing result calculated based on the sensing data to the second device through the second signal. The sensing result may include: no user was sensed or a user was sensed.
[0130] In addition, one possibility is that both the first and second devices are sensing devices. For example, in a two-way sensing scenario, the first signal sent by the second device can be a detection signal. After receiving the detection signal, the first device obtains sensing data based on the detection signal. The second signal sent to the first device can include the sensing data acquired by the first device, and can also include the detection signal of the first device. The second device obtains sensing data based on the received detection signal, and then obtains the sensing result based on the acquired sensing data and the sensing data received from the first device. This two-way sensing method has stronger anti-interference capabilities.
[0131] Optionally, the sensing range of the first device can be determined based on its sensing capabilities, the current scenario, or a preset range. For example, if the first device is a mouse, its sensing capability might be to detect the presence of a user within a one-meter radius of the mouse, and therefore its sensing range could be within that one-meter radius. Alternatively, if the current scenario is a study, the sensing range of the first device could be within the study; that is, when the user leaves the study, the first device would detect no user. Or, the sensing range can be preset. For instance, based on the sensing capabilities of the first device and the distance between the first and second devices, a preset range can be established as the sensing range of the first device. If the first device detects that there is no user within this preset range, its sensing result would be: no user detected. The sensing range of the second device can be referenced to the sensing range of the first device, and will not be elaborated further. It should be understood that in some possible implementations, the sensing ranges of the first and second devices are the same.
[0132] S102, The second device receives a second signal from the first device.
[0133] Optionally, the second signal may be a detection signal for detecting the presence of a user, or the second signal may be sensing data acquired by the first device or a sensing result obtained based on the sensing data, or the second signal may include a detection signal for detecting the presence of a user, and sensing data acquired by the first device or a sensing result obtained based on the sensing data.
[0134] For example, the second signal includes a set of signals that are transmitted intermittently within a continuous time period. For instance, if the second signal is used to detect the presence of a user, it can be detected by a set of signals transmitted at discrete times.
[0135] S103. If the second device does not detect the user according to the second signal, it enters a second preset state, which is different from the first preset state.
[0136] For example, the second preset state includes states different from the first preset state. For instance, while the first preset state is considered idle but still maintains display, the second preset state may include various states where no display occurs, such as screen off or locked, or screensaver mode. It should be understood that the second device switches to a more energy-efficient state after receiving no user feedback.
[0137] This embodiment of the application, in conjunction with a second device in a first preset state and a first device in the same network (or a networked device of the second device, such as a keyboard, mouse, desk lamp, or other sensing device), detects the presence of a user. If no user is detected, the first preset state is switched to a second preset state, thus changing the current state. Typically, the second preset state is more energy-efficient than the first preset state; therefore, changing the state of the second device can reduce energy consumption. Simultaneously, since sensing is initiated in the first preset state, it can promptly switch to the second preset state when no user is detected, reducing energy consumption in time. Furthermore, triggering sensing in the first preset state is more energy-efficient than continuous sensing.
[0138] In one possible implementation, the operation of the second device entering a second preset state when the user is not detected can be based on one-way or two-way sensing technology. The operation depends on the different second signals received (e.g., the second signal could be a detection signal, or a signal carrying sensing data or a sensing result). For example, in a scenario where the user leaves the study, based on one-way sensing technology, the second device entering the second preset state when the user is not detected could include the following scenarios: If the received second signal is a detection signal, the second device can acquire sensing data based on the detection signal, obtain a sensing result that the user is not detected based on the sensing data, and enter the second preset state based on this sensing result. Alternatively, if the received second signal is a detection signal, the second device can acquire sensing data based on the detection signal, send the sensing data to the first device, obtain a sensing result based on the sensing data, and then instruct the second device, which in turn enters the second preset state based on this instruction. Or, if the received second signal is an instruction for a sensing result, such as indicating that the user is not detected, the second device enters the second preset state based on this instruction. Alternatively, if the received second signal is sensing data acquired by the first device, the second device obtains the sensing result that no user was sensed based on the sensing data and enters the second preset state.
[0139] In a scenario where the user leaves the study, based on two-way sensing technology, if the second device does not detect the user, entering a second preset state can include the following: If the second signal includes a detection signal for detecting the presence of a user and sensing data acquired by the first device, the second device can obtain sensing data based on the detection signal (hereinafter referred to as sensing data A for ease of description) and send a detection signal to the first device (hereinafter referred to as detection signal A for ease of description). The first device obtains sensing data based on this detection signal A (hereinafter referred to as sensing data B for ease of description) and feeds back sensing data B to the second device. The second device, based on the detected sensing data A and the received sensing data B, jointly obtains a sensing result. If the obtained sensing result is that no user is detected, the second device enters the second preset state. Optionally, the first device can feed back the sensing result it obtained based on sensing data B and indicate this sensing result to the second device. Alternatively, if the second signal includes a detection signal for detecting the presence of a user and sensing data acquired by the first device, the content of the second signal is obtained by the bidirectional sensing of the first device. The bidirectional sensing process of the first device can be referred to the bidirectional sensing implementation of the second device, and will not be elaborated further. Optionally, in addition to the detection signal, the second signal may also include sensing data obtained by the first device, or an indication of the sensing result obtained by the second device based on the sensing data. This application embodiment does not limit this.
[0140] In one possible implementation, refer to Figure 4 If the second device senses the user, it can maintain a first preset state for a first time period. That is... Figure 4 exist Figure 3 In addition to this, it also includes S104.
[0141] S104. When the second device senses the user based on the second signal, it maintains the first preset state for a first time period.
[0142] The first time period can be a preset time period, such as one that can be preset based on the user's usage habits or by referring to the display retention time commonly used by similar devices (such as other laptops) corresponding to the second device, or it can be preset by the user.
[0143] Optionally, after the first time period, the second device can also switch to a second preset state to save energy.
[0144] The second device, upon sensing the user's presence based on the second signal, can maintain its current state, such as the idle state. This ensures that the desired display remains unchanged even during idle periods, allowing the user to continue operation at any time without needing to be reactivated, making the control method more flexible and providing a better user experience.
[0145] It should be understood that the second device obtains a perception result based on the second signal. This perception result includes the case where a user is perceived. Referring to the example above, the second device may also obtain a perception result based on the second signal, including the case where no user is perceived. For example, the second device and the first device may obtain a perception result of a perceived user through unidirectional sensing, or the second device and the first device may obtain a perception result of a perceived user through bidirectional sensing. The operational process of the second device obtaining a perception result of a perceived user will not be described again in the embodiments of this application.
[0146] Figure 5 This is a flowchart illustrating another control method provided in this application embodiment. The method is illustrated using an example of execution by a first device (e.g., a processor, chip, or chip system). The first device can be a device or component in a sensing electronic device, or it can be the sensing electronic device itself; this application embodiment does not limit the scope. Figure 5 As shown, the method includes S201 and S202.
[0147] S201. The first device receives a first signal, which is used to trigger the first device to sense whether a user exists.
[0148] The first device can be a device that is in the same network as the second device and has established a connection with the second device. The first device can be selected by the second device from multiple devices with sensing or auxiliary sensing functions, or it can be pre-set. Sensing capability includes the ability to sense the presence of a user, or in other words, the sensing capability includes obtaining a sensing result of whether a user is present based on the signals it senses. Auxiliary sensing capability includes assisting the sensing device in obtaining a sensing result of whether a user is sensed, such as the ability to send detection signals to the sensing device.
[0149] Optionally, the sensing range of the first device can be determined with reference to the description in the S101 example, and will not be elaborated further here.
[0150] S202, the first device sends a second signal to the second device, the second signal being obtained based on the first signal.
[0151] For example, after receiving a first signal, the first device can trigger a sensing action to determine whether a user exists. This triggering includes, if the first signal is a detection signal for sensing, the first device can obtain sensing data based on the detection signal. This sensing data can be used to determine whether a user exists. One possibility is that the first device generates a second signal based on the sensing data, or in other words, the second signal includes the sensing data. Another possibility is that the first device obtains a sensing result based on the sensing data, the sensing result including whether a user exists, and then indicates in the second signal whether a user has been sensed or not. It should be understood that the first device can obtain a sensing result regarding whether a user exists within the sensing range after receiving the first signal.
[0152] The trigger also includes the following: when the first signal is used to trigger the first device to send a detection signal for sensing, the first device sends a detection signal, that is, triggers the first device to assist the second device in starting to sense whether a user is present.
[0153] In one possible implementation, the first device can send a second signal at a preset frequency, such as sending multiple sensing data or results indicating the presence of a user. This allows the second device to update the status of the user in a timely manner and perform corresponding operations based on the updated information, making the state switching of the second device more accurate. Alternatively, the second signal, which is a detection signal, can be sent at a preset frequency. The second device can then update the acquired sensing data and obtain sensing results based on these detection signals, performing real-time operations to further improve the accuracy of the second device's state switching.
[0154] Figure 6 This is a flowchart illustrating a display control method provided in an embodiment of this application. The method is described with a mouse as the first device and a PC as the second device, wherein the mouse and PC are on the same network, the PC acts as a sensing device, and the mouse acts as an assisting sensing device. Figure 6 As shown, the method includes S301 to S308.
[0155] S301, PC determines the first device.
[0156] For example, the PC can determine the first device when the display is initiated, such as when the user starts the PC. The first device is a device that is on the same network as the PC. This application embodiment uses the PC selecting a mouse as the first device as an example to illustrate the selection process, but it is not limited to a mouse.
[0157] Optionally, the PC can select one of the assisting sensing devices as the first device. For example, if there are multiple assisting sensing devices, the PC can select one as the first device to cooperate with the PC to obtain the sensing results. Alternatively, the PC can pre-select one of the assisting sensing devices as the first device.
[0158] For example, a PC can detect whether there is an assistive sensing device among the devices connected to the same network (the assistive sensing device described in this application embodiment includes a device with assistive sensing function, and the device may also have sensing capability; this application embodiment does not limit this). For instance, if the PC is on the same network as an assistive sensing device, that assistive sensing device can be identified as the first device. If the PC is on the same network as multiple assistive sensing devices, one can be selected from the multiple assistive sensing devices as the first device. For example, if a desk lamp, a smart speaker, and a mouse are all assistive sensing devices on the same network as the PC, the PC can select one as the first device based on the distance between each assistive sensing device and the PC. In one possible implementation, the PC can select the assistive sensing device closest to it as the first device; for example, the mouse is closest to the PC, so the mouse can be selected as the first device. Alternatively, the PC can select one from the desk lamp, smart speaker, or mouse as the first device based on a first preset distance. Assuming the distance between the smart speaker and mouse and the PC is less than or equal to a first preset distance, and the distance between the desk lamp and the PC is greater than the first preset distance, the PC can choose either the smart speaker or the mouse as the first device. Alternatively, the PC can select the smart speaker or the mouse that has previously served as the first device, such as the mouse, which provided detection signals during one or more previous PC startups. The first preset distance provided in this embodiment can be determined based on at least one of the following factors: applicable scenario, historical setup experience, or the sensing range of the assisting sensing device. This embodiment does not limit the distance. For example, the first preset distance can be 1 meter, 2 meters, etc.
[0159] In another possible implementation, the PC can select the assisting sensing device with the strongest signal strength between itself and the PC as the first device. For example, if the signal strength between the mouse and the PC is the strongest, the mouse can be selected as the first device. Alternatively, the PC can select one of the following as the first device: a desk lamp, a smart speaker, or a mouse, based on a first preset signal strength. Assuming that the signal strength between the smart speaker and the mouse and the PC is greater than or equal to the first preset signal strength, while the signal strength between the desk lamp and the PC is less than the first preset signal strength, the PC can choose either the smart speaker or the mouse as the first device. Alternatively, the PC can select the smart speaker or the mouse that has previously served as the first device. For example, if the mouse served as the first device after one or more previous PC startups, providing a detection signal for detecting the presence of a user, the mouse can be selected as the first device. The preset signal strength provided in this application embodiment can be determined based on at least one of the following factors: applicable scenario, historical setting experience, or the sensing range of the assisting sensing device. This application embodiment does not impose any limitations on this.
[0160] Additionally, the PC can pre-configure assistive sensing devices. One possible implementation is that the PC pre-configures an assistive sensing device as the primary device. For example, the PC could pre-configure the mouse as the primary device. When a display is initiated, the distance between the mouse and the PC is detected. If it is less than or equal to a preset distance, the mouse is considered suitable for sensing (also known as being suitable for sensing), and the mouse completes the subsequent operation. If the distance between the mouse and the PC is greater than the first preset distance, the PC can refer to the method described above, which involves the PC detecting whether there is an assistive sensing device among the devices connected to the same network and selecting one as the primary device. Another possible implementation is that the PC sets multiple assistive sensing devices according to priority. If the mouse is the highest priority assistive sensing device, when a display is initiated, the distance between the mouse and the PC is detected. If it is less than or equal to a preset distance, the mouse is considered suitable for sensing, and the mouse completes the subsequent operation. If the distance between the mouse and the PC is greater than the first preset distance, other assistive sensing devices with lower priority than the mouse can be used to complete the subsequent operation. For example, if the priority order is mouse, keyboard, and desk lamp, the PC can select the keyboard as the primary device to complete the subsequent operation if the distance between the mouse and the PC is greater than the first preset distance. Alternatively, the PC can select the closest or with the strongest signal strength from other assistive sensing devices (those connected to the same network as the PC) that have lower priority than the mouse to complete subsequent operations. For example, after a display is initiated, the PC can select the mouse to complete subsequent operations. This mouse can be considered the default paired device with the PC, that is, the mouse is set as the preset assistive sensing device so that it can be identified as the first device during subsequent sensing.
[0161] In one possible implementation, the PC can obtain the distance to each assisting sensing device using a wireless short-range ranging method. The wireless short-range ranging method includes at least one of star-flash ranging, RSSI measurement, or WiFi ranging. For example, assuming the assisting sensing devices on the same network as the PC include a mouse and a desk lamp, the PC can first perform RSSI measurements. For instance, through messages sent between the PC and the mouse, the PC can obtain the distance between the PC and the mouse; through messages sent between the PC and the desk lamp, the PC can obtain the distance between the PC and the desk lamp. The measurement data obtained from RSSI measurement has lower accuracy, but the PC can also compare this data with a first preset distance. For example, if the distance between the desk lamp and the PC is greater than the first preset distance, and the distance between the mouse and the PC is less than the first preset distance, then the mouse is the first device. The PC can also trigger a more precise calculation algorithm based on the RSSI measurement results to obtain a more accurate ranging distance. For example, the PC can use star-flash technology to trigger a star-flash ranging process to detect the distance between the PC and each assisting sensing device. For example, if the first preset distance is 0.5 meters, the data obtained by the PC through RSSI measurement has an accuracy at the meter level, which cannot determine whether the distance is less than or equal to the first preset distance. Therefore, other more precise distance measurement methods, such as star-flash distance measurement or WiFi distance measurement, can be used to obtain more precise orders of magnitude, such as millimeter or micrometer-level distances between the assistive sensing devices and the PC. Optionally, star-flash distance measurement can be used to measure the distance between all assistive sensing devices and the PC, or a distance measurement method more suitable for different assistive sensing devices can be used to measure the distance between the assistive sensing devices and the PC. For example, using star-flash distance measurement, the distance between the PC and the mouse is found to be 0.3 meters; using WiFi distance measurement, the distance between the desk lamp and the PC is found to be 0.6 meters, etc. Based on the distance measurement results, the mouse is an assistive sensing device with a distance less than the first preset distance. Therefore, the mouse is the first device, and the PC will interact with the mouse to obtain the sensing results and then control the display.
[0162] S302, the PC sends a first signal to the mouse in the first preset state. The first signal is used to trigger the mouse to send a second signal to detect the presence of a user.
[0163] This application embodiment uses the state where the first preset state is no input signal and no output signal as an example for explanation. When the first preset state is no input signal, or when the first preset state is no output signal, the PC can refer to... Figure 6 Examples of controlling the display screen are provided, and the embodiments in this application will not be described in detail one by one.
[0164] Optionally, the PC determines that it is in the first preset state in the following ways: One possibility is that the mouse detects that it has no input signal but outputs a signal, informing the PC that it is in the first preset state, triggering the PC to send the first signal to the mouse. Another possibility is that the PC detects no input signal but outputs a signal; for example, if the PC detects no input signal from the mouse and no output signal to the mouse, it determines that it is in the first preset state and sends the first signal to the mouse.
[0165] S303, The mouse receives the first signal.
[0166] Optionally, the first signal is used to instruct the mouse to begin sensing the presence of a user, that is, to begin sending a second signal capable of sensing the presence of a user. Alternatively, the first signal is used to instruct the mouse to send a second signal to the PC at a second frequency.
[0167] S304, The mouse sends a second signal to the PC.
[0168] For example, the mouse sends a second signal at a second frequency. For example, the second signal may be a detection signal for CSI data, or the second signal may be a detection signal for respiratory detection or heartbeat detection, or the second signal may include both a detection signal for CSI data and a detection signal for respiratory detection or heartbeat detection.
[0169] S305 and PC obtain sensing data based on the second signal.
[0170] For example, the PC can obtain sensing data of its current environment based on the second signal. The current environment can be determined with reference to the PC's sensing range, which can be referred to in the description in example S101, and will not be repeated here.
[0171] Optionally, the PC can obtain the sensing data based on the second signal through at least one of the following methods: the PC obtains the sensing data by detecting CSI data and determining whether there are fluctuations in the current environment, and the sensing data can determine whether a user exists; or, the PC obtains the sensing data by using a static user detection algorithm based on at least one of breathing detection or heartbeat detection, and the sensing data can determine whether a user exists, etc.
[0172] The PC uses sensory data to determine whether it has sensed the user, or in other words, it obtains a result indicating whether it has sensed the user. (See reference...) Figure 7a and Figure 7bLet's illustrate this scenario. For example, a PC can acquire CSI data via a second signal and preprocess the CSI data. Preprocessing can include filtering and noise reduction to improve CSI quality. After preprocessing, the time-varying nature of the preprocessed CSI data can be analyzed to determine if there are fluctuations in the current environment. If the time-varying nature of the preprocessed CSI data is small, it can be considered relatively stable, indicating no user movement in the current environment. If, after detection using one or more methods such as CSI variance variation, difference variation, or machine learning classification, the preprocessed CSI data shows significant fluctuations, it can be considered that a user has moved in the current environment. The PC can then determine that the user still exists based on the assumption that the user has not moved, resulting in the perception result: a user is detected. (Reference) Figure 7a The user's status, i.e., the user is leaving. Figure 7b In the context of user status, i.e., the user has left, the PC can determine that the user is about to leave the current scene based on the user's movement, which is considered a perception result of not detecting the user. Alternatively, the PC can combine the detection results of CSI data with other detection algorithms to jointly determine the presence of a user. For example, the PC can obtain breathing-related data through secondary signals or other detection signals. The PC can detect the presence of a stationary user by accumulating respiratory cycles and checking for periodicity. If the data obtained from the respiratory cycles is periodic, it indicates the presence of a stationary user, and if the data is not periodic, it indicates that the user may be moving, and it can be determined that the user is not present. Alternatively, the PC can analyze the frequency domain value of breathing or the breathing shape to detect the presence of a user. In some possible implementations, the PC can also use wireless sensing to detect fluctuations caused by user movement, see reference. Figure 7a If a user is leaving, the fluctuation can be detected, and the presence of fluctuation can be interpreted as the user not being detected. Alternatively, breathing and heart rate technologies can be used to determine the presence of a user by observing the presence or absence of breathing or heart rate; a heartbeat indicates the user is detected, while the absence of a heartbeat indicates the user is not detected. It should be understood that there can be multiple methods for detecting the presence of a user, and the methods can be configured according to the PC's sensing capabilities and applicable scenarios. The embodiments in this application only illustrate some methods for detecting the presence of a user and are not limited thereto.
[0173] Optionally, after obtaining the sensing data from the second signal, the PC can also send the sensing data to the mouse, which calculates the sensing result and then feeds it back to the PC. The PC then obtains the sensing result based on the mouse's feedback. The calculation of the sensing result by the mouse based on the sensing data can be referenced from the calculation of the sensing result by the PC based on the sensing data, and will not be elaborated further.
[0174] S306. If the PC obtains a perception result that no user is perceived based on the perception data, then execute S307; if it obtains a perception result that a user is perceived, then execute S308.
[0175] S307, PC enters the second preset state.
[0176] For example, the second preset state includes, but is not limited to, power-saving states such as screen off and screen locked.
[0177] S308 and PC maintain the first preset state during the first time period.
[0178] For example, when the PC senses the presence of a user based on the second signal, it can maintain the current display state, or it can turn off the screen or lock the screen after a timed screen-off period (which can be regarded as a first time period) preset by the user.
[0179] It should be understood that after sending the second signal to the PC, the mouse can stop sending signals to reduce power consumption. Alternatively, the mouse can stop sending signals to the PC after sending a detection signal for a second preset time period, which is equivalent to the PC stopping sensing. This allows the PC to continue sensing for a period of time so that it can notify the PC promptly when the user returns, or it can stop sensing promptly after the user has not returned for a period of time, thus reducing power consumption. The duration of the second preset time period is not limited in this embodiment and can be set according to the actual applicable scenario. Alternatively, the PC can send a third signal to the mouse to request the mouse to stop sending the second signal.
[0180] Figure 8 This is a flowchart illustrating another display control method provided in an embodiment of this application, where the first device is a mouse and the second device is a PC. Figure 8 As shown, this method is based on Figure 6 S301 to S308, and also S309 to S311.
[0181] S309 can be executed after S307.
[0182] S309, PC sends a fourth signal to the mouse.
[0183] The fourth signal can instruct the mouse to continue sending a detection signal to sense the presence of a user; this detection signal can be called the fifth signal. The fourth signal can also instruct the frequency of sending the fifth signal to be reduced, such as using a first frequency, where the fifth signal is sent at a frequency lower than the second frequency. For example, if the first frequency is 5 Hz, the second frequency could be 10 Hz, etc.
[0184] Optionally, if the mouse continues to send a fifth signal after defaulting to sending a second signal, the fourth signal can instruct the mouse to send a second feedback message at a first frequency. If the mouse stops sending detection signals after defaulting to sending a second signal (i.e., stops sensing), the fourth signal can be used to request the first device to continue sending detection signals (i.e., the fifth signal), and instruct the first device to send the fifth signal at the first frequency. Alternatively, if the PC and mouse have pre-agreed that the sent fourth signal indicates a need for the mouse to continue sending detection signals, the PC can send a message in the fourth signal to the mouse instructing the mouse to send the fifth signal at the first frequency.
[0185] It should be understood that PCs can also reduce the methods for detecting the presence of users. For example, after receiving a second signal, the PC uses CSI data and static user detection algorithms, such as obtaining sensing data based on CSI and breathing detection, to obtain a sensing result. If the sensing result indicates that no user is detected, the PC can use only CSI data detection or only static user detection algorithms to obtain a sensing result, thereby achieving energy saving.
[0186] S310, the mouse sends the fifth signal to the PC at the first frequency.
[0187] For example, the mouse can send multiple sets of detection signals at a first frequency. In this embodiment, the fifth signal is used as one of the detection signals for illustration.
[0188] S311, upon sensing the user based on the fifth signal, the PC enters the third preset state.
[0189] For example, the third preset state can be the same as the first preset state. For instance, when a user leaves the text editing interface, the first preset state is a state of no input and no output of the edited text. The PC obtains perception data based on the fifth signal. When it finds that the user is not detected based on the perception data, it maintains the second preset state. When it finds that the user is detected based on the perception data, which is equivalent to the user returning to the current environment, it can re-enter the first preset state, such as displaying the text editing interface used before leaving to the user.
[0190] Alternatively, when the user returns to their current environment, the PC can enter a third preset state, which is different from the first preset state. The third preset state may include turning on the screen or entering a welcome display page (or entering a welcome display state, etc.).
[0191] The control method provided in this application continues to detect the current environment even when no user is detected, and can promptly unlock or turn off the screen for the user when the user returns, thus welcoming the user back and providing a better user experience.
[0192] In one possible implementation, refer to Figure 6 For example, the mouse can also actively trigger perception, such as... Figure 9 As shown, the method is executed starting from S304, including S304 to S308; see reference. Figure 8 For example, the mouse can also actively trigger perception, such as... Figure 10 As shown, the method is executed starting from S304 and includes S304 to S311.
[0193] Figure 11 This is a flowchart illustrating another display control method provided in an embodiment of this application, where the first device is a mouse and the second device is a PC. Figure 10 As shown, this method is based on Figure 6 The method, before S307, also includes S312, and replaces S307 with S313, that is, the method includes S301 to S306, S312 and S313.
[0194] S312 and PC acquire optical detection results, which are used to display whether a user has been detected.
[0195] For example, a PC can use an optical camera (also known as a webcam) to detect the presence of a user. This technology can also be called "user awareness" or "face detection," and its optical detection results are highly accurate.
[0196] S313 and PC enter the second preset state when the optical detection results show that no user has been detected.
[0197] The PC combines the perception results from the second signal with the optical detection results. When both results indicate that the user is not in the current scene, it enters a second preset state, such as locking the screen or turning off the screen. The accuracy of these screen-locking or screen-off operations is higher. Furthermore, the optical detection result is triggered by the PC during idle time; the camera and other optical devices do not continuously detect the user's presence, reducing the security risks associated with continuous camera operation and the possibility of misuse of camera data. Additionally, detecting the user's presence only when the PC is idle effectively solves the energy consumption problem caused by the continuous operation of the camera and related algorithms. For example, by combining the perception and optical detection results and entering the second preset state when both indicate that the user is not in the current scene, it can effectively save energy, extend device usage time, and improve the user experience when laptops are powered by batteries.
[0198] In one possible implementation, the method is based on Figure 10 S301 to S306, S312 and S313 are executed after S306, or S308 is executed after S306. And after S312, the following can be executed: Figure 8 S309 to S311 are shown.
[0199] The above example illustrates how perceptual data is obtained from a PC and calculated to obtain the perceptual result. Below, we will use perceptual data obtained from a mouse as an example. Figure 12 This is a flowchart illustrating another control method provided in an embodiment of this application. The method is described with a mouse as the first device and a PC as the second device, wherein the mouse, desk lamp, and PC are on the same network. Figure 12 As shown, the method includes S401 to S408.
[0200] S401, PC determines the first device.
[0201] For example, the PC can determine the first device for sensing when the display is initiated, or in other words, determine the sensing device. The method for determining the sensing device can refer to the method for determining the assisting sensing device in S301, the difference being that the determined sensing device should include sensing functions, which will not be elaborated here.
[0202] S402, the PC sends a first signal to the mouse in the first preset state. The first signal includes a detection signal to sense whether a user is present.
[0203] This application uses the example of a first preset state where there is no input signal and no output signal, but this is not a limitation. For details on the PC determining whether it is in the first preset state, please refer to S302, which will not be elaborated further.
[0204] S403, the mouse receives the first signal.
[0205] Optionally, the first signal is a detection signal, which can refer to the detection signal (i.e., the second signal) provided in S304. For example, the detection signal may include a detection signal for CSI data, or one or more detection signals that can acquire fluctuations in respiratory or heart rate.
[0206] For example, the first signal can instruct the mouse to begin sensing the presence of a user, i.e., to obtain sensing data based on the detection signal. Alternatively, the first signal can also carry instruction information, such as instructing the mouse to feed back sensing data or sensing results to the PC at a second frequency.
[0207] S404, Mouse detects whether a user is present.
[0208] Optionally, the mouse can detect the presence of a user by at least one of the following methods: by detecting CSI data and determining whether there are fluctuations in the current environment; or by using a static user detection algorithm and determining whether there is a user based on at least one of breathing detection or heartbeat detection.
[0209] The mouse can detect the presence of a user; you can refer to the PC detection implementation in S304, which will not be elaborated further.
[0210] S405, The mouse sends a second signal to the PC.
[0211] Optionally, the mouse can obtain a second signal based on the perceived data and feed it back to the PC. For example, the mouse can feed back the perceived data at a second frequency. For instance, the mouse can periodically send messages to the PC at a second frequency indicated by the PC, such as sending CSI data. The PC then processes the CSI data to determine whether the user was detected or not.
[0212] Alternatively, the mouse can calculate the perception result based on the perceived data and indicate the perception result to the PC via a second signal. For example, the PC can periodically send feedback signals, such as a second signal, to the mouse based on a pre-agreed or pre-set second frequency.
[0213] S406. The PC receives the second signal. If the second signal indicates that no user is detected, then S407 is executed. If the second signal indicates that a user is detected, then S408 is executed.
[0214] S407, PC enters the second preset state.
[0215] For example, the second preset state includes, but is not limited to, power-saving states such as screen off and screen locked.
[0216] S408 and PC maintain the first preset state during the first time period.
[0217] For example, when the PC determines that a user is present based on the second signal, it can maintain the current display state, or it can turn off the screen or lock the screen according to the user's preset timeout period (which can be regarded as the first time period).
[0218] It should be understood that after the mouse sends a second signal to the PC indicating that it has not detected the user, it can stop sensing to reduce power consumption. Alternatively, after sending the second signal to the PC indicating that it has not detected the user, the mouse can stop sensing after a second preset time period. This allows it to continue sensing for a period of time so that it can promptly notify the PC when the user returns, or it can stop sensing promptly after the user has not returned for a period of time, thus reducing power consumption. The duration of the second preset time period is not limited in this embodiment and can be set according to the actual applicable scenario. Alternatively, the PC can send a third signal to the mouse to request the mouse to stop sensing whether a user is present, and the mouse will stop sensing based on this message.
[0219] The mouse-based sensing method provided in this application, which acquires sensing data through the mouse, increases the applicable scenarios of the control method, making it more widely applicable.
[0220] Figure 13 This is a flowchart illustrating another control method provided in an embodiment of this application, where the first device is a mouse and the second device is a PC. Figure 13 As shown, this method is based on Figure 12 S401 to S408, and also S409 to S411.
[0221] S409 can be executed after S407.
[0222] S409, the PC sends a fourth signal to the mouse.
[0223] The fourth signal can instruct the mouse to continue sensing. The mouse can use the fifth signal to provide feedback on sensing data or results to the PC. Alternatively, the fourth signal can also instruct the mouse to reduce the frequency at which it sends the fifth signal, such as instructing the mouse to use a first frequency, which is lower than the second frequency. For example, if the first frequency is 5 Hz, the second frequency could be 10 Hz, etc.
[0224] Optionally, if the mouse sends a fifth signal after defaulting to sending a second signal, the fourth signal can instruct the mouse to send a second feedback message at a first frequency. If the mouse stops sensing after defaulting to sending the second signal, the fourth signal can be used to request the first device to continue sending sensing data or sensing results, and instruct the first device to send them at the first frequency. Alternatively, if the PC and mouse have pre-agreed that the sent fourth signal indicates a need for the mouse to continue sending detection signals, the fourth signal sent by the PC to the mouse carries information instructing the mouse to send a fifth signal at the first frequency.
[0225] It should be understood that mice can also reduce the methods of detecting the presence of users. For example, mice can use CSI data detection and static user detection algorithms, such as breathing detection, to detect the presence of users. If the mouse determines that no user is detected based on the detection data, it can send a second signal and then use only CSI data detection or only static user detection algorithms to detect the presence of users, thereby achieving energy saving.
[0226] S410, the mouse sends the fifth signal to the PC at the first frequency.
[0227] S411, upon sensing the user based on the fifth signal, the PC enters the third preset state.
[0228] For instructions on how to enter the third preset state of the PC, please refer to S311. This will not be repeated here.
[0229] The control method provided in this application continues to detect the current environment even when no user is detected, and can promptly unlock or turn off the screen for the user when the user returns, thus welcoming the user back and providing a better user experience.
[0230] In one possible implementation, refer to Figure 12 For example, the mouse can also actively trigger the sensing, meaning the method executes from S404 to S408; see reference. Figure 13 For example, the mouse can also actively trigger perception, that is, the method starts execution from S404, including S404 to S411.
[0231] In one possible implementation, Figure 12 or Figure 13 The provided control method can also be combined with an optical camera. The PC uses the detection results from the optical camera and the sensory data or results from the mouse feedback to enter a second preset state, such as locking the screen or turning off the screen, when both results indicate that the user is not in the current scene. The accuracy of the screen locking or screen turning off operation is higher.
[0232] The control method provided in this application embodiment can also be applied to bidirectional sensing scenarios. In bidirectional sensing scenarios, the operation of the PC or mouse to acquire sensing data or obtain sensing results can refer to the above examples. In unidirectional sensing scenarios, the example of acquiring sensing data or sensing results will not be elaborated further.
[0233] For example, the control method provided in this application embodiment, when implemented in a first device, can be implemented based on the system in the first device. For instance, if the first device is a keyboard, it can be implemented in the keyboard operating system. For example, the method for sensing the presence of a user can be implemented through the system's wireless sensing system, driver, or server. This application embodiment also relates to the interaction between the first device and the second device, and algorithms for calculating the distance or signal strength between the first device and the second device. These algorithms can be implemented in corresponding calculators or servers, etc.
[0234] For example, the detection signal provided in this application embodiment includes a set of signals that are intermittently transmitted within a continuous time period, such as a set of signals transmitted at discrete time periods, to obtain perception data and then obtain the perception result of whether a user exists.
[0235] This application provides various control methods that can quickly turn off the screen (or lock the screen) and wake it up (screen on or welcome, etc.) based on the presence of a user. This improves the user experience, saves energy and reduces carbon emissions, and enhances display security. In this method, the distance or signal strength between the sensing device and the second device is used to determine whether the first device is suitable for sensing. This improves sensing accuracy and avoids abnormal situations where the selected assisting sensing device malfunctions, such as the inability to sense objects if the mouse is removed, thus ensuring the accuracy and feasibility of the display.
[0236] The control method provided in this application is applicable to at least one of wireless communication methods, such as Bluetooth (BT) communication, Sparklink (or Nearlink) communication, and Wi-Fi communication. In this application, BT and Bluetooth Low Energy (BLE) can refer to each other. Sparklink can include at least one of the following: Sparklink Low Energy (SLE), Sparklink Basic (SLB), or Sparklink Position (SLP).
[0237] Figure 14 This is a schematic diagram of the structure of a second device provided in an embodiment of this application, as shown below. Figure 14 As shown, the second device 30 includes a transmitting module 301, a receiving module 302, and a processing module 303.
[0238] The sending module is configured to send a first signal to the first device in a first preset state, the first preset state including at least one of a state with no input signal or a state with no output signal, the first signal being used to trigger the first device to sense whether a user is present.
[0239] The receiving module 302 is also used to receive a second signal from the first device.
[0240] The processing module 303 is configured to enter a second preset state when the user is not detected according to the second signal, the second preset state being different from the first preset state.
[0241] In one possible implementation, the second preset state includes at least one of screen lock or sleep mode.
[0242] In one possible implementation, the first signal triggering the first device to sense the presence of a user includes: the first signal triggering the first device to send the second signal, the second signal including a detection signal for sensing the presence of the user; the processing module 303 is specifically used to acquire sensing data based on the second signal, the sensing data being used to determine whether the user exists; and based on the sensing data, the user is not sensed.
[0243] In one possible implementation, the first signal triggering the first device to sense the presence of a user includes: the first signal triggering the first device to sense the presence of the user based on the first signal; the second signal includes an indication of the sensing result of the first device, the sensing result including not sensing the user; and the processing module 303 is specifically used to obtain the sensing result of not sensing the user based on the indication of the second signal.
[0244] In one possible implementation, the first signal used to trigger the first device to sense whether a user exists includes: the first signal used to trigger the first device to sense whether the user exists based on the first signal; the second signal includes sensing data acquired by the first device; and the processing module 303 is specifically used to determine whether the user is not sensed based on the sensing data acquired by the first device.
[0245] In one possible implementation, the processing module 303 is further configured to maintain the first preset state for a first time period when the user is sensed according to the second signal.
[0246] In one possible implementation, the processing module 303 is further configured to enter the second preset state after the first time period.
[0247] In one possible implementation, the first device and the second device satisfy at least one of the following: the distance between the first device and the second device is less than or equal to a first preset distance, or the signal strength of the first device and the second device is greater than or equal to the first preset signal strength.
[0248] In one possible implementation, the first device is a pre-defined sensing device.
[0249] In one possible implementation, the processing module 303 is further configured to obtain the distance between the first device and the second device using a wireless short-range ranging method, which includes at least one of star-flash ranging, RSSI measurement, or WiFi ranging.
[0250] In one possible implementation, the sending module 301 is further configured to send a third signal to the first device, the third signal being used to trigger the first device to stop sensing the presence of the user.
[0251] In one possible implementation, the transmitting module 301 is further configured to transmit a fourth signal to the first device, the fourth signal being configured to instruct the first device to transmit a fifth signal at a first frequency, or the fourth signal being configured to request the first device to continue sensing whether the user exists, and instruct the first device to transmit the fifth signal at the first frequency, wherein the fifth signal includes an indication of whether the first device senses the user, or includes sensing data acquired by the first device, or includes a detection signal for sensing whether the user exists.
[0252] In one possible implementation, the processing module 303 is further configured to enter a third preset state when the user is sensed according to the fifth signal, the third preset state being the same as or different from the first preset state.
[0253] In one possible implementation, the second device further includes an optical module for acquiring optical detection results, which indicate whether the user is detected; the processing module 303 is specifically used to enter the second preset state when the optical detection results indicate that the user is not detected and the perception results include that the user is not perceived.
[0254] In one possible implementation, refer to Figure 15 The second device also includes a star flash module 304 for transmitting star flash signals.
[0255] It should be understood that Figure 14 and Figure 15 The modules shown are merely examples. Each module can perform its operations or variations thereof by referring to the method section of the embodiments of this application. Other operations can also be performed in the examples provided in the embodiments of this application, and are not limited to the examples of the embodiments of this application.
[0256] In one possible implementation, the communication module (including at least one of a receiving module and a transmitting module) and the processing module in this application embodiment can be simultaneously deployed in the StarScan module, Bluetooth module, or Wi-Fi module; or, the communication module in this application embodiment can be deployed in the StarScan module, Bluetooth module, or Wi-Fi module, and the processing module in this application embodiment can be deployed in other modules besides the StarScan module, Bluetooth module, or Wi-Fi module; or, the processing module in this application embodiment can be deployed in the StarScan module, Bluetooth module, or Wi-Fi module, and the communication module in this application embodiment can be deployed in other modules besides the StarScan module, Bluetooth module, or Wi-Fi module. This application embodiment does not specifically limit this.
[0257] Figure 16 This is a schematic diagram of the structure of a first device provided in an embodiment of this application, as shown below. Figure 16 As shown, the first device 40 includes a receiving module 401 and a transmitting module 402.
[0258] The receiving module 401 is used to receive a first signal, which is used to trigger the first device to sense whether a user is present.
[0259] The transmitting module 402 is used to transmit a second signal to the second device, the second signal being obtained based on the first signal.
[0260] In one possible implementation, the first signal is used to trigger the first device to send the second signal, which includes a detection signal for sensing the presence of the user.
[0261] In one possible implementation, the first signal is used to trigger the first device to sense the presence of the user based on the first signal, the first device referring to... Figure 17 It also includes a processing module 403, which is used to acquire sensing data based on the first signal, the sensing data being used to determine whether the user exists; and to obtain a second signal indicating the sensing result based on the sensing data, the sensing result including that the user was not detected.
[0262] In one possible implementation, the first signal is used to trigger the first device to sense the presence of the user based on the first signal. The processing module 403 is also used to acquire sensing data based on the first signal and obtain the second signal based on the sensing data. The second signal includes the sensing data acquired by the first device.
[0263] In one possible implementation, the processing module 403 acquires the sensing data by at least one of the following methods: acquiring the sensing data based on the presence of fluctuations in the current environment through the detection of CSI data; or acquiring the sensing data based on at least one of breathing detection or heartbeat detection through a static user detection algorithm.
[0264] In one possible implementation, the receiving module 401 is further configured to receive a third signal, which triggers the first device to stop sensing the presence of the user.
[0265] In one possible implementation, the receiving module 401 is further configured to receive a fourth signal, which is used to instruct the first device to send a fifth signal at a first frequency, or the fourth signal is used to request the first device to continue sensing whether the user exists, and instruct the first device to send the fifth signal at the first frequency, wherein the fifth signal includes an indication of whether the first device senses the user, or includes sensing data acquired by the first device, or includes a detection signal for sensing whether the user exists.
[0266] In one possible implementation, the transmitting module 402 is further configured to transmit the fifth signal to the second device according to the first frequency.
[0267] In one possible implementation, refer to Figure 18 The second device also includes a star flash module for transmitting star flash signals.
[0268] It should be understood that Figures 16 to 18 The modules shown are merely examples. Each module can perform its operations or variations thereof by referring to the method section of the embodiments of this application. Other operations can also be performed in the examples provided in the embodiments of this application, and are not limited to the examples of the embodiments of this application.
[0269] In one possible implementation, the communication module (including at least one of a receiving module and a transmitting module) and the processing module in this application embodiment can be simultaneously deployed in the StarScan module, Bluetooth module, or Wi-Fi module; or, the communication module in this application embodiment can be deployed in the StarScan module, Bluetooth module, or Wi-Fi module, and the processing module in this application embodiment can be deployed in other modules besides the StarScan module, Bluetooth module, or Wi-Fi module; or, the processing module in this application embodiment can be deployed in the StarScan module, Bluetooth module, or Wi-Fi module, and the communication module in this application embodiment can be deployed in other modules besides the StarScan module, Bluetooth module, or Wi-Fi module. This application embodiment does not specifically limit this.
[0270] In addition, such as Figure 19As shown, Figure 19 This is a schematic diagram of the structure of device 50 according to an embodiment of this application. Figure 19 The device 50 shown includes a transceiver 501 and a processor 502. This device 50 is equivalent to the second device, display device, or PC executable in the method examples above, for executing methods S101 to S103, or S101 to S104, or S301 to S308, or S301 to S311, or S304 to S308, or S304 to S311, or S301 to S306, S312 and S313, or S401 to S408, or S401 to S411, or S404 to S408, or S404 to S411, etc. Alternatively, the device 50 may be equivalent to the first device or mouse exemplified in the method, used to perform methods S201 and S202 in the above embodiments, or to perform S301 to S308, or to perform S301 to S311, or to perform S304 to S308, or to perform S304 to S311, or to perform S301 to S306, S312 and S313, or to perform S401 to S408, or to perform S401 to S411, or to perform S404 to S408, or to perform S404 to S411, etc.
[0271] It should be noted that the division of parts in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. The functions in this embodiment are integrated into a single processor, or the transceiver and processor may exist separately. Furthermore, device 50 may include built-in memory, or it may not include memory, or it may include external memory, etc., and is not limited to the division exemplified in this embodiment. The integrated device described above can be implemented in hardware, such as a chip, or in the form of a software functional unit, or in a combination of hardware and software.
[0272] In addition, this application embodiment also provides a device 60, see [link to relevant documentation]. Figure 20 As shown, Figure 20 This is a schematic diagram of the structure of a device 60 provided in an embodiment of this application. For example... Figure 20As shown, device 60 may include a processor 601, a memory 602 coupled to the processor 601, and a transceiver 603. The transceiver 603 may include a MR (Metal-to-Metal), LR (Metal-to-Low), communication interface, optical module, etc., for receiving messages or data information. The processor 601 may include a central processing unit (CPU), a network processor (NP), or a combination of a CPU and an NP, for executing the wake-up signal processing steps in the device exemplified in the above embodiments. The processor may also be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. Processor 601 may refer to a single processor or may include multiple processors. Memory 602 may include volatile memory, such as random-access memory (RAM); memory may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD); memory 602 may also include combinations of the above types of memory. Memory 602 may refer to a single memory or include multiple memories for storing program instructions. In one embodiment, memory 602 stores computer-readable instructions, which include multiple software modules, such as a sending module, a processing module, and a receiving module. After executing each software module, processor 601 can perform corresponding operations according to the instructions of each software module. In this embodiment, the operation performed by a software module actually refers to the operation performed by processor 601 according to the instructions of the software module. Optionally, processor 601 may also store program code or instructions for executing the scheme of the embodiments of this application, in which case processor 601 does not need to read program code or instructions from memory 602.
[0273] The device 60 can be used to perform the methods in the above embodiments. Specifically, the device 60 is equivalent to the second device, display device, or PC in the examples of the method, and can perform methods S101 to S103 in the above embodiments, or perform S101 to S104, or perform S301 to S308, or perform S301 to S311, or perform S304 to S308, or perform S304 to S311, or perform S301 to S306, S312 and S313, or perform S401 to S408, or perform S401 to S411, or perform S404 to S408, or perform S404 to S411, etc. Alternatively, the device 60 may be equivalent to the first device or mouse exemplified in the method, used to perform methods S201 and S202 in the above embodiments, or to perform S301 to S308, or to perform S301 to S311, or to perform S304 to S308, or to perform S304 to S311, or to perform S301 to S306, S312 and S313, or to perform S401 to S408, or to perform S401 to S411, or to perform S404 to S408, or to perform S404 to S411, etc.
[0274] Furthermore, this application also provides a communication device. The communication device includes a storage medium and a processor connected to the storage medium. The storage medium stores instructions, which, when executed by the processor, enable the processor to implement some or all of the operations in any of the methods described in any of the foregoing embodiments.
[0275] Furthermore, this application also provides a communication device. The communication device includes a processor connected to a storage medium. The storage medium may be disposed within or outside the communication device. The storage medium stores instructions, which, when executed by the processor, enable the processor to implement some or all of the operations in any of the methods described in any of the foregoing embodiments.
[0276] This application also provides a computer-readable storage medium storing instructions that, when executed on a processor, implement some or all of the operations in any of the methods in any of the foregoing embodiments.
[0277] This application also provides a computer program product, including a computer program that, when run on a processor, implements some or all of the operations in any method of any of the foregoing embodiments.
[0278] This application also provides a chip, including an interface circuit and a processor. The interface circuit and the processor are connected, and the processor is used to cause the chip to perform some or all of the operations in any of the methods in any of the foregoing embodiments.
[0279] This application also provides a chip system, including: a processor coupled to a memory, the memory being used to store programs or instructions, and when the program or instructions are executed by the processor, the chip system enables the implementation of some or all of the operations in any one of the methods in any of the foregoing embodiments.
[0280] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.
[0281] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.
[0282] For example, the chip system can be an FPGA, an ASIC, a system on-chip (SoC), a CPU, an NP, a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.
[0283] This application also provides a system, including one or more of the above-described devices, apparatuses, computer-readable storage media, computer program products, chips, or chip systems. It can be applied to... Figure 1 The scenario shown is not limited to this one.
[0284] In one possible implementation, the system provided in this application embodiment includes a first device and a second device.
[0285] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0286] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0287] In the embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical business division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between apparatuses or units, and may be electrical, mechanical, or other forms.
[0288] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0289] Furthermore, the various business units in the embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software business unit.
[0290] If the integrated unit is implemented as a software business unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the technical solution of this application can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, Random Access Memory, magnetic disks, or optical disks.
[0291] Those skilled in the art will recognize that, in one or more of the examples above, the services described in this application can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these services can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of computer programs from one place to another. Storage media can be any available medium accessible to general-purpose or special-purpose computers.
[0292] The above-described specific embodiments further illustrate the purpose, technical solution, and beneficial effects of this application. It should be understood that the above are merely specific embodiments of this application.
[0293] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A control method, characterized in that, include: In a first preset state, the second device sends a first signal to the first device. The first preset state includes at least one of a state with no input signal or a state with no output signal. The first signal is used to trigger the first device to sense whether a user is present. The second device receives a second signal from the first device; If the second device does not detect the user according to the second signal, it enters a second preset state, which is different from the first preset state.
2. The method according to claim 1, characterized in that, The second preset state includes at least one of screen lock or sleep mode.
3. The method according to claim 1 or 2, characterized in that, The first signal used to trigger the first device to detect the presence of a user includes: the first signal used to trigger the first device to send the second signal. The second signal includes a detection signal for sensing the presence of the user. The statement that the user was not detected according to the second signal includes: Based on the second signal, perception data is acquired, and the perception data is used to determine whether the user exists. According to the perceived data, the user was not detected.
4. The method according to claim 1 or 2, characterized in that, The first signal triggering the first device to sense the presence of a user includes: the first signal triggering the first device to sense the presence of the user based on the first signal. The second signal includes an indication of the sensing result of the first device, the sensing result including no sensing of the user. The statement that the user was not detected according to the second signal includes: Based on the indication of the second signal, the perception result of the user who was not perceived is obtained.
5. The method according to claim 1 or 2, characterized in that, The first signal triggering the first device to sense the presence of a user includes: the first signal triggering the first device to sense the presence of the user based on the first signal. The second signal includes the sensing data acquired by the first device. The statement that the user was not detected according to the second signal includes: According to the sensing data obtained by the first device, the user was not detected.
6. The method according to any one of claims 1 to 5, characterized in that, Also includes: When the second device senses the user based on the second signal, it maintains the first preset state for a first time period.
7. The method according to claim 6, characterized in that, Also includes: After the first time period, the second device enters the second preset state.
8. The method according to any one of claims 1 to 7, characterized in that, The first device and the second device satisfy at least one of the following: The distance between the first device and the second device is less than or equal to a first preset distance, or, The signal strength of the first device and the second device is greater than or equal to the first preset signal strength.
9. The method according to any one of claims 1 to 8, characterized in that, The first device is a pre-set sensing device.
10. The method according to claim 8, characterized in that, Also includes: The second device obtains the distance between the first device and the second device through a wireless short-range ranging method, which includes at least one of star-flash ranging, received signal strength index (RSSI) measurement, or Wi-Fi ranging.
11. The method according to any one of claims 1 to 10, characterized in that, After entering the second preset state, the process also includes: The second device sends a third signal to the first device, the third signal being used to trigger the first device to stop sensing whether the user exists.
12. The method according to any one of claims 1 to 10, characterized in that, After entering the second preset state, the process also includes: The second device sends a fourth signal to the first device, the fourth signal being used to instruct the first device to send a fifth signal at a first frequency, or the fourth signal being used to request the first device to continue sensing whether the user exists, and instructing the first device to send the fifth signal at the first frequency, wherein the fifth signal includes an indication of whether the first device senses the user, or includes sensing data acquired by the first device, or includes a detection signal for sensing whether the user exists.
13. The method according to claim 12, characterized in that, Also includes: When the second device senses the user based on the fifth signal, it enters a third preset state, which may be the same as or different from the first preset state.
14. The method according to any one of claims 1 to 13, characterized in that, Before entering the second preset state, the method further includes: the second device acquiring an optical detection result, the optical detection result being used to indicate whether the user is detected; If the optical detection result indicates that the user has not been detected, the second device enters the second preset state.
15. A control method, characterized in that, include: The first device receives a first signal, which triggers the first device to detect the presence of a user. The first device sends a second signal to the second device, the second signal being derived from the first signal.
16. The method according to claim 15, characterized in that, The first signal is used to trigger the first device to send the second signal, the second signal including a detection signal for sensing the presence of the user.
17. The method according to claim 15, characterized in that, The first signal is used to trigger the first device to sense whether the user exists based on the first signal. The method further includes: The first device acquires sensing data based on the first signal, and the sensing data is used to determine whether the user exists. The first device obtains a second signal indicating the perception result based on the perception data, the perception result including that the user was not perceived.
18. The method according to claim 15, characterized in that, The first signal is used to trigger the first device to sense whether the user exists based on the first signal. The method further includes: The first device acquires sensing data based on the first signal; The first device obtains the second signal based on the sensing data, and the second signal includes the sensing data acquired by the first device.
19. The method according to claim 17 or 18, characterized in that, The acquisition of the perceived data includes at least one of the following methods: By detecting Channel State Information (CSI) data, the perceived data is obtained based on whether there are fluctuations in the current environment; or, The perception data is obtained by using a static user detection algorithm based on at least one of breathing detection or heartbeat detection.
20. The method according to any one of claims 15 to 19, characterized in that, Also includes: The first device receives a third signal, which triggers the first device to stop sensing whether the user exists.
21. The method according to any one of claims 15 to 19, characterized in that, Also includes: The first device receives a fourth signal, which instructs the first device to send a fifth signal at a first frequency, or the fourth signal requests the first device to continue sensing whether the user exists, and instructs the first device to send the fifth signal at the first frequency, wherein the fifth signal includes an indication of whether the first device senses the user, or includes sensing data acquired by the first device, or includes a detection signal for sensing whether the user exists.
22. The method according to claim 21, characterized in that, Also includes: The first device sends the fifth signal to the second device according to the first frequency.
23. A communication device, characterized in that, The communication device includes a module for performing the method according to any one of claims 1 to 14, or includes a module for performing the method according to any one of claims 15 to 22.
24. A communication device, characterized in that, The communication device includes a star flash module for transmitting star flash signals, and the communication device further includes a module for performing the method according to any one of claims 1 to 14, or includes a module for performing the method according to any one of claims 15 to 22.
25. A communication device, characterized in that, The communication device includes a processor configured to perform the method of any one of claims 1 to 14, or configured to perform the method of any one of claims 15 to 22.
26. A communication device, characterized in that, include: The input / output interface and logic circuit are provided, wherein the input / output interface is used to acquire at least one of input information or output information; and the logic circuit is used to perform the method of any one of claims 1 to 14, or to perform the method of any one of claims 15 to 22.
27. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed, cause the method of any one of claims 1 to 14 to be implemented, or cause the method of any one of claims 15 to 22 to be implemented.
28. A computer program product, characterized in that, The computer program product includes instructions that, when executed, cause the method of any one of claims 1 to 14 to be implemented, or cause the method of any one of claims 15 to 22 to be implemented.