Device control method, electronic device, storage medium and program product
By obtaining the motion parameters of the electronic device, determining the target operating frequency, and realizing control of the display device based on short-range wireless communication, the problems of inconvenient operation and high power consumption of traditional device control methods are solved, thereby improving user experience and reducing power consumption.
Patent Information
- Application Number
- CN202410309571.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-18
- Publication Date
- 2025-09-19
AI Technical Summary
Traditional device control methods are inconvenient to operate and have high power consumption. Existing external input devices have problems of inconvenient operation and high power consumption when controlling display devices.
By obtaining a patent and responding to the patent specification, the target operating frequency is determined by obtaining the motion parameters of the electronic device, and the display device is controlled based on short-range wireless communication.
The convenience of users controlling the display device is improved, the power consumption of the electronic device controlling the display device is reduced, and synchronization and smooth operation of the electronic device and the display device are achieved.
Smart Images

Figure CN120669568A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of electronic devices, and in particular to a device control method, electronic device, storage medium, and program product. Background Art
[0002] Traditional device control methods typically rely on users moving external input devices around their desktop to control display devices. However, with the continuous pursuit of improved user experience, new methods for mid-air device control have gradually developed. Existing methods, which typically use remote controls to control display devices, are inconvenient to operate. Furthermore, existing external input devices have high output frequencies when controlling display devices, resulting in high power consumption. Summary of the Invention
[0003] To overcome the problems existing in the related art, the present disclosure provides a device control method, an electronic device, a storage medium and a program product, which can reduce the power consumption of the electronic device controlling the display device and improve the user experience.
[0004] According to a first aspect of an embodiment of the present disclosure, there is provided a device control method, including:
[0005] Responding to the control instruction, obtaining motion parameters of the electronic device;
[0006] determining a target operating frequency of the electronic device based on a motion parameter of the electronic device;
[0007] Based on the target operating frequency, a display device connected to the electronic device is controlled.
[0008] In one embodiment, determining the target operating frequency of the electronic device based on the motion parameter of the electronic device includes:
[0009] When the motion parameter of the electronic device is greater than a preset parameter threshold, determining the target operating frequency to be a first preset frequency;
[0010] When the motion parameter of the electronic device is less than or equal to the preset parameter threshold, determining the target operating frequency to be a second preset frequency;
[0011] Wherein, the first preset frequency is greater than the second preset frequency.
[0012] In one embodiment, the motion parameter of the electronic device includes: the motion speed of the electronic device or the motion distance of the electronic device.
[0013] In one embodiment, controlling a display device connected to the electronic device based on the target operating frequency includes:
[0014] Converting the motion parameters of the electronic device using a coordinate conversion algorithm to obtain converted parameters;
[0015] Based on the target operating frequency, the converted parameters are sent to the display device to adjust a display position of a pointer in the display device.
[0016] In one embodiment, converting the motion parameters of the electronic device using a coordinate conversion algorithm to obtain the converted parameters includes:
[0017] The coordinate conversion algorithm is run by the sensor processing chip of the electronic device to convert the motion parameters of the electronic device to obtain the converted parameters.
[0018] In one embodiment, the method further comprises:
[0019] generating the control instruction in response to a key operation on the electronic device;
[0020] or,
[0021] generating the control instruction in response to a voice or gesture instruction directed to the display device;
[0022] or,
[0023] The control instruction is generated when the distance between the electronic device and the display device meets a preset distance condition; wherein different display devices correspond to different preset distance conditions.
[0024] In one embodiment, the method further comprises:
[0025] The display device is connected via short-range wireless communication; wherein the short-range wireless communication includes Bluetooth communication or Star Flash communication.
[0026] In one embodiment, obtaining the motion parameters of the electronic device includes:
[0027] In response to a calibration instruction for the electronic device, obtaining calibration parameters through an ultra-wideband module of the electronic device;
[0028] calibrating the motion sensor of the electronic device based on the calibration parameters;
[0029] The motion parameters of the electronic device are detected based on the calibrated motion sensor.
[0030] In one embodiment, the method further comprises:
[0031] Obtaining an initial operating frequency sent by a cloud server connected to the electronic device;
[0032] The electronic device is controlled to switch from the initial operating frequency to the target operating frequency.
[0033] According to a second aspect of an embodiment of the present disclosure, there is provided an electronic device, including:
[0034] an acquisition module, configured to acquire motion parameters of the electronic device in response to a control instruction;
[0035] a determination module configured to determine a target operating frequency of the electronic device based on a motion parameter of the electronic device;
[0036] The control module is configured to control a display device connected to the electronic device based on the target operating frequency.
[0037] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising at least:
[0038] processor;
[0039] a memory for storing processor-executable instructions;
[0040] The processor is configured to execute the device control method described in any one of the first aspects above.
[0041] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, which stores a computer program or instructions. When the computer program or instructions in the storage medium are executed by an electronic device, the steps of the method described in the first aspect above are implemented.
[0042] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program or instructions, which, when executed by a processor, implements the steps of the method described in the first aspect above.
[0043] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:
[0044] In the embodiment of the present disclosure, the motion parameters of the electronic device are obtained in response to a control instruction, and based on the motion parameters of the electronic device, the target operating frequency of the electronic device is determined, and then based on the target operating frequency, the display device connected to the electronic device is controlled. It can be seen that, on the one hand, the embodiment of the present disclosure can control the display device through the electronic device, thereby improving the convenience of the user in controlling the display device; on the other hand, compared with using a fixed operating frequency to control the display device, the embodiment of the present disclosure can flexibly select different target operating frequencies to control the display device according to the motion parameters of the electronic device, thereby not only making the movement of the electronic device more synchronized with the display of the display device, but also realizing dynamic adjustment of the operating frequency of the electronic device to reduce the power consumption of the electronic device in the process of controlling the display device.
[0045] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0047] Figure 1 The figure is a flow chart of a device control method according to an exemplary embodiment.
[0048] Figure 2 The figure shows a structure diagram of a sensor control chip according to an exemplary embodiment.
[0049] Figure 3 The figure is a structural diagram showing communication interaction between an electronic device and a display device according to an exemplary embodiment.
[0050] Figure 4 The figure is a schematic diagram showing the interaction among an electronic device, a display device and a cloud server according to an exemplary embodiment.
[0051] Figure 5 A structural frame of an electronic device according to an exemplary embodiment is shown Figure 1 .
[0052] Figure 6 A structural frame of an electronic device according to an exemplary embodiment is shown Figure 2 . DETAILED DESCRIPTION
[0053] Exemplary embodiments are described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numbers in different drawings represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible implementations consistent with the present disclosure. Rather, they are merely examples of device control methods, electronic devices, storage media, and program products consistent with certain aspects of the present disclosure, as detailed in the appended claims.
[0054] Figure 1 This is a flow chart of a device control method according to an exemplary embodiment. The device control method can realize the control of a display device by an electronic device. Figure 1 As shown, the electronic device executing the device control method may include the following steps:
[0055] Step 101: Responding to a control instruction, obtaining motion parameters of an electronic device;
[0056] Step 102: Determine a target operating frequency of the electronic device based on the motion parameters of the electronic device;
[0057] Step 103: Control a display device connected to the electronic device based on the target operating frequency.
[0058] In the embodiments of the present disclosure, electronic devices may include mobile terminal devices and wearable electronic devices. Mobile terminal devices include mobile phones, tablet computers, etc., and wearable electronic devices include smart bracelets, smart watches, etc.; the above-mentioned display devices may include laptop computers, desktop computers or televisions, etc., and the embodiments of the present disclosure do not limit this.
[0059] For example, the device control method can be applied in scenarios where a mobile phone is used as an external input device. For office and meeting purposes, a mobile phone can be used to directly control a display device to display and turn pages of office documents or explain meeting videos. Alternatively, for gaming and entertainment purposes, a mobile phone can be used to control the audio and video on a television, select game modules, and control the display position of the pointer on the television during gaming to perform game operations.
[0060] In embodiments of the present disclosure, an electronic device can function as an external input device via a built-in communication module. The communication module includes an ultra-wideband module or a short-range communication module. The electronic device can communicate with a display device via short-range wireless communication, and can also communicate with the display device via the ultra-wideband module.
[0061] It should be noted that the electronic device can first obtain the motion parameters of the electronic device through the motion sensor, convert the motion parameters of the electronic device, and finally send the converted parameters to the display device through the built-in communication module to achieve control of the display device.
[0062] The electronic device as an external input device refers to the electronic device being used as a keyboard, mouse, or game controller, etc. For example, when the electronic device is used as a mouse, the electronic device is used to simulate the functions of a mouse, such as moving a pointer, clicking, or dragging.
[0063] In step 101, the control instruction is generated when the electronic device needs to control the display device. The electronic device obtains the motion parameters of the electronic device in response to the control instruction.
[0064] It should be noted that the electronic device can generate a control instruction based on an operation or instruction on the electronic device. For example, in one embodiment, the control instruction can be generated in response to a key operation on the electronic device; in another embodiment, the control instruction can be generated in response to a voice or gesture instruction directed at the display device; and in yet another embodiment, the control instruction can be generated when the electronic device detects that the distance between the electronic device and the display device meets a preset distance condition.
[0065] Among them, the above-mentioned key operation can be to trigger a physical key, such as double-clicking the power key, double-clicking the volume key, etc.; it can also act on a virtual key operation displayed on the display screen of the electronic device.
[0066] The above-mentioned voice command directed at the display device can be characterized as requiring an electronic device to control the display device. For example, a voice command directed at a television or a computer, for example, requires an electronic device to control the television or the computer. The voice command directed at the display device can be sent directly by the user to the electronic device, or it can be sent by another electronic device to the electronic device.
[0067] The aforementioned gesture command directed at the display device may also indicate a need for the electronic device to control the display device. The finger command may include tracing a preset gesture for controlling the display device on the screen of the electronic device or performing a preset gesture directed at the camera of the electronic device. Preset gestures may include drawing a triangle or a circle, etc., which are not limited in the present embodiment.
[0068] In the embodiments of the present disclosure, obtaining motion parameters of an electronic device can be achieved by providing various motion sensors in the electronic device. For example, an accelerometer can be provided in the electronic device to obtain acceleration data of the electronic device through the accelerometer; and / or a gyroscope can be provided in the electronic device to obtain angular velocity data through the gyroscope, etc., which are not limited in the embodiments of the present disclosure.
[0069] It should be noted that by obtaining the motion parameters of the electronic device, the motion state and position change of the electronic device in three-dimensional space can be determined, laying a data foundation for subsequent control of the display device.
[0070] In step 102 , the target operating frequency of the electronic device is determined based on the motion parameters of the electronic device, which indicates that the target operating frequency of the electronic device is not fixed but can be changed based on changes in the motion parameters of the electronic device.
[0071] In the embodiment of the present disclosure, determining the target operating frequency of the electronic device based on the motion parameter of the electronic device includes: determining the target operating frequency based on a comparison result of the motion parameter of the electronic device and a preset parameter threshold.
[0072] Exemplarily, in one embodiment, when the motion parameter of the electronic device is greater than the first preset parameter threshold, the target operating frequency is determined to be the first preset frequency; when the motion parameter of the electronic device is less than or equal to the first preset parameter threshold, the target operating frequency is determined to be the second preset frequency; wherein the first preset frequency is greater than the second preset frequency.
[0073] In another embodiment, when the motion parameter of the electronic device is greater than the first preset parameter threshold, the target operating frequency is determined to be the first preset frequency; when the motion parameter of the electronic device is less than or equal to the first preset parameter threshold and greater than the second preset parameter threshold, the target operating frequency is determined to be the second preset frequency; when the motion parameter of the electronic device is less than the second preset parameter threshold, the target operating frequency is determined to be the third preset frequency; wherein the first preset frequency is greater than the second preset frequency, and the second preset frequency is greater than the third preset frequency.
[0074] It should be noted that the above-mentioned motion parameters include the motion speed, motion distance or motion acceleration of the electronic device, etc., and the embodiments of the present disclosure are not limited to this.
[0075] The target operating frequency refers to the frequency at which the electronic device transmits data (eg, motion parameters) to the display device, that is, the target operating frequency determines the rate at which the electronic device sends data to the connected display device.
[0076] The target operating frequency can be set according to actual conditions. For example, the target operating frequency can be set within a range of 20 Hz to 100 Hz, which is not limited in the embodiment of the present disclosure.
[0077] It can be understood that determining the target operating frequency of an electronic device based on the motion parameters of the electronic device can improve the flexibility of the electronic device in setting the target operating frequency, so as to ensure that the electronic device responds to user operations in a timely manner when controlling the display device, so that the user can feel the smoothness and real-time nature of the operation of the electronic device, thereby improving the user experience.
[0078] In step 103, controlling the display device connected to the electronic device based on the target operating frequency includes: controlling the rate at which the electronic device sends data to the connected display device based on the target operating frequency, and controlling the display device based on the sent data.
[0079] In the embodiment of the present disclosure, the electronic device and the display device can be connected via short-range wireless communication, and the electronic device converts the motion parameters and transmits the converted parameters to the display device via short-range wireless communication.
[0080] It should be noted that after the display device receives the converted parameters transmitted by the electronic device, it will control the display position of the pointer on the display screen of the display device according to the received converted parameters; or control the position of the highlighted area on the display screen of the display device. The highlighted area is used to indicate the position of the display screen currently selected by the user, so as to select or navigate the content in the highlighted area.
[0081] It is understood that the display position of the pointer or highlighted area on the display device is adjusted based on the target operating frequency of the electronic device. In this way, the pointer or highlighted area moves on the screen of the display device following the movement of the electronic device, maintaining synchronization and smoothness during user operation.
[0082] In the embodiment of the present disclosure, the motion parameters of the electronic device are obtained in response to a control instruction, and based on the motion parameters of the electronic device, the target operating frequency of the electronic device is determined, and then based on the target operating frequency, the display device connected to the electronic device is controlled. It can be seen that, on the one hand, the embodiment of the present disclosure can control the display device through the electronic device, thereby improving the convenience of the user in controlling the display device; on the other hand, compared with using a fixed operating frequency to control the display device, the embodiment of the present disclosure can flexibly select different target operating frequencies to control the display device according to the motion parameters of the electronic device, thereby not only making the movement of the electronic device and the display of the display device more synchronized, but also realizing dynamic adjustment of the operating frequency of the electronic device to reduce the power consumption of the electronic device in controlling the display device.
[0083] In one embodiment, determining a target operating frequency of the electronic device based on a motion parameter of the electronic device includes:
[0084] When the motion parameter of the electronic device is greater than a preset parameter threshold, determining the target operating frequency to be a first preset frequency;
[0085] When the motion parameter of the electronic device is less than or equal to the preset parameter threshold, determining the target operating frequency to be a second preset frequency;
[0086] The first preset frequency is greater than the second preset frequency.
[0087] In the embodiment of the present disclosure, the motion parameters of the electronic device may include: the motion speed of the electronic device or the motion distance of the electronic device, and may also include the acceleration, angular velocity, etc. of the electronic device.
[0088] Exemplarily, when the motion parameter of the electronic device is motion speed, when the first motion speed of the electronic device is greater than the preset speed threshold, the target operating frequency is determined to be the first preset frequency; when the second motion speed of the electronic device is less than or equal to the preset speed threshold, the target operating frequency is determined to be the second preset frequency.
[0089] It is understood that the electronic device sends the converted parameters to the connected display device at a first preset frequency, and the electronic device sends the converted parameters to the connected display device at a second preset frequency. Here, when the first movement speed of the electronic device is greater than the second movement speed, the first preset frequency of the electronic device sending the converted parameters to the connected display device is greater than the second preset frequency.
[0090] It should be noted that the larger the motion parameters of the electronic device, the higher the operating frequency of the electronic device needs to be, so that the position changes of the electronic device can be better reflected on the display screen of the display device connected to the electronic device, making the control of the electronic device to the display device more synchronized.
[0091] The motion parameters can be obtained by a motion sensor of the electronic device. For example, the acceleration of the electronic device can be obtained by an accelerometer, and the rotation direction and angular velocity of the electronic device can be obtained by a gyroscope, etc., although this disclosure does not limit this. Here, the acceleration of the electronic device can be obtained by an accelerometer, and then the speed of the electronic device can be obtained by converting the acceleration.
[0092] It is understood that when the first preset frequency is greater than the second preset frequency, the power loss of the electronic device operating at the first preset frequency is greater than the power loss of the electronic device operating at the second preset frequency. Therefore, switching the target operating frequency of the electronic device based on the motion parameters of the electronic device can reduce the power loss of the electronic device.
[0093] In the embodiment of the present disclosure, the target operating frequency of the electronic device is determined based on the result of comparing the motion parameters of the electronic device with a preset threshold, thereby achieving precise control of the display device and reducing the power consumption of the electronic device in controlling the display device.
[0094] In one embodiment, controlling a display device connected to an electronic device based on a target operating frequency includes:
[0095] Converting motion parameters of the electronic device using a coordinate conversion algorithm to obtain converted parameters;
[0096] Based on the target operating frequency, the converted parameters are sent to the display device to adjust the display position of the pointer in the display device.
[0097] In the embodiment of the present disclosure, the coordinate conversion algorithm includes a coordinate system definition and mutual conversion algorithm, a coordinate translation transformation algorithm, a coordinate projection transformation algorithm, etc., which is not limited in the embodiment of the present disclosure.
[0098] The converted parameters include the coordinates of the pointer in the display device after movement. Here, the motion parameters of the electronic device are converted to obtain the converted parameters, including:
[0099] The coordinates of the electronic device after it moves are determined based on the coordinates of the electronic device before it moves, the angular velocity value of the electronic device, and the acceleration value of the electronic device; the coordinates of the pointer in the display device after it moves are determined based on the coordinates of the pointer in the display device before it moves, the movement direction and distance of the electronic device, and the ratio of the movement distance of the electronic device to the movement distance of the pointer of the display device.
[0100] The coordinates of the pointer before movement in the display device may be the initial coordinates of the pointer, or the coordinates before one of the multiple movements of the pointer, which is not limited in the embodiment of the present disclosure.
[0101] The ratio of the movement distance of the above-mentioned electronic device to the movement distance of the pointer in the display device can be determined according to the distance between the electronic device and the display device, can be determined according to the size of the display device, or can be set according to user-defined data. The embodiment of the present disclosure does not limit this.
[0102] It should be noted that the electronic device can send a pointer control instruction to the display device. The pointer control instruction carries the coordinates of the pointer after movement. The electronic device sends the coordinates of the pointer after movement to the display device at the target operating frequency. The display device controls the pointer to move to the coordinate position after movement in the display screen in response to the pointer control instruction. In this way, the electronic device can adjust the display position of the pointer in the display device.
[0103] In the embodiment of the present disclosure, the motion parameters of the electronic device are converted through a coordinate conversion algorithm to obtain the converted parameters, and the converted parameters are sent to the display device at the target operating frequency. This can more accurately adjust the display position of the pointer in the display device and reduce the power consumption of the electronic device in controlling the display device.
[0104] In one embodiment, the motion parameters of the electronic device are converted using a coordinate conversion algorithm to obtain the converted parameters, including:
[0105] The motion parameters of the electronic device are converted by a coordinate conversion algorithm executed by a sensor main processing chip of the electronic device to obtain converted parameters.
[0106] In the disclosed embodiment, the sensor hub is a hardware and software solution based on a low-power microcontroller unit (MCU) and a lightweight real-time operating system, and is used to fuse data from different types of sensors to achieve functions that can only be achieved by combining data from multiple sensors.
[0107] For example, Figure 2 FIG. 1 is a structural diagram of a sensor processing chip according to an exemplary embodiment. Figure 2 As shown, the sensor processing chip includes:
[0108] Hardware Abstraction Layer (HAL): It is the interface between the sensor framework and motion sensors (such as accelerometers and gyroscopes). The Sensors HAL defines a series of functions for controlling motion sensors.
[0109] Service layer (Sensor Service): used to run application algorithms, including algorithms for processing motion sensor data, such as coordinate conversion algorithms.
[0110] User layer (Client): used to process user accounts, such as storing user accounts, which store configuration parameters of electronic devices.
[0111] In an embodiment of the present disclosure, based on the target operating frequency and the sensor main control chip of the electronic device, controlling the display device includes: the sensor main processing chip of the electronic device converts the motion parameters of the electronic device transmitted by the motion sensor, and converts the motion parameters into position changes of the electronic device, obtains the display position of the pointer in the display device based on the position change of the electronic device, and the electronic device sends the display position of the pointer to the display device at the target operating frequency.
[0112] It should be noted that the sensor processing chip can achieve real-time control of the motion sensor when the central processing unit (CPU) of the electronic device is dormant, thereby reducing the power consumption of the pointer in the electronic device controlling the display device.
[0113] In the embodiment of the present disclosure, the display position of the pointer in the display device is controlled by the target operating frequency and the sensor main processing chip of the electronic device, so that the display device can be controlled more flexibly, and the motion parameters transmitted by the motion sensor do not need to be processed through the application layer and the central processing unit of the electronic device. That is, the use of the sensor main control chip can reduce the power consumption of the electronic device in controlling the display device.
[0114] In one embodiment, the device control method further includes:
[0115] generating a control instruction in response to a key operation on the electronic device;
[0116] or,
[0117] generating a control instruction in response to a voice or gesture instruction directed to the display device;
[0118] or,
[0119] When the distance between the electronic device and the display device meets a preset distance condition, a control instruction is generated; wherein different display devices correspond to different preset distance conditions.
[0120] In an embodiment of the present disclosure, responding to a key operation on an electronic device includes: single-clicking or double-clicking a physical key such as a power key or a volume key of the electronic device to generate a control instruction.
[0121] The above-mentioned response to the voice instruction pointing to the display device includes: voice prompts, such as voice pointing to the display screen.
[0122] The voice prompt can be either direct or indirect. For example, when the voice prompt is direct, the user may directly send a voice to the electronic device, and the electronic device generates a control instruction after receiving the voice. When the voice prompt is indirect, the user may control another electronic device to send a voice, and the electronic device generates a control instruction after receiving the voice sent by the other electronic device. This embodiment of the present disclosure does not limit this.
[0123] The above-mentioned response to the gesture instruction pointing to the display device includes: a gesture operation acting on the display screen of the electronic device, such as sliding the display screen of the electronic device with three fingers, etc., to generate a control instruction.
[0124] When the distance between the electronic device and the display device satisfies a preset distance condition, generating the control instruction includes: generating the control instruction when the distance between the electronic device and the display device is less than or equal to a preset distance threshold.
[0125] It should be noted that the preset distance threshold may be set according to the type of display device, the size of the display screen of the display device, or a user-defined setting, and the embodiment of the present disclosure does not limit this.
[0126] Among them, when the preset distance threshold is set according to the type of display device, the preset distance threshold for the display device being a TV may be different from the preset distance threshold for the display device being a notebook; when the preset distance threshold is set according to the size of the display screen of the display device, the larger the size of the display screen, the larger the preset distance threshold, or the smaller the size of the display screen, the larger the preset distance threshold.
[0127] In this way, when the electronic device controls the display position of the pointer in the display device, it can better fit the area of the display screen of the display device or better conform to the user's usage habits, thereby more conveniently adjusting the display position of the pointer in the display device.
[0128] In the embodiments of the present disclosure, control instructions are generated in different ways to control the display position of the pointer on the display device, which can improve the flexibility of the interaction between the electronic device and the display device.
[0129] In one embodiment, the device control method further includes:
[0130] The display device is connected via short-range wireless communication; wherein the short-range wireless communication includes Bluetooth communication or Star Flash communication.
[0131] In the disclosed embodiment, Bluetooth is used for pairing and connecting electronic devices and display devices. After the electronic devices and display devices are paired via Bluetooth, subsequent communication connections do not require confirmation each time. Star Flash communication is a new wireless short-range communication standard. Existing wireless short-range communication can no longer meet the requirements of connecting electronic devices and display devices in a local area in terms of latency, reliability, synchronization accuracy, and security. Therefore, electronic devices connected to display devices based on Star Flash communication have the advantages of lower power consumption, faster speed, lower latency, more stable connection, wider coverage, and larger networking.
[0132] It should be noted that short-range wireless communications can also include ultra-wideband (UWB). UWB is a wireless carrier communication with the advantages of low system complexity, low power spectrum density of transmitted signals, insensitivity to channel fading, low interception capability, and high positioning accuracy. It is suitable for high-speed wireless access of electronic devices and display devices in dense multipath places such as indoors.
[0133] In the embodiment of the present disclosure, the electronic device and the display device are connected via short-range wireless communication, which can improve the convenience of data transmission between the electronic device and the display device and reduce the power consumption of data transmission between the electronic device and the display device.
[0134] In one embodiment, obtaining motion parameters of an electronic device includes:
[0135] In response to a calibration instruction for the electronic device, obtaining calibration parameters through an ultra-wideband module of the electronic device;
[0136] calibrating a motion sensor of the electronic device based on the calibration parameters;
[0137] The motion parameters of the electronic device are detected based on the calibrated motion sensor.
[0138] In the disclosed embodiment, the calibration parameters include the position of the electronic device and the distance and angle between the electronic device and the display device. The ultra-wideband module can use a timestamp difference method to calculate the time of flight of electromagnetic waves between the electronic device and the display device, thereby calculating the distance and angle between the electronic device and the display device.
[0139] It should be noted that both the electronic device and the display device are provided with an ultra-wideband module. The electronic device is connected to the display device based on the ultra-wideband module, and the distance between the electronic device and the display device is calculated based on the timestamp sent by the electronic device.
[0140] For example, the time of flight is calculated based on the timestamp sent by the electronic device to the display device and the timestamp received by the display device. The time of flight is the difference between the sent timestamp and the received timestamp. The distance from the electronic device to the display device is calculated as the product of half the speed of light and the time of flight. UWB ranging can also use two-way ranging and bilateral two-way ranging, which are not limited in the present embodiment.
[0141] In the disclosed embodiments, motion sensors (such as accelerometers and gyroscopes) may generate errors during operation due to the influence of interference torques. These errors accumulate over time, reducing the accuracy of motion parameter acquisition for electronic devices. Therefore, to compensate for these errors, the motion sensors must be calibrated.
[0142] Exemplarily, when the electronic device detects that the electronic device is in a stationary state, the first motion parameter of the electronic device is obtained through the motion sensor, the distance and angle between the electronic device and the display device are obtained based on UWB, and the first motion parameter is calibrated based on the distance and angle between the electronic device and the display device, i.e., the calibration parameter.
[0143] In the embodiment of the present disclosure, by detecting the motion parameters of the electronic device based on the calibrated motion sensor, more accurate motion parameters of the electronic device can be obtained, and the display position of the pointer in the display device can be adjusted more accurately.
[0144] In one embodiment, the device control method further includes:
[0145] Obtaining an initial operating frequency sent by a cloud server connected to the electronic device;
[0146] Control the electronic device to switch from the initial operating frequency to the target operating frequency.
[0147] In the embodiment of the present disclosure, the electronic device may also be connected to a cloud server, and the electronic device obtains an initial operating frequency sent by the cloud server, and controls the display device with the initial operating frequency.
[0148] It is understood that the initial operating frequency of the electronic device controlling the display device may be different depending on the display screen area of the display device. For example, the initial operating frequency of the electronic device may be 20 Hz, 30 Hz, or 50 Hz, etc., which is not limited in the embodiments of the present disclosure.
[0149] In this way, sending the initial operating frequency based on the cloud server can reduce the time it takes for the electronic device to obtain the initial operating frequency based on the motion parameters.
[0150] In the embodiment of the present disclosure, after the target operating frequency of the electronic device is determined, the initial operating frequency can be switched to the target operating frequency, and the display device connected to the electronic device can be controlled based on the target operating frequency.
[0151] It should be noted that when the target operating frequency is the same as the initial operating frequency, there is no need to switch the operating frequency of the electronic device, and the electronic device still operates at the initial operating frequency; when the target operating frequency is different from the initial operating frequency, it is necessary to switch the operating frequency of the electronic device from the initial operating frequency to the target operating frequency, and the electronic device operates at the target operating frequency.
[0152] In the embodiment of the present disclosure, the electronic device can receive the initial operating frequency sent by the cloud server and control the display device with the initial operating frequency, thereby improving the efficiency of the electronic device in controlling the display device. The target operating frequency can be switched based on the initial operating frequency, and the frequency of the electronic device controlling the display device can be flexibly adjusted to reduce the power consumption of the electronic device in controlling the display device.
[0153] To better understand the device control method in one or more of the above embodiments, the following examples are provided for reference:
[0154] Figure 3FIG. 1 is a structural diagram showing the communication interaction between an electronic device and a display device according to an exemplary embodiment. Figure 3 As shown, the electronic device includes a sensor processing chip and a communication module, such as Bluetooth, Star Flash, and UWB; the display device also includes a communication module, such as Bluetooth, Star Flash, and UWB. Both the electronic device and the display device can connect to a cloud server.
[0155] In the disclosed embodiments, when the distance between an electronic device and a display device is less than a preset distance, the electronic device can pair with the display device via Bluetooth. After pairing is complete, the electronic device generates a control instruction. Here, a control instruction represents the electronic device controlling the display device. The electronic device controlling the display device can include controlling the movement of a pointer on a display screen of the display device, or controlling the display device to perform click operations, scroll or turn pages, and so on.
[0156] After the electronic device is paired with the display device, the initial operating frequency sent by the cloud server to the electronic device can be received, so that the electronic device can control the display device using the initial operating frequency.
[0157] During the movement of the electronic device, the electronic device obtains an acceleration value of the electronic device through an accelerometer and an angular velocity value of the electronic device through a gyroscope, and then calculates the movement speed of the electronic device based on the acceleration value or the angular velocity value. If the movement speed of the electronic device is greater than a preset parameter threshold, the target operating frequency of the electronic device is determined to be a first preset frequency; if the movement speed of the electronic device is less than or equal to the preset parameter threshold, the target operating frequency of the electronic device is determined to be a second preset frequency. The first preset frequency is greater than the second preset frequency.
[0158] It should be noted that after determining the target operating frequency of the electronic device, the target operating frequency is compared with the initial operating frequency. If the target operating frequency is different from the initial operating frequency, the operating frequency of the electronic device is adjusted, switching the operating frequency of the electronic device from the initial operating frequency to the target operating frequency.
[0159] After the operating frequency of the electronic device is switched to the target operating frequency, the electronic device can control the display position of the pointer in the display device connected to the electronic device based on the target operating frequency, including: running a coordinate conversion algorithm at the service layer of the sensor main processing chip of the electronic device to convert the motion parameters of the electronic device, and obtaining the coordinates of the pointer in the display device after it moves on the display screen of the display device; the electronic device transmits the coordinates of the pointer after movement to the display device through Bluetooth communication or Star Flash communication at the target operating frequency to adjust the display device.
[0160] In the embodiment of the present disclosure, the motion parameters of the electronic device are obtained in response to a control instruction, and based on the motion parameters of the electronic device, the target operating frequency of the electronic device is determined, and then based on the target operating frequency, the display device connected to the electronic device is controlled. It can be seen that, on the one hand, the embodiment of the present disclosure can control the display device through the electronic device, thereby improving the convenience of the user in controlling the display device; on the other hand, compared with using a fixed operating frequency to control the display device, the embodiment of the present disclosure can flexibly select different target operating frequencies to control the display device according to the motion parameters of the electronic device, thereby not only making the movement of the electronic device and the display of the display device more synchronized, but also realizing dynamic adjustment of the operating frequency of the electronic device to reduce the power consumption of the electronic device in controlling the display device.
[0161] In one embodiment, Figure 4 FIG. 1 is a schematic diagram showing the interaction between an electronic device, a display device and a cloud server according to an exemplary embodiment. Figure 3 and Figure 4 As shown, the display device includes configuration parameters, which are used to initialize the display device. The cloud server can send configuration parameters, such as the size, resolution, and refresh rate of the display device, to display device 1 and display device 2. Display device 1 and display device 2 can be initialized based on the configuration parameters sent by the cloud server.
[0162] In this way, when the electronic device switches from display device 1 to display device 2, the display device does not need to perform initialization operations, thereby improving the initialization speed of the display device. This not only improves the smoothness of switching when the electronic device switches from controlling display device 1 to controlling display device 2, but also enables one electronic device to control the display position of the pointer of multiple display devices.
[0163] The present disclosure also provides an electronic device. Figure 5 An electronic device structure frame according to an exemplary embodiment is shown Figure 1 .like Figure 5 As shown, the electronic device 1000 includes:
[0164] An acquisition module 1001 is configured to acquire motion parameters of the electronic device in response to a control instruction;
[0165] A determination module 1002 is configured to determine a target operating frequency of the electronic device based on a motion parameter of the electronic device;
[0166] The control module 1003 is configured to control a display device connected to the electronic device based on the target operating frequency.
[0167] In one embodiment, the determination module is further configured to determine the target operating frequency as a first preset frequency when the motion parameter of the electronic device is greater than a preset parameter threshold; and to determine the target operating frequency as a second preset frequency when the motion parameter of the electronic device is less than or equal to the preset parameter threshold; wherein the first preset frequency is greater than the second preset frequency.
[0168] In one embodiment, the motion parameter of the electronic device includes: a motion speed of the electronic device or a motion distance of the electronic device.
[0169] In one embodiment, the control module is further configured to convert the motion parameters of the electronic device through a coordinate conversion algorithm to obtain converted parameters; based on the target operating frequency, the converted parameters are sent to the display device to adjust the display position of the pointer in the display device.
[0170] In one embodiment, the control module is further configured to convert the motion parameters of the electronic device by running a coordinate conversion algorithm on a sensor main processing chip of the electronic device to obtain converted parameters.
[0171] In one embodiment, the electronic device further comprises:
[0172] A generation module is configured to generate a control instruction in response to a key operation on an electronic device; or, to generate a control instruction in response to a voice or gesture instruction directed to a display device; or, to generate a control instruction when the distance between the electronic device and the display device meets a preset distance condition; wherein different display devices have different corresponding preset distance conditions.
[0173] In one embodiment, the electronic device further comprises:
[0174] The communication connection module is configured to connect to the display device via short-range wireless communication; wherein the short-range wireless communication includes Bluetooth communication or Star Flash communication.
[0175] In one embodiment, the acquisition module is further configured to obtain calibration parameters through the ultra-wideband module of the electronic device in response to a calibration instruction for the electronic device; calibrate the motion sensor of the electronic device based on the calibration parameters; and detect the motion parameters of the electronic device based on the calibrated motion sensor.
[0176] In one embodiment, the electronic device further comprises:
[0177] an initial frequency acquisition module configured to acquire an initial operating frequency sent by a cloud server connected to the electronic device;
[0178] The frequency switching control module is configured to control the electronic device to switch from an initial operating frequency to a target operating frequency.
[0179] Regarding the electronic device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0180] Figure 6 The structure of an electronic device 600 is shown according to an exemplary embodiment. Figure 2 For example, the electronic device 600 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.
[0181] Reference Figure 6 , the electronic device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .
[0182] The processing component 602 generally controls the overall operation of the electronic device 600, such as operations associated with at least one of display, phone calls, data communications, camera operation, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 602 may include one or more modules to facilitate interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate interaction between the multimedia component 608 and the processing component 602.
[0183] The memory 604 is configured to store various types of data to support operations on the electronic device 600. Examples of such data include at least one of the following: instructions for any application or method operating on the electronic device 600, contact data, phone book data, messages, pictures, and videos. The memory 604 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.
[0184] The power supply component 606 provides power to various components of the electronic device 600. The power supply component 606 may include at least one of the following: a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 600.
[0185] The multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the electronic device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
[0186] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 600 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 604 or transmitted via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.
[0187] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as a keyboard, click wheel, and buttons. These buttons may include, but are not limited to, a home button, volume buttons, a start button, and a lock button.
[0188] The sensor assembly 614 includes one or more sensors for providing various aspects of the status assessment of the electronic device 600. For example, the sensor assembly 614 can detect the open / closed state of the electronic device 600, the relative positioning of components, such as the display and keypad of the electronic device 600. The sensor assembly 614 can also detect changes in the position of the electronic device 600 or a component thereof, the presence or absence of user contact with the electronic device 600, the orientation or acceleration / deceleration of the electronic device 600, and changes in the temperature of the electronic device 600. The sensor assembly 614 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 614 can also include an optical sensor, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 can also include, but is not limited to, at least one of the following: an accelerometer, a gyroscope, a magnetic sensor, a pressure sensor, and a temperature sensor.
[0189] The communication component 616 is configured to facilitate communication between the electronic device 600 and other devices in a wired or wireless manner. The electronic device 600 can access a wireless network based on a communication standard, such as Wi-Fi, 4G, 5G, or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0190] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components.
[0191] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is further provided, such as a memory 604 including executable instructions or a computer program. The instructions or computer program can be executed by a processor 620 of the electronic device 600 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.
[0192] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform any of the device control methods described above in the embodiments of the present disclosure. For example, the method includes: obtaining motion parameters of the electronic device in response to a control instruction; determining a target operating frequency of the electronic device based on the motion parameters of the electronic device; and controlling a display device connected to the electronic device based on the target operating frequency.
[0193] The present disclosure provides a computer program product comprising a computer program or executable instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program or executable instructions from the computer-readable storage medium and executes the computer program or executable instructions, causing the computer device to perform any of the device control methods described above in the present disclosure.
[0194] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the claims.
[0195] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A device control method, characterized in that: include: Responding to the control instruction, obtaining motion parameters of the electronic device; determining a target operating frequency of the electronic device based on a motion parameter of the electronic device; Based on the target operating frequency, a display device connected to the electronic device is controlled.
2. The method according to claim 1, characterized in that The determining the target operating frequency of the electronic device based on the motion parameter of the electronic device includes: When the motion parameter of the electronic device is greater than a preset parameter threshold, determining the target operating frequency to be a first preset frequency; When the motion parameter of the electronic device is less than or equal to the preset parameter threshold, determining the target operating frequency to be a second preset frequency; Wherein, the first preset frequency is greater than the second preset frequency.
3. The method according to claim 2, characterized in that The motion parameter of the electronic device includes: the motion speed of the electronic device or the motion distance of the electronic device.
4. The method according to any one of claims 1 to 3, characterized in that The controlling of a display device connected to the electronic device based on the target operating frequency includes: Converting the motion parameters of the electronic device using a coordinate conversion algorithm to obtain converted parameters; Based on the target operating frequency, the converted parameters are sent to the display device to adjust a display position of a pointer in the display device.
5. The method according to claim 4, characterized in that The step of converting the motion parameters of the electronic device using a coordinate conversion algorithm to obtain the converted parameters includes: The coordinate conversion algorithm executed by the sensor processing chip of the electronic device converts the motion parameters of the electronic device to obtain the converted parameters.
6. The method according to any one of claims 1 to 3, characterized in that The method further comprises: generating the control instruction in response to a key operation on the electronic device; or, generating the control instruction in response to a voice or gesture instruction directed to the display device; or, The control instruction is generated when the distance between the electronic device and the display device meets a preset distance condition; wherein different display devices correspond to different preset distance conditions.
7. The method according to any one of claims 1 to 3, characterized in that The method further comprises: The display device is connected via short-range wireless communication; wherein the short-range wireless communication includes Bluetooth communication or Star Flash communication.
8. The method according to claim 7, characterized in that The obtaining of motion parameters of the electronic device includes: In response to a calibration instruction for the electronic device, obtaining calibration parameters through an ultra-wideband module of the electronic device; calibrating the motion sensor of the electronic device based on the calibration parameters; The motion parameters of the electronic device are detected based on the calibrated motion sensor.
9. The method according to any one of claims 1 to 3, characterized in that The method further comprises: Obtaining an initial operating frequency sent by a cloud server connected to the electronic device; The electronic device is controlled to switch from the initial operating frequency to the target operating frequency.
10. An electronic device, characterized in that: The electronic device comprises: An acquisition module configured to acquire motion parameters of the electronic device in response to a control instruction; a determination module configured to determine a target operating frequency of the electronic device based on a motion parameter of the electronic device; The control module is configured to control a display device connected to the electronic device based on the target operating frequency.
11. An electronic device, characterized in that: The electronic device at least comprises: processor; a memory for storing processor-executable instructions; The processor is configured to execute the device control method according to any one of claims 1 to 9.
12. A non-transitory computer-readable storage medium storing a computer program or instruction, characterized in that: When the computer program or instructions in the storage medium are executed by an electronic device, the steps of the method according to any one of claims 1 to 9 are implemented.
13. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.