Wireless control method and device, wearable equipment and host equipment

Abstract

The invention relates to a wireless control method and device, wearable equipment and host equipment. The wireless control method comprises the steps that wireless connection is established between the wearable equipment and the host equipment; first data including at least one of the sensing data and the control data is sent through the wireless connection, so that the host equipment responds to the first data, and operation corresponding to the first data is displayed on the target screen. The wearable device is high in cruising ability and can be worn on the wrist or the arm, so that the user can freely move the palm and the fingers when using the somatosensory application to do exercises, the experience feeling in the exercise process is improved, the situation that the user slips out of the hand in the exercise process can be avoided, the use safety of the product is improved, and in addition, the user experience is improved. The data transmission delay based on the wireless connection is low, and the immersion of the user in the motion process can be improved.

Description

Technical Field

[0001] The present disclosure relates to the field of electronic technology, and in particular to a wireless control method, device, wearable device, and host device. Background Art

[0002] With the rapid development of artificial intelligence technology, its application in the field of sports and fitness is becoming more and more extensive. Electronic devices can provide users with professional and personalized fitness plans through somatosensory games, using image sensing technology, motion recognition and voice recognition, etc., to meet users' needs for efficient fitness. For example, there are many somatosensory fitness games on the Switch console, such as "Ring Fit Adventure", "Just Dance", "Aerobic Boxing", etc. Users can control the controller adapted to the console to complete the somatosensory games, making gamified fitness more interesting. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a wireless control method, apparatus, wearable device, and host device.

[0004] According to a first aspect of an embodiment of the present disclosure, a wireless control method is provided, which is applied to a wearable device, and the method includes:

[0005] Establish a wireless connection with the host device;

[0006] Sending first data via the wireless connection, the first data comprising at least one of the following: sensing data, control data, wherein the first data is used by the host device to control a somatosensory application, and the sensing data comprises at least one of the following: human body sign data, human body motion data;

[0007] So that the host device displays the operation corresponding to the first data on a target screen in response to the first data, wherein the target screen includes: a display screen on the host device and / or a display screen to which the host device is communicatively connected.

[0008] In some exemplary embodiments of the present disclosure, the control data includes at least one of the following: physical button data, screen touch data, wherein the screen touch data is one of the following: touch data for a control component displayed on the screen, touch data for a blank area displayed on the screen.

[0009] In some exemplary embodiments of the present disclosure, sending the first data through the wireless connection includes:

[0010] The first data is sent via the wireless connection at a first frequency, where the first frequency is greater than a threshold frequency, and the threshold frequency is a minimum frequency value that ensures that a delay tolerance of an operation corresponding to displaying the first data by the host device is less than a preset requirement.

[0011] In some exemplary embodiments of the present disclosure, establishing a wireless connection with a host device includes:

[0012] Opening a first application, wherein the first application is used to simulate a function of a controller;

[0013] Scanning a host device that supports connection in a first wireless communication manner, and sending a matching request to the host device;

[0014] Receive the matching success information sent by the host device.

[0015] In some exemplary embodiments of the present disclosure, the method further includes:

[0016] The device information of the wearable device is sent to the host device through a human-machine interface device HID service, where the device information is used by the host device to identify the attributes of the wearable device.

[0017] In some exemplary embodiments of the present disclosure, the method further includes:

[0018] A control interface is displayed, wherein the control interface includes at least one control button.

[0019] According to a second aspect of an embodiment of the present disclosure, a wireless control method is provided, which is applied to a host device, and the method includes:

[0020] Establish wireless connection with wearable devices;

[0021] receiving first data through the wireless connection, the first data including at least one of the following: sensing data and control data, wherein the first data is used by the host device to control a somatosensory application, and the sensing data includes at least one of the following: human body sign data and human body motion data;

[0022] In response to the first data, an operation corresponding to the first data is displayed on a target screen, wherein the target screen includes: a display screen on the host device and / or a display screen to which the host device is communicatively connected.

[0023] In some exemplary embodiments of the present disclosure, the receiving the first data through the wireless connection includes:

[0024] The first data is received at a first frequency through the wireless connection, where the first frequency is greater than a threshold frequency, and the threshold frequency is a minimum frequency value that ensures that the delay tolerance of the operation corresponding to the display of the first data by the host device is less than a preset requirement.

[0025] In some exemplary embodiments of the present disclosure, establishing a wireless connection with a wearable device includes:

[0026] Scanning a wearable device that supports connection in a first wireless communication manner, and receiving a matching request from the wearable device;

[0027] Send matching success information to the wearable device.

[0028] In some exemplary embodiments of the present disclosure, the method further includes:

[0029] Receiving device information of the wearable device sent by the wearable device through a human-machine interface device HID service, wherein the device information is used by the host device to identify attributes of the wearable device;

[0030] And / or, the method further comprises:

[0031] Controlling the display effect of the somatosensory application according to the sensing data;

[0032] The process of the somatosensory application is controlled according to the control data.

[0033] According to a third aspect of an embodiment of the present disclosure, a wireless control device is provided, which is applied to a wearable device, and the wireless control device includes:

[0034] A first connection module, used to establish a wireless connection with a host device;

[0035] A first transceiver module is used to send first data through the wireless connection, wherein the first data includes at least one of the following: sensing data and control data, wherein the first data is used by the host device to control a somatosensory application, and the sensing data includes at least one of the following: human body sign data and human body motion data;

[0036] So that the host device displays the operation corresponding to the first data on a target screen in response to the first data, wherein the target screen includes: a display screen on the host device and / or a display screen to which the host device is communicatively connected.

[0037] According to a fourth aspect of an embodiment of the present disclosure, there is provided a wireless control device, which is applied to a host device, and the wireless control device includes:

[0038] A second connection module, used to establish a wireless connection with the wearable device;

[0039] A second transceiver module is used to receive first data through the wireless connection, wherein the first data includes at least one of the following: sensing data and control data, wherein the first data is used by the host device to control a somatosensory application, and the sensing data includes at least one of the following: human body sign data and human body motion data;

[0040] The second control module is used to display the operation corresponding to the first data on a target screen in response to the first data, wherein the target screen includes: a display screen on the host device and / or a display screen connected to the host device in communication.

[0041] According to a fifth aspect of an embodiment of the present disclosure, a wearable device is provided, the wearable device comprising:

[0042] processor;

[0043] a memory for storing processor-executable instructions;

[0044] The processor is configured to execute executable instructions in the memory to implement the wireless control method provided in the first aspect of the present disclosure.

[0045] According to a sixth aspect of an embodiment of the present disclosure, a host device is provided, the host device comprising:

[0046] processor;

[0047] a memory for storing processor-executable instructions;

[0048] The processor is configured to execute executable instructions in the memory to implement the wireless control method provided in the second aspect of the present disclosure.

[0049] The above method disclosed in the present invention has the following beneficial effects: the wearable device disclosed in the present invention is wirelessly connected to the host device, and the wearable device sends the first data for controlling the somatosensory application to the host device through the wireless connection, so that the host device controls the somatosensory application based on the first data. Since the wearable device has a long battery life and can be worn on the wrist or arm, the user can freely move the palm and fingers when exercising with the somatosensory application, which improves the experience during exercise and can also prevent the user from dropping the hand during exercise, thereby improving the safety of product use. In addition, the data transmission delay based on the wireless connection is low, which can enhance the user's immersion during exercise.

[0050] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0052] Figure 1 The figure is a flow chart of a wireless control method according to an exemplary embodiment.

[0053] Figure 2It is a schematic diagram showing the application of a wireless control method according to an exemplary embodiment.

[0054] Figure 3 The figure is a flow chart of a wireless control method according to an exemplary embodiment.

[0055] Figure 4 It is a schematic diagram showing the application of a wireless control method according to an exemplary embodiment.

[0056] Figure 5 The figure is a flow chart of a wireless control method according to an exemplary embodiment.

[0057] Figure 6 The figure is a flow chart of a wireless control method according to an exemplary embodiment.

[0058] Figure 7 is a block diagram of a wireless control device according to an exemplary embodiment.

[0059] Figure 8 is a block diagram of a wireless control device according to an exemplary embodiment.

[0060] Fig. 9 is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0061] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0062] At present, there are two main solutions for implementing somatosensory motion using electronic devices.

[0063] One is based on connecting a smart bracelet to a mobile phone or other electronic device via Bluetooth, using the Bluetooth, six-axis sensor, and heart rate monitor in the smart bracelet to record user behavior data and heart rate, and transmit them to the mobile phone APP. The APP locally caches the motion video, or uses a third-party application to open the motion video, read the data transmitted by the smart bracelet via Bluetooth, and realize somatosensory motion feedback based on the motion algorithm.

[0064] Due to the performance limitations of mobile phones, when the smart bracelet is connected to the mobile phone APP, the content of the sports video is less expanded, the quality of the sports video is lower, and there are fewer options. During the user's exercise, the best experience of watching sports videos is a large-screen display. Currently, most mobile phones only support wireless screen projection, and the wireless local area network will delay 1-2s. The launch of third-party applications on the mobile phone will also cause delays in the data transmission process. Therefore, the user's perception is very obvious, which will greatly reduce the user's immersion and continuity experience during exercise.

[0065] The other is based on the combination of motion-sensing game consoles and controllers, such as handheld game consoles such as Switch. The controller is an accessory of the motion-sensing game console and has no other auxiliary functions. Its role is limited to the motion-sensing game console. The controller contains buttons, six-axis sensors, NFC sensors, IR (Infrared) sensors, HD vibration motors, Bluetooth and other hardware. The controller has a built-in SPI flash memory for saving firmware patches, controller colors, calibration data and other content. The game console and controller are connected via Bluetooth to obtain the controller status. After that, the game console requests device information and enters the report mode. The report type determines what type of data the game console expects to return from the controller. The sub-commands of the game console are connected to various hardware in the controller to perform various functions.

[0066] The controller comes in only two standard colors, and the colors are used as fixed combinations to distinguish them. Even stickers cannot completely cover up the real colors. The controller is not waterproof, and the large amount of sweat generated by the user during exercise may also affect the product. Since the controller needs to be held in one hand, it is easy to accidentally touch the buttons on the controller during exercise. When the user stretches his arms and palms, it will affect the user's limb coordination and restrain the user. In order to prevent the controller from being thrown out due to human inertia during exercise, you need to purchase additional wristbands or straps to use with it to avoid damaging surrounding items or injuring family and friends around you.

[0067] In order to solve the above problems, the present disclosure provides a wireless control method, using a wearable device to replace a controller matched with a host device, the wearable device is wirelessly connected to the host device, and the wearable device sends first data for controlling a somatosensory application to the host device through a wireless connection, so that the host device responds to the first data and displays the operation corresponding to the first data on the target screen. Since the wearable device has a long battery life and can be worn on the wrist or arm, the user can freely move the palm and fingers when exercising with the somatosensory application, which improves the experience during exercise, and can also prevent the user from dropping the hand during exercise, thereby improving the safety of product use. In addition, the data transmission delay based on the wireless connection is low, which can enhance the user's immersion during exercise.

[0068] The exemplary embodiments of the present disclosure provide a wireless control method, which is applied to a wearable device, which may be a smart bracelet, a smart watch or other smart electronic device that can be worn on a wrist or arm. The host device may be a game console, a tablet or other device that supports running a somatosensory application. Figure 2 As shown, the wearable device 1 may be a smart bracelet, and the host device 2 may be a handheld game console. Figure 1 As shown, the wireless control method shown in the present disclosure includes:

[0069] S101, establishing a wireless connection with a host device;

[0070] S102: Send first data via a wireless connection, so that the host device displays an operation corresponding to the first data on a target screen in response to the first data.

[0071] In step S101, the wireless connection function between the wearable device and the host device is turned on, and based on the information interaction between the wearable device and the host device, the wearable device establishes a wireless connection with the host device. The wireless connection may be a Bluetooth connection, a ZigBee connection, a WiFi connection, an NFC connection, or the like. Since the data transmission delay based on the Bluetooth connection is within the range of 100-200 milliseconds, that is, the data transmission delay is low within a short distance, the wearable device and the host device may choose to connect via Bluetooth.

[0072] The present disclosure does not limit the number of wearable devices that can be wirelessly connected to a host device. When a user uses a somatosensory application alone for exercise or entertainment, he or she can choose to use one or two wearable devices to wirelessly connect to the host device. For example, a user can wear two smart bracelets on their wrists and connect to a game console via Bluetooth. When multiple users use a somatosensory application together for exercise or entertainment, they can choose to use two or more wearable devices to wirelessly connect to a host device. For example, user A wears a smart bracelet on his or her wrist, and user B wears another smart bracelet on his or her wrist, and both smart bracelets are connected to the game console via Bluetooth. For another example, user A wears two smart bracelets on his or her wrist, and user B chooses to use a game controller, and both smart bracelets and a game controller are connected to the game console via Bluetooth.

[0073] In step S102, the wearable device sends first data to the host device through a wireless connection, and the first data is used by the host device to control the somatosensory application. The first data includes at least one of the somatosensory data of the user during exercise and the control data of the wearable device. The wearable device can obtain the somatosensory data of the user during exercise through built-in sensors (for example, heart rate sensors, acceleration sensors, etc.), and the somatosensory data can reflect the user's behavioral actions and physical state. For example, a high heart rate of the user reflects that the user is doing strenuous exercise, and a high acceleration of the user reflects that the user's actions change frequently. Control data refers to data generated by the user's setting operations on the functions and attributes of the wearable device, such as operating the physical buttons of the wearable device to turn on the wireless connection function, and operating the virtual buttons of the display screen to adjust the display brightness.

[0074] Since the somatosensory application is an application that operates according to the user's motion posture changes, the host device that receives the first data can respond to the first data to display the operation corresponding to the first data on the target screen. For example, the first data is used by the host device to control the character in the somatosensory application to jump, hit, etc., and the target screen will synchronously display the character's jumping, hitting, etc. For another example, the first data is used by the host device to control the start and pause of the somatosensory application, and the target screen will synchronously display the start and pause of the somatosensory application. Among them, the target screen includes the display screen on the host device and / or the display screen connected to the host device in communication. For example, if the host device is not connected to other display screens, and the user only uses the wearable device and the host device to complete the somatosensory game, the operation of the somatosensory application is displayed on the display screen of the host device; if the host device is also connected to other display screens in communication, such as a TV, when the user uses the wearable device to play the somatosensory game, the operation of the somatosensory application can be displayed on the display screen of the host device and the display screen of the TV at the same time, which is convenient for the user to watch from multiple angles; it is also possible to choose to put the host device in a screen-off state, and only display the operation of the somatosensory application on the display screen of the TV connected to the host device in communication.

[0075] In the present disclosure, the wearable device has a long battery life and can be worn on the wrist or arm. The user can move the palms and fingers freely when exercising with the somatosensory application, which improves the experience during exercise and prevents the user from dropping the device during exercise, thereby improving the safety of product use. In addition, the data transmission delay based on the wireless connection is low, which can enhance the user's sense of immersion during exercise.

[0076] In some embodiments, the sensory data includes at least one of the following:

[0077] Human body signs data; human body movement data.

[0078] The sensing data includes human body sign data and human body motion data, wherein human body sign data includes heart rate, blood pressure, calories, etc. For example, wearable devices can record the changes in the user's heart rate during exercise through a heart rate sensor; wearable devices can record the changes in the user's blood pressure by irradiating light to the wrist blood vessels based on a photoelectric sensor; wearable devices can use an accelerometer to calculate the calories consumed by the user during exercise based on the user's motion trajectory, exercise intensity and other information. Due to the differences in the physical fitness of different users, when using wearable devices for physical exercise, different data such as heart rate and blood pressure will be generated. Based on the health monitoring capabilities of wearable devices, it can not only reflect the changes in the user's physical sign data during exercise, but also remind the user to rest, which provides an extra layer of protection for the user's physical health. In addition, after completing the exercise, the wearable device can disconnect the wireless connection with the host device, connect the wearable device to the user's commonly used electronic devices such as mobile phones, return the human body sign data to the mobile phone, and synchronously generate an exercise report, so that the user can intuitively understand the changes in the body during the entire exercise process.

[0079] Human motion data includes acceleration, angular velocity, movement direction, magnetic field information, movement time, etc. For example, wearable devices can obtain the acceleration of the user's movement through an accelerometer to reflect the speed of the user's movement; wearable devices can obtain the angular velocity and movement direction of the user's movement through a gyroscope to reflect the user's rotation; wearable devices can also obtain the magnetic field information of the user's location through a magnetic sensor. The magnetic field information will affect the accuracy of data collection of the wearable device.

[0080] For example, a user is using a somatosensory application that simulates playing badminton, and binds two smart bracelets to their two wrists for exercise. When the user raises his right hand to do a toss-up motion, the wearable device on the right hand side collects the acceleration data of the user's toss-up motion through the acceleration sensor, collects the user's angular velocity and horizontal displacement data through the gyroscope to reflect the user's moving direction, and collects the user's heart rate through the heart rate sensor. The wearable device wirelessly sends the first data including the heart rate, acceleration, angular velocity and moving direction to the host device, and the host device can synchronously display on its display screen that the game player's right hand is doing a toss-up motion, and because the user's heart rate is high, it shows that the game player is in a breathless state.

[0081] In some embodiments, the control data includes at least one of the following: physical button data, screen touch data, wherein the screen touch data is one of the following: touch data for a control component displayed on the screen, touch data for a blank area displayed on the screen.

[0082] The control data includes physical button data. The physical buttons of the wearable device have corresponding functions. Users can trigger the implementation of functions by pressing physical buttons. For example, the side of the wearable device has two physical buttons. The physical button on the upper side is used to turn on the wireless connection function of the wearable device, and the physical button on the lower side is used to switch the pairing mode of the wireless connection. When the user presses the physical button on the lower side, the wearable device obtains a pressure information and saves it as physical button data. When the host device receives the physical button data on the lower side, it knows that the wearable device has turned on the wireless pairing mode. In addition, the functions of the physical buttons of the wearable device can also be set by the user. The user can adjust the default physical button implementation function based on personal usage habits.

[0083] The control data also includes screen touch data, wherein the screen touch data includes touch data for the control components displayed on the screen and touch data for the blank areas displayed on the screen. Figure 4 As shown, a virtual control component is displayed on the wearable device 1, and the user can realize the corresponding function by clicking the corresponding virtual button. When the electronic device does not display the control component or displays a blank area, the wearable device will also obtain the user's touch data for the blank area displayed on the screen, and realize the corresponding function based on the touch operation on the blank area. For example, the user can swipe up at a preset position in the blank area to take a screenshot of the current game screen and save it.

[0084] According to an exemplary embodiment, Figure 3 As shown, the wireless control method in this embodiment includes:

[0085] S301, opening a first application, where the first application is used to simulate a function of a controller;

[0086] S302, displaying a control interface, where the control interface includes at least one control button;

[0087] S303, scanning a host device that supports connection in a first wireless communication manner, and sending a matching request to the host device;

[0088] S304, receiving matching success information sent by the host device;

[0089] S305, sending device information of the wearable device to the host device through the human-machine interface device HID service;

[0090] S306: Send first data at a first frequency via a wireless connection.

[0091] In step S301, the user can open the first application through touch commands, voice commands, gesture commands, etc. The first application is used to simulate the function of the controller, that is, after opening the first application, the wearable device can be used as the controller of the host device, and the wearable device will collect the somatosensory data and control data of the user during the somatosensory movement. When the wearable device does not open the first application or exits the first application, the wearable device resumes to be used as a smart bracelet, which can be used to check time, send and receive communication messages, and make electronic payments.

[0092] In step S302, after entering the first application, the interface of the wearable device displays virtual control buttons, and the user can touch the control buttons to make the wearable device perform the functions corresponding to the control buttons, such as setting the display brightness, taking screenshots to save the game screen, and turning on the wireless connection function. Figure 4 As shown, after the wearable device 1 opens the first application, control buttons with the same arrangement as the physical buttons of the controller 3 matched with the game console are displayed.

[0093] In step S303, the first control information refers to the data generated when the user turns on the wireless connection function of the wearable device and enters the pairing mode by operating the control button. The wearable device turns on the pairing mode of the wireless connection based on the first control information, sets the CoD (Class of Device) and device name of the wearable device, scans the host device that supports connection in the first wireless communication mode, and sends a matching request to the host device, wherein the first wireless communication mode can be Bluetooth, WiFi, ZigBee, etc. For example, after receiving the first control information, the CoD of the wearable device is set to 0x002508 to represent the device type of the wearable device, and the device name of the wearable device is set to "Joy-Con (R)" / "Joy-Con (L)", which is convenient for the host device to find when matching with the wearable device.

[0094] In step S304, a host device connected to the wearable device via the first wireless communication method is found based on the pairing mode. After the wearable device and the host device are matched, the wearable device receives matching success information sent by the host device.

[0095] In step S305, the wearable device has a human interface device HID (Human Interface Devices) service, and the human interface device HID refers to an input or output device used to interact with other electronic devices. The wearable device sends the device information of the wearable device to the host device through the human interface device HID service, wherein the device information includes the device type, version number, device color, initial calibration data of the sensor, waterproof level, etc. of the wearable device, and the host device can identify the attributes of the wearable device based on the device information. After the wearable device completes sending the device information and the host device completes receiving the device information, the wearable device is successfully connected to the host device. For example, the wearable device sends device information including a device type of 0x002508, a device color of red, and a waterproof level of 5ATM to the host device.

[0096] In step S306, the wearable device sends the first data to the host device at the first frequency through the wireless connection. Since the first data will be generated and transmitted in real time according to the user's behavior and action, the data volume is large, and the first data needs to be sent at a higher frequency. If the first frequency is lower than the threshold frequency, the transmission requirements of the first data cannot be met, and the data transmission speed may be slow, the transmission content may be incomplete, and a delay may occur, which affects the host device's control of the somatosensory application. Among them, the threshold frequency is to ensure that the delay tolerance of the operation corresponding to the first data displayed by the host device is less than the preset requirement. The preset requirement can be a default setting, or it can be adjusted based on the type of somatosensory application. For example, if some somatosensory applications have high requirements for synchronization, the preset requirement can be lowered, and the preset requirement can be set to 0.2s, then the threshold frequency is to ensure that the host device delays the display of the operation corresponding to the first data for less than 0.2s. The minimum frequency value; some somatosensory applications have loose requirements for synchronization, and the default setting can be used to keep the preset requirement at 0.3s, then the threshold frequency is to ensure that the host device delays the display of the operation corresponding to the first data for less than 0.3s. The minimum frequency value.

[0097] In the present disclosure, wearable devices such as smart bracelets can be used instead of controllers matched with game consoles. The wearable devices have good waterproof properties, which can effectively prevent water stains from damaging the product and reduce product loss. The wearable devices can be bound to the wrists without affecting the user's movements. This not only allows the user's palms and fingers to move freely, thereby improving the user experience, but also avoids the wearable device from slipping out of the hand, thereby improving the safety of product use.

[0098] The exemplary embodiment of the present disclosure provides a wireless control method, which is applied to a host device. Figure 5 As shown, the wireless control method shown in the present disclosure includes:

[0099] S501, establishing a wireless connection with a wearable device;

[0100] S502, receiving first data via a wireless connection;

[0101] S503: In response to the first data, display an operation corresponding to the first data on the target screen.

[0102] In step S501, the wireless connection function of the host device is turned on, and based on the information interaction between the wearable device and the host device, the electronic device and the wearable device establish a wireless connection. The wireless connection can be a Bluetooth connection, a ZigBee connection, a WiFi connection, an NFC connection, etc. Although the number of host devices is unique, the host device can determine the number of wearable devices allowed to be wirelessly connected based on performance, so that multiple people can participate in sports or entertainment together.

[0103] In step S502, the host device receives first data sent by the wearable device through a wireless connection, where the first data includes at least one of the body sensing data of the user during exercise and the control data of the wearable device.

[0104] In step S503, since the first data can reflect the user's behavior and operation on the wearable device, the host device can synchronously control the somatosensory application in response to the acquired first data, and display the operation corresponding to the first data on the target screen. For example, if the first data represents that the user is doing a jumping motion, the host device will synchronously display the game player doing a jumping motion in the somatosensory application; for another example, if the first data represents the control component for adjusting the display brightness displayed on the user's touch screen, the host device will adjust the display brightness according to the first data.

[0105] In some embodiments, the sensory data includes at least one of the following:

[0106] Human body signs data; human body movement data.

[0107] In some embodiments, the control data includes at least one of the following: physical button data, screen touch data, wherein the screen touch data is one of the following: touch data for a control component displayed on the screen, touch data for a blank area displayed on the screen.

[0108] The somatosensory data and control data received by the host device are sent by the wearable device. The specific content of the somatosensory data and control data received by the host device is the same as the somatosensory data and control data sent by the wearable device in the above embodiment, and will not be repeated here.

[0109] According to an exemplary embodiment, Figure 6 As shown, the wireless control method in this embodiment includes:

[0110] S601, scanning a wearable device that supports connection in a first wireless communication manner, and receiving a matching request from the wearable device;

[0111] S602, sending matching success information to the wearable device;

[0112] S603, receiving the device information of the wearable device sent by the wearable device through the human-machine interface device HID service;

[0113] S604, receiving first data at a first frequency through a wireless connection, where the first frequency is greater than a threshold frequency;

[0114] S605, controlling the display effect of the somatosensory application according to the sensing data;

[0115] S606: Control the progress of the somatosensory application according to the control data.

[0116] In step S601, the host device turns on the wireless connection function, scans the surrounding wearable devices that are allowed to connect in the first wireless communication mode, displays the wearable devices that are allowed to connect on the host device, and receives the matching request of the wearable device. The host device can automatically connect according to the history record, or the user can select the matching electronic device. The first wireless communication mode can be Bluetooth, WiFi, ZigBee, etc.

[0117] In step S602, the electronic device matched with the host device is the wearable device. After the wearable device and the host device complete the matching, the host device sends a matching success message to the wearable device to prompt that the wearable device can be used as a controller.

[0118] In step S603, the host device has a human-machine interface device HID service, and the host device receives the device information of the wearable device sent by the wearable device through the human-machine interface device HID service, wherein the device information includes the device type, version number, device color, initial calibration data of the sensor, waterproof level, etc. of the wearable device. When the host device completes receiving the device information, the wearable device is successfully connected to the host device.

[0119] In step S604, the host device receives the first data sent by the wearable device through a wireless connection at a first frequency. Since the first data is generated and transmitted in real time according to the user's behavior and action, the data volume is large and the first data needs to be received at a higher frequency. If the first frequency is lower than the threshold frequency, the transmission requirements of the first data cannot be met, and the data transmission speed may be slow, the transmission content may be incomplete, and a delay may occur, which affects the host device's control of the somatosensory application.

[0120] In step S605, the sensing data includes human body sign data and human body movement data, which can reflect the physiological state and action behavior of the user during exercise. The host device controls the display effect of the somatosensory application according to the sensing data, and the display effect includes the actions and expressions of game players in the somatosensory application, the screen changes of the somatosensory application, etc. For example, the host device obtains human body sign data such as the user's heart rate and blood pressure. The human body sign data reflects that the user is in a fatigued state. The host device displays an animation of cheerleaders encouraging on the display interface to motivate the user to keep exercising. For another example, the host device obtains human body movement data such as the user's acceleration, angular velocity, and movement direction. The host device synchronously displays the same actions of the game player on the display interface, enabling the user to intuitively see their own actions and make adjustments in a timely manner.

[0121] In step S606, the control data includes physical button data and screen touch data, which can reflect the user's operations on the wearable device. The host device controls the process of the somatosensory application according to the control data. For example, the host device obtains the control data of the user on the physical button on the side of the wearable device, and the host device controls the start or pause of the game in the somatosensory application. For another example, the host device obtains the touch data of the user on the control component displayed on the screen of the wearable device, and the host device switches the game in progress in the somatosensory application or sets the game player.

[0122] In the present disclosure, the host device obtains the first data of the wearable device through a wireless connection with the wearable device. The host device controls the somatosensory application based on the first data, provides a rich display effect for the user, facilitates the user to operate the somatosensory application, and improves the user experience.

[0123] An exemplary embodiment of the present disclosure provides a wireless control device applied to a wearable device. As Figure 7 shown, a block diagram of a wireless control device shown in the present disclosure.

[0124] The block diagram includes: a first connection module 71 and a first transceiver module 72. The first connection module 71 is used to establish a wireless connection with the host device. The first transceiver module 72 is used to send the first data through the wireless connection. The first data includes at least one of the following: sensing data, control data. Among them, the first data is used for the host device to control the somatosensory application. The sensing data includes at least one of the following: human body sign data, human body movement data. So that the host device responds to the first data and displays the operation corresponding to the first data on the target screen, where the target screen includes: the display screen on the host device and / or the display screen communicatively connected to the host device.

[0125] In an exemplary embodiment of the present disclosure, the control data includes at least one of the following: physical button data, screen touch data, wherein the screen touch data is one of the following: touch data for a control component displayed on the screen, touch data for a blank area displayed on the screen.

[0126] In an exemplary embodiment of the present disclosure, the first transceiver module 72 is also used to: send first data at a first frequency via a wireless connection, the first frequency being greater than a threshold frequency, and the threshold frequency is used to ensure that the delay tolerance of the operation corresponding to the display of the first data by the host device is less than a preset minimum frequency value.

[0127] In an exemplary embodiment of the present disclosure, the first connection module 71 is also used to: open a first application, which is used to simulate the functions of a controller; scan a host device that supports connection in a first wireless communication manner, and send a matching request to the host device; and receive matching success information sent by the host device.

[0128] In an exemplary embodiment of the present disclosure, the first transceiver module 72 is further used to: send device information of the wearable device to the host device through the human-machine interface device HID service, and the device information is used by the host device to identify the attributes of the wearable device.

[0129] In an exemplary embodiment of the present disclosure, the wireless control device further includes a first control module 73 for displaying a control interface, wherein the control interface includes at least one control button.

[0130] Regarding the wireless control device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0131] The exemplary embodiment of the present disclosure provides a wireless control device, which is applied to a host device. Figure 8 As shown, a block diagram of a wireless control device shown in the present disclosure.

[0132] The block diagram includes: a second connection module 81, a second transceiver module 82, and a second control module 83. The second connection module 81 is used to establish a wireless connection with a wearable device; the second transceiver module 82 is used to receive first data through the wireless connection, and the first data includes at least one of the following: sensing data, control data, wherein the first data is used by the host device to control the somatosensory application, and the sensing data includes at least one of the following: human body sign data, human body movement data; the second control module 83 is used to respond to the first data and display the operation corresponding to the first data on the target screen, wherein the target screen includes: the display screen on the host device and / or the display screen connected to the host device by communication. In an exemplary embodiment of the present disclosure, the second transceiver module 82 is also used to: receive the first data at a first frequency through a wireless connection, the first frequency is greater than a threshold frequency, and the threshold frequency is to ensure that the delay tolerance of the operation corresponding to the display of the first data by the host device is less than the preset minimum frequency value.

[0133] In an exemplary embodiment of the present disclosure, the second connection module 81 is further used to: scan a wearable device that supports connection in the first wireless communication manner, receive a matching request from the wearable device; and send matching success information to the wearable device.

[0134] In an exemplary embodiment of the present disclosure, the second transceiver module 82 is further used to: receive device information of the wearable device sent by the wearable device through a human-machine interface device HID service, wherein the device information is used by the host device to identify attributes of the wearable device.

[0135] In an exemplary embodiment of the present disclosure, the second control module 83 is further used to: control the display effect of the somatosensory application according to the sensing data; and control the progress of the somatosensory application according to the control data.

[0136] Regarding the wireless control device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0137] Fig. 9 1 is a block diagram of an electronic device 900 according to an exemplary embodiment. For example, the electronic device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0138] Reference Fig. 9 , the electronic device 900 may include one or more of the following components: a processing component 902 , a memory 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output (I / O) interface 912 , a sensor component 914 , and a communication component 916 .

[0139] The processing component 902 generally controls the overall operation of the electronic device 900, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 902 may include one or more modules to facilitate the interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0140] The memory 904 is configured to store various types of data to support operations on the electronic device 900. Examples of such data include instructions for any application or method operating on the electronic device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0141] The power supply component 906 provides power to the various components of the electronic device 900. The power supply component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 900.

[0142] The multimedia component 908 includes a screen that provides an output interface between the electronic device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the electronic device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0143] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), and when the electronic device 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 904 or sent via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting audio signals.

[0144] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0145] The sensor assembly 914 includes one or more sensors for providing various aspects of status assessment for the electronic device 900. For example, the sensor assembly 914 can detect the open / closed state of the electronic device 900, the relative positioning of components, such as the display and keypad of the electronic device 900, and the sensor assembly 914 can also detect the position change of the electronic device 900 or a component of the electronic device 900, the presence or absence of user contact with the electronic device 900, the orientation or acceleration / deceleration of the electronic device 900, and the temperature change of the electronic device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0146] The communication component 916 is configured to facilitate wired or wireless communication between the electronic device 900 and other devices. The electronic device 900 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0147] In an exemplary embodiment, the electronic device 900 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0148] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions, and the instructions can be executed by the processor 920 of the electronic device 900 to complete the wireless control method described above. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0149] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables a processing device of the electronic device to execute a wireless control method provided by an exemplary embodiment of the present disclosure.

[0150] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0151] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A wireless control method, It is characterized in that Applied to a wearable device, the method comprises: Establish a wireless connection with the host device; Sending first data via the wireless connection, the first data comprising at least one of the following: sensing data, control data, wherein the first data is used by the host device to control a somatosensory application, and the sensing data comprises at least one of the following: human body sign data, human body motion data; So that the host device displays the operation corresponding to the first data on a target screen in response to the first data, wherein the target screen includes: a display screen on the host device and / or a display screen to which the host device is communicatively connected.

2. The method according to claim 1, It is characterized in that The control data includes at least one of the following: physical button data, screen touch data, wherein the screen touch data is one of the following: touch data for a control component displayed on the screen, touch data for a blank area displayed on the screen.

3. The method according to claim 1, It is characterized in that The sending of the first data through the wireless connection comprises: The first data is sent at a first frequency via the wireless connection, where the first frequency is greater than a threshold frequency, and the threshold frequency is a minimum frequency value that ensures that the delay tolerance of the operation corresponding to the display of the first data by the host device is less than a preset requirement.

4. The method according to claim 1, It is characterized in that The step of establishing a wireless connection with the host device comprises: Opening a first application, wherein the first application is used to simulate a function of a controller; Scanning a host device that supports connection in a first wireless communication manner, and sending a matching request to the host device; Receive the matching success information sent by the host device.

5. The method according to claim 3, It is characterized in that The method further comprises: The device information of the wearable device is sent to the host device through a human-machine interface device HID service, where the device information is used by the host device to identify the attributes of the wearable device.

6. The method according to claim 1, It is characterized in that The method further comprises: A control interface is displayed, wherein the control interface includes at least one control button.

7. A wireless control method, It is characterized in that Applied to a host device, the method comprises: Establish wireless connection with wearable devices; receiving first data through the wireless connection, the first data including at least one of the following: sensing data and control data, wherein the first data is used by the host device to control a somatosensory application, and the sensing data includes at least one of the following: human body sign data and human body motion data; In response to the first data, an operation corresponding to the first data is displayed on a target screen, wherein the target screen includes: a display screen on the host device and / or a display screen to which the host device is communicatively connected.

8. The method according to claim 7, It is characterized in that The receiving first data through the wireless connection comprises: The first data is received at a first frequency through the wireless connection, where the first frequency is greater than a threshold frequency, and the threshold frequency is a minimum frequency value that ensures that the delay tolerance of the operation corresponding to the display of the first data by the host device is less than a preset requirement.

9. The method according to claim 7, It is characterized in that The establishing of a wireless connection with the wearable device comprises: Scanning a wearable device that supports connection in a first wireless communication manner, and receiving a matching request from the wearable device; Send matching success information to the wearable device.

10. The method according to claim 7, It is characterized in that The method further comprises: Receiving device information of the wearable device sent by the wearable device through a human-machine interface device HID service, wherein the device information is used by the host device to identify attributes of the wearable device; And / or, the method further comprises: Controlling the display effect of the somatosensory application according to the sensing data; The process of the somatosensory application is controlled according to the control data.

11. A wireless control device, It is characterized in that Applied to a wearable device, the wireless control device comprises: A first connection module, used to establish a wireless connection with a host device; A first transceiver module is used to send first data through the wireless connection, wherein the first data includes at least one of the following: sensing data and control data, wherein the first data is used by the host device to control a somatosensory application, and the sensing data includes at least one of the following: human body sign data and human body motion data; So that the host device displays the operation corresponding to the first data on a target screen in response to the first data, wherein the target screen includes: a display screen on the host device and / or a display screen to which the host device is communicatively connected.

12. A wireless control device, It is characterized in that Applied to a host device, the wireless control device comprises: A second connection module, used to establish a wireless connection with the wearable device; A second transceiver module is used to receive first data through the wireless connection, wherein the first data includes at least one of the following: sensing data and control data, wherein the first data is used by the host device to control a somatosensory application, and the sensing data includes at least one of the following: human body sign data and human body motion data; The second control module is used to display the operation corresponding to the first data on a target screen in response to the first data, wherein the target screen includes: a display screen on the host device and / or a display screen connected to the host device in communication.

13. A wearable device, It is characterized in that The wearable device comprises: processor; a memory for storing processor-executable instructions; The processor is configured to execute executable instructions in the memory to implement the wireless control method according to any one of claims 1 to 6.

14. A host device, It is characterized in that The host device comprises: processor; a memory for storing processor-executable instructions; The processor is configured to execute executable instructions in the memory to implement the wireless control method according to any one of claims 7 to 10.

Images