Equipment control method and device, equipment and storage medium

Abstract

The invention relates to an equipment control method and device, equipment and a storage medium, and is applied to wearable equipment, and the method comprises the following steps: monitoring action data of a user; and in response to the condition that the wearable device works in a controller simulation mode and the controller simulation identity authentication of the wearable device is passed, sending the action data to a host device, so that the host device responds to the action data and controls a target screen to display picture content associated with the action data, the target screen comprises a screen configured by the host device and / or a screen host device in communication connection with the host device. Through the method, the equipment control convenience and the user experience can be improved; and meanwhile, the control safety can also be improved.

Description

Technical Field

[0001] The present disclosure relates to the field of equipment technology, and in particular to an equipment control method and apparatus, equipment, and storage medium. Background Art

[0002] With the development of artificial intelligence technology, it is becoming more and more popular to interconnect devices for control. For example, mobile phones can control smart speakers, and the diversification of game forms has made somatosensory games popular, and game control can also be achieved through wearable devices. However, how to improve the security of inter-device control and user experience has become an urgent problem to be solved. Summary of the invention

[0003] The present disclosure provides a device control method and apparatus, a device, and a storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided a device control method, which is applied to a wearable device, and includes:

[0005] Monitor user action data;

[0006] In response to the wearable device operating in the controller simulation mode and the controller of the wearable device passing the simulated identity authentication, the action data is sent to the host device, so that the host device responds to the action data and controls the target screen to display the screen content associated with the action data, wherein the target screen includes: the screen configured by the host device, and / or the screen to which the host device is communicatively connected.

[0007] In some embodiments, the action data includes touch operation data, and the method further includes:

[0008] According to the touch operation data, obtaining network configuration information of the network where the host device is located;

[0009] Based on the network configuration information, join the network where the host device is located;

[0010] Within the network, a controller simulation identity authentication of the wearable device is performed with the host device.

[0011] In some embodiments, performing controller simulation authentication of the wearable device with the host device within the network includes:

[0012] In the network, performing a communication handshake with the host device and determining a data transmission delay between the host device and the host device;

[0013] In response to the communication handshake being successful and the data transmission delay satisfying the preset delay requirement, a notification message sent by the host device indicating that the controller of the wearable device has passed the simulated identity authentication is received.

[0014] In some embodiments, the network configuration information includes: a network identifier and a password corresponding to the network identifier, and acquiring the network configuration information of the network where the host device is located according to the touch operation data includes:

[0015] Acquiring a network identifier of a network where the host device is located according to a touch operation on the network identifier;

[0016] Sending a password acquisition request to the user terminal according to the network identifier;

[0017] Based on the password acquisition request, a password corresponding to the network identifier fed back by the user terminal is received.

[0018] In some embodiments, the password fed back by the user terminal is an encrypted password, and obtaining the network configuration information of the network where the host device is located further includes:

[0019] The encrypted password fed back by the user terminal is decrypted to obtain the password corresponding to the network identifier.

[0020] In some embodiments, the method further comprises:

[0021] detecting an instruction to turn on a controller simulation mode of the wearable device;

[0022] Based on the opening instruction, a control interface of the host device is displayed on a display screen of the wearable device, wherein the displayed control interface is used to indicate that the wearable device operates in the controller simulation mode.

[0023] In some embodiments, the detecting an instruction to turn on a controller simulation mode of the wearable device includes:

[0024] Detect an instruction sent by a user terminal to turn on a controller simulation mode of the wearable device.

[0025] In some embodiments, the motion data includes body movement data, wherein the body movement data is used by the host device to simulate game controls of the user and displayed on the target screen.

[0026] According to a second aspect of an embodiment of the present disclosure, there is provided a device control method, which is applied to a host device, and the method includes:

[0027] In response to the wearable device operating in the controller simulation mode and the controller simulation identity authentication of the wearable device passing, receiving the user's motion data sent by the wearable device;

[0028] In response to the action data, a target screen is controlled to display the screen content associated with the action data, wherein the target screen includes: a screen configured by the host device and / or a screen connected to the host device in communication.

[0029] In some embodiments, the method further comprises:

[0030] Performing a communication handshake with the wearable device and determining a data transmission delay between the wearable device and the wearable device;

[0031] In response to the communication handshake being successful and the data transmission delay satisfying the preset delay requirement, a notification message indicating that the controller of the wearable device has passed the simulated identity authentication is sent to the wearable device.

[0032] In some embodiments, in response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement, sending a notification message indicating that the controller of the wearable device has passed the simulated identity authentication to the wearable device includes:

[0033] In response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement, displaying an identification of the wearable device;

[0034] Based on the displayed identifier, receiving a confirmation instruction to the wearable device;

[0035] Based on the confirmation instruction, the notification message indicating that the controller of the wearable device has passed the simulated identity authentication is sent to the wearable device.

[0036] In some embodiments, the motion data includes body movement data, and in response to the motion data, controlling the target screen to display screen content associated with the motion data includes:

[0037] In response to the body movement data, game controls of the user are simulated and displayed on the target screen.

[0038] According to a third aspect of an embodiment of the present disclosure, there is provided a device control apparatus, which is applied to a wearable device, and the apparatus includes:

[0039] A monitoring module configured to monitor the user's motion data;

[0040] The first sending module is configured to send the action data to the host device in response to the wearable device operating in the controller simulation mode and the controller of the wearable device passing the simulated identity authentication, so that the host device responds to the action data and controls the target screen to display the screen content associated with the action data, wherein the target screen includes: the screen configured by the host device and / or the screen connected to the host device for communication.

[0041] In some embodiments, the action data includes touch operation data, and the device further includes:

[0042] An acquisition module, configured to acquire network configuration information of a network where the host device is located according to the touch operation data;

[0043] A network access module, configured to join the network where the host device is located based on the network configuration information;

[0044] The authentication module is configured to perform a simulated identity authentication of the controller of the wearable device with the host device within the network.

[0045] In some embodiments, the authentication module is also configured to perform a communication handshake with the host device within the network and determine the data transmission delay between the host device and the host device; in response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement, receive a notification message sent by the host device indicating that the controller of the wearable device has passed the simulated identity authentication.

[0046] In some embodiments, the network configuration information includes: a network identifier and a password corresponding to the network identifier. The acquisition module is further configured to obtain the network identifier of the network where the host device is located based on a touch operation on the network identifier; send a password acquisition request to the user terminal based on the network identifier; and receive the password corresponding to the network identifier fed back by the user terminal based on the password acquisition request.

[0047] In some embodiments, the password fed back by the user terminal is an encrypted password, and the acquisition module is further configured to decrypt the encrypted password fed back by the user terminal to obtain the password corresponding to the network identifier.

[0048] In some embodiments, the apparatus further comprises:

[0049] a detection module configured to detect an instruction to turn on a simulation mode of a controller of the wearable device;

[0050] The display module is configured to display the control interface of the host device on the display screen of the wearable device based on the opening instruction; wherein the displayed control interface is used to represent that the wearable device operates in the controller simulation mode.

[0051] In some embodiments, the detection module is further configured to detect an instruction sent by a user terminal to turn on a controller simulation mode of the wearable device.

[0052] In some embodiments, the motion data includes body movement data, wherein the body movement data is used by the host device to simulate game controls of the user and displayed on the target screen.

[0053] According to a fourth aspect of an embodiment of the present disclosure, there is provided a device control apparatus, which is applied to a host device, and the apparatus includes:

[0054] a receiving module configured to receive the user's motion data sent by the wearable device in response to the wearable device operating in the controller simulation mode and the controller simulation identity authentication of the wearable device passing;

[0055] The control module is configured to control the target screen to display the screen content associated with the action data in response to the action data, wherein the target screen includes: a screen configured by the host device and / or a screen connected to the host device in communication.

[0056] In some embodiments, the apparatus further comprises:

[0057] A handshake module, configured to perform a communication handshake with the wearable device and determine a data transmission delay between the wearable device and the wearable device;

[0058] The second sending module is configured to send a notification message indicating that the controller of the wearable device has passed the simulated identity authentication to the wearable device in response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement.

[0059] In some embodiments, the second sending module is further configured to display the identification of the wearable device in response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement; based on the displayed identification, receive a confirmation instruction to the wearable device; based on the confirmation instruction, send the notification message to the wearable device indicating that the simulated identity authentication of the controller of the wearable device has passed.

[0060] In some embodiments, the motion data includes body movement data, and the control module is further configured to simulate game controls of the user and display them on the target screen in response to the body movement data.

[0061] According to a fifth aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0062] processor;

[0063] a memory for storing processor-executable instructions;

[0064] Wherein, the processor is configured to execute the device control method as described in the first aspect or the second aspect above.

[0065] According to a sixth aspect of an embodiment of the present disclosure, there is provided a storage medium, including:

[0066] When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the device control method as described in the first aspect above, or is configured to execute the device control method as described in the second aspect above.

[0067] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0068] In an embodiment of the present disclosure, a wearable device is used to monitor the motion data of the wearer, and when the wearable device operates in a controller simulation mode and the controller of the wearable device simulates an identity authentication and passes, the motion data is sent to a host device. After the host device obtains the motion data, the target screen is controlled to display the screen content associated with the motion data. On the one hand, since the host device is controlled by the wearable device, the wearable device is worn on the user without holding it, so the device control is convenient and the user experience can be improved. On the other hand, since the controller of the wearable device simulates an identity and can control the host device only when the authentication is passed, the control security can be improved.

[0069] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0071] Figure 1 This is a schematic diagram of the interaction between a smart bracelet and a mobile phone APP in the related technology to achieve somatosensory motion control.

[0072] Figure 2 for Figure 1 Interaction example diagram of somatosensory motion control.

[0073] Figure 3The schematic diagram is a schematic diagram of the interaction between the controller and the game console in the related art to realize somatosensory game control.

[0074] Figure 4 for Figure 3 Controller protocol related register information table.

[0075] Figure 5 A device control method process shown in the embodiment of the present disclosure Figure 1 .

[0076] Figure 6 This is an example diagram of a network architecture of a somatosensory game in an embodiment of the present disclosure.

[0077] Figure 7 This is an example diagram of the control interface of the wearable device controller simulation mode according to an embodiment of the present disclosure.

[0078] Figure 8 This is a device control method process provided by the embodiment of the present disclosure Figure 2 .

[0079] Fig. 9 This is an interactive diagram of the process of a device control method in an embodiment of the present disclosure.

[0080] Fig.10 This is an example of a device control device in the embodiment of the present disclosure. Figure 1 .

[0081] Fig.11 This is an example of a device control device in the embodiment of the present disclosure. Figure 2 .

[0082] Fig.12 The present invention is a block diagram of a wearable device according to an exemplary embodiment.

[0083] Fig.13 The invention is a block diagram showing a host device according to an exemplary embodiment. DETAILED DESCRIPTION

[0084] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0085] In the related art, there is a method of realizing somatosensory motion by connecting a smart bracelet with a mobile phone application (Application, APP). Figure 1The schematic diagram of the interaction between the smart bracelet and the mobile phone APP in the related technology to realize the somatosensory motion control is as follows: Figure 1 As shown, the smart bracelet is connected to the mobile phone via Bluetooth. The smart bracelet is equipped with a six-axis sensor and a heart rate monitor. The smart bracelet can use the six-axis sensor and the heart rate monitor in the bracelet to record the user's behavior data and heart rate, and transmit them to the mobile phone APP. After the mobile phone APP receives the data transmitted by the smart bracelet, it caches the motion video locally, or calls a third-party motion video apk (application package) or SDK (Software Development Kit) to perform motion algorithm-related processing on the received data, thereby realizing somatosensory motion feedback.

[0086] Figure 2 for Figure 1 Interaction example diagram of somatosensory motion control in the video. Figure 2 In the device Figure 1 In the smart bracelet, iMotion is a third-party sports video processing platform that adjusts the sports video based on the received sports data. Figure 2 As shown, the following steps are included:

[0087] First, the device connects to the mobile phone APP via Bluetooth; after the connection is complete, select the exercise type on the mobile phone APP and click Start; check whether the device has jumped to the status interface corresponding to the exercise selected in the mobile phone APP. If the jump is successful, continue with the following steps. If the jump is unsuccessful, the connection between the device and the mobile phone APP may be disconnected or dropped for some reason. At this time, the mobile phone APP prompts to connect the device and returns to the previous step to confirm again whether the connection between the device and the mobile phone APP is successful; if the device jumps successfully, the device requests the mobile phone APP to send the type of data to the mobile phone APP, such as acceleration, angular velocity, user heart rate, etc. The mobile phone APP sends all sensor data types associated with the exercise type to the device according to the selected exercise type, so that the device can feedback the full amount of data corresponding to each type to the mobile phone APP. After the above steps are completed, the user wears the device to exercise. During the user's exercise, the device uses sensors to synchronously collect acceleration, angular velocity, the user's heart rate, calories consumed and other data corresponding to the above data types, and sends the collected data to the mobile phone APP via Bluetooth communication; after the mobile phone APP receives the data, it processes the data based on the motion algorithm of the mobile phone APP, including data fusion, data processing using sensor algorithms, etc.; after the mobile phone APP completes data processing, it sends the processed data to the iDong end; after receiving the processed data sent by the mobile phone APP, the iDong end adjusts the video display and feeds back the adjusted video data to the mobile phone APP so that the user can see the feedback of the exercise; while the mobile phone APP sends the processed data to the iDong end, it can also send the processed data to the device end. After the device receives the data sent by the mobile phone APP, it displays the data on the display screen.

[0088] In the above solution, when the smart bracelet is connected to the mobile phone APP, the mobile phone APP can only obtain sports videos from the local or iDong platform. The sports video content is less extended, and the video selectivity is low based on the performance of the mobile phone or the video quality. In addition, users usually use the mobile phone to project the screen, which is based on the wireless local area network. The high latency of the wireless local area network will reduce the user's immersion and continuity of the exercise process.

[0089] There is also a method of playing somatosensory games by combining a somatosensory game console and a controller in the related art, in which the role of the controller is limited to the somatosensory game console, as a somatosensory game console accessory, and has no other auxiliary functions. Taking the switch console and switch controller as an example, the controller includes the following configurations: control buttons, six-axis sensors, NFC, IR (Infrared) sensors, HD vibration motors, and Bluetooth; among them, the NFC of the switch is used with the official controller to swipe the Amiibo card officially launched by Nintendo, which can be used to obtain props in the game; the IR sensor can detect obstacles; and the HD vibration motor can make corresponding action prompts for feedback in the game.

[0090] Figure 3 It is a schematic diagram of the interaction between the controller and the game console in the related art to realize the somatosensory game control. Figure 3 In the game, the controller is a somatosensory game console accessory, such as Figure 3 As shown, the game console and the controller are manually paired and connected via Bluetooth. After the connection is completed, the game console obtains the controller status, which includes whether the controller is successfully connected to the game console; after the pairing connection is successful, the game console requests the device information and input report mode of the controller, which includes the interval time for the controller to send data to the game console and whether the controller actively uploads data to the game console, etc.; the user can set the IR sensor, number of players, player number, etc. on the controller, and the controller can write the corresponding data to the read-write register according to the user settings.

[0091] Figure 4 for Figure 3 The register information table related to the controller protocol in Figure 4 As shown, the data information required for "requesting device information" is stored in the register "0*02" address of the controller, the data information required for "resetting pairing information" is stored in the register "0*07" address of the controller, the data information required for "setting the number of players" is stored in the register "0*07" address of the controller, and the data information required for "enabling vibration" is stored in the register "0*48" address of the controller, where enabling vibration is to start the HD vibration motor in the controller. The controller can call relevant information through the register address to control the game accordingly. The various command modules of the game console are also connected to various hardware in the controller to perform various functions. An SPI (Serial Peripheral interface) flash memory is also set inside the controller to save the calibration data corresponding to the controller, etc.

[0092] In the above solution, when playing somatosensory games, users need to hold one or two controllers and wear a wristband or strap that can be purchased for a fee to prevent the game handle from being thrown out due to human inertia during sports games. When playing somatosensory games, users holding the controller may accidentally touch the control buttons on the controller, and when stretching their arms and palms, they are more likely to subconsciously open their palms. Holding the controller at this time will reduce the user's immersive experience when playing somatosensory games; in addition, for example, the switch console is equipped with two controllers that are distinguished by color, and the two controllers use a fixed color combination, which is relatively simple.

[0093] In this regard, the present disclosure provides a device control method, which is applied to a wearable device. Figure 5 This is a device control method flow shown in the embodiment of the present disclosure Figure 1 ,like Figure 5 As shown, the following steps are included:

[0094] S11, monitoring user's action data;

[0095] S12. In response to the wearable device operating in the controller simulation mode and the controller of the wearable device passing the simulated identity authentication, the action data is sent to the host device, so that the host device responds to the action data and controls the target screen to display the screen content associated with the action data, wherein the target screen includes: a screen configured by the host device and / or a screen to which the host device is communicatively connected.

[0096] In the embodiments of the present disclosure, the wearable device includes a smart watch, a smart bracelet, and other devices that can be directly worn on the user. For example, if the wearable device is a smart watch, the color of the wearable device can be changed by changing the watch strap. In addition, the smart watch and the smart bracelet can be made of waterproof material to effectively prevent water stains from damaging the product and reduce product loss.

[0097] The disclosed embodiments can be applied to various scenarios where devices are interconnected to control each other, such as connecting a wearable device to a smart speaker, and controlling the playback of the smart speaker by monitoring the user's touch operation data on the wearable device; another example is connecting a wearable device to smart home devices such as smart air conditioners and smart washing machines, and controlling the operation and working parameters of the smart home devices by monitoring the user's touch operation data on the wearable device; it can also be applied to the somatosensory game control scenario, where the wearable device is connected to a host device (game host), monitoring the user's body movement data, and sending the data to the host device, and the host device controls the target screen to display the screen content associated with the action data based on the received data. The disclosed embodiments are specifically described using somatosensory games as an example.

[0098] In step S11, the wearable device can monitor the motion data of the wearer through sensors, wherein the motion data includes touch operation data and body motion data; the sensors include three-axis sensors, six-axis sensors, nine-axis sensors and other sensors that can monitor body motion data, as well as touch sensors, force sensors and other sensors that can monitor user touch operation data; the body motion data may include acceleration data, angular velocity data, wearer's heart rate data, wearer's calorie consumption data and other data related to the motion monitored by the wearable device when the user is playing a somatosensory game, and the specific body motion data type varies according to the type of somatosensory game selected by the user. The touch operation data is the data generated by the user's operation on the touch area of ​​the wearable device, including the user's click operation, drag operation, long press operation and the like in the touch area.

[0099] In step S12, the wearable device responds to operating in the controller simulation mode, and the controller of the wearable device simulates identity authentication and sends the action data to the host device, so that the host device responds to the action data and controls the target screen to display the screen content associated with the action data, wherein the target screen includes: the screen configured by the host device, and / or the screen connected to the host device by communication. The wearable device and the host device can communicate based on wireless communication technologies such as Wireless-Fidelity (Wi-Fi), Bluetooth, and ZigBee.

[0100] It should be noted that the controller simulation mode of the wearable device is a mode in which the wearable device performs other than basic functions. Taking a smart watch as an example, the basic functions of a smart watch may include time display function, voice function, motion data collection function, information reminder function, etc. Taking a smart bracelet as an example, the basic functions of a smart bracelet may include time display function, motion data collection function, access card function, etc.

[0101] In the embodiment of the present disclosure, the wearable device can operate in the controller simulation mode by directly operating the wearable device to operate in the controller simulation mode, or by other user terminals to enable the wearable device to operate in the controller simulation mode. The user terminal includes a movable device or a fixed device, which can be a mobile phone, a tablet computer, a laptop computer, a desktop computer, etc.

[0102] In the disclosed embodiment, the controller of the wearable device simulates identity authentication to indicate that pairing of the wearable device with the host device is successful, and the wearable device has the authority to cooperate with the host device to control the host device.

[0103] In the disclosed embodiments, the wearable device can realize identity authentication based on the user's operation, for example, the user presses the preset buttons of the host device and the wearable device within a preset time to realize pairing; or the wearable device can realize pairing based on automatic communication interaction with the host device. It should be noted that the above two methods are both realized based on the communication protocol between the wearable device and the host device.

[0104] In addition, in the embodiment of the present disclosure, the controller of the wearable device simulates identity authentication, which may refer to the communication handshake between the wearable device and the host device being passed, and may also include other authentications, such as network quality authentication, etc., which are not limited in the embodiment of the present disclosure.

[0105] In the embodiment of the present disclosure, when the wearable device is working in the controller simulation mode and the controller simulation identity authentication is passed, the monitored motion data is sent to the host device, and the sending of the motion data includes sending through a private protocol or sending through a network. After the host device obtains the motion data sent by the wearable device, it can respond to the motion data and control the target screen to display the screen content associated with the motion data, wherein the target screen includes: a screen configured by the host device, and / or a screen connected to the host device by communication. For example, the display screen of the wearable device that is successfully configured with the host device, the display screen of the host device itself, etc., can also include the display screen of other smart terminals that are connected to the host device by communication, such as the host device is connected to the TV, and the corresponding screen content can be displayed on the TV display screen. In the embodiment of the present disclosure, the host device can have its own display screen, and the display screen of the host device can display the screen content associated with the motion data, for example, it can show the control of the game by the body language such as the body movements or hitting strength of the wearer when playing a somatosensory game, so as to facilitate the wearer to make corresponding control adjustments according to the display; in addition, the host device can also be placed on the base of the host device and connected to the TV with an HDMI (High Definition Multimedia Interface) line to cast the screen. Compared with mobile phone screen projection, this screen projection method can reduce the screen projection delay, thereby improving the user's immersion in somatosensory games.

[0106] In some embodiments, the motion data includes body movement data, wherein the body movement data is used by the host device to simulate game controls of the user and displayed on the target screen.

[0107] In the disclosed embodiment, as mentioned above, the wearable device can monitor acceleration data, angular velocity data, wearer's heart rate data, wearer's calorie consumption data and other data related to the user's motion when playing a somatosensory game, and the motion data sent to the host device includes body motion data. The host device can simulate the user's game control based on the body motion data and display it on the target screen. For example, the wearer's game control can be simulated based on the body motion data, for example, in a dance game, the wearer's body movements can be simulated, and in a boxing game, the wearer's hitting strength can be simulated, and displayed on the target screen.

[0108] In the disclosed embodiments, a wearable device is connected to a host device, the wearable device monitors the user's body motion data and sends it to the host device, and the host device simulates the user's game control based on the body motion data. On the one hand, since the host device usually contains rich game resources, compared with the method in the related art that can only obtain fewer game resources from local or third-party platforms, the diversity of somatosensory game support can be improved; on the other hand, in the disclosed embodiments, the functions of the wearable device are reused, and the wearable device is used to simulate the controller of the host device. Since the wearable device can be worn on the wearer, it is not easy to throw it compared to a controller that needs to be held, which can make the control of the somatosensory game more precise, thereby improving the user's immersion in the exercise process; and since the wearable device is easy to flexibly configure the appearance, it can also enhance the fun of the somatosensory game.

[0109] It can be understood that in this embodiment, the wearable device is used to monitor the user's motion data, and when the wearable device operates in the controller simulation mode and the controller of the wearable device simulates the identity authentication and passes, the motion data is sent to the host device. After the host device obtains the motion data, it controls the target screen to display the screen content associated with the motion data. On the one hand, since the host device is controlled by the wearable device, the wearable device is worn on the user without holding it, so the device control is convenient and can improve the user experience; on the other hand, since the controller of the wearable device simulates the identity and can control the host device only when the authentication is passed, the control security can be improved.

[0110] In some embodiments, the action data includes touch operation data, and the method further includes:

[0111] According to the touch operation data, obtaining network configuration information of the network where the host device is located;

[0112] Based on the network configuration information, join the network where the host device is located;

[0113] Within the network, a controller simulation identity authentication of the wearable device is performed with the host device.

[0114] In the embodiment of the present disclosure, as mentioned above, the action data includes touch operation data, and the wearable device can monitor the touch operation data and obtain the network configuration information of the network where the host device is located according to the touch operation data, wherein the network configuration information can be obtained based on the click operation of the monitored user, such as the network configuration information of the Wi-Fi network. The network configuration information includes at least a wireless network identifier, and may also include a password corresponding to the wireless network identifier. In the embodiment of the present disclosure, the network configuration information may belong to the network configuration information of a public network, or may belong to the network configuration information of a private network. For a public network without a password, the network configuration information may include a wireless network identifier. Among them, the wireless network identifier may be a service set identifier (Service Set Identifier, SSID), which is used to distinguish different networks. SSID can be the name of a local area network, and devices set to the value of the same SSID name can communicate with each other in the local area network where they are located. In the embodiment of the present disclosure, the wearable device joins the local area network where the host device is located by obtaining the network configuration information of the network where the host device is located.

[0115] In the disclosed embodiment, the wearable device has a display screen, and the wearable device displays a network identifier based on the display screen, so that it can receive a user's touch operation on the network identifier to obtain the network configuration information of the network where the host device is located.

[0116] It should be noted that the embodiments of the present disclosure are not limited to obtaining network configuration information through touch operation of wearable devices, but can also be based on user voice operation to obtain network configuration information, or through other user terminals to obtain the network configuration information of the network where the host device is located. For example, the user terminal is a mobile phone, tablet computer or laptop computer, etc. The wearable device can obtain partial or all of the network configuration information of the host device through the user terminal.

[0117] In the disclosed embodiment, after the wearable device and the host device are connected to the same network, the wearable device controller simulation identity authentication can be performed with the host device. The authentication of the wearable device controller simulation identity authentication may include the communication identity authentication of the wearable device and the host device within the network; it may also include the communication quality authentication between the wearable device and the host device, etc.

[0118] In the disclosed embodiment, authentication of the simulated identity of the wearable device controller is performed before the wearable device and the host device transmit motion data, which can improve the security and privacy of information interaction between the wearable device and the host device.

[0119] In some embodiments, performing controller simulation authentication of the wearable device with the host device within the network includes:

[0120] In the network, performing a communication handshake with the host device and determining a data transmission delay between the host device and the host device;

[0121] In response to the communication handshake being successful and the data transmission delay satisfying the preset delay requirement, a notification message sent by the host device indicating that the controller of the wearable device has passed the simulated identity authentication is received.

[0122] In the disclosed embodiment, the wearable device and the host device first perform a communication handshake to get to know each other and transmit information. During the communication handshake process, the wearable device and the host device can confirm data synchronization and information confirmation with each other.

[0123] In the disclosed embodiment, the wearable device and the host device can perform a communication handshake based on a private protocol. Before the communication handshake begins, the wearable device can receive a communication handshake request sent by the host device, or the wearable device can send a communication handshake request to the host device. Taking the example of a wearable device receiving a communication handshake request sent by the host device, after the wearable device receives the communication handshake request, it can send to the host device player information including the number of players, player names, and other data required for the user (such as the wearer) to synchronize the game; taking the example of a wearable device sending a communication handshake request to the host device, the communication handshake request can carry the above data including the number of players. After the host device receives the above data, it can send a notification message of a successful handshake to the wearable device.

[0124] In the embodiments of the present disclosure, the wearable device and the host device not only perform a communication handshake, but also determine the data transmission delay between the wearable device and the host device. In some embodiments, the host device and the wearable device can calculate the data transmission delay based on the data transmitted during the communication handshake. In other embodiments, the host device and the wearable device can also use test data to determine the data transmission delay after the communication handshake is successful. This is not limited to the embodiments of the present disclosure. Among them, the data transmission delay can include the time required from the first bit of the data frame to the last bit of the frame. The data transmission delay is affected by the network transmission rate. If the data transmission delay is large, it may also be that the network transmission rate is too low.

[0125] Since a large data transmission delay may cause a sense of lag in game control, in the embodiment of the present disclosure, when the communication handshake is successful and the data transmission delay meets the preset delay requirement, the wearable device receives a notification message sent by the host device indicating that the controller of the wearable device has passed the simulated identity authentication. The preset delay requirement can be set according to the needs of the user (such as the wearer), and after the wearable device receives the notification message, it can inform the user through a pop-up window or voice broadcast.

[0126] The solution in the disclosed embodiment is to perform a communication handshake between the wearable device and the host device, and determine whether the controller of the wearable device passes the simulated identity authentication based on the data transmission delay result. Through the method of this embodiment, the efficiency, reliability and security of information interaction between the host device and the wearable device can be improved.

[0127] In some embodiments, the network configuration information includes: a network identifier and a password corresponding to the network identifier, and acquiring the network configuration information of the network where the host device is located according to the touch operation data includes:

[0128] Acquire the network identifier of the network where the host device is located according to the touch operation on the network identifier;

[0129] Sending a password acquisition request to the user terminal according to the network identifier;

[0130] Based on the password acquisition request, a password corresponding to the network identifier fed back by the user terminal is received.

[0131] As mentioned above, the wearable device can obtain the network configuration information of the host device based on the touch operation of the user (e.g., the wearer). In the embodiment of the present disclosure, the scanned network identifier can be displayed on the display screen of the wearable device, so as to obtain the network identifier of the network where the host device is located according to the user's touch operation on the network identifier. For example, the wearable device can display multiple detected network identifiers and determine the network identifier of the network where the host device is located based on the user's click and other touch operations. After determining the network identifier, the wearable device sends a password acquisition request to the user terminal to obtain the password corresponding to the network identifier. For example, after receiving the password acquisition request, the user terminal can pop up a network password input interface on the display interface, and the user (e.g., the wearer) can enter the network password on the user terminal. After the user terminal obtains the network password, it can send the network password to the wearable device, thereby joining the network where the host device is located.

[0132] It should be noted that the wearable device and the user terminal are bound and connected before the wearable device joins the network where the host device is located. The wearable device and the user terminal can be bound based on Bluetooth or other wireless networks, and the user terminal and the wearable device can communicate through a private protocol.

[0133] Figure 6 This is an example diagram of a network architecture of a somatosensory game in an embodiment of the present disclosure. Figure 6 In the above, watches / bracelets are wearable devices, game consoles are host devices, Just Dance is a somatosensory game in game consoles, and sports and health applications are applications in user terminals. Figure 6In the network architecture shown, the watch / bracelet can be connected to the user terminal via Bluetooth. The watch / bracelet can send the user's body motion data such as heart rate, blood pressure, and calories consumed during the somatosensory game to the user terminal. The sports health application in the user terminal can judge the user's physical condition during the somatosensory game based on the above body motion data. In addition, the watch / bracelet and the host device are in the same wireless local area network. The watch / bracelet can send body motion data such as acceleration and angular velocity to the host device. The host device simulates the user's game control based on the motion data sent by the watch / bracelet, and displays the screen content associated with the body motion data on the target screen such as the display screen of the host device and the display screen of the user terminal.

[0134] It can be understood that in the embodiments of the present disclosure, considering that wearable devices may not support key or voice input of passwords, and user terminals such as mobile phones have relatively complete functions, the method of obtaining the password of the network where the host device is located through the user terminal can improve the applicability of controlling the host device based on the wearable device.

[0135] In some embodiments, the password fed back by the user terminal is an encrypted password, and obtaining the network configuration information of the network where the host device is located further includes:

[0136] The encrypted password fed back by the user terminal is decrypted to obtain the password corresponding to the network identifier.

[0137] In the disclosed embodiment, the encrypted password fed back by the user terminal may be generated by encryption using a symmetric encryption algorithm such as DES (Data Encryption Standard) or an asymmetric encryption algorithm such as DSA (Digital Signature Algorithm), and the disclosed embodiment does not limit this. It should be noted that the wearable device can negotiate an encryption key and a decryption key with the user terminal during the binding process, and the wearable device can store the corresponding decryption key, so as to decrypt the encrypted password after receiving it to obtain the password corresponding to the network identifier.

[0138] In the disclosed embodiment, the user terminal encrypts the password and sends it to the wearable device, and the wearable device decrypts the password. In this way, the privacy and security of the password can be improved and the risk of password theft can be reduced.

[0139] In some embodiments, the method further comprises:

[0140] detecting an instruction to turn on a controller simulation mode of the wearable device;

[0141] Based on the opening instruction, the control interface of the host device is displayed on the display screen of the wearable device; wherein the displayed control interface is used to represent that the wearable device operates in the controller simulation mode.

[0142] In an embodiment of the present disclosure, the wearable device detects an instruction to turn on the controller simulation mode. In some embodiments, the wearable device can detect the user's instruction to turn on the controller simulation mode. For example, the instruction to turn on the controller simulation mode can be determined by detecting the user's touch operation on the display screen of the wearable device. For another example, the instruction to turn on the controller simulation mode can also be determined by detecting the user's voice operation. In other embodiments, the wearable device can also detect the instruction to turn on the controller simulation mode sent by the user terminal. Exemplarily, the user terminal can detect the instruction to turn on the controller simulation mode based on the touch operation or voice operation, and then send the opening instruction to the wearable device. It should be noted that in the embodiment of the present disclosure, the user terminal is supported to turn on the controller simulation mode of the wearable device, which is highly intelligent.

[0143] In the disclosed embodiment, after the wearable device detects the instruction to turn on the controller simulation mode, the control interface of the host device is displayed on the display screen, thereby operating in the controller simulation mode. It should be noted that if the wearable device does not display the control interface of the host device, the turn-on of the controller simulation mode of the wearable device is unsuccessful and needs to be restarted.

[0144] Figure 7 This is an example diagram of the control interface of the wearable device controller simulation mode in the embodiment of the present disclosure. Figure 7 In the example, the watch / bracelet is a wearable device, and controller 1 and controller 2 are accessories of the somatosensory game console in the simulated related technology. It should be noted that one wearable device (watch / bracelet) can only simulate one controller. Figure 7 As shown, the control interface shows the corresponding Figure 3 The relevant functions of the controller, wearable devices can simulate Figure 3 The controller has functions such as NFC, HD vibration motor, etc., and can also display directional control controls. Based on the displayed directional control controls, the wearable device can also detect the operation of the directional control controls to select games in the game console or control the direction during the game.

[0145] In the disclosed embodiments, the analog identifier may be set during the communication handshake process between the controller and the host device; wherein the analog identifier is used to distinguish the analog part of the wearable device. For example, the wearable device carries the analog identifier data set by the user in the communication handshake request and sends it to the host device, or the wearable device carries the analog identifier data set by the user in the data fed back based on the communication handshake request of the host device and sends it to the host device; or the host device assigns the corresponding analog identifier to the wearable device during the communication handshake process with the wearable device. In the case where the analog identifier is set by the user, for example, the wearable device may obtain the analog identifier set by the user through the monitored touch operation of the user, and for another example, the wearable device may also obtain the analog identifier set by the user based on the user's voice operation.

[0146] It should be noted that after determining the simulation identifier, the host device will store the mapping relationship between the simulation identifier and the device identifier of the wearable device that sends the simulation identifier, so that after the host device receives the motion data sent by the wearable device, it can determine the simulation identifier corresponding to the wearable device currently sending the motion data based on the stored mapping relationship, and simulate the control of the part indicated by the simulation identifier in the game based on the motion data of the current wearable device.

[0147] In the disclosed embodiment, by detecting the opening instruction of the controller simulation mode of the wearable device, the control interface of the host device is displayed on the display screen, which can facilitate the user to control the host device more conveniently based on the displayed control interface and also facilitate the user to know that the current wearable device is working in the controller simulation mode, and the intelligence is relatively high.

[0148] The present disclosure also provides a device control method, which is applied to a host device. Figure 8 This is a device control method process provided by the embodiment of the present disclosure Figure 2 ,like Figure 8 As shown, the following steps are included:

[0149] S21, in response to the wearable device operating in the controller simulation mode and the controller of the wearable device passing the simulated identity authentication, receiving the user's motion data sent by the wearable device;

[0150] S22. In response to the action data, control a target screen to display screen content associated with the action data, wherein the target screen includes: a screen configured by the host device and / or a screen connected to the host device in communication.

[0151] In step S21, the host device responds to the wearable device operating in the controller simulation mode and the wearable device passing the identity authentication in the network where the host device is located, and receives the user's motion data sent by the wearable device. As mentioned above, the wearable device and the host device can communicate based on wireless communication technologies such as Wi-Fi, Bluetooth, and ZigBee.

[0152] In the disclosed embodiment, the controller of the wearable device simulates identity authentication and passes, indicating that the pairing of the wearable device and the host device is successful, and the wearable device has the authority to cooperate with the host device to control the host device. As mentioned above, the controller of the wearable device simulates identity authentication and passes, which may refer to the communication handshake between the wearable device and the host device, and may also include other authentications, such as network quality authentication. The motion data received by the host device includes acceleration data, angular velocity data, wearer's heart rate data, wearer's calorie consumption data, etc. monitored by the wearable device.

[0153] In step S22, the host device controls the target screen to display the screen content associated with the action data in response to the action data, wherein the target screen includes: a screen configured by the host device, and / or a screen connected to the host device in communication. After receiving the action data, the host device can control the target screen to display the screen content associated with the action data. As mentioned above, the target screen includes the display screen of the wearable device successfully configured with the host device, the display screen of the host device itself, etc. It can also include the display screen of other smart terminals connected to the host device in communication, such as when the host device is connected to a TV, the corresponding screen content can be displayed on the TV display screen.

[0154] In the disclosed embodiment, the host device may have a display screen, and the display screen of the host device may display in real time the user's body language such as body movements or hitting strength when playing a somatosensory game to control the game, so as to facilitate the user to make corresponding control adjustments according to the display. In addition, the host device may also be configured with a host device base, and the host device may be placed on the host device base and connected to the TV with an HDMI cable to project the screen. Compared with mobile phone projection, this projection method can reduce the projection delay, thereby improving the user's immersion in somatosensory games.

[0155] In some embodiments, the action data includes body motion data, and the host device may also respond to the body motion data after receiving the user's body motion data, simulate the user's game control and display it on the target screen. That is, after receiving the action data including body motion data, the host device simulates the user's game control according to the body motion data, that is, recognizes the corresponding action of the user (such as the wearer), such as in a dance game, simulating the wearer's body movements, in a boxing game, simulating the wearer's hitting strength, etc., and displays the corresponding picture on the target screen.

[0156] In the disclosed embodiment, the host device receives action data including body motion data sent by the wearable device after the controller of the wearable device simulates identity authentication, and simulates the user's game control based on the body motion data, thereby improving the diversity of somatosensory game support and facilitating users (such as the wearer) to make corresponding adjustments based on the display, thereby improving the controllability of the somatosensory game.

[0157] In the disclosed embodiment, the host device receives the motion data sent by the wearable device after the controller of the wearable device simulates identity authentication, and makes corresponding displays based on the motion data. This improves the control security of the device and facilitates the user to make corresponding adjustments based on the display, thereby improving the controllability of the control.

[0158] In some embodiments, the method further comprises:

[0159] Performing a communication handshake with the wearable device and determining a data transmission delay between the wearable device and the wearable device;

[0160] In response to the communication handshake being successful and the data transmission delay satisfying the preset delay requirement, a notification message indicating that the controller of the wearable device has passed the simulated identity authentication is sent to the wearable device.

[0161] In the disclosed embodiment, the host device and the wearable device first perform a communication handshake to get to know each other and transmit information. During the communication handshake process, the host device and the wearable device can confirm data synchronization and information confirmation with each other.

[0162] In the disclosed embodiment, the host device and the wearable device can perform a communication handshake based on a private protocol. Before the communication handshake begins, the host device can send a communication handshake request to the wearable device, or the host device can receive a communication handshake request sent by the wearable device. Taking the example of the host device sending a communication handshake request to the wearable device, after the host device sends the communication handshake request, it receives player information including the number of players, player names, and other data that the user (such as the wearer) needs to synchronize to play the game, etc. sent by the wearable device; taking the example of the host device receiving a communication handshake request sent by the wearable device, the host device receives a communication handshake request sent by the wearable device that carries the above data including the number of players. After receiving the above data, the host device can send a notification message of successful handshake to the wearable device.

[0163] In the embodiments of the present disclosure, the host device and the wearable device not only perform a communication handshake, but also determine the data transmission delay between the host device and the wearable device. In some embodiments, the host device and the wearable device can calculate the data transmission delay based on the data transmitted during the communication handshake. In other embodiments, the host device and the wearable device can also use test data to determine the data transmission delay after the communication handshake is successful. The embodiments of the present disclosure are not limited to this. When the communication handshake between the host device and the wearable device is successful and the data transmission delay meets the preset delay requirement, a notification message is sent to the wearable device indicating that the controller of the wearable device has passed the simulated identity authentication, informing the wearable device that the identity authentication has passed.

[0164] In the disclosed embodiment, when the host device successfully performs a handshake with the wearable device and the data transmission delay between the host device and the wearable device meets the requirements, a notification message is sent to the wearable device indicating that the controller of the wearable device has passed the simulated identity authentication. The method of this embodiment can improve the efficiency, reliability and security of information interaction between the host device and the wearable device.

[0165] In some embodiments, in response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement, sending a notification message indicating that the controller of the wearable device has passed the simulated identity authentication to the wearable device includes:

[0166] In response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement, displaying an identification of the wearable device;

[0167] Based on the displayed identifier, receiving a confirmation instruction to the wearable device;

[0168] Based on the confirmation instruction, the notification message indicating that the controller of the wearable device has passed the simulated identity authentication is sent to the wearable device.

[0169] In the disclosed embodiment, in response to a successful handshake with the wearable device and a data transmission delay that satisfies a preset delay requirement, the host device displays the identification of the wearable device on the display interface, wherein the identification of the wearable device includes the name or appearance of the wearable device and other information that can identify the corresponding wearable device. The user (such as the wearer) can confirm the wearable device based on the identification displayed by the host device. The host device receives the user's confirmation instruction and, based on the confirmation instruction, sends a notification message to the wearable device indicating that the controller of the wearable device has passed the simulated identity authentication. If the host device receives a non-confirmation instruction from the user, it will re-handshake with the wearable device and confirm the data transmission delay.

[0170] In the embodiment of the present disclosure, when the communication handshake between the host device and the wearable device is successful and the data transmission delay meets the preset delay requirement, the logo of the wearable device is first displayed on the display interface of the host device, and then a notification message is sent to the wearable device after confirmation by the user, which can improve the intelligence of the host device sending notifications to the wearable device.

[0171] In the disclosed embodiment, the host device can be connected to one or more wearable devices. When the host device is connected to multiple wearable devices, each wearable device can simulate a controller, and the control content of different wearable devices is different. The host device can obtain the simulation identifier corresponding to the wearable device sent by the wearable device during the communication handshake process with each controller (wearable device), or the host device can assign a simulation identifier to the wearable device during the communication handshake process with the wearable device. The simulation identifier is used to distinguish the simulation part of the wearable device.

[0172] It should be noted that the host device will store the mapping relationship between the simulation identifier and the device identifier of the wearable device, so that after receiving the motion data sent by the wearable device, it can determine the simulation identifier corresponding to the wearable device currently sending the motion data based on the stored mapping relationship, and perform simulated control of the part indicated by the simulation identifier in the game based on the motion data of the current wearable device.

[0173] Fig. 9 is a flow chart of a device control method in an embodiment of the present disclosure, such as Fig. 9 As shown, the following steps are included:

[0174] S31, the wearable device monitors the user's motion data;

[0175] S32, in response to the wearable device operating in the controller simulation mode and the controller simulation identity authentication of the wearable device passing, the wearable device sending the motion data to the host device;

[0176] S33. The host device controls the target screen to display screen content associated with the action data in response to the action data.

[0177] In the disclosed embodiment, the target screen includes: a screen configured by the host device and / or a screen connected to the host device in communication. When the wearable device is operating in the controller simulation mode and the controller simulation identity authentication is passed, the monitored motion data is sent to the host device. After the host device receives the motion data sent by the wearable device, it can control the target screen to display the screen content associated with the motion data in response to the motion data. In the above manner, the convenience of device control can be improved while improving the security of information interaction between the wearable device and the host device, thereby improving the user experience.

[0178] It should be noted that in the above method of the specific implementation mode, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0179] Fig.10 This is an example of a device control device in the embodiment of the present disclosure. Figure 1 , used in wearable devices, refer to Fig.10 , the device comprises:

[0180] A monitoring module 101 is configured to monitor the user's motion data;

[0181] The first sending module 102 is configured to send the action data to the host device in response to the wearable device operating in the controller simulation mode and the controller of the wearable device passing the simulated identity authentication, so that the host device responds to the action data and controls the target screen to display the screen content associated with the action data, wherein the target screen includes: the screen configured by the host device and / or the screen to which the host device is communicatively connected.

[0182] In some embodiments, the action data includes touch operation data, and the device further includes:

[0183] An acquisition module, configured to acquire network configuration information of a network where the host device is located according to the touch operation data;

[0184] A network access module, configured to join the network where the host device is located based on the network configuration information;

[0185] The authentication module is configured to perform a simulated identity authentication of the controller of the wearable device with the host device within the network.

[0186] In some embodiments, the authentication module is also configured to perform a communication handshake with the host device within the network and determine the data transmission delay between the host device and the host device; in response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement, receive a notification message sent by the host device indicating that the controller of the wearable device has passed the simulated identity authentication.

[0187] In some embodiments, the network configuration information includes: a network identifier and a password corresponding to the network identifier. The acquisition module is further configured to obtain the network identifier of the network where the host device is located based on a touch operation on the network identifier; send a password acquisition request to the user terminal based on the network identifier; and receive the password corresponding to the network identifier fed back by the user terminal based on the password acquisition request.

[0188] In some embodiments, the password fed back by the user terminal is an encrypted password, and the acquisition module is further configured to decrypt the encrypted password fed back by the user terminal to obtain the password corresponding to the network identifier.

[0189] In some embodiments, the apparatus further comprises:

[0190] a detection module configured to detect an instruction to turn on a simulation mode of a controller of the wearable device;

[0191] The display module is configured to display the control interface of the host device on the display screen of the wearable device based on the opening instruction; wherein the displayed control interface is used to represent that the wearable device operates in the controller simulation mode.

[0192] In some embodiments, the detection module is further configured to detect an instruction sent by a user terminal to turn on a controller simulation mode of the wearable device.

[0193] In some embodiments, the motion data includes body movement data, wherein the body movement data is used by the host device to simulate game controls of the user and displayed on the target screen.

[0194] Fig.11 This is an example of a device control device in the embodiment of the present disclosure. Figure 2 , applied to the host device, refer to Fig.11 , the device comprises:

[0195] The receiving module 201 is configured to receive the motion data sent by the wearable device in response to the wearable device operating in the controller simulation mode and the controller simulation identity authentication of the wearable device passing;

[0196] The control module 202 is configured to control the target screen to display the screen content associated with the action data in response to the action data, wherein the target screen includes: a screen configured by the host device and / or a screen connected to the host device in communication.

[0197] In some embodiments, the apparatus further comprises:

[0198] A handshake module, configured to perform a communication handshake with the wearable device and determine a data transmission delay between the wearable device and the wearable device;

[0199] The second sending module is configured to send a notification message indicating that the controller of the wearable device has passed the simulated identity authentication to the wearable device in response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement.

[0200] In some embodiments, the second sending module is further configured to display the identification of the wearable device in response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement; based on the displayed identification, receive a confirmation instruction to the wearable device; based on the confirmation instruction, send the notification message to the wearable device indicating that the simulated identity authentication of the controller of the wearable device has passed.

[0201] In some embodiments, the motion data includes body movement data, and the control module 202 is further configured to simulate the game control of the user and display it on the target screen in response to the body movement data.

[0202] about Fig.10 and Fig.11 The specific manner in which each module performs operations in the device in the illustrated embodiment has been described in detail in the embodiment of the method, and will not be elaborated on here.

[0203] Fig.12 FIG. 8 is a block diagram of a wearable device apparatus 800 according to an exemplary embodiment. For example, the apparatus 800 may be a watch, a bracelet, or the like.

[0204] Reference Fig.12 , the device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0205] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0206] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0207] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0208] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0209] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0210] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0211] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, and the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800, and the temperature change of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0212] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0213] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0214] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0215] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a wearable device, enables the wearable device to perform a device control method, the method comprising:

[0216] Monitor user action data;

[0217] In response to the wearable device operating in the controller simulation mode and the controller of the wearable device passing the simulated identity authentication, the action data is sent to the host device, so that the host device responds to the action data and controls the target screen to display the screen content associated with the action data, wherein the target screen includes: the screen configured by the host device, and / or the screen to which the host device is communicatively connected.

[0218] Fig.13 is a block diagram of a host device 900 according to an exemplary embodiment. Fig. 9 The device 900 includes a processing component 922, which further includes one or more processors, and a memory resource represented by a memory 932 for storing instructions executable by the processing component 922, such as an application. The application stored in the memory 932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 922 is configured to execute instructions to perform the above-mentioned somatosensory game control method.

[0219] The device 900 may also include a power supply component 926 configured to perform power management of the device 900, a wired or wireless network interface 950 configured to connect the device 900 to a network, and an input / output (I / O) interface 958. The device 900 may operate based on an operating system stored in the memory 932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0220] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 932 including instructions, and the instructions can be executed by the processing component 922 of the device 900 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0221] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processing component of a host device, enables the host device to perform a device control method, the method comprising:

[0222] In response to the wearable device operating in the controller simulation mode and the controller simulation identity authentication of the wearable device passing, receiving the user's motion data sent by the wearable device;

[0223] In response to the action data, a target screen is controlled to display the screen content associated with the action data, wherein the target screen includes: a screen configured by the host device and / or a screen connected to the host device in communication.

[0224] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims above.

[0225] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A device control method, It is characterized in that Applied to a wearable device, the method comprises: Monitor user action data; In response to the wearable device operating in the controller simulation mode and the controller of the wearable device passing the simulated identity authentication, the action data is sent to the host device, so that the host device responds to the action data and controls the target screen to display the screen content associated with the action data, wherein the target screen includes: the screen configured by the host device, and / or the screen connected to the host device for communication.

2. The method according to claim 1, It is characterized in that The action data includes touch operation data, and the method further includes: According to the touch operation data, obtaining network configuration information of the network where the host device is located; Based on the network configuration information, join the network where the host device is located; Within the network, a controller simulation identity authentication of the wearable device is performed with the host device.

3. The method according to claim 2, It is characterized in that The step of performing a controller simulation identity authentication of the wearable device with the host device within the network includes: In the network, performing a communication handshake with the host device and determining a data transmission delay between the host device and the host device; In response to the communication handshake being successful and the data transmission delay satisfying the preset delay requirement, a notification message sent by the host device indicating that the controller of the wearable device has passed the simulated identity authentication is received.

4. The method according to claim 2, It is characterized in that The network configuration information includes: a network identifier and a password corresponding to the network identifier, and obtaining the network configuration information of the network where the host device is located according to the touch operation data includes: Acquire the network identifier of the network where the host device is located according to the touch operation on the network identifier; Sending a password acquisition request to the user terminal according to the network identifier; Based on the password acquisition request, a password corresponding to the network identifier fed back by the user terminal is received.

5. The method according to claim 4, It is characterized in that The password fed back by the user terminal is an encrypted password, and the obtaining of network configuration information of the network where the host device is located further includes: The encrypted password fed back by the user terminal is decrypted to obtain the password corresponding to the network identifier.

6. The method according to claim 1, It is characterized in that The method further comprises: detecting an instruction to turn on a controller simulation mode of the wearable device; Based on the opening instruction, the control interface of the host device is displayed on the display screen of the wearable device; wherein the displayed control interface is used to represent that the wearable device operates in the controller simulation mode.

7. The method according to claim 6, It is characterized in that The detecting an instruction to turn on the controller simulation mode of the wearable device includes: Detect an instruction sent by a user terminal to turn on a controller simulation mode of the wearable device.

8. The method according to claim 1, It is characterized in that The motion data includes body movement data, wherein the body movement data is used by the host device to simulate game control of the user and is displayed on the target screen.

9. A device control method, It is characterized in that Applied in a host device, the method comprises: In response to the wearable device operating in the controller simulation mode and the controller simulation identity authentication of the wearable device passing, receiving the user's motion data sent by the wearable device; In response to the action data, a target screen is controlled to display the screen content associated with the action data, wherein the target screen includes: a screen configured by the host device and / or a screen connected to the host device in communication.

10. The method according to claim 9, It is characterized in that The method further comprises: Performing a communication handshake with the wearable device and determining a data transmission delay between the wearable device and the wearable device; In response to the communication handshake being successful and the data transmission delay satisfying the preset delay requirement, a notification message indicating that the controller of the wearable device has passed the simulated identity authentication is sent to the wearable device.

11. The method according to claim 10, It is characterized in that In response to the communication handshake being successful and the data transmission delay satisfying the preset delay requirement, sending a notification message indicating that the controller of the wearable device has passed the simulated identity authentication to the wearable device, comprising: In response to the communication handshake being successful and the data transmission delay satisfying a preset delay requirement, displaying an identification of the wearable device; Based on the displayed identifier, receiving a confirmation instruction to the wearable device; Based on the confirmation instruction, the notification message indicating that the controller of the wearable device has passed the simulated identity authentication is sent to the wearable device.

12. The method according to claim 9, It is characterized in that The action data includes body movement data, and in response to the action data, controlling the target screen to display screen content associated with the action data includes: In response to the body movement data, game controls of the user are simulated and displayed on the target screen.

13. A device control device, It is characterized in that Applied in a wearable device, the device comprises: A monitoring module configured to monitor the user's motion data; The first sending module is configured to send the action data to the host device in response to the wearable device operating in the controller simulation mode and the controller of the wearable device passing the simulated identity authentication, so that the host device responds to the action data and controls the target screen to display the screen content associated with the action data, wherein the target screen includes: the screen configured by the host device and / or the screen connected to the host device for communication.

14. A device control device, It is characterized in that Applied in a host device, the device comprises: a receiving module configured to receive the user's motion data sent by the wearable device in response to the wearable device operating in the controller simulation mode and the identity authentication of the wearable device in the network where the host device is located being passed; The control module is configured to control the target screen to display the screen content associated with the action data in response to the action data, wherein the target screen includes: a screen configured by the host device and / or a screen connected to the host device in communication.

15. An electronic device, It is characterized in that include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the device control method according to any one of claims 1 to 8; or, is configured to execute the device control method according to any one of claims 9 to 12.

16. A non-transitory computer-readable storage medium, It is characterized in that When the instructions in the storage medium are executed by a processor in an electronic device, the electronic device is enabled to execute the device control method as described in any one of claims 1 to 8, or is configured to execute the device control method as described in any one of claims 9 to 12.

Images