Device interaction method and device, storage medium

Abstract

The present disclosure relates to a device interaction method, apparatus, and storage medium. The method includes: obtaining the current task of the first identified device; determining the target task and the execution object of the target task based on the current task; and executing a preset action so that the execution object executes the target task. The embodiment of the present disclosure can enable different execution objects to execute the target task according to the change of the current task, thereby realizing the interaction between the wearable electronic device and the different execution objects, and making the interaction mode of the wearable electronic device more flexible.

Description

Technical Field

[0001] The present disclosure relates to the field of Internet technology, and in particular to a device interaction method and apparatus, and a storage medium. Background Art

[0002] With the development of technology, the Internet of Things (IoT) can realize the interconnection and interoperability of devices.

[0003] Wearable electronic devices can interact with Artificial Intelligence & Internet of Things (AIoT) devices. However, in the process of realizing device interconnection, the control of device functions and the allocation of execution tasks often require manual control by users, which is not intelligent enough.

[0004] Therefore, finding a solution that can achieve intelligent interconnection between wearable electronic devices and AIoT devices has become a hot topic in current research. Summary of the invention

[0005] In order to overcome the problems existing in the related art, the present disclosure provides a device interaction method and apparatus, and a storage medium.

[0006] According to a first aspect of an embodiment of the present disclosure, a device interaction method is provided, including:

[0007] Get the current task of the first identified device;

[0008] Based on the current task, determine a target task and an execution object of the target task;

[0009] Execute a preset action so that the execution object executes the target task.

[0010] In some embodiments, the executing a preset action so that the execution object executes the target task includes:

[0011] When the execution object is the first identified device, sending a first instruction so that the first identified device executes the target task;

[0012] When the execution object is the wearable electronic device, controlling the wearable electronic device to execute the target task;

[0013] When the execution object is a second identified device, sending a second instruction so that the second identified device executes the target task;

[0014] The first identified device and the execution object both have at least one same function of executing the target task.

[0015] In some embodiments, obtaining the current task of the first identified device includes:

[0016] Based on a first predetermined rule, determining the first identified device;

[0017] Based on a second predetermined rule, the current task of the first identified device is obtained.

[0018] In some embodiments, the determining the first identified device based on the first predetermined rule includes one or more of the following:

[0019] Determining the first identified device based on the communication connection relationship of the wearable electronic device;

[0020] Determining the first identified device based on visual recognition of the wearable electronic device;

[0021] Based on the sound wave signal recognition of the wearable electronic device, the first recognized device is determined.

[0022] In some embodiments, the determining the first identified device based on the visual recognition of the wearable electronic device includes:

[0023] Performing recognition based on a computer vision recognition model of the wearable electronic device to determine the first recognized device;

[0024] or,

[0025] The first identified device is determined based on the wearable electronic device identifying the visual two-dimensional code.

[0026] In some embodiments, the acquiring the current task of the first identified device based on the second predetermined rule includes one or more of the following:

[0027] Based on the communication connection established between the first identified device and the wearable electronic device through the communication protocol, receiving the current task sent by the first identified device;

[0028] Based on the computer vision recognition model of the wearable electronic device, acquiring the current task of the first recognized device;

[0029] Based on a public network connecting the wearable electronic device and the first identified device, the current task sent by the first identified device to the public network is received.

[0030] In some embodiments, determining a target task and an execution object of the target task based on the current task includes:

[0031] When the target task determined according to the current task is the task with the highest priority among the tasks executed by the wearable electronic device, the wearable electronic device is controlled to execute the target task.

[0032] According to a second aspect of an embodiment of the present disclosure, a device interaction apparatus is provided, which is applied to a wearable electronic device, and the apparatus includes:

[0033] A first acquisition module, configured to acquire a current task of a first identified device;

[0034] A first determination module is configured to determine a target task and an execution object of the target task based on the current task;

[0035] The execution module is configured to execute a preset action so that the execution object executes the target task.

[0036] In some embodiments, the execution module is further configured to, when the execution object is the first identified device, send a first instruction so that the first identified device performs the target task; when the execution object is the wearable electronic device, control the wearable electronic device to perform the target task; when the execution object is the second identified device, send a second instruction so that the second identified device performs the target task; wherein, the first identified device and the execution object both have at least one identical function of executing the target task.

[0037] In some embodiments, the first acquisition module includes:

[0038] A second determination module, configured to determine the first identified device based on a first predetermined rule;

[0039] The second acquisition module is configured to acquire the current task of the first identified device based on a second predetermined rule.

[0040] In some embodiments, the second determining module is further configured to do one or more of the following:

[0041] A third determination module is configured to determine the first identified device based on the communication connection relationship of the wearable electronic device;

[0042] a fourth determination module, configured to determine the first identified device based on visual recognition of the wearable electronic device;

[0043] The fifth determination module is configured to determine the first identified device based on the sound wave signal recognition of the wearable electronic device.

[0044] In some embodiments, the fourth determination module is configured to determine the first identified device based on recognition by a computer vision recognition model of the wearable electronic device; or to determine the first identified device based on recognition of a visual QR code by the wearable electronic device.

[0045] In some embodiments, the second acquisition module is configured as one or more of the following: based on the communication connection established between the first identified device and the wearable electronic device through a communication protocol, receiving the current task sent by the first identified device; based on a computer vision recognition model of the wearable electronic device, acquiring the current task of the first identified device; based on a public network connecting the wearable electronic device and the first identified device, receiving the current task sent by the first identified device to the public network.

[0046] In some embodiments, the first determination module is further configured to control the wearable electronic device to execute the target task when the target task determined according to the current task is the task with the highest priority among the tasks executed by the wearable electronic device.

[0047] According to a third aspect of an embodiment of the present disclosure, a device interaction apparatus is provided, the device interaction apparatus comprising at least: a processor and a memory for storing executable instructions that can be run on the processor, wherein:

[0048] When the processor is used to run the executable instructions, the executable instructions execute the steps in the device interaction method provided in the first aspect above.

[0049] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the device interaction method provided in the first aspect above.

[0050] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0051] In the disclosed embodiment, the wearable electronic device obtains the current task of the first identified device, determines the target task and the execution object of the target task based on the current task, and executes a preset action so that the execution object executes the target task. In this way, the disclosed embodiment can make different execution objects execute the target task according to the change of the current task, thereby realizing the interaction between the wearable electronic device and the different execution objects, and making the interaction mode of the wearable electronic device more flexible and intelligent.

[0052] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0054] Figure 1 This is a device interaction method process shown in the embodiment of the present disclosure Figure 1 .

[0055] Figure 2 This is a device interaction method process shown in the embodiment of the present disclosure Figure 2 .

[0056] Figure 3 It is a schematic diagram of determining a first identified device shown in an embodiment of the present disclosure.

[0057] Figure 4 It is a schematic diagram of determining a current task shown in an embodiment of the present disclosure.

[0058] Figure 5 The figure is a schematic diagram of device interaction according to an exemplary embodiment.

[0059] Figure 6 A device interaction apparatus according to an exemplary embodiment is shown Figure 1 .

[0060] Figure 7 A device interaction apparatus according to an exemplary embodiment is shown Figure 2 . DETAILED DESCRIPTION

[0061] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0062] Figure 1 This is a device interaction method process shown in the embodiment of the present disclosure Figure 1 ,like Figure 1 As shown, the method applied to a wearable electronic device comprises the following steps:

[0063] S101, obtaining a current task of a first identified device;

[0064] S102, determining a target task and an execution object of the target task based on the current task;

[0065] S103: Execute a preset action so that the execution object executes the target task.

[0066] In the disclosed embodiment, the device interaction method is applicable to the interaction scenario between a wearable electronic device and an Artificial Intelligence & Internet of Thing (AIoT) device. The wearable electronic device may include a head-mounted display device, such as an AR device, a VR device, an MR device, etc.; it may also include a wearable sports device, such as a smart watch or a smart bracelet. The AIOT device includes but is not limited to terminal devices and smart home appliances in the Internet of Things, such as mobile phones, routers, televisions, speakers, air conditioners, or rice cookers.

[0067] The interaction scenarios between the wearable electronic devices and AIOT devices may include: interaction scenarios between AR glasses and TV, interaction scenarios between AR glasses and speakers, or interaction scenarios between AR glasses and mobile phones. For example, AR glasses interact with TV to display TV video images; AR glasses interact with speakers to play music output by speakers; AR glasses interact with mobile phones to take photos.

[0068] In step S101, the first identified device is an electronic device identified by the wearable electronic device within the identification range. The first identified device may be any electronic device in the AIOT device. For example, the first identified device may include a television, a speaker, an air conditioner or a mobile phone, which is not limited in the embodiments of the present disclosure. The identification range may be determined based on different first identified devices. When the first identified device is a head-mounted display device, the identification range may be the field of view angle range or the field of view range of the head-mounted display device; when the first identified device is a smart bracelet or a smart watch, the identification range may be a range defined by a predetermined distance as a radius, or may be an emission range of an identification sensor in a smart watch or a smart bracelet, such as a radar sensor or a laser sensor, which is not limited in the embodiments of the present disclosure.

[0069] It should be noted that the current task can be understood as the operation being performed by the first identified device or the current operating state of the first identified device. For example, when the first identified device is a TV, the current task of the TV may include playing animations, playing videos, or playing pictures; when the first identified device is an air conditioner, the current task of the air conditioner may include being in a heating state, adjusting the wind speed, or adjusting the temperature, which is not limited in the embodiments of the present disclosure.

[0070] The above-mentioned acquisition of the current task of the first identified device can be understood as first identifying the first identified device, and then acquiring the current task of the first identified device. For example, the AR glasses first identify the first identified device as a speaker, and then identify that the current task of the first identified device is to play nursery rhymes. For another example, the AR glasses first identify the first identified device as an air conditioner, and then identify that the current task of the air conditioner is in the heating state.

[0071] In step S102, the target task is determined based on the current task. In some embodiments, the target task may be the current task, that is, the execution object is the same as the execution task of the first identified device. For example, the speaker and the AR glasses are both playing a nursery rhyme. For another example, the TV and the AR glasses are both playing the same video.

[0072] In other embodiments, the target task may be determined based on the current task and the corresponding relationship between the current task and the preset target task. The corresponding relationship between the current task and the preset target task is pre-stored in the wearable electronic device. On the premise of obtaining the current task, the target task can be determined by finding the corresponding relationship between the current task and the preset target task.

[0073] Among them, the correspondence may include: when the current task is for a small-screen electronic device to perform display-related operations, the corresponding target task is to allow a large-screen electronic device to perform display-related operations; when the current task is for an electronic device with limited operation (for example, an electronic device with an operation interface smaller than a preset threshold) to perform various control operations, the target task is to allow an electronic device with easy operation (for example, an electronic device with an operation interface larger than a preset threshold) to perform various control operations.

[0074] For example, the current task of a small-screen electronic device such as a mobile phone in an AIOT device is playing a video. According to the current task and the corresponding relationship, it can be determined that a large-screen electronic device is playing a video. At this time, the execution object can be a TV or a computer, and the target task can be the TV or computer playing a video. In this way, by passing the target task to the large-screen electronic device, the user's viewing experience can be improved. For another example, the current task of an electronic device with limited operation in an AIOT device, such as a watch, is to take pictures. According to the current task and the corresponding relationship, it can be determined that an electronic device that is easy to operate is needed to control the picture taking. At this time, the execution object can be a mobile phone or a tablet computer, and the target task can be to execute the picture taking control. In this way, by passing the target task to a mobile phone or a tablet computer to control the picture taking, the picture taking control can be made more convenient.

[0075] In other embodiments, the target task may be an associated task of the current task, and the associated task may be a task with a higher execution priority than the current task, or a task running in the background or a task to be executed in a task list, which is not limited in the embodiments of the present disclosure. For example, the current task is a video playing task, and the associated task may be a telephone task with a higher priority than the video playing task.

[0076] In the disclosed embodiment, the execution object may be the first identified device or the wearable electronic device, or may be a second identified device other than the first identified device and the wearable electronic device. The second identified device may have the ability to execute the target task. For example, the second identified device and the first identified device both have screens and can play videos; or, the second identified device and the first identified device both have speakers and can play music.

[0077] It should be noted that the execution object and target task are determined according to the current task, that is, the target task and the execution object may change with the change of the current task. For example, when the current task is to play music, the target task and the execution object may be to play music on AR glasses; when the current task is to play video on a small screen, the target task and the execution object may be to play video on a large screen of a TV, and the embodiments of the present disclosure are not limited thereto.

[0078] In the embodiments of the present disclosure, when the execution objects are different, the wearable electronic device can interact with different execution objects. For example, when the execution object is a first identified device, the wearable electronic device can interact with the first identified device so that the first identified device performs the target task. When the execution object is a second identified device, the wearable electronic device can interact with the first identified device and the second identified device respectively so that the second identified device performs the target task. That is, the wearable electronic device can interact with different identified devices, thereby improving the interaction flexibility of the wearable electronic device.

[0079] In step S103, after the wearable electronic device determines the target task and the execution object, the wearable electronic device may execute a preset action so that the execution object executes the target task.

[0080] It should be noted that the preset action is associated with the execution object, and different execution objects have different preset actions. When the execution object is the first identified device or the second identified device, the preset action may be that the wearable electronic device sends the target task to the first identified device or the second identified device; when the execution object is a wearable electronic device, the preset action may be that the wearable electronic device directly controls itself to execute the target task.

[0081] That is to say, the wearable electronic device can control itself to perform the target task, and can also interact with the first identified device or the second identified device so that the first identified device or the second identified device performs the target task.

[0082] In the disclosed embodiment, the wearable electronic device obtains the current task of the first identified device, determines the target task and the execution object of the target task based on the current task, and executes a preset action to make the execution object execute the target task. In this way, the disclosed embodiment can make different execution objects execute the target task according to the change of the current task, thereby realizing the interaction between the wearable electronic device and the different execution objects, and making the interaction mode of the wearable electronic device more flexible and intelligent.

[0083] In some embodiments, Figure 2 As shown, the execution of the preset action causes the execution object to execute the target task, including:

[0084] S103a, when the execution object is the first identified device, sending a first instruction to enable the first identified device to execute the target task;

[0085] S103b, when the execution object is the wearable electronic device, controlling the wearable electronic device to execute the target task;

[0086] S103c, when the execution object is a second identified device, sending a second instruction to enable the second identified device to execute the target task;

[0087] The first identified device and the execution object both have at least one same function of executing the target task.

[0088] In the embodiments of the present disclosure, the execution object has the function of executing the target task, so that the execution object can execute the target task. For example, the functions of the execution object include: video, picture and voice playback function; call function; cross-screen assistance function; photo control function, which are not limited in the embodiments of the present disclosure.

[0089] In step S103a, when the execution object is the first identified device, a first instruction is sent to enable the first identified device to execute the target task. The first instruction carries information related to the target task, and the target task needs to be sent to the first identified device. At this time, the wearable electronic device serves as the master device and the first identified device serves as the slave device. The master device transmits the target task to the slave device, so that the slave device executes the target task.

[0090] For example, the first identified device is a TV, the wearable electronic device is AR glasses, the AR glasses are recording a video, and the current task of the TV is in the display state. According to the current task, it can be determined that the TV needs to display the recorded video. At this time, the TV as the execution object displays the video being recorded by the AR glasses. For another example, the first identified device can also be a mobile phone or a monitoring device with a camera, and the wearable electronic device is AR glasses. The AR glasses send the target task to the mobile phone or the monitoring device with a camera through the first instruction, so that the mobile phone or the monitoring device can play the video.

[0091] In step S103b, when the execution object is a wearable electronic device, the wearable electronic device is controlled to execute the target task. That is, when the wearable electronic device determines that the execution object is itself, it directly controls itself to execute the target task. At this time, the wearable electronic device is a slave device, so that the slave device executes the target task.

[0092] For example, the wearable electronic device is AR glasses. When the first electronic device is a mobile phone, when the target task determined according to the current task is screen projection or video call relay, the AR glasses perform the screen projection operation or the video call operation as an executable object; when the first electronic device is a speaker, when the target task determined according to the current task is music playback, the AR glasses perform the music playback operation as an executable object; when the first electronic device is a TV, when the target task determined according to the current task is picture playback or video playback, the AR glasses perform picture playback and video playback operations as an executable object.

[0093] In step S103c, when the execution object is the second identified device, a second instruction is sent to enable the second identified device to execute the target task. The second instruction carries information related to the target task, and the target task needs to be sent to the second identified device. At this time, the first identified device is the master device, the second identified device is the slave device, and the wearable electronic device is the intermediate transmission device. The embodiment of the present disclosure transmits the target task obtained from the first identified device to the second identified device through the wearable electronic device, so that the second identified device executes the target task.

[0094] For example, the wearable electronic device is AR glasses. When the first identified device is a small-screen notebook or mobile phone, and the second identified device is a large-screen TV, when the target task determined according to the current task is video or picture relay, the large-screen TV performs the operation of playing the video or picture to obtain the best viewing experience; when the first identified device is a mobile phone and the second identified device is a computer, when the target task determined according to the current task is cross-screen assistance, the computer performs the cross-screen assistance operation; when the first identified device is a mobile phone and the second identified device is a speaker, when the target task determined according to the current task is audio, voice or video call relay, the speaker performs the playback of audio, voice or video calls; when the first identified device is a watch or bracelet and the second identified device is a mobile phone, when the target task determined according to the current task is photo control, the mobile phone performs the photo control operation; when the first identified device is a speaker and the second identified device is a TV, when the target task determined according to the current task is audio or video relay, the TV performs audio or video playback.

[0095] In the disclosed embodiment, based on different execution objects, the wearable electronic device can directly execute the target task after acquiring the target task as a slave device; it can also act as a master device to interact with the first identified device and pass the target task to the first identified device so that the first identified device executes the target task; it can also act as an intermediate transmission device to pass the target task acquired from the first identified device to the second identified device so that the second identified device executes the target task. In this way, the interaction mode of the wearable electronic device can be made more flexible.

[0096] In some embodiments, obtaining the current task of the first identified device includes:

[0097] Based on a first predetermined rule, determining the first identified device;

[0098] Based on a second predetermined rule, the current task of the first identified device is obtained.

[0099] In the embodiment of the present disclosure, the first predetermined rule is a rule for the wearable electronic device to identify the first identified device.

[0100] In some embodiments, the determining the first identified device based on the first predetermined rule includes one or more of the following:

[0101] Determining the first identified device based on the communication connection relationship of the wearable electronic device;

[0102] Determining the first identified device based on visual recognition of the wearable electronic device;

[0103] Based on auditory recognition of the wearable electronic device, the first identified device is determined.

[0104] In the embodiments of the present disclosure, the communication connection relationship of the wearable electronic device includes: Bluetooth communication established between the wearable electronic device and the first identified device; or, ultra-wideband communication established between the wearable electronic device and the first identified device; or, near-field communication established between the wearable electronic device and the first identified device, which is not limited in the embodiments of the present disclosure.

[0105] Among them, the wearable electronic device can have an ultra-wideband (UWB) module, and can also communicate through a wifi module, a bluetooth module, a laser module, an infrared module, or a zigbee module. Correspondingly, the first identified device also has the above-mentioned modules to establish different communication connections with the wearable electronic device to determine the first identified device.

[0106] It should be noted that after establishing the communication connection, the wearable electronic device can directly determine the first identified device through the identity information sent by the first identified device. The identity information can be a device serial number, or a device SN number, a device identifier, or information related to device authentication.

[0107] In an embodiment of the present disclosure, determining a first identified device based on auditory recognition of a wearable electronic device includes: determining the first identified device based on a sound wave signal output by the first identified device and received by the wearable electronic device; or determining the first identified device based on identifying an auditory QR code on the first identified device.

[0108] The sound wave signal may include a sound wave signal audible to the human ear, or a sound wave signal inaudible to the human ear, such as ultrasonic wave or infrasonic wave.

[0109] It should be noted that the wearable electronic device can determine the first identified device through the millimeter wave module, ultrasonic module or radar module it has.

[0110] In the embodiment of the present disclosure, in the process of determining the first identified device by visual recognition, the first identified device can be determined by image acquisition or identification of a QR code. In some embodiments, the determination of the first identified device based on the visual recognition of the wearable electronic device includes: determining the first identified device by identifying based on a computer visual recognition model of the wearable electronic device; or determining the first identified device by identifying a visual QR code based on the wearable electronic device.

[0111] It should be noted that the wearable electronic device can obtain the device information of the first identified device through a camera, a laser sensor or a radar sensor, and input the device information into a computer visual recognition model for identification to determine the first identified device; the first identified device can also be determined by identifying a visual QR code on the first identified device. The visual QR code is formed by the fusion of the background image area and the QR code body area. For example, the visual QR code includes but is not limited to a light on / off QR code.

[0112] In the embodiment of the present disclosure, in the process of determining the first identified device, the first identified device may be determined by using a variety of determination methods. Figure 3 As shown, the determination method of the first identified device includes: artificial intelligence vision, artificial intelligence hearing, ultra-wideband, Bluetooth, ultrasound or light-on / dark QR code. In the embodiment of the present disclosure, one or more methods can be selected from the determination methods of the first identified device to determine the first identified device.

[0113] For example, the first identified device can be jointly determined based on the relationship of the Bluetooth connection of the wearable electronic device and the artificial intelligence vision. For another example, the first identified device can be jointly determined based on the relationship of the ultra-wideband connection of the wearable electronic device and the light-on / dark QR code. In this way, by selecting multiple identification methods to jointly determine the first identified device, the accuracy of identification can be improved.

[0114] It should be noted that, in the process of determining the first identified device, the first identified device can also be determined by formulating an identification priority. For example, when a wearable electronic device establishes a communication connection with a first identified device, the first identified device can be determined based on the communication connection relationship of the wearable electronic device; when the wearable electronic device cannot establish a communication connection with the first identified device, the first identified device can be determined based on the visual recognition or auditory recognition of the wearable electronic device. In this way, the embodiment of the present disclosure can preferentially use the communication connection method to determine the first identified device, which can improve the recognition efficiency and recognition accuracy of the first identified device.

[0115] In some embodiments, the acquiring the current task of the first identified device based on the second predetermined rule includes one or more of the following:

[0116] Based on the communication connection established between the first identified device and the wearable electronic device through the communication protocol, receiving the current task sent by the first identified device;

[0117] Based on the computer vision recognition model of the wearable electronic device, acquiring the current task of the first recognized device;

[0118] Based on a public network connecting the wearable electronic device and the first identified device, the current task sent by the first identified device to the public network is received.

[0119] In the embodiment of the present disclosure, the communication protocol includes a Bluetooth communication protocol, an ultra-wideband communication protocol or a near-field communication protocol, which is not limited in the embodiment of the present disclosure. After establishing the communication connection, the wearable electronic device can directly receive the current task sent by the first identified device. For example, when the wearable electronic device is a smart bracelet or a smart watch, the first identified device can be determined through the communication connection established by the ultra-wideband UWB, and the current task transmitted by the first identified device through the communication connection established by the ultra-wideband is obtained. When the wearable electronic device is a smart bracelet or a smart watch, the wearable electronic device may include an ultra-wideband UWB positioning module, which determines the first identified device through the pointing operation of the wearable electronic device, and obtains the current task transmitted by the first identified device through the ultra-wideband communication protocol or other communication protocols.

[0120] In the process of obtaining the current task by using the computer vision recognition model, the image information of the first identified device can be collected by using the camera on the wearable electronic device, and the image information can be input into the computer vision recognition model to obtain the current task of the first identified device. The image information includes but is not limited to the current task of the first identified device virtually displayed on the surface of the first identified device.

[0121] In the process of using the public network to obtain the current task, the public network can establish communication connections with the wearable electronic device and the first identified device respectively, and thus the wearable electronic device of the embodiment of the present disclosure can indirectly obtain the current task through the public network.

[0122] In the embodiment of the present disclosure, in the process of determining the current task, the current task can be determined by using multiple determination methods. Figure 4 As shown, the determination method of the current task includes: public network, communication connection or visual recognition model. In the embodiment of the present disclosure, one or more than two methods can be selected from the determination methods of the first identified device to determine the first identified device.

[0123] For example, the current task can be determined based on the communication connection relationship of the wearable electronic device and the computer vision recognition model. In this way, obtaining the current task through multiple determination methods can improve the recognition accuracy.

[0124] It should be noted that in the process of determining the current task, the current task can also be determined by setting a priority. For example, when a wearable electronic device establishes a communication connection with a first identified device, the current task sent by the first identified device can be received based on the communication connection established between the first identified device and the wearable electronic device through a communication protocol; when the wearable electronic device cannot establish a communication connection with the first identified device, the current task can be determined based on a public network connecting the wearable electronic device and the first identified device. In this way, the embodiment of the present disclosure can preferentially use a communication connection to determine the first identified device, which can improve the recognition efficiency and accuracy of the current task.

[0125] In some embodiments, determining a target task and an execution object of the target task based on the current task includes:

[0126] When the target task determined according to the current task is the task with the highest priority among the tasks executed by the wearable electronic device, the wearable electronic device is controlled to execute the target task.

[0127] In the disclosed embodiment, the task with the highest priority can be set as needed. The task with the highest priority among the tasks executed by the wearable electronic device includes, but is not limited to, a telephone task, a voice task, a video task, or an alarm task, which is not limited in the disclosed embodiment. For example, when it is determined that the target task is an alarm task, the wearable electronic device can be controlled to directly issue an alarm prompt, which can achieve timely alarm and improve the user experience. For another example, when the target task is a telephone task, the wearable electronic device can be controlled to directly issue an incoming call prompt, which can achieve timely answering of the call and improve the user experience.

[0128] It should be noted that the highest priority tasks that need to be performed by wearable electronic devices are different for different devices. For example, for air conditioners or washing machines, the highest priority task is alarm prompts; for mobile phones, the highest priority task is phone calls or voice prompts.

[0129] In some embodiments, the execution object is a wearable electronic device. When the execution object is in an executable state and the priority of the execution task of the execution object is higher than the priority of the target task, the target task is passed to the first identified device or the second identified device, so that the first identified device or the second identified device executes the target task.

[0130] In the disclosed embodiment, the wearable electronic device will first execute tasks of different priorities in order of priority, that is, the wearable electronic device will first execute the task with the highest priority.

[0131] The above-mentioned execution task may be a task that the wearable electronic device is processing, for example, the wearable electronic device is communicating on the phone or is giving an alarm prompt.

[0132] In the disclosed embodiment, when it is determined that the priority of the execution task is higher than the priority of the target task, the target task is transferred to the first identified device or the second identified device. In this way, the target task and the execution task can be processed in time, improving the user experience.

[0133] In order to better understand the above embodiment, taking the wearable electronic device as AR glasses and the first identified device as a mobile phone as an example, the embodiments of the present disclosure are exemplified as follows:

[0134] like Figure 5 As shown, the AR glasses establish a Bluetooth communication connection with the mobile phone. After the AR glasses establish a communication connection with the mobile phone, the mobile phone can send identity information and current tasks to the AR glasses through the Bluetooth communication connection; wherein, the AR glasses can determine that the identified device is a mobile phone based on the received identity information; after the AR glasses determine that the identified device is a mobile phone and the current task of the mobile phone, they can determine the target task and the execution object of the target task based on the current task, and perform preset actions so that the execution object executes the target task. In this way, the AR glasses can make different execution objects execute the target task according to the changes in the current task, thereby realizing the interaction between the AR glasses and different execution objects, which can make the interaction mode of the AR glasses more flexible and intelligent.

[0135] Figure 6 A device interaction apparatus according to an exemplary embodiment is shown Figure 1 . Reference Figure 6 The device interaction apparatus includes a first acquisition module 1001, a first determination module 1002 and an execution module 1003, wherein:

[0136] A first acquisition module 1001 is configured to acquire a current task of a first identified device;

[0137] A first determining module 1002 is configured to determine a target task and an execution object of the target task based on the current task;

[0138] The execution module 1003 is configured to execute a preset action so that the execution object executes the target task.

[0139] In some embodiments, the execution module is further configured to, when the execution object is the first identified device, send a first instruction so that the first identified device performs the target task; when the execution object is the wearable electronic device, control the wearable electronic device to perform the target task; when the execution object is the second identified device, send a second instruction so that the second identified device performs the target task; wherein, the first identified device and the execution object both have at least one identical function of executing the target task.

[0140] In some embodiments, the first acquisition module includes:

[0141] A second determination module, configured to determine the first identified device based on a first predetermined rule;

[0142] The second acquisition module is configured to acquire the current task of the first identified device based on a second predetermined rule.

[0143] In some embodiments, the second determining module is further configured to do one or more of the following:

[0144] A third determination module is configured to determine the first identified device based on the communication connection relationship of the wearable electronic device;

[0145] a fourth determination module, configured to determine the first identified device based on visual recognition of the wearable electronic device;

[0146] The fifth determination module is configured to determine the first identified device based on the sound wave signal recognition of the wearable electronic device.

[0147] In some embodiments, the fourth determination module is configured to determine the first identified device based on recognition by a computer vision recognition model of the wearable electronic device; or to determine the first identified device based on recognition of a visual QR code by the wearable electronic device.

[0148] In some embodiments, the second acquisition module is configured as one or more of the following: based on the communication connection established between the first identified device and the wearable electronic device through a communication protocol, receiving the current task sent by the first identified device; based on a computer vision recognition model of the wearable electronic device, acquiring the current task of the first identified device; based on a public network connecting the wearable electronic device and the first identified device, receiving the current task sent by the first identified device to the public network.

[0149] In some embodiments, the first determination module is further configured to control the wearable electronic device to execute the target task when the target task determined according to the current task is the task with the highest priority among the tasks executed by the wearable electronic device.

[0150] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0151] Figure 7 A device interaction apparatus according to an exemplary embodiment is shown Figure 2 For example, the device may be a wearable electronic device, and the wearable electronic device includes: a smart phone, a smart bracelet, or AR glasses.

[0152] Reference Figure 7 , the device may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0153] The processing component 802 generally controls the overall operation of the device, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0154] The memory 804 is configured to store various types of data to support the operation of the device. Examples of such data include instructions for any application or method operating on the device, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0155] The power component 806 provides power to the various components of the device. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device.

[0156] The multimedia component 808 includes a screen that provides an output interface between the device and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0157] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0158] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0159] The sensor assembly 814 includes one or more sensors for providing various aspects of the status assessment for the device. For example, the sensor assembly 814 can detect the open / closed state of the device, the relative positioning of the components, such as the display and keypad of the device, and the sensor assembly 814 can also detect the position change of the device or a component of the device, the presence or absence of user contact with the device, the device orientation or acceleration / deceleration and the temperature change of the device. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0160] The communication component 816 is configured to facilitate wired or wireless communication between the device and other devices. The device can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0161] In an exemplary embodiment, the apparatus may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above methods.

[0162] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the device to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0163] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a wearable electronic device, enables the wearable electronic device to perform a device interaction method, the method comprising:

[0164] Get the current task of the first identified device;

[0165] Based on the current task, determine a target task and an execution object of the target task;

[0166] Execute a preset action so that the execution object executes the target task.

[0167] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0168] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A device interaction method, characterized in that: Applied to a wearable electronic device, the method comprises: Get the current task of the first identified device; Based on the current task, determine a target task and an execution object of the target task; Executing a preset action so that the execution object executes the target task; The determining, based on the current task, a target task and an execution object of the target task includes: When the target task determined according to the current task is the task with the highest priority among the tasks executed by the wearable electronic device, controlling the wearable electronic device to execute the target task; The method further comprises: When the execution object is the wearable electronic device, the execution object is in an executable state and the priority of the execution task of the execution object is higher than the priority of the target task, the target task is transmitted to the first identified device so that the first identified device executes the target task; The executing preset action so that the execution object executes the target task includes: When the execution object is a second identified device, sending a second instruction so that the second identified device executes the target task; Wherein, when the current task is for the first identified device to perform display-related operations, the corresponding target task is for the second identified device to perform display-related operations.

2. The method according to claim 1, characterized in that The executing preset action so that the execution object executes the target task includes: When the execution object is the first identified device, sending a first instruction so that the first identified device executes the target task; When the execution object is the wearable electronic device, the wearable electronic device is controlled to execute the target task.

3. The method according to claim 1 or 2, characterized in that: The obtaining of the current task of the first identified device includes: Based on a first predetermined rule, determining the first identified device; Based on a second predetermined rule, the current task of the first identified device is obtained.

4. The method according to claim 3, characterized in that The determining the first identified device based on the first predetermined rule includes one or more of the following: Determining the first identified device based on the communication connection relationship of the wearable electronic device; Determining the first identified device based on visual recognition of the wearable electronic device; Based on auditory recognition of the wearable electronic device, the first identified device is determined.

5. The method according to claim 4, characterized in that The determining the first identified device based on the visual recognition of the wearable electronic device includes: Performing recognition based on a computer vision recognition model of the wearable electronic device to determine the first recognized device; or, The first identified device is determined based on the wearable electronic device identifying the visual two-dimensional code.

6. The method according to claim 4, characterized in that The acquiring the current task of the first identified device based on the second predetermined rule includes one or more of the following: Based on the communication connection established between the first identified device and the wearable electronic device through the communication protocol, receiving the current task sent by the first identified device; Based on the computer vision recognition model of the wearable electronic device, acquiring the current task of the first recognized device; Based on a public network connecting the wearable electronic device and the first identified device, the current task sent by the first identified device to the public network is received.

7. A device interaction apparatus, characterized in that: Applied to a wearable electronic device, the device comprises: A first acquisition module, configured to acquire a current task of a first identified device; A first determination module is configured to determine a target task and an execution object of the target task based on the current task; An execution module, configured to execute a preset action so that the execution object executes the target task; The first determination module is further configured to control the wearable electronic device to execute the target task when the target task determined according to the current task is the task with the highest priority among the tasks executed by the wearable electronic device; The device interaction device also includes: a transfer module, configured to transfer the target task to the first identified device when the execution object is the wearable electronic device, the execution object is in an executable state and the priority of the execution task of the execution object is higher than the priority of the target task, so that the first identified device executes the target task; The execution module is also configured to send a second instruction when the execution object is a second identified device, so that the second identified device executes the target task; wherein, when the current task is for the first identified device to execute display-related operations, the corresponding target task is to let the second identified device execute display-related operations.

8. The device according to claim 7, characterized in that The execution module is further configured to, when the execution object is the first identified device, send a first instruction so that the first identified device executes the target task; and when the execution object is the wearable electronic device, control the wearable electronic device to execute the target task.

9. The device according to claim 7 or 8, characterized in that The first acquisition module includes: A second determination module, configured to determine the first identified device based on a first predetermined rule; The second acquisition module is configured to acquire the current task of the first identified device based on a second predetermined rule.

10. The device according to claim 9, characterized in that The second determining module is further configured as one or more of the following: A third determination module is configured to determine the first identified device based on the communication connection relationship of the wearable electronic device; a fourth determination module, configured to determine the first identified device based on visual recognition of the wearable electronic device; The fifth determination module is configured to determine the first identified device based on the sound wave signal recognition of the wearable electronic device.

11. The device according to claim 10, characterized in that The fourth determination module is configured to determine the first identified device by performing recognition based on a computer vision recognition model of the wearable electronic device; or, to determine the first identified device by performing recognition of a visual two-dimensional code based on the wearable electronic device.

12. The device according to claim 9, characterized in that The second acquisition module is configured to do one or more of the following: based on a communication connection established between the first identified device and the wearable electronic device through a communication protocol, receive the current task sent by the first identified device; Based on the computer vision recognition model of the wearable electronic device, the current task of the first identified device is obtained; based on the public network connecting the wearable electronic device and the first identified device, the current task sent by the first identified device to the public network is received.

13. A device interaction apparatus, characterized in that: The device comprises at least: a processor and a memory for storing executable instructions that can be run on the processor, wherein: When the processor is used to run the executable instructions, the executable instructions execute the steps in the device interaction method provided in any one of claims 1 to 6.

14. A non-transitory computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the device interaction method provided in any one of claims 1 to 6.

Images