Equipment control method and device, electronic equipment and computer readable storage medium
By detecting and comparing interactive feature information in smart devices, filtering out the most suitable devices for response, solving the problems of wasted resources and high power consumption when multiple devices wake up, and improving the interactive experience and device diversity.
Patent Information
- Application Number
- CN202411247954.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-06
- Publication Date
- 2025-01-03
AI Technical Summary
In multiple smart devices, when the wake-up words are the same, it is difficult for users to accurately wake up the target device, resulting in problems of wasted resources and high power consumption.
By detecting device interaction information, the first interactive feature information is generated and broadcast, the second interactive feature information of each interactive device is received, and the device response result is determined based on the comparison of the two, and whether the current device responds to the user's interaction information is controlled to realize the multi-device Response device filtering in scenarios.
It reduces unnecessary device response, improves interactive experience, is suitable for screening of undistributed devices, and improves the diversity of device processing and response accuracy.
Smart Images

Figure CN119252238A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of smart devices, and specifically to a device control method, apparatus, electronic device, and computer-readable storage medium. Background Art
[0002] With the development of smart devices, the types of smart home devices are gradually diverse. For example, smart devices suitable for home include TVs, refrigerators, air conditioners, washing machines, etc. With the improvement of intelligence, voice wake-up and control of devices have become a common way to control devices.
[0003] However, with the development of brands, a merchant of one brand can produce multiple types of smart devices, and the wake-up words may be the same among multiple smart devices of the same merchant. Therefore, when users wake up the devices, there is a situation of "one call and multiple responses". Waking up multiple devices at the same time is usually not the user's intention, and waking up and responding to multiple devices at the same time leads to resource waste and high power consumption. Therefore, how to select the best device from many devices to respond to the user's wake-up is a problem that needs to be solved at present. Summary of the invention
[0004] The embodiments of the present application provide a device control method, apparatus, electronic device, and computer-readable storage medium, which can realize the screening of response devices in a multi-device scenario and enhance the interactive experience.
[0005] In a first aspect, an embodiment of the present application provides a device control method, which is applied to a current device, and the method includes:
[0006] If device interaction information is detected, determining first interaction feature information corresponding to the device interaction information;
[0007] Broadcasting first interaction characteristic information to at least one interaction device within a communication range, and receiving second interaction characteristic information broadcasted by each interaction device, wherein each second interaction characteristic information is determined by each interaction device according to the device interaction information;
[0008] Determine a device response result according to the first interaction feature information and each second interaction feature information;
[0009] Control the response of the current device to the device interaction information according to the device response result;
[0010] Among them, at least one device among the current device and each interactive device is an unconfigured device.
[0011] In a second aspect, an embodiment of the present application further provides a device control apparatus, which is applied to the current device, and the device includes:
[0012] A detection module, configured to determine first interaction feature information corresponding to the device interaction information if device interaction information is detected;
[0013] A communication module, configured to broadcast first interaction characteristic information to at least one interaction device within a communication range, and receive second interaction characteristic information broadcast by each interaction device, wherein each second interaction characteristic information is determined by each interaction device according to device interaction information;
[0014] A determination module, used to determine a device response result according to the first interaction feature information and each second interaction feature information;
[0015] A control module, used to control the response of the current device to the device interaction information according to the device response result;
[0016] Among them, at least one device among the current device and each interactive device is an unconfigured device.
[0017] Optionally, in some embodiments of the present application, the device response result includes responding to device interaction information or does not affect device interaction information, and the control module includes:
[0018] A first control unit, configured to respond to the device interaction information according to the device response result if the device response result is a response to the device interaction information;
[0019] The second control unit is used to keep the current device in a current state if the device response result is no response to the device interaction information, wherein being in the current state indicates that the current device does not respond to the device interaction information.
[0020] Among them, in some embodiments of the present application, the determination module includes:
[0021] A first determining unit, used to determine first detection time information corresponding to the first interaction feature information, and to determine second detection time information corresponding to each second interaction feature information;
[0022] A second determining unit is used to determine the earliest target detection time information at which the device interaction information is detected from the first detection time information and each second detection time information;
[0023] The third determination unit is used to determine the device response result according to the first interaction feature information and each second interaction feature information based on the target detection time information as the starting time information and the first preset time length.
[0024] In some embodiments of the present application, the device interaction information includes voice wake-up information, and the third determining unit includes:
[0025] A first determination subunit is used to extract a first sound pressure value from the first interaction feature information, and extract a second sound pressure value from the second interaction feature information, and determine a device response result according to the first sound pressure value and each second sound pressure value; and / or,
[0026] The second determination subunit is used to extract the first signal-to-noise ratio value from the first interaction feature information and the second signal-to-noise ratio value from the second interaction feature information, and determine the device response result according to the first signal-to-noise ratio value and the second signal-to-noise ratio values.
[0027] In some embodiments of the present application, the first determining subunit is specifically used for:
[0028] If the first sound pressure value is greater than each second sound pressure value, setting the response device interaction information as the device response result;
[0029] If the first sound pressure value is less than any one of the second sound pressure values, setting the non-responding device interaction information as the device response result;
[0030] If the first sound pressure value is equal to the maximum value of the second sound pressure values, the first physical address of the current device and the second physical address of the interactive device corresponding to the maximum value are obtained, and the device response result is determined according to the first physical address and the second physical address.
[0031] In some embodiments of the present application, the device further includes a coordination module, and the coordination module includes:
[0032] A broadcast unit, configured to broadcast first detection request information to at least one interactive device within a communication range in response to the detection instruction, wherein the interactive device includes a network-configured device or an unconfigured device;
[0033] A fourth determining unit, configured to determine detection result information for the first detection request information;
[0034] a fifth determining unit, configured to determine target synchronization information according to the detection result information, wherein the current device and each interactive device communicate through the target synchronization information;
[0035] The communication module includes:
[0036] The communication unit is used to broadcast the first interaction characteristic information to at least one interaction device within the communication range through the target channel information in the target synchronization information, and to receive the second interaction characteristic information broadcasted by each interaction device through the target channel information.
[0037] In some embodiments of the present application, the fifth determining unit includes:
[0038] A third determining subunit is configured to extract the target synchronization information from the first detection response information if the detection result information indicates that the first detection response information fed back by the first target interaction device in at least one interaction device for the first detection request information is received;
[0039] The fourth determination sub-unit is used to generate target synchronization information according to the networking status of the current device if the detection result information indicates that the first detection response information for the first detection request information fed back by any interactive device among at least one interactive device has not been received. At the same time, the conflict detection request information is broadcast to at least one interactive device, and the detection result information for the conflict detection request information is determined, and the target synchronization information is updated according to the detection result information.
[0040] In some embodiments of the present application, the fourth determining subunit is specifically used for:
[0041] If the detection result information indicates that conflict detection response information for the conflict detection request information fed back by the second target interaction device in at least one interaction device is detected, determining a priority comparison result between the current device and the second target interaction device according to the conflict detection response information;
[0042] If the priority comparison result indicates that the priority of the current device is higher, the target synchronization information generated according to the default communication channel information is kept unchanged;
[0043] If the priority comparison result indicates that the priority of the current device is lower, then the peer synchronization information is extracted from the conflict detection response information, and the target synchronization information is updated according to the peer synchronization information;
[0044] If the detection result information indicates that the conflict detection response information fed back by any interactive device among the at least one interactive device for the conflict detection request information is not detected, the target synchronization information generated according to the default communication channel information remains unchanged.
[0045] In some embodiments of the present application, the fourth determining subunit is specifically used for:
[0046] If the current device's networking status is unconnected, the target synchronization information is generated according to the default communication channel information of the current device;
[0047] If the networking status of the current device is already connected to the network, the target synchronization information is generated according to the communication channel of the router to which the current device is connected.
[0048] In some embodiments of the present application, the coordination module further includes:
[0049] The switching unit is used to switch the current device to another communication channel if the current device is a network-connected device and the router connected to the current device switches the communication channel to another communication channel, wherein each interactive device scans and switches to another communication channel of the router.
[0050] In some embodiments of the present application, the coordination module further includes an analysis unit, and the analysis unit includes:
[0051] an extraction subunit, configured to extract the communication channel information from the second detection request information if the second detection request information broadcasted by the third target interaction device in the at least one interaction device is received;
[0052] A first analyzing subunit, configured to cancel replying to the second detection request information if the communication channel information is inconsistent with the default communication channel information of the current device;
[0053] A second analysis subunit is used to generate second probe response information for the probe request information if the communication channel information is consistent with the default communication channel information of the current device, and send the second probe response information to the third target interaction device, wherein the third target interaction device communicates according to the target synchronization information in the second probe response information;
[0054] Among them, the third target interactive device includes an interactive device that is powered on again after power failure, or an interactive device whose network-connected and connected router is replaced, or an interactive device whose service set identifier of a network-connected and connected router is changed, or an interactive device that is powered on again after power failure, or an interactive device that is re-networked.
[0055] In some embodiments of the present application, the detection instruction is generated by the current device after turning on the multi-device interaction switch, or after the current device becomes an initial device, wherein the initial device refers to a device that cannot receive the target synchronization information broadcast by the interactive device.
[0056] In a third aspect, an embodiment of the present application further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and which implements the steps in the above-mentioned device control method when the computer program is executed by the processor.
[0057] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above-mentioned device control method are implemented.
[0058] In a fifth aspect, the embodiments of the present application further provide a computer program product or a computer program, the computer program product or the computer program including computer instructions, the computer instructions being stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in various optional implementations of the embodiments of the present application.
[0059] In summary, if the current device of the embodiment of the present application detects device interaction information, it determines the first interaction feature information corresponding to the device interaction information, broadcasts the first interaction feature information to at least one interaction device within the communication range, and receives the second interaction feature information broadcast by each interaction device, each second interaction feature information is determined by each interaction device according to the device interaction information, and a device response result is determined according to the first interaction feature information and each second interaction feature information, and the response of the current device to the device interaction information is controlled according to the device response result, wherein the current device and at least one of the interaction devices are unconfigured devices.
[0060] Among them, by generating the first interaction feature information by itself and receiving the second interaction feature information of other interaction devices, and determining the device response result according to the first interaction feature information and each second interaction feature information, and then controlling the response of the current device according to the device response result, it is realized to determine whether the current device is suitable for response according to the interaction feature information of each device, and to control whether the current device responds to the device interaction information.
[0061] Among them, each device compares its own interaction feature information with the interaction feature information received from other devices and performs response control, thereby realizing the screening of response devices in multiple device scenarios. While reducing the number of response devices and reducing resource waste, it can also screen out devices that meet user expectations based on the interaction feature information, thereby improving the interaction experience.
[0062] Among them, since the current device and at least one of the interactive devices can be unconfigured devices, the response device screening scheme in the multi-device scenario of the embodiment of the present application is suitable for the screening of unconfigured devices, that is, the devices finally screened for response can be configured devices or unconfigured devices, which improves the diversity of device processing. The screening with more devices involved also makes it easier to screen out devices that meet user interaction needs, thereby improving the interaction experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0063] In order to more clearly illustrate the technical solutions in the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0064] Figure 1 is a schematic diagram of a scenario of a device control method provided in an embodiment of the present application;
[0065] Figure 2 It is a flowchart of a device control method provided in an embodiment of the present application;
[0066] Figure 3 is a schematic diagram of the interaction between a user and a device provided in an embodiment of the present application;
[0067] Figure 4 is a schematic diagram of analyzing a selection response device provided in an embodiment of the present application;
[0068] Figure 5 is an interactive diagram of multiple devices determining target synchronization information provided by an embodiment of the present application;
[0069] Figure 6 is a schematic diagram of synchronization target synchronization information provided by an embodiment of the present application;
[0070] Figure 7 is a schematic diagram of channel switching provided by an embodiment of the present application;
[0071] Figure 8 It is a flowchart of the third target interactive device provided in the embodiment of the present application as a coordinator that is powered on again after losing connection and determining the synchronization information between the coordinator and the target;
[0072] Fig. 9 is another structural schematic diagram of the device control device provided in an embodiment of the present application;
[0073] Fig.10 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0074] The following will be combined with the drawings in this application to clearly and completely describe the technical solutions in this application. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments in the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.
[0075] The embodiments of the present application provide a device control method, device, electronic device, and computer-readable storage medium. Specifically, the embodiments of the present application provide a device control device applicable to an electronic device (current device), wherein the electronic device includes a terminal device, and the terminal device includes but is not limited to a mobile phone, a tablet, a television, a computer, an air conditioner, a refrigerator, a washing machine, a smart light, a smart curtain, and a smart sweeping robot and other intelligent interactive devices.
[0076] For details, please refer to Figure 1 , Figure 1 : is a schematic diagram of a scenario in which the current device performs the device control method provided in an embodiment of the present application, wherein the specific execution process of the current device performing the device control method is as follows:
[0077] If the current device 10 detects device interaction information, it determines the first interaction feature information corresponding to the device interaction information, broadcasts the first interaction feature information to at least one interaction device within the communication range, and receives the second interaction feature information broadcast by each interaction device, each second interaction feature information is determined by each interaction device according to the device interaction information, determines the device response result according to the first interaction feature information and each second interaction feature information, and controls the response of the current device to the device interaction information according to the device response result.
[0078] Among them, at least one device among the current device and each interactive device is an unconfigured device.
[0079] In the embodiment of the present application, the device interaction information includes voice information. For example, if the user wakes up the device through a voice wake-up word, the voice wake-up word is the device interaction information. Correspondingly, the first interaction feature information is the sound pressure information or signal-to-noise ratio information of the voice wake-up word recorded by the current device. Similarly, the second interaction feature information is the sound pressure information or signal-to-noise ratio information of the voice wake-up word recorded by the interactive device.
[0080] In actual scenarios, when users wake up their devices through voice wake-up words, each device in the scene generates corresponding interactive feature information for the recorded voice wake-up words. For example, devices that are farther away from the user generate lower sound pressure values, while devices that are closer to the user generate higher sound pressure values.
[0081] In summary, the embodiment of the present application generates the first interaction feature information by itself and receives the second interaction feature information of other interaction devices, and determines the device response result according to the first interaction feature information and each second interaction feature information, and then controls the response of the current device according to the device response result, thereby determining whether the current device is suitable for response according to the interaction feature information of each device, and controlling whether the current device responds to the device interaction information.
[0082] Among them, each device compares its own interaction feature information with the interaction feature information received from other devices and performs response control, thereby realizing the screening of response devices in multiple device scenarios. While reducing the number of response devices and reducing resource waste, it can also screen out devices that meet user expectations based on the interaction feature information, thereby improving the interaction experience.
[0083] Among them, since the current device and at least one of the interactive devices can be unconfigured devices, the response device screening scheme in the multi-device scenario of the embodiment of the present application is suitable for the screening of unconfigured devices, that is, the devices finally screened for response can be configured devices or unconfigured devices, which improves the diversity of device processing. The screening with more devices involved also makes it easier to screen out devices that meet user interaction needs, thereby improving the interaction experience.
[0084] It should be noted that the order of description of the following embodiments is not intended to limit the priority order of the embodiments.
[0085] See also Figure 2 , Figure 2 A flowchart of a device control method provided in an embodiment of the present application. Although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in an order different from that shown in the accompanying drawings. Specifically, the specific process of the device control method is as follows:
[0086] 101. If device interaction information is detected, determine first interaction feature information corresponding to the device interaction information.
[0087] Among them, the device interaction information refers to the information of the interaction between the user and the device. For example, the device interaction information can be voice information, interactive signals (such as remote control signals sent by a remote control), vibration audio information (such as controlling the device by audio generated by tapping, such as waking up the device), etc., which can be recognized by the device and generate corresponding processing. For example, the device interaction information can be any information that can wake up the device.
[0088] Among them, the embodiment of the present application is explained by taking the device interaction information as voice information as an example, and other types of information or signals can be understood by reference.
[0089] Among them, the component for detecting device interaction information may be a related detection module, for example, detecting voice information through voice detection module recognition.
[0090] It can be understood that the first interaction feature information is feature information corresponding to the device interaction information, and the feature information reflects the characteristics of the device interaction information. For example, the first interaction feature information may include sound pressure value information, signal-to-noise ratio information, etc. corresponding to the device interaction information (voice information).
[0091] 102. Broadcast first interaction feature information to at least one interaction device within a communication range, and receive second interaction feature information broadcast by each interaction device, where each second interaction feature information is determined by each interaction device according to device interaction information.
[0092] It is understandable that the communication range refers to the range of the broadcast. The broadcast range can be determined according to the actual transmission distance of the broadcast, or according to the user's settings. For example, the user controls the communication range within a certain area according to the need for wake-up response. For example, the user generally only needs to wake up and respond to the devices near him. Therefore, the user can set a communication range with a smaller distance to reduce the broadcast range, reduce the number of devices for parameter processing, and reduce resource waste.
[0093] Among them, each second interaction feature information is determined by each interaction device for its own recorded voice information. The second interaction feature information and the first interaction feature information are of the same type, that is, the second interaction feature information can also be sound pressure value information or signal-to-noise ratio information, etc., wherein, due to the different distances from the user, the clarity, sound pressure, time, etc. of the recorded voice information are different. Therefore, there is a difference between the first interaction feature information of the current device and the second interaction feature information of each other interaction device.
[0094] 103. Determine a device response result according to the first interaction feature information and each piece of second interaction feature information.
[0095] It can be understood that by comparing the first interaction feature information with each second interaction feature information, the advantages and disadvantages, or suitability of the current device and each other interaction device in response can be analyzed, and then the device response result for the current device can be obtained, thereby improving the accuracy of the device response result.
[0096] 104. Control the response of the current device to the device interaction information according to the device response result.
[0097] It can be understood that different device response results reflect the response of the current device to the device interaction information. For example, if the device response result indicates a response to the device interaction information, the current device is controlled to respond to the device interaction information. If the device response result indicates no response to the device interaction information, the current device is controlled not to respond to the device interaction information, that is, the current state of the device is kept unchanged.
[0098] It should be emphasized that in the embodiment of the present application, the current device and at least one of the interactive devices are unconfigured devices, that is, the scheme of selecting a response device from multiple devices in the embodiment of the present application supports the selection of unconfigured devices, that is, unconfigured devices can also participate in the selection of multiple devices. For example, the user's home includes both configured devices and unconfigured devices. After the user wakes up through voice, the device control method based on this scheme can select a target device for response from the configured and unconfigured devices. Accordingly, the target device can be a configured device or an unconfigured device.
[0099] In summary, the embodiment of the present application generates the first interaction feature information by itself and receives the second interaction feature information of other interaction devices, and determines the device response result according to the first interaction feature information and each second interaction feature information, and then controls the response of the current device according to the device response result, thereby determining whether the current device is suitable for response according to the interaction feature information of each device, and controlling whether the current device responds to the device interaction information.
[0100] Among them, each device compares its own interaction feature information with the interaction feature information received from other devices and performs response control, thereby realizing the screening of response devices in multiple device scenarios. While reducing the number of response devices and reducing resource waste, it can also screen out devices that meet user expectations based on the interaction feature information, thereby improving the interaction experience.
[0101] Among them, since the current device and at least one of the interactive devices can be unconfigured devices, the response device screening scheme in the multi-device scenario of the embodiment of the present application is suitable for the screening of unconfigured devices, that is, the devices finally screened for response can be configured devices or unconfigured devices, which improves the diversity of device processing. The screening with more devices involved also makes it easier to screen out devices that meet user interaction needs, thereby improving the interaction experience.
[0102] Optionally, since the purpose of the embodiment of the present application is to select a device for responding from multiple devices, for a single device, for example, for the current device, the device response result of the current device may include one of responding to the device interaction information and not responding to the device interaction information, that is, optionally, in some embodiments of the present application, the device response result includes responding to the device interaction information or not affecting the device interaction information, and the step of "controlling the response of the current device to the device interaction information according to the device response result" includes:
[0103] If the device response result is a response to device interaction information, respond to the device interaction information according to the device response result;
[0104] If the device response result is no response to the device interaction information, the current device is kept in the current state, wherein being in the current state indicates that the current device does not respond to the device interaction information.
[0105] Correspondingly, the current device makes a control result of whether to respond according to the device response result, and completes the control processing of the current device itself responding or not responding. It can be understood that each interactive device also compares its own interactive feature information with the received interactive feature information sent by other devices to obtain the device response result of each interactive device itself, and then each interactive device makes a control processing of whether to respond according to its own device response result. Then, the current device and the responding devices in each interactive device are selected, where the current device and each interactive device constitute multiple devices.
[0106] For example, see Figure 3 As shown, Figure 3 is a schematic diagram of user-device interaction provided by an embodiment of the present application, wherein, when a user (Actor) wakes up a device by using a voice "Little T Little T", devices 1, 2 and 3 in the scene are all awakened by the voice "Little T Little T", and accordingly, devices 1, 2 and 3 broadcast their own interaction feature information to each other, so that device 1 not only generates first interaction feature information for itself, but also can receive second interaction feature information from devices 2 and 3, and then, device 1 can make a decision based on the first interaction feature information and the two second interaction feature information to determine the device response result of device 1 itself, and then control the response of device 1 itself to the voice "Little T Little T" based on the device response result, that is, if the device response result is to respond to the voice "Little T Little T", then device 1 responds to the voice "Little T Little T", conversely, if the device response result is not to respond to the voice "Little T Little T", then device 1 maintains the current state, or exits the awakening state, that is, at this time, device 1 does not respond to the voice "Little T Little T". Similarly, device 2 and device 3 also receive the interactive feature information of the other two devices respectively, and decide whether to respond to the device response result of the voice "Xiao T Xiao T".
[0107] It should be noted that, since each device contains the interactive feature information of itself and the other two devices, the interactive feature information used by each device for analysis is consistent. Therefore, the decision results of each device based on the interactive feature information should be consistent, that is, the target device or final device used for response is decided from multiple devices. In the embodiment of the present application, for each device, only the response of the device itself is decided. For example, for device 1, if the device response result of device 1 is to respond to the wake-up of the voice "Xiao T Xiao T", the device response results of devices 2 and 3 are not to respond to the wake-up of the voice "Xiao T Xiao T".
[0108] It can be understood that in a feasible implementation, the user can also set more than one responding device, for example, select two devices from multiple devices to respond to the user's voice wake-up, for example, select device 1 and device 2, or device 1 and 3, or device 2 and 3 from device 1, device 2 and device 3 to respond to the user's voice wake-up.
[0109] Optionally, since the device needs to respond in a relatively short time to respond to the user's interaction needs, it is necessary to screen out devices for response in a relatively short time, that is, optionally, in some embodiments of the present application, the step of "determining the device response result according to the first interaction feature information and each second interaction feature information" includes:
[0110] Determine first detection time information corresponding to the first interaction feature information, and determine second detection time information corresponding to each second interaction feature information;
[0111] Determine the earliest target detection time information at which the device interaction information is detected from the first detection time information and each second detection time information;
[0112] The target detection time information is used as the starting time information, and a device response result is determined according to the first interaction feature information and each second interaction feature information according to a first preset time length.
[0113] The first detection time information is the time information when the current device detects the device interaction information, and the second detection time information is the time information when the interactive device detects the device interaction information. It can be understood that the target detection time information is the time information when the device interaction information is first detected in the current device and each interactive device. For example, if the detection time information is timestamp information, the target detection time information is the earliest timestamp information when the device interaction information is detected in the current device and each interactive device.
[0114] The first preset duration limits the duration for selecting the responding device, so as to avoid a long selection decision causing the user's wake-up voice to not receive feedback for a long time. Figure 4 As shown, Figure 4 is a schematic diagram of analyzing the selection response device provided in an embodiment of the present application, wherein it shows the detection time information of the device 1, the device 2, the device 3 and the device 4 detecting or identifying the device interaction information, Figure 4 The first preset duration is 200ms as an example for explanation, wherein: Figure 4It is shown that device 1 first recognizes the device interaction information, and devices 2, 3 and 4 recognize the device interaction information later. In the embodiment of the present application, the earliest awakened target detection time information (i.e., the time information when device 1 recognizes the device interaction information in the embodiment of the present application) is used as the starting point to select the awakened devices within 200ms, that is, select devices 1, 2 and 3, and select the target device for responding to the device interaction information. Among them, since the time when device 4 recognizes the device interaction information is later than 200ms after the target detection time information, device 4 does not belong to one of the multiple devices that select the responding device, that is, device 4 does not participate in the final selection process.
[0115] Optionally, in the embodiment of the present application, the device interaction information is taken as voice wake-up information as an example, and the interaction feature information may include sound pressure value information or signal-to-noise ratio information. That is, optionally, in some embodiments of the present application, the device interaction information includes voice wake-up information, and the step of “determining a device response result according to the first interaction feature information and each second interaction feature information” includes:
[0116] Extracting a first sound pressure value from the first interactive feature information, and extracting a second sound pressure value from the second interactive feature information, and determining a device response result according to the first sound pressure value and each second sound pressure value; and / or,
[0117] A first signal-to-noise ratio value is extracted from the first interaction feature information, and a second signal-to-noise ratio value is extracted from the second interaction feature information, and a device response result is determined according to the first signal-to-noise ratio value and each second signal-to-noise ratio value.
[0118] Among them, the sound pressure value and the signal-to-noise ratio value can both reflect the distance between each device (including the current device and each interactive device) and the user. Therefore, determining the device response result based on the sound pressure value and the signal-to-noise ratio value helps to screen out devices that are closer to the user as responding devices, that is, in line with the user's interaction habits. For example, users are more inclined to interact with nearby devices or devices that are closer to the user. For example, when a user wants to control a device, the user usually walks near the device and then controls the device through voice wake-up. Or the sound pressure value can also help to screen out devices located in front of the user's face. For example, when the voice is propagating, the sound pressure at different sound source output angles is different. The devices for response obtained based on the larger sound pressure value can also help to screen out devices corresponding to the front of the user, which is in line with the user's habits. For example, when a user wants to control a device, he usually sends a voice wake-up word or control voice toward the device.
[0119] Specifically, the step of “determining the device response result according to the first sound pressure value and each second sound pressure value” includes:
[0120] If the first sound pressure value is greater than each second sound pressure value, setting the response device interaction information as the device response result;
[0121] If the first sound pressure value is less than any one of the second sound pressure values, setting the non-responding device interaction information as the device response result;
[0122] If the first sound pressure value is equal to the maximum value of the second sound pressure values, the first physical address of the current device and the second physical address of the interactive device corresponding to the maximum value are obtained, and the device response result is determined according to the first physical address and the second physical address.
[0123] It is understandable that when the sound pressure values are consistent or close, the devices for response can be screened according to the physical address, for example, the devices with smaller or larger physical addresses are used as the devices for response, so the device response result can be obtained according to whether to respond. Among them, in the embodiment of the present application, the size of the physical address refers to the size of the digital serial number corresponding to the physical address. For example, if the first digital serial number corresponding to the first physical address is greater than the second digital serial number corresponding to the second physical address, the non-responding device interaction information is set as the device response result, and if the first digital serial number corresponding to the first physical address is less than the second digital serial number corresponding to the second physical address, the responding device interaction information is set as the device response result.
[0124] Among them, since the embodiments of the present application involve the awakening and response selection operations of unconfigured network devices, in order to ensure that the devices can broadcast their respective interaction feature information to each other after awakening, it is necessary for each device to negotiate in advance a channel for broadcasting the interaction feature information, so that after the device is awakened, the interaction feature information can be broadcast based on the channel determined by the negotiation, and the negotiation process can be implemented by broadcasting a detection request, that is, optionally, in some embodiments of the present application, before the step of "broadcasting the first interaction feature information to at least one interactive device within the communication range, and receiving the second interaction feature information broadcast by each interactive device", the method also includes:
[0125] In response to the detection instruction, broadcasting first detection request information to at least one interactive device within the communication range, the interactive device including a network-configured device or an unconfigured device;
[0126] Determine detection result information for the first detection request information;
[0127] Determine target synchronization information according to the detection result information, wherein the current device and each interactive device communicate through the target synchronization information;
[0128] Broadcasting first interaction feature information to at least one interaction device within a communication range, and receiving second interaction feature information broadcast by each interaction device, includes:
[0129] The first interaction characteristic information is broadcasted to at least one interaction device within the communication range through the target channel information in the target synchronization information, and the second interaction characteristic information broadcasted by each interaction device is received through the target channel information.
[0130] It should be noted that in the embodiment of the present application, the target synchronization information includes target channel information determined by negotiation, based on which the first interaction feature information can be broadcast to the interaction devices within the communication range and the second interaction feature information broadcast by the receiving interaction devices.
[0131] Among them, since the embodiment of the present application needs to meet the negotiation processing of unconfigured network devices, it is necessary to meet the sending and receiving processing of detection requests of unconfigured network devices. The embodiment of the present application is explained based on the example that the current device and the interactive device are wireless network (wifi) devices. It is necessary to use the management frame in the wireless network to carry out the sending and receiving processing of the detection request.
[0132] Among them, even if the unconfigured device can send and receive detection requests through management frames, if the transceiver devices are not on the same channel, the detection response to the detection request cannot be returned. Therefore, the channel negotiation cannot be carried out between the transceiver devices, and the target synchronization information cannot be determined, that is, the target negotiation information cannot be determined. Therefore, in an embodiment of the present application, it is necessary to determine the target synchronization information based on the detection result information of the first detection request information broadcast by the current device.
[0133] Correspondingly, if the first probe response information returned for the first probe request information is received, the target synchronization information including the target channel information is extracted from the first probe response information, that is, optionally, in some embodiments of the present application, the step of “determining the target synchronization information according to the probe result information” includes:
[0134] If the detection result information indicates that first detection response information for the first detection request information fed back by the first target interaction device in at least one interaction device is received, then the target synchronization information is extracted from the first detection response information;
[0135] If the detection result information indicates that the first detection response information for the first detection request information has not been fed back by any interactive device among at least one interactive device, target synchronization information is generated according to the networking status of the current device. At the same time, conflict detection request information is broadcast to at least one interactive device, and detection result information for the conflict detection request information is determined, and the target synchronization information is updated according to the detection result information.
[0136] Among them, the first detection response information is a reply to the first detection request information. If the first target interaction device feeds back the first detection response information to the first detection request information, it indicates that the first target interaction device has determined a target channel information for broadcasting interaction feature information. Therefore, the target synchronization information can be generated according to the target channel information contained in the first detection response information, and the current device has been switched to the target channel corresponding to the target channel information to facilitate broadcast communication with the first target interaction device.
[0137] Among them, if the first detection response information for the first detection request information is not received from any interactive device, it can be determined that at this time, a target channel information for broadcasting interactive feature information has not been determined among multiple devices, and a preliminary target synchronization information is temporarily determined based on its own networking status.
[0138] In the embodiment of the present application, the probe request information includes user identification information and device physical address information. The probe response information includes target channel information. If the first target interactive device is a network-configured device, the probe response information also includes the service set identification information (ssid) of the router.
[0139] Among them, in order to ensure that the target synchronization information corresponding to multiple devices in the scene is consistent, that is, the target channel information is consistent, it is also necessary to perform conflict detection on whether the channels are consistent, so as to determine the unique target channel information in the multiple devices through conflict detection, that is, optionally, in some embodiments of the present application, the step of "updating the target synchronization information according to the detection result information" includes:
[0140] If the detection result information indicates that conflict detection response information for the conflict detection request information fed back by the second target interaction device in at least one interaction device is detected, determining a priority comparison result between the current device and the second target interaction device according to the conflict detection response information;
[0141] If the priority comparison result indicates that the priority of the current device is higher, the target synchronization information generated according to the default communication channel information is kept unchanged;
[0142] If the priority comparison result indicates that the priority of the current device is lower, then the peer synchronization information is extracted from the conflict detection response information, and the target synchronization information is updated according to the peer synchronization information;
[0143] If the detection result information indicates that the conflict detection response information fed back by any interactive device among the at least one interactive device for the conflict detection request information is not detected, the target synchronization information generated according to the default communication channel information remains unchanged.
[0144] Among them, the conflict detection response information is feedback to the conflict detection request information. For example, in an embodiment of the present application, the conflict detection response information includes conflict detection frame information, and the conflict detection response information includes conflictresponse frame information.
[0145] Among them, if the conflict detection response information is fed back, it indicates that there is a channel inconsistency. Therefore, it can be determined whether to update the target synchronization information based on the priority comparison result between the current device and the second target interactive device. Among them, in the embodiment of the present application, the priority of the device can be determined based on whether the device is networked. For example, the priority of a networked device is higher than that of an unnetworked device, and a device with a smaller digital serial number corresponding to the device's physical address has a higher priority.
[0146] If no feedback conflict detection response information is received, it indicates that there is no inconsistent channel, and therefore, the current target channel can be kept unchanged, that is, the current target synchronization information can be kept unchanged.
[0147] The present application embodiment takes the coordinator performing channel negotiation as an example for explanation. Figure 5 , Figure 5 is an interactive diagram of multiple devices determining target synchronization information provided by an embodiment of the present application. Specifically, Figure 5 FIG. 4 shows an interactive process in which device 1, device 2, device 3 and device 4 determine target synchronization information through four stages, wherein the first stage, the second stage, the third stage and the fourth stage are respectively:
[0148] Phase 1: The user turns on the multi-device wake-up function of each device (also known as turning on the multi-device interaction switch). Specifically, the user discovers the surrounding devices through the applet, connects to the device via Bluetooth, turns on the multi-device wake-up function, and sends a function turn-on instruction (user ID, timestamp) to the device. The device stores the user ID in the flash memory.
[0149] The second stage: Detection and discovery of the coordinator. Specifically, after the multi-device wake-up function is turned on, the timing starts at 10s, and the probe request information (probe req frame, including the user identifier and the device physical address) is broadcasted every 1s. The unconfigured device switches to send the probe request information through all channels, and the connected device sends the probe request information through a single channel.
[0150] If a probe response message (probe resp frame) is received from the coordinator, the device switches the channel by default to join the coordinator's group. The probe resp frame contains information such as the target channel information (channel) and the router ssid, that is, the device switches to the channel corresponding to the target channel information.
[0151] Phase 3: Detection timeout phase. Specifically, if the probe req probe fails to find the coordinator, after a 10s timeout, it will default to the coordinator.
[0152] That is, if the coordinator does not receive the probe response information, the target channel information is determined according to its own networking status, and the channel corresponding to the target channel information is switched. For example, if the networked device and the unconfigured coordinator are not on the same channel, the coordinator will not reply. If the networking status is connected, the channel information of the router is used as the target channel information, that is, the channel is switched to the same channel as the router channel. If the networking status is not connected, the default channel information is used as the target channel information, that is, the channel corresponding to the default channel information is switched, such as the default channel is channel 6;
[0153] The fourth stage: conflict detection. Specifically, when the device just acts as a coordinator, the coordinator sends a conflict detection request message (conflict detection frame) once a minute for 10 minutes (to prevent multiple devices from becoming coordinators at the same time due to packet loss). After 10 minutes, the unconfigured coordinator switches all channels every 5 minutes and sends a conflict detection frame to find other connected devices with the same userid.
[0154] Among them, during the conflict detection process, if the other party has a higher priority (such as the other party is a networked device), the coordinator actively changes to a sub-device. Specifically, the device that receives the conflict detection request information (conflict detection frame) determines the priority of the other party's device and its own device, and determines whether it is suitable to continue to be a coordinator. If it is still suitable to be a coordinator, it will continue to be a coordinator, and feedback the conflict detection response information (conflict response frame), and inform the other party that it needs to be a sub-device. The other party that receives the conflict detection response information switches to a sub-device; if it is determined that it is not suitable to continue to be a coordinator, it will switch to a sub-device, and feedback the conflict detection response information, and inform the other party that it needs to be a coordinator. The other party that receives the conflict detection response information continues to be a coordinator.
[0155] like Figure 5 In the process, since device 1 and device 2 did not detect the coordinator in the second stage (i.e., device 4, the main reason for not detecting the coordinator is that the channels of device 1 and device 2 and the coordinator are inconsistent, resulting in the coordinator not feeding back the detection response information after receiving the detection request information broadcast by device 1 and device 2), they are set as coordinators in the third stage, and in the fourth stage, they are switched to sub-devices of device 4 through the processing of conflict detection request information and conflict detection response information.
[0156] And in Figure 5In the example, since the channel of device 3 is consistent with that of the coordinator, device 3 receives the detection response information fed back by the coordinator, and device 3 directly serves as a child device of the coordinator.
[0157] Among them, after the coordinator among multiple devices is determined through detection request information and conflict detection request information (wherein the coordinator is one of the devices, usually a device with a higher priority), the coordinator broadcasts its own target synchronization information to enable each device to switch to the target channel corresponding to the target synchronization information, so that the channel used by each device to broadcast the interactive feature information is consistent, that is, it is ensured that each device can broadcast its own first interactive feature information to each device, and can also receive the second interactive feature information broadcast by other devices through broadcasting.
[0158] like Figure 6 middle, Figure 6 is a schematic diagram of synchronization target synchronization information provided by an embodiment of the present application, Figure 6 The figure shows a situation including two coordinators on the left and right, wherein the coordinator on the left broadcasts target synchronization information to each sub-device, and similarly, the coordinator on the right also broadcasts target synchronization information to the sub-device ( Figure 6 Not used in the game).
[0159] The special thing is that after the device is called a coordinator, it can broadcast conflict detection request information to other devices in the scene as needed, so as to determine whether to switch from the coordinator to a sub-device according to whether the conflict detection response information for the conflict detection request information is received and the specific content of the received conflict detection response information, such as Figure 6 In the example, the coordinator on the left interacts with the coordinator on the right for conflict detection request information and conflict detection response information. Since the coordinator on the left is an unconnected device (not connected to the network), its priority is lower than that of the coordinator on the right. After the conflict detection request information and the conflict detection response information are interacted, the coordinator on the left switches to a sub-device and immediately sends an instruction to update the target synchronization information to the sub-device to support the sub-device in updating the target synchronization information. If the final coordinator is a connected device, such as Figure 6 If it is the coordinator on the right side of the network, the child device also needs to save the service set identification information (ssid) of the connected router.
[0160] Subsequently, the coordinator on the right periodically broadcasts target synchronization information to the sub-devices (including the sub-devices switched by the coordinator on the left), such as broadcasting the target channel information of the router connected to the network.
[0161] Optionally, in an embodiment of the present application, if the coordinator is a networked device and the channel of the router connected to the coordinator is switched, the coordinator needs to reconnect to the switched channel of the router. At this time, since each sub-device cannot receive the target synchronization information broadcast by the coordinator, it is called an isolated device. Therefore, the router can be scanned through SSID and switched to the new channel of the router, such as Figure 7 As shown, Figure 7 This is a schematic diagram of channel switching provided in an embodiment of the present application. After the router switches the channel, the networked coordinator and each sub-device are switched to the new channel of the router. Subsequently, the coordinator still broadcasts the target synchronization information regularly.
[0162] That is, optionally, in some embodiments of the present application, after the step of "generating target synchronization information according to the networking status of the current device", the method further includes:
[0163] If the current device is a network-connected device, and the router connected to the current device switches the communication channel to another communication channel, the current device is also switched to another communication channel, wherein each interactive device scans and switches to another communication channel of the router.
[0164] See also Figure 7 As shown, the current device is Figure 7 For the networked coordinator in the router, if the router switches to channel 11, the coordinator and each sub-device will also switch to channel 11.
[0165] Among them, if the current device is a coordinator, after receiving the second detection request information broadcast by the interactive device of the third target interactive device, it determines whether to reply to the second detection response information based on the channel consistency. If the channel is consistent, it replies to the second detection response information; if it is inconsistent, it does not reply to the detection response information.
[0166] Among them, in the case of replying the second detection response information to the third target interaction device, the coordinator can perform conflict detection with the third target interaction device to determine whether the current device needs to be switched to a sub-device. For example, after determining that the priority of the current device is lower, the current device is switched to a sub-device, and the third target interaction device is switched to a coordinator.
[0167] Among them, in the embodiment of the present application, after replying the second detection response information to the third target interaction device to determine that the third target interaction device is a sub-device and the current device is a coordinator, if the third target interaction device is a coordinator before, it is necessary to perform a conflict detection with the third target interaction device to determine whether it is necessary to switch the current device to a sub-device and switch the third target interaction device to a coordinator, such as Figure 8 As shown, Figure 8This is a flowchart of the third target interactive device provided in the embodiment of the present application as a coordinator that is powered on again after losing connection to determine the synchronization information between the coordinator and the target, specifically:
[0168] The third target interaction device (coordinator) broadcasts target synchronization information to sub-device 1 and sub-device 2;
[0169] If the coordinator loses power, sub-device 1 and sub-device 2 cannot obtain the target synchronization information, that is, the heartbeat times out and becomes an isolated device. Then sub-device 1 and sub-device 2 scan the router respectively and switch to the router's channel. If the heartbeat times out again after switching, it is called the initial device;
[0170] After sub-device 1 and sub-device 2 are called initial devices, they broadcast probe request information respectively, and after receiving probe response information from each other, sub-device 1 and sub-device 2 become coordinators respectively;
[0171] Then, a conflict detection is performed between sub-device 1 and sub-device 2, and it is determined that sub-device 1 is the coordinator, and sub-device 2 is switched from the coordinator to the sub-device.
[0172] If the third target interactive device is powered on again, the third target interactive device broadcasts a detection request message. If no detection response message is received, it becomes a coordinator and performs conflict detection on sub-device 1 (which is a coordinator at this time) to determine that the third target interactive device is the final coordinator. Sub-device 1 switches from a coordinator to a sub-device. At this time, sub-device 1 immediately sends information to sub-device 2 to update the target synchronization information and indicate the channel switching.
[0173] If the third target interactive device is powered on again and reconnected to the router, the third target interactive device broadcasts a detection request message and receives a detection response message returned by sub-device 1, and the third target interactive device becomes a sub-device. Moreover, since the third target interactive device was previously a coordinator, sub-device 1 (at this time a coordinator) performs conflict detection with the third target interactive device and determines that the third target interactive device is the final coordinator. Sub-device 1 switches from a coordinator to a sub-device. At this time, sub-device 1 immediately sends information to sub-device 2 to update the target synchronization information indicating the channel switching.
[0174] Subsequently, the third target interaction device (coordinator) broadcasts target synchronization information to sub-device 1 and sub-device 2 periodically.
[0175] That is, optionally, in the embodiment of the present application, after the step of “updating the target synchronization information according to the detection result information”, the method further includes:
[0176] If second detection request information broadcasted by a third target interaction device in at least one interaction device is received, then communication channel information is extracted from the second detection request information;
[0177] If the communication channel information is inconsistent with the default communication channel information of the current device, canceling the reply to the second detection request information;
[0178] If the communication channel information is consistent with the default communication channel information of the current device, generating second probe response information for the probe request information, and sending the second probe response information to the third target interaction device, wherein the third target interaction device communicates according to the target synchronization information in the second probe response information;
[0179] Among them, the third target interactive device includes an interactive device that is powered on again after power failure, or an interactive device whose network-connected and connected router is replaced, or an interactive device whose service set identifier of a network-connected and connected router is changed, or an interactive device that is powered on again after power failure, or an interactive device that is re-networked.
[0180] Among them, when the third target interactive device acts as a coordinator, if the router is replaced or the SSID is changed, it can be understood by referring to the situation where the third target interactive device loses connection (power off) when it acts as a coordinator. The only difference is that after the router is replaced or the SSID is changed, sub-devices 1 and 2 will become initial devices because they cannot find the router.
[0181] That is, if the current device becomes the initial device or turns on the multi-device interaction switch, the detection instruction is triggered to start the process of determining the coordinator and the target synchronization information. That is, optionally, in some embodiments of the present application, the detection instruction is generated by the current device after turning on the multi-device interaction switch, or after the current device becomes the initial device, wherein the initial device refers to a device that cannot receive the target synchronization information broadcast by the interactive device.
[0182] In summary, the embodiment of the present application generates the first interaction feature information by itself and receives the second interaction feature information of other interaction devices, and determines the device response result according to the first interaction feature information and each second interaction feature information, and then controls the response of the current device according to the device response result, thereby determining whether the current device is suitable for response according to the interaction feature information of each device, and controlling whether the current device responds to the device interaction information.
[0183] Among them, each device compares its own interaction feature information with the interaction feature information received from other devices and performs response control, thereby realizing the screening of response devices in multiple device scenarios. While reducing the number of response devices and reducing resource waste, it can also screen out devices that meet user expectations based on the interaction feature information, thereby improving the interaction experience.
[0184] Among them, since the current device and at least one of the interactive devices can be unconfigured devices, the response device screening scheme in the multi-device scenario of the embodiment of the present application is suitable for the screening of unconfigured devices, that is, the devices finally screened for response can be configured devices or unconfigured devices, which improves the diversity of device processing. The screening with more devices involved also makes it easier to screen out devices that meet user interaction needs, thereby improving the interaction experience.
[0185] Among them, the accuracy of selecting a response device among multiple devices is improved through sound pressure value or signal-to-noise ratio.
[0186] Among them, the negotiation process of the channels of each device before waking up the device helps each device to send and receive interactive characteristic information through the negotiated channel when waking up the device.
[0187] In order to better implement the device control method of the present application, the present application also provides a device control apparatus based on the device control method, wherein the meanings of the terms are the same as those in the device control method, and the specific implementation details can refer to the description in the method embodiment.
[0188] See also Fig. 9 , Fig. 9 : is a schematic diagram of the structure of a device control device provided in an embodiment of the present application, wherein the device control device may specifically include:
[0189] The detection module 301 is configured to determine first interaction feature information corresponding to the device interaction information if device interaction information is detected;
[0190] The communication module 302 is used to broadcast the first interaction characteristic information to at least one interaction device within the communication range, and receive the second interaction characteristic information broadcasted by each interaction device, where each second interaction characteristic information is determined by each interaction device according to the device interaction information;
[0191] A determination module 303, configured to determine a device response result according to the first interaction feature information and each second interaction feature information;
[0192] A control module 304, used to control the response of the current device to the device interaction information according to the device response result;
[0193] Among them, at least one device among the current device and each interactive device is an unconfigured device.
[0194] Optionally, in some embodiments of the present application, the device response result includes responding to device interaction information or does not affect device interaction information, and the control module 304 includes:
[0195] A first control unit, configured to respond to the device interaction information according to the device response result if the device response result is a response to the device interaction information;
[0196] The second control unit is used to keep the current device in a current state if the device response result is no response to the device interaction information, wherein being in the current state indicates that the current device does not respond to the device interaction information.
[0197] In some embodiments of the present application, the determination module 303 includes:
[0198] A first determining unit, used to determine first detection time information corresponding to the first interaction feature information, and to determine second detection time information corresponding to each second interaction feature information;
[0199] A second determining unit is used to determine the earliest target detection time information at which the device interaction information is detected from the first detection time information and each second detection time information;
[0200] The third determination unit is used to determine the device response result according to the first interaction feature information and each second interaction feature information based on the target detection time information as the starting time information and the first preset time length.
[0201] In some embodiments of the present application, the device interaction information includes voice wake-up information, and the third determining unit includes:
[0202] A first determination subunit is used to extract a first sound pressure value from the first interaction feature information, and extract a second sound pressure value from the second interaction feature information, and determine a device response result according to the first sound pressure value and each second sound pressure value; and / or,
[0203] The second determination subunit is used to extract the first signal-to-noise ratio value from the first interaction feature information and the second signal-to-noise ratio value from the second interaction feature information, and determine the device response result according to the first signal-to-noise ratio value and the second signal-to-noise ratio values.
[0204] In some embodiments of the present application, the first determining subunit is specifically used for:
[0205] If the first sound pressure value is greater than each second sound pressure value, setting the response device interaction information as the device response result;
[0206] If the first sound pressure value is less than any one of the second sound pressure values, setting the non-responding device interaction information as the device response result;
[0207] If the first sound pressure value is equal to the maximum value of the second sound pressure values, the first physical address of the current device and the second physical address of the interactive device corresponding to the maximum value are obtained, and the device response result is determined according to the first physical address and the second physical address.
[0208] In some embodiments of the present application, the device further includes a coordination module, and the coordination module includes:
[0209] A broadcast unit, configured to broadcast first detection request information to at least one interactive device within a communication range in response to the detection instruction, wherein the interactive device includes a network-configured device or an unconfigured device;
[0210] A fourth determining unit, configured to determine detection result information for the first detection request information;
[0211] a fifth determining unit, configured to determine target synchronization information according to the detection result information, wherein the current device and each interactive device communicate through the target synchronization information;
[0212] The communication module 302 includes:
[0213] The communication unit is used to broadcast the first interaction characteristic information to at least one interaction device within the communication range through the target channel information in the target synchronization information, and to receive the second interaction characteristic information broadcasted by each interaction device through the target channel information.
[0214] In some embodiments of the present application, the fifth determining unit includes:
[0215] A third determining subunit is configured to extract the target synchronization information from the first detection response information if the detection result information indicates that the first detection response information fed back by the first target interaction device in at least one interaction device for the first detection request information is received;
[0216] The fourth determination sub-unit is used to generate target synchronization information according to the networking status of the current device if the detection result information indicates that the first detection response information for the first detection request information fed back by any interactive device among at least one interactive device has not been received. At the same time, the conflict detection request information is broadcast to at least one interactive device, and the detection result information for the conflict detection request information is determined, and the target synchronization information is updated according to the detection result information.
[0217] In some embodiments of the present application, the fourth determining subunit is specifically used for:
[0218] If the detection result information indicates that conflict detection response information for the conflict detection request information fed back by the second target interaction device in at least one interaction device is detected, determining a priority comparison result between the current device and the second target interaction device according to the conflict detection response information;
[0219] If the priority comparison result indicates that the priority of the current device is higher, the target synchronization information generated according to the default communication channel information is kept unchanged;
[0220] If the priority comparison result indicates that the priority of the current device is lower, then the peer synchronization information is extracted from the conflict detection response information, and the target synchronization information is updated according to the peer synchronization information;
[0221] If the detection result information indicates that the conflict detection response information fed back by any interactive device among the at least one interactive device for the conflict detection request information is not detected, the target synchronization information generated according to the default communication channel information remains unchanged.
[0222] In some embodiments of the present application, the fourth determining subunit is specifically used for:
[0223] If the current device's networking status is unconnected, the target synchronization information is generated according to the default communication channel information of the current device;
[0224] If the networking status of the current device is already connected to the network, the target synchronization information is generated according to the communication channel of the router to which the current device is connected.
[0225] In some embodiments of the present application, the coordination module further includes:
[0226] The switching unit is used to switch the current device to another communication channel if the current device is a network-connected device and the router connected to the current device switches the communication channel to another communication channel, wherein each interactive device scans and switches to another communication channel of the router.
[0227] In some embodiments of the present application, the coordination module further includes an analysis unit, and the analysis unit includes:
[0228] an extraction subunit, configured to extract the communication channel information from the second detection request information if the second detection request information broadcasted by the third target interaction device in the at least one interaction device is received;
[0229] A first analyzing subunit, configured to cancel replying to the second detection request information if the communication channel information is inconsistent with the default communication channel information of the current device;
[0230] A second analysis subunit is used to generate second probe response information for the probe request information if the communication channel information is consistent with the default communication channel information of the current device, and send the second probe response information to the third target interaction device, wherein the third target interaction device communicates according to the target synchronization information in the second probe response information;
[0231] Among them, the third target interactive device includes an interactive device that is powered on again after power failure, or an interactive device whose network-connected and connected router is replaced, or an interactive device whose service set identifier of a network-connected and connected router is changed, or an interactive device that is powered on again after power failure, or an interactive device that is re-networked.
[0232] In some embodiments of the present application, the detection instruction is generated by the current device after turning on the multi-device interaction switch, or after the current device becomes an initial device, wherein the initial device refers to a device that cannot receive the target synchronization information broadcast by the interactive device.
[0233] In the embodiment of the present application, if the detection module 301 detects device interaction information, the first interaction feature information corresponding to the device interaction information is determined. Then, the communication module 302 broadcasts the first interaction feature information to at least one interaction device within the communication range, and receives the second interaction feature information broadcast by each interaction device. Each second interaction feature information is determined by each interaction device according to the device interaction information. Subsequently, the determination module 303 determines the device response result according to the first interaction feature information and each second interaction feature information. Then, the control module 304 controls the response of the current device to the device interaction information according to the device response result. The current device and at least one of the interaction devices are unconfigured devices.
[0234] Among them, the embodiment of the present application generates the first interaction feature information by itself and receives the second interaction feature information of other interaction devices, and determines the device response result according to the first interaction feature information and each second interaction feature information, and then controls the response of the current device according to the device response result, so as to determine whether the current device is suitable for response according to the interaction feature information of each device, and realize control of whether the current device responds to the device interaction information.
[0235] Among them, each device compares its own interaction feature information with the interaction feature information received from other devices and performs response control, thereby realizing the screening of response devices in multiple device scenarios. While reducing the number of response devices and reducing resource waste, it can also screen out devices that meet user expectations based on the interaction feature information, thereby improving the interaction experience.
[0236] Among them, since the current device and at least one of the interactive devices can be unconfigured devices, the response device screening scheme in the multi-device scenario of the embodiment of the present application is suitable for the screening of unconfigured devices, that is, the devices finally screened for response can be configured devices or unconfigured devices, which improves the diversity of device processing. The screening with more devices involved also makes it easier to screen out devices that meet user interaction needs, thereby improving the interaction experience.
[0237] In addition, the present application also provides an electronic device, such as Fig.10 As shown, it shows a schematic diagram of the structure of the electronic device involved in this application, specifically:
[0238] The electronic device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that Fig.10 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0239] The processor 401 is the control center of the electronic device, and uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 402, and calling data stored in the memory 402, the processor 401 performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 401.
[0240] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.
[0241] The electronic device also includes a power supply 403 for supplying power to each component. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. The power supply 403 can also include one or more DC or AC power supplies, recharging systems, power supply device debugging circuits, power converters or inverters, power status indicators, and other arbitrary components.
[0242] The electronic device may further include an input unit 404, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
[0243] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 401 in the electronic device will load the executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 401 will run the application programs stored in the memory 402, thereby implementing the steps in any device control method provided in the embodiments of the present application.
[0244] If the current device of the embodiment of the present application detects device interaction information, it determines first interaction feature information corresponding to the device interaction information, broadcasts the first interaction feature information to at least one interaction device within the communication range, and receives second interaction feature information broadcasted by each interaction device, each second interaction feature information is determined by each interaction device according to the device interaction information, determines a device response result according to the first interaction feature information and each second interaction feature information, and controls the response of the current device to the device interaction information according to the device response result.
[0245] Among them, the embodiment of the present application generates the first interaction feature information by itself and receives the second interaction feature information of other interaction devices, and determines the device response result according to the first interaction feature information and each second interaction feature information, and then controls the response of the current device according to the device response result, so as to determine whether the current device is suitable for response according to the interaction feature information of each device, and realize control of whether the current device responds to the device interaction information.
[0246] Among them, each device compares its own interaction feature information with the interaction feature information received from other devices and performs response control, thereby realizing the screening of response devices in multiple device scenarios. While reducing the number of response devices and reducing resource waste, it can also screen out devices that meet user expectations based on the interaction feature information, thereby improving the interaction experience.
[0247] Among them, since the current device and at least one of the interactive devices can be unconfigured devices, the response device screening scheme in the multi-device scenario of the embodiment of the present application is suitable for the screening of unconfigured devices, that is, the devices finally screened for response can be configured devices or unconfigured devices, which improves the diversity of device processing. The screening with more devices involved also makes it easier to screen out devices that meet user interaction needs, thereby improving the interaction experience.
[0248] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0249] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0250] To this end, the present application provides a computer-readable storage medium, on which a computer program is stored. The computer program can be loaded by a processor to execute the steps in any device control method provided in the present application.
[0251] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0252] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0253] Since the instructions stored in the computer-readable storage medium can execute the steps in any device control method provided in the present application, the beneficial effects that can be achieved by any device control method provided in the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.
[0254] The above is a detailed introduction to a device control method, apparatus, electronic device and computer-readable storage medium provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for technical personnel in this field, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
[0255] It should be noted that in the specific implementation of the present application, related data such as user identification, device physical address, device interaction information (voice information), time information, interaction feature information (sound pressure value or signal-to-noise ratio), device networking status, and router service set identification are involved. When the above embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.
Claims
1. A device control method, characterized in that: Applied to the current device, the method includes: If device interaction information is detected, determining first interaction feature information corresponding to the device interaction information; broadcasting the first interaction characteristic information to at least one interaction device within a communication range, and receiving second interaction characteristic information broadcasted by each of the interaction devices, wherein each of the second interaction characteristic information is determined by each of the interaction devices according to the device interaction information; Determine a device response result according to the first interaction feature information and each of the second interaction feature information; Controlling the response of the current device to the device interaction information according to the device response result; Among them, at least one device among the current device and each of the interactive devices is an unconfigured network device.
2. The device control method according to claim 1, characterized in that: The device response result includes responding to the device interaction information or not affecting the device interaction information, and controlling the response of the current device to the device interaction information according to the device response result includes: If the device response result is a response to the device interaction information, responding to the device interaction information according to the device response result; If the device response result is not responding to the device interaction information, the current device is kept in a current state, wherein being in the current state indicates that the current device does not respond to the device interaction information.
3. The device control method according to claim 1, characterized in that: The determining a device response result according to the first interaction feature information and each of the second interaction feature information includes: Determine first detection time information corresponding to the first interaction feature information, and determine second detection time information corresponding to each of the second interaction feature information; Determine the earliest target detection time information at which the device interaction information is detected from the first detection time information and each of the second detection time information; The target detection time information is used as the starting time information, and a device response result is determined according to the first interaction feature information and each of the second interaction feature information according to a first preset time length.
4. The device control method according to claim 3, characterized in that: The device interaction information includes voice wake-up information, and determining a device response result according to the first interaction feature information and each of the second interaction feature information includes: extracting a first sound pressure value from the first interactive feature information, and extracting a second sound pressure value from the second interactive feature information, and determining a device response result according to the first sound pressure value and each of the second sound pressure values; and / or, A first signal-to-noise ratio value is extracted from the first interaction feature information, and a second signal-to-noise ratio value is extracted from the second interaction feature information, and a device response result is determined according to the first signal-to-noise ratio value and each of the second signal-to-noise ratio values.
5. The device control method according to claim 4, characterized in that: The determining of a device response result according to the first sound pressure value and each of the second sound pressure values includes: If the first sound pressure value is greater than each of the second sound pressure values, setting the response to the device interaction information as the device response result; If the first sound pressure value is less than any one of the second sound pressure values, setting the non-response to the device interaction information as the device response result; If the first sound pressure value is equal to the maximum value of the second sound pressure values, the second physical address of the interactive device corresponding to the first physical address of the current device and the maximum value is obtained, and the device response result is determined according to the first physical address and the second physical address.
6. The device control method according to claim 1, characterized in that: Before broadcasting the first interaction feature information to at least one interaction device within the communication range and receiving the second interaction feature information broadcast by each interaction device, the method further includes: In response to the detection instruction, broadcasting first detection request information to at least one interactive device within the communication range, wherein the interactive device includes a network-configured device or an unconfigured device; Determining detection result information for the first detection request information; Determine target synchronization information according to the detection result information, wherein the current device and each of the interactive devices communicate through the target synchronization information; The broadcasting of the first interaction feature information to at least one interaction device within a communication range, and receiving the second interaction feature information broadcast by each of the interaction devices, comprises: The first interaction feature information is broadcast to at least one interaction device within a communication range through the target channel information in the target synchronization information, and the second interaction feature information broadcast by each of the interaction devices is received through the target channel information.
7. The device control method according to claim 6, characterized in that: The determining target synchronization information according to the detection result information includes: If the detection result information indicates that first detection response information fed back by a first target interaction device in the at least one interaction device for the first detection request information is received, then the target synchronization information is extracted from the first detection response information; If the detection result information indicates that the first detection response information for the first detection request information has not been fed back by any of the at least one interactive device, target synchronization information is generated according to the networking status of the current device. At the same time, conflict detection request information is broadcast to the at least one interactive device, and detection result information for the conflict detection request information is determined, and the target synchronization information is updated according to the detection result information.
8. The device control method according to claim 7, characterized in that: The updating of the target synchronization information according to the detection result information includes: If the detection result information indicates that conflict detection response information fed back by a second target interaction device in the at least one interaction device for the conflict detection request information is detected, determining a priority comparison result between the current device and the second target interaction device according to the conflict detection response information; If the priority comparison result indicates that the priority of the current device is higher, the target synchronization information generated according to the default communication channel information is kept unchanged; If the priority comparison result indicates that the priority of the current device is lower, extracting peer synchronization information from the conflict detection response information, and updating the target synchronization information according to the peer synchronization information; If the detection result information indicates that the conflict detection response information fed back by any interactive device among the at least one interactive device for the conflict detection request information is not detected, the target synchronization information generated according to the default communication channel information is kept unchanged.
9. The device control method according to claim 7, characterized in that: The generating target synchronization information according to the networking status of the current device includes: If the networking state of the current device is unconnected, generating target synchronization information according to the default communication channel information of the current device; If the networking status of the current device is that the network is already configured, the target synchronization information is generated according to the communication channel of the router to which the current device is connected.
10. The device control method according to claim 7, characterized in that: After generating the target synchronization information according to the networking status of the current device, the method further includes: If the current device is a network-connected device, and the router to which the current device is connected switches the communication channel to another communication channel, the current device is also switched to the other communication channel, wherein each interactive device scans and switches to the other communication channel of the router.
11. The device control method according to claim 7, characterized in that: After updating the target synchronization information according to the detection result information, the method further includes: If second detection request information broadcasted by a third target interaction device among the at least one interaction device is received, extracting communication channel information from the second detection request information; If the communication channel information is inconsistent with the default communication channel information of the current device, canceling the reply to the second detection request information; If the communication channel information is consistent with the default communication channel information of the current device, generating a second probe response information for the probe request information, and sending the second probe response information to the third target interaction device, wherein the third target interaction device communicates according to the target synchronization information in the second probe response information; Among them, the third target interactive device includes an interactive device that is powered on again after power failure, or an interactive device whose network-connected and connected router is replaced, or an interactive device whose service set identifier of a network-connected and connected router is changed, or an interactive device that is powered on again after power failure, or an interactive device that is re-networked.
12. The device control method according to claim 6, characterized in that: The detection instruction is generated by the current device after turning on the multi-device interaction switch, or after the current device becomes an initial device, wherein the initial device refers to a device that cannot receive the target synchronization information broadcast by the interactive device.
13. A device control device, characterized in that: Applied to the current device, the device includes: A detection module, configured to determine first interaction feature information corresponding to the device interaction information if device interaction information is detected; a communication module, configured to broadcast the first interaction characteristic information to at least one interaction device within a communication range, and receive second interaction characteristic information broadcast by each of the interaction devices, wherein each of the second interaction characteristic information is determined by each of the interaction devices according to the device interaction information; a determination module, configured to determine a device response result according to the first interaction feature information and each of the second interaction feature information; A control module, used for controlling the response of the current device to the device interaction information according to the device response result; Among them, at least one device among the current device and each of the interactive devices is an unconfigured network device.
14. An electronic device, characterized in that: The device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps in the device control method according to any one of claims 1 to 12 when executing the computer program.
15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the device control method according to any one of claims 1 to 12 are implemented.
Citation Information
Cited By
Device control method and apparatus, electronic device, and computer-readable storage medium
WO2026051564A1