Device wake-up method and apparatus, electronic device, and medium
By detecting the spatial consistency between users and devices in smart home devices, wake-up requests are only generated for devices in the same spatial location, optimizing network transmission, solving the problem of slow response speed for multiple device wake-up, and improving user experience.
Patent Information
- Application Number
- CN202210268030.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-17
- Publication Date
- 2025-12-26
- Estimated Expiration
- 2042-03-17
AI Technical Summary
In home environments with multiple smart devices, voice wake-up suffers from slow response times and long network transmission latency, resulting in a poor user experience.
By detecting whether the user's spatial location is the same as that of the target smart device, a wake-up request is generated only for devices in the same spatial location. Sound wave signals are used to sense other devices. The server determines the wake-up result based on the wake-up request and the sensing result, reducing the number of devices sending wake-up requests at the same time and optimizing network transmission.
It improves the wake-up response speed of smart devices, reduces the transmission latency of wake-up requests, and enhances the user experience.
Smart Images

Figure CN114639383B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of communication, and particularly relates to a device wake-up method and device, an electronic device and a medium. BACKGROUND
[0002] With the development of artificial intelligence technology and the increasing maturity of 5G technology, more and more smart devices are landing in the home environment, and the scene of having multiple smart devices in the home environment is already very common. Voice wake-up is the entrance of smart interaction, and multiple smart devices face the problem of multiple wake-up responses. When all devices compete for response to the user's voice instruction, it will cause a very bad user experience. In order to provide a good user experience, no matter how many smart devices are in the home environment, only one device needs to respond to the user's demand in the end.
[0003] In the related art, when the user's voice is woken up, the smart device has the problem of slow response speed. SUMMARY
[0004] In order to overcome the problems in the related art, the present disclosure provides a device wake-up method, device, electronic device and medium.
[0005] According to a first aspect of an embodiment of the present disclosure, a device wake-up method is provided, applied to multiple smart devices included in a smart home device, and the method comprises:
[0006] In response to the target smart device detecting a wake-up word, determining whether a first space position where a user is located and a second space position where the target smart device is located are the same space position, wherein the first space position is obtained from data representing the space position where the user is located and sent to the target smart device by a server;
[0007] If the first space position and the second space position are the same space position, the target smart device generates a wake-up request and sends it to the server, and the wake-up request includes the sound energy of the wake-up word detected by the target smart device;
[0008] The target smart device receives a wake-up result fed back by the server, and the wake-up result includes performing wake-up or suppressing wake-up;
[0009] The target smart device performs a wake-up operation corresponding to the wake-up result.
[0010] Optionally, the method further comprises:
[0011] If the first space position and the second space position are different space positions, the wake-up request is suppressed from being generated.
[0012] Optionally, the method further comprises:
[0013] The target intelligent device transmits a first sound wave signal, the first sound wave signal being used to perceive whether other target intelligent devices capable of sound wave communication are included in the second spatial position;
[0014] The target intelligent device obtains a perception result according to the first sound wave signal;
[0015] The perception result is sent to the server, so that the server determines the wake-up result according to the wake-up request and the perception result.
[0016] Optionally, the target intelligent device is a preset device used to detect a positional relationship between a user and the second spatial position;
[0017] The method further comprises:
[0018] The target intelligent device transmits a second sound wave signal;
[0019] The target intelligent device receives a third sound wave signal after reflection of the second sound wave signal;
[0020] The target intelligent device determines the positional relationship according to a transmission frequency of the second sound wave signal and a reception frequency of the third sound wave signal, wherein the positional relationship includes that the user is away from the second spatial position or the user enters the second spatial position;
[0021] The positional relationship is reported to the server, so that the server determines the first spatial position according to the positional relationship.
[0022] Optionally, in a case where the second spatial position includes multiple second spatial positions, frequencies of the second sound wave signals transmitted by the target intelligent devices in different second spatial positions are different.
[0023] Optionally, the determination of whether the first spatial position in which the user is located and the second spatial position in which the target intelligent device is located are the same spatial position comprises:
[0024] The target intelligent device determines consistency between a first identifier of the first spatial position and a second identifier of the second spatial position stored in the target intelligent device;
[0025] If the consistency is consistent, it is determined that the first spatial position and the second spatial position are the same spatial position;
[0026] If the consistency is inconsistent, it is determined that the first spatial position and the second spatial position are different spatial positions.
[0027] According to a second aspect of the embodiments of the present disclosure, a device wake-up method applied to a server is provided, and the method comprises the following steps:
[0028] obtaining a wake-up request, the wake-up request being sent by a first smart device located in a target space position, and comprising sound energy indicating a wake-up word detected by the first smart device, the target space position being a space position in which a user is located and stored on the first smart device, and the first smart device being one of a plurality of smart devices included in a smart home device;
[0029] determining, according to the wake-up request, a wake-up result sent to the first smart device, the wake-up result comprising execution of wake-up or suppression of wake-up;
[0030] sending the wake-up result to the first smart device located in the target space position.
[0031] Optionally, the method further comprises the following steps:
[0032] obtaining a position relationship between a user and a device space position, the position relationship being sent by a second smart device, the second smart device being a device included in the smart home device and used to detect the position relationship between the user and the device space position, the device space position being a space position in which the second smart device is located, and the position relationship comprising that the user is away from the device space position or the user enters the device space position;
[0033] determining the target space position according to the position relationship;
[0034] issuing data representing the target space position to a smart device included in the smart home device.
[0035] Optionally, the device space position is a plurality of device space positions including at least a first device space position, and the step of determining the target space position according to the position relationship comprises the following steps:
[0036] if the position relationship comprises that the user is away from the first device space position and does not enter other device space positions, determining that the target position space is the first device space position;
[0037] if the position relationship comprises that the user is away from the first device space position and enters other device space positions, determining that the user position space is the other device space position.
[0038] Optionally, the step of determining, according to the wake-up request, the wake-up result sent to the first smart device comprises the following steps:
[0039] obtain a perception result sent by a third smart device as a reporting party in the target spatial position, indicating whether the third smart device perceives that the target spatial position includes another smart device capable of communicating with a sound wave;
[0040] determine the wake-up result according to the perception result and the wake-up request;
[0041] If the perception result does not include the other smart device, determine the wake-up result of performing wake-up according to the perception result and the wake-up request.
[0042] If the perception result includes the other smart device, determine the wake-up result according to the sound energy of the wake-up word in the wake-up request sent by the first smart device and the other smart device.
[0043] According to a third aspect of the embodiments of the present disclosure, an apparatus for device wake-up is provided, which is applied to a plurality of smart devices included in a smart home device, and the apparatus comprises:
[0044] A determination module is configured to determine whether a first spatial position where a user is located and a second spatial position where a target smart device is located are the same spatial position in response to the target smart device detecting a wake-up word, wherein the first spatial position is obtained from data representing the spatial position where the user is located and sent to the target smart device by a server.
[0045] A generation module is configured to control the target smart device to generate a wake-up request and send it to the server if the first spatial position and the second spatial position are the same spatial position, wherein the wake-up request includes sound energy of the wake-up word detected by the target smart device.
[0046] A receiving module is configured to control the target smart device to receive a wake-up result fed back by the server, wherein the wake-up result includes performing wake-up or suppressing wake-up.
[0047] An execution module is configured to control the target smart device to perform a wake-up operation corresponding to the wake-up result.
[0048] Optionally, the generation module is further configured to:
[0049] If the first spatial position and the second spatial position are different spatial positions, suppress generating the wake-up request.
[0050] Optionally, the apparatus further comprises:
[0051] The perception module is configured to control the target intelligent device to emit a first sound wave signal, and the first sound wave signal is used to perceive whether other target intelligent devices capable of communicating with the target intelligent device by sound waves are included in the second space position.
[0052] The target intelligent device obtains a perception result according to the first sound wave signal.
[0053] The perception result is sent to the server, and the server determines the wake-up result according to the wake-up request and the perception result.
[0054] Optionally, the target intelligent device is a preset device used to detect a positional relationship between a user and the second space position.
[0055] The apparatus further includes:
[0056] The determination module is configured to control the target intelligent device to emit a second sound wave signal.
[0057] The target intelligent device receives a third sound wave signal reflected by the second sound wave signal.
[0058] The target intelligent device determines the positional relationship according to an emission frequency of the second sound wave signal and a receiving frequency of the third sound wave signal, and the positional relationship includes that the user is away from the second space position or the user enters the second space position.
[0059] The positional relationship is reported to the server, and the server determines the first space position according to the positional relationship.
[0060] Optionally, in a case where the second space position includes multiple second space positions, frequencies of the second sound wave signals emitted by the target intelligent devices in different second space positions are different.
[0061] Optionally, the determination module determines whether the first space position where the user is located and the second space position where the target intelligent device is located are the same space position in the following manner:
[0062] The target intelligent device determines consistency between a first identifier of the first space position and a second identifier of the second space position.
[0063] If the consistency is consistent, it is determined that the first space position and the second space position are the same space position.
[0064] If the consistency is inconsistent, it is determined that the first space position and the second space position are different space positions.
[0065] According to a fourth aspect of the embodiments of the present disclosure, an apparatus for device wake-up is provided, applied to a server, and the apparatus comprises:
[0066] an obtaining module, configured to obtain a wake-up request, the wake-up request being sent by a first smart device located in a target space position, and comprising sound energy of a wake-up word detected by the first smart device, the target space position being a space position in which a user is located and stored on the first smart device, and the first smart device being one of a plurality of smart devices included in a smart home device;
[0067] a processing module, configured to determine, according to the wake-up request, a wake-up result sent to the first smart device, the wake-up result comprising execution of wake-up or suppression of wake-up;
[0068] a sending module, configured to send the wake-up result to the first smart device located in the target space position.
[0069] Optionally, the obtaining module is further configured to:
[0070] obtain a position relationship between a user and a device space position, the device being a second smart device included in the smart home device and used to detect the position relationship between the user and the device space position, the device space position being a space position in which the second smart device is located, and the position relationship comprising that the user is away from the device space position or that the user enters the device space position;
[0071] determine the target space position according to the position relationship;
[0072] issue data representing the target space position to a smart device included in the smart home device.
[0073] Optionally, the device space position is a plurality of device space positions including at least a first device space position, and the obtaining module determines the target space position according to the position relationship in the following manner:
[0074] if the position relationship comprises that the user is away from the first device space position and has not entered other device space positions, the target space position is determined as the first device space position;
[0075] if the position relationship comprises that the user is away from the first device space position and enters other device space positions, the user position space is determined as the other device space position.
[0076] Optionally, the processing module determines the wake-up result sent to the first smart device according to the wake-up request in the following manner:
[0077] obtain a perception result, the perception result being sent by a third intelligent device as a reporter in the target spatial position, and indicating whether the third intelligent device perceives that the target spatial position includes another intelligent device capable of communicating with a sound wave;
[0078] determine the wake-up result according to the perception result and the wake-up request;
[0079] If the perception result does not include the other intelligent device, determine the wake-up result of performing wake-up according to the perception result and the wake-up request.
[0080] If the perception result includes the other intelligent device, determine the wake-up result according to the sound energy of the wake-up word in the wake-up request sent by the first intelligent device and the other intelligent device.
[0081] According to a fifth aspect of the embodiments of the present disclosure, an electronic device is provided, comprising:
[0082] a memory having a computer program stored thereon;
[0083] a processor configured to execute the computer program in the memory to implement the steps of the device wake-up method provided in the first aspect of the present disclosure.
[0084] According to a sixth aspect of the embodiments of the present disclosure, an electronic device is provided, comprising:
[0085] a memory having a computer program stored thereon;
[0086] a processor configured to execute the computer program in the memory to implement the steps of the device wake-up method provided in the second aspect of the present disclosure.
[0087] According to a seventh aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, having computer program instructions stored thereon, the program instructions being executed by a processor to implement the steps of the device wake-up method provided in the first aspect of the present disclosure.
[0088] According to an eighth aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, having computer program instructions stored thereon, the program instructions being executed by a processor to implement the steps of the device wake-up method provided in the second aspect of the present disclosure.
[0089] The technical solutions provided by the embodiments of the present disclosure can include the following beneficial effects:
[0090] In response to the target smart device detecting the wake-up word, by comparing the first space position where the user is located and the second space position where the target smart device is located, it is determined whether the first space position and the second space position are the same space position. If the first space position and the second space position are the same space position, the target smart device generates a wake-up request and sends it to the server. The wake-up request includes the sound energy of the wake-up word detected by the target smart device. In this way, the server can only process the wake-up request sent by one or more target smart devices included in the second space position. The server processing time is fast, and because the number of smart devices sending the wake-up request to the server at the same time period is reduced, the transmission delay of the wake-up request is reduced, and the wake-up response speed of the target smart device is improved.
[0091] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS
[0092] The accompanying drawings, which are incorporated into the specification and constitute part of it, illustrate embodiments consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure.
[0093] Figure 1 is a flowchart of a device wake-up method according to an exemplary embodiment.
[0094] Figure 2 is a flowchart of a device wake-up method according to an exemplary embodiment.
[0095] Figure 3 is an interaction flowchart of a device wake-up method according to an exemplary embodiment.
[0096] Figure 4 is a device wake-up method application scenario schematic diagram according to an exemplary embodiment.
[0097] Figure 5 is a block diagram of a device wake-up apparatus according to an exemplary embodiment.
[0098] Figure 6 is a block diagram of a device wake-up apparatus according to an exemplary embodiment.
[0099] Figure 7 is a block diagram of an electronic device according to an exemplary embodiment.
[0100] Figure 8 is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION
[0101] The exemplary embodiments will be described in detail herein with reference to the attached drawings. In the following description, like reference numerals refer to like elements throughout the description. The following exemplary embodiments described herein represent the best attempts at providing embodiments in conformity with the present disclosure. They are not intended to represent that all embodiments in conformity with the present disclosure are exhausted.
[0102] In the related art, in the application scenario of voice wake-up, after a user shouts a wake-up word, multiple smart devices included in a smart home device all detect the wake-up word, generate a wake-up request according to the wake-up word, and send the wake-up request carrying the sound energy of the wake-up word to a server. The server acquires the wake-up requests sent by all the smart devices included in the smart home device, determines a wake-up result for each smart device according to the sound energy of the wake-up word in the wake-up request sent by each smart device, and sends the wake-up result to the corresponding smart device, so that the smart device performs a wake-up operation or suppresses a wake-up operation.
[0103] However, the inventors of the present disclosure found that the scheme in the related art has the following problems in the process of implementing the technical scheme of the present disclosure. First, because different smart devices detect the wake-up word at different times, and different smart devices send the wake-up request carrying the sound energy of the wake-up word to the server at different times, the server can only determine the wake-up result for each smart device after receiving the wake-up requests of all the smart devices. The server has a long waiting time, which reduces the wake-up response speed of the smart device.
[0104] Second, because the smart devices that detect the wake-up word send the wake-up request to the server at the same time period, they occupy the network transmission channel such as WiFi, increase the transmission delay of the wake-up request, and also reduce the wake-up response speed of the smart device.
[0105] Therefore, the present disclosure provides a device wake-up method. In the device wake-up method of the present disclosure, in response to a target smart device detecting a wake-up word, by comparing a first spatial position where a user is located and a second spatial position where the target smart device is located, it is determined whether the first spatial position and the second spatial position are the same spatial position. If the first spatial position and the second spatial position are the same spatial position, the target smart device generates a wake-up request and sends it to a server. The wake-up request includes the sound energy of the wake-up word detected by the target smart device. In this way, the server can only process the wake-up request sent by one or more target smart devices in the second spatial position. The server processing time is fast, and because the number of smart devices sending the wake-up request to the server at the same time period is reduced, the transmission delay of the wake-up request is reduced, and the wake-up response speed of the target smart device is improved.
[0106] Figure 1 is a flowchart of a device wake-up method according to an exemplary embodiment, as Figure 1 As shown, the device wake-up method is applied to multiple smart devices included in a smart home device, and includes the following steps.
[0107] In step S11, in response to the target smart device detecting a wake-up word, it is determined whether a first spatial position where a user is located and a second spatial position where the target smart device is located are the same spatial position.
[0108] The first spatial position is obtained from data representing the spatial position where the user is located, which is issued by a server to the target smart device.
[0109] It can be understood that, in the case where there is no user in the second spatial position where the target smart device is located, the user has no intention to wake up the target smart device. In the case where there is a user in the second spatial position where the target smart device is located, the user can have the intention to wake up the target smart device.
[0110] Therefore, after the target smart device detects the wake-up word, it is necessary to determine whether the first spatial position where the user is located and the second spatial position where the target smart device is located are the same spatial position.
[0111] If the first spatial position and the second spatial position are the same spatial position, the target smart device generates a wake-up request and sends it to the server. If the first spatial position and the second spatial position are different spatial positions, the generation of the wake-up request is suppressed.
[0112] In addition, in an embodiment, the device wake-up method further includes: the target smart device emitting a first sound wave signal, the first sound wave signal being used to perceive whether other target smart devices capable of sound wave communication are included in the second spatial position. The target smart device obtains a perception result according to the first sound wave signal, and sends the perception result to the server, so that a wake-up result is determined by the server according to the wake-up request and the perception result.
[0113] The sound wave signal may, for example, be an ultrasonic signal. For example, a smart television and a smart speaker included in a smart home device are in a living room, and a smart air conditioner and a smart alarm clock are in a master bedroom, so that the smart devices perceive each other through ultrasonic communication. For example, the smart speaker sends an ultrasonic signal that can only be received by the smart television, and the smart air conditioner and the smart alarm clock cannot receive it due to the blocking of a wall, so that the smart television knows that the smart speaker and itself are in the same sub-space, and the smart air conditioner and the smart alarm clock know that they are in the same sub-space. Each smart device perceives in turn, and thus can ultimately divide the sub-spaces where all smart devices are located.
[0114] In addition, the present disclosure can determine the first spatial position where the user is located based on the following idea:
[0115] If the user leaves the current space position but no other space position is detected, the user does not leave the current space position; if the user leaves space position A and space position B detects the user, the user is in space position B.
[0116] Further, in the present disclosure, a device for detecting the positional relationship between the user and the second space position can be pre-set in each space position, and the device is used to determine the position of the user.
[0117] For example, the target intelligent device in the present disclosure is a pre-set device for detecting the positional relationship between the user and the second space position;
[0118] According to the Doppler effect, when the user is far away from the target intelligent device, the emission frequency of the sound wave signal emitted by the target intelligent device is higher than the reception frequency of the sound wave signal received; when the user is close to the target intelligent device, the emission frequency of the sound wave signal emitted is lower than the reception frequency of the sound wave signal received. Thus, based on the Doppler effect, in an embodiment, the device wake-up method further comprises:
[0119] The target intelligent device emits a second sound wave signal; the target intelligent device receives a third sound wave signal reflected by the second sound wave signal; the target intelligent device determines the positional relationship according to the emission frequency of the second sound wave signal and the reception frequency of the third sound wave signal, wherein the positional relationship includes that the user is far away from the second space position or the user enters the second space position; and the target intelligent device reports the positional relationship to the server, so that the server determines the first space position of the user according to the positional relationship.
[0120] Further, in order to avoid interference of the sound wave frequency band, each sub-space can be allocated a different sound wave frequency band, and thus the frequency of the second sound wave signal emitted by the target intelligent device in different second space positions is different.
[0121] In step S12, if the first space position and the second space position are the same space position, the target intelligent device generates a wake-up request and sends it to the server.
[0122] The wake-up request includes the sound energy of the wake-up word detected by the target intelligent device.
[0123] In an embodiment, whether the first space position where the user is located and the second space position where the target intelligent device is located are the same space position can be determined, for example, by the following method:
[0124] The target intelligent device determines consistency between a first identifier of the first space position where the user is located and a second identifier of the second space position where the target intelligent device is located. If the consistency is determined, the first space position and the second space position are determined as the same space position. If the consistency is not determined, the first space position and the second space position are determined as different space positions.
[0125] In step S13, the target intelligent device receives the wake-up result fed back by the server, and the wake-up result includes performing wake-up or inhibiting wake-up.
[0126] Since the sub-space between the intelligent devices is determined, that is, all the target intelligent devices included in the second space position are determined, if the second space position where the target intelligent device is located and the first space position where the user is located are the same space position, it indicates that all the target intelligent devices in the second space position will generate a wake-up request according to the detected wake-up word, and send the wake-up request including the sound energy of the detected wake-up word to the server. The server determines which target intelligent device performs the wake-up operation and other target intelligent devices perform the wake-up inhibition operation according to the sound energy of the wake-up word sent by each target intelligent device included in the second space position.
[0127] In step S14, the target intelligent device performs the wake-up operation corresponding to the wake-up result.
[0128] In the example embodiment of the present disclosure, in response to the target intelligent device detecting the wake-up word, by comparing the first space position where the user is located and the second space position where the target intelligent device is located, it is determined whether the first space position and the second space position are the same space position. If the first space position and the second space position are the same space position, the target intelligent device generates a wake-up request and sends it to the server. The wake-up request includes the sound energy of the wake-up word detected by the target intelligent device. In this way, the server can only process the wake-up request sent by one or more target intelligent devices included in the second space position. The server processing time is fast, and since the number of intelligent devices sending the wake-up request to the server at the same time period is reduced, the transmission delay of the wake-up request is reduced, and the wake-up response speed of the target intelligent device is improved.
[0129] Figure 2 is a flowchart of a device wake-up method according to an example embodiment, as shown in Figure 2 The device wake-up method is applied to a server and includes the following steps.
[0130] In step S21, a wake-up request is obtained, and the wake-up request is sent by a first intelligent device located in a target space position and includes sound energy of a wake-up word detected by the first intelligent device.
[0131] The target space position is a space position in which the user is located and is stored in the first smart device.
[0132] In an embodiment, the device wake-up method further comprises: obtaining a position relationship between the user and the device space position sent by the second smart device. According to the position relationship, the target space position is determined, and data representing the target space position is issued to the smart device included in the smart home device.
[0133] The second smart device is a device included in the smart home device and used to detect the position relationship between the user and the device space position. The device space position is a space position in which the second smart device is located. The position relationship includes that the user is away from the device space position or that the user enters the device space position.
[0134] The device space position includes at least the first device space position. According to the position relationship, the target space position is determined, which includes:
[0135] If the position relationship includes that the user is away from the first device space position and does not enter other device space positions, the target space position is determined as the first device space position. If the position relationship includes that the user is away from the first device space position and enters other device space positions, the user space position is determined as the other device space position.
[0136] In step S22, according to the wake-up request, a wake-up result sent to the first smart device is determined. The wake-up result includes performing wake-up or suppressing wake-up.
[0137] In an embodiment, according to the wake-up request, the wake-up result sent to the first smart device can be determined, for example, by the following method:
[0138] The perception result is sent by a third smart device as a reporting party in the target space position and indicates whether the third smart device perceives that other smart devices capable of communicating with it by sound waves are included in the target space position. According to the perception result and the wake-up request, the wake-up result is determined.
[0139] If the perception result does not include other smart devices, the wake-up result of performing wake-up is determined according to the perception result and the wake-up request. If the perception result includes other smart devices, the wake-up result is determined according to the sound energy of the wake-up word in the wake-up request sent by the first smart device and the other smart devices.
[0140] The sound energy of the wake-up word can be determined, for example, by the following method:
[0141] The target smart device detects the wake-up word through a VAD (Voice Activity Detection) algorithm, and obtains the length of the wake-up word as T frames. The sound energy of the wake-up word can be determined through the following formula:
[0142]
[0143] In formula (1), E n represents the average energy of the wake-up word voice signal collected by the nth target smart device, x n (t) represents the time-domain voice signal collected by the nth first electronic device at time t.
[0144] All first smart devices send the sound energy of the wake-up word to the server. After the server receives the sound energy of the wake-up word sent by all first smart devices in the space where the user is located, the maximum energy E max = max (E1, E2, … E n ) is calculated, and it is decided which first smart device in the subspace should respond to the wake-up operation. The server sends the wake-up result including the execution of the wake-up to the corresponding first smart device, and sends the wake-up result suppressing the wake-up to other first smart devices.
[0145] In step S23, the wake-up result is sent to the first smart device located in the target space position.
[0146] In the example embodiment of the present disclosure, the wake-up request is obtained, which is sent by the first smart device located in the target space position and includes the sound energy of the wake-up word detected by the first smart device. The target space position is the space position where the user is located and is stored on the first smart device. The first smart device is one of the plurality of smart devices included in the smart home device. In this way, the server can only process the wake-up request sent by one or more first smart devices in the target space position. The server processing time is fast, and because the number of smart devices sending the wake-up request to the server at the same time period is reduced, the transmission delay of the wake-up request is reduced, and the wake-up response speed of the target smart device is improved.
[0147] Figure 3 is an interaction flowchart of a device wake-up method according to an example embodiment, as shown in Figure 3 The device wake-up method includes the following steps.
[0148] In step S31, in response to the target smart device detecting the wake-up word, the target smart device determines whether the first space position where the user is located and the second space position where the target smart device is located are the same space position.
[0149] In step S32, the target smart device determines that the first spatial position and the second spatial position are the same spatial position, and the target smart device generates a wake-up request.
[0150] In step S33, the wake-up request is sent to the server.
[0151] In step S34, the server acquires the wake-up request.
[0152] In step S35, according to the wake-up request, a wake-up result sent to the target smart device is determined, and the wake-up result includes performing wake-up or suppressing wake-up.
[0153] In step S36, the wake-up result is sent to the target smart device.
[0154] In step S37, the target smart device receives the wake-up result fed back by the server.
[0155] In step S38, the target smart device performs a wake-up operation corresponding to the wake-up result.
[0156] Figure 4 FIG. 1 is a schematic diagram of an application scenario of a device wake-up method according to an example embodiment.
[0157] In Figure 4 , the spatial positions in which the smart devices are located include spatial position I, spatial position II, and spatial position III.
[0158] In spatial position I, the smart devices can include a television 13 and a camera 14, in spatial position II, the smart devices can include an air conditioner 15 and an air purifier 16, and in spatial position III, the smart devices can include a rice cooker 11 and a refrigerator 12.
[0159] For example, in the case where the user is located in spatial position II, after the user speaks a wake-up word, the smart devices located in spatial position I and spatial position III determine that the spatial position in which the user is located and the spatial position II in which the smart devices are located are different spatial positions, and the smart devices located in spatial position I and spatial position III suppress generating a wake-up request.
[0160] The intelligent device located in the space position II determines that the space position where the user is located and the space position II where the intelligent device is located are the same space position, and the air conditioner 15 and the air purifier 16 located in the space position II generate wake-up requests respectively, and send the wake-up requests carrying the sound energy of the wake-up word to the server. After the server receives the wake-up requests of the air conditioner 15 and the air purifier 16 in the space position II, the server determines and sends the wake-up result to the air conditioner 15 and the air purifier 16 according to the sound energy of the wake-up word. After the air conditioner 15 and the air purifier 16 receive the wake-up result fed back by the server, the air conditioner 15 and the air purifier 16 perform the wake-up operation corresponding to the wake-up result.
[0161] Figure 5 is a block diagram of a device wake-up apparatus 500 according to an exemplary embodiment. The device wake-up apparatus is applied to a plurality of intelligent devices included in a smart home device, and the apparatus comprises:
[0162] A determination module 501 is configured to determine whether a first space position where a user is located and a second space position where a target intelligent device is located are the same space position in response to the target intelligent device detecting a wake-up word, wherein the first space position is obtained from data representing the space position where the user is located and sent to the target intelligent device by a server;
[0163] A generation module 502 is configured to control the target intelligent device to generate a wake-up request and send it to the server if the first space position and the second space position are the same space position, wherein the wake-up request comprises sound energy of the wake-up word detected by the target intelligent device;
[0164] A receiving module 503 is configured to control the target intelligent device to receive a wake-up result fed back by the server, wherein the wake-up result comprises performing wake-up or inhibiting wake-up;
[0165] An execution module 504 is configured to control the target intelligent device to perform a wake-up operation corresponding to the wake-up result.
[0166] Optionally, the generation module 502 is further configured to:
[0167] If the first space position and the second space position are different space positions, the generation of the wake-up request is inhibited.
[0168] Optionally, the apparatus further comprises:
[0169] A perception module is configured to control the target intelligent device to emit a first sound wave signal, wherein the first sound wave signal is used to perceive whether other target intelligent devices capable of communicating with sound waves are included in the second space position;
[0170] The target intelligent device obtains a sensing result according to the first sound wave signal.
[0171] The sensing result is sent to the server, so that the server determines the wake-up result according to the wake-up request and the sensing result.
[0172] Optionally, the target intelligent device is a preset device for detecting a positional relationship between a user and the second spatial position.
[0173] The device further includes:
[0174] A determination module for controlling the target intelligent device to emit a second sound wave signal.
[0175] The target intelligent device receives a third sound wave signal reflected by the second sound wave signal.
[0176] The target intelligent device determines the positional relationship according to an emission frequency of the second sound wave signal and a receiving frequency of the third sound wave signal, wherein the positional relationship includes that the user is away from the second spatial position or the user enters the second spatial position.
[0177] The positional relationship is reported to the server, so that the server determines the first spatial position according to the positional relationship.
[0178] Optionally, in a case where the second spatial position includes multiple second spatial positions, frequencies of the second sound wave signals emitted by the target intelligent devices in different second spatial positions are different.
[0179] Optionally, the determination module 501 determines whether the first spatial position where the user is located and the second spatial position where the target intelligent device is located are the same spatial position in the following manner:
[0180] The target intelligent device determines consistency between a first identifier of the first spatial position and a second identifier of the second spatial position.
[0181] If the consistency is consistent, it is determined that the first spatial position and the second spatial position are the same spatial position.
[0182] If the consistency is inconsistent, it is determined that the first spatial position and the second spatial position are different spatial positions.
[0183] Figure 6 is a block diagram of a device wake-up apparatus 600 according to an example embodiment. The device wake-up apparatus is applied to a server, and the apparatus includes:
[0184] The acquisition module 601 is configured to acquire a wake-up request, the wake-up request being sent by a first smart device located in a target space position, and including sound energy indicating a wake-up word detected by the first smart device, the target space position being a space position in which a user is located and stored on the first smart device, and the first smart device being one of a plurality of smart devices included in a smart home device;
[0185] The processing module 602 is configured to determine, according to the wake-up request, a wake-up result sent to the first smart device, the wake-up result including performing wake-up or inhibiting wake-up;
[0186] The sending module 603 is configured to send the wake-up result to the first smart device located in the target space position.
[0187] Optionally, the acquisition module 601 is further configured to:
[0188] acquire a position relationship between a user and a device space position, the second smart device being a device included in the smart home device and used to detect the position relationship between the user and the device space position, the device space position being a space position in which the second smart device is located, and the position relationship including that the user is away from the device space position or that the user enters the device space position;
[0189] determine the target space position according to the position relationship;
[0190] determine the target space position according to the position relationship;
[0191] Optionally, the device space position is a plurality of device space positions including at least a first device space position, and the acquisition module 601 determines the target space position according to the position relationship in the following manner:
[0192] if the position relationship includes that the user is away from the first device space position and has not entered other device space positions, the target position space is determined as the first device space position;
[0193] if the position relationship includes that the user is away from the first device space position and enters other device space positions, the user position space is determined as the other device space position.
[0194] Optionally, the processing module 602 determines the wake-up result sent to the first smart device according to the wake-up request in the following manner:
[0195] obtain a perception result, the perception result being sent by a third intelligent device as a reporting party in the target spatial position, and indicating whether the third intelligent device perceives that the target spatial position includes another intelligent device capable of communicating with it through a sound wave;
[0196] determine the wake-up result according to the perception result and the wake-up request;
[0197] If the perception result does not include the other intelligent device, determine the wake-up result of performing wake-up according to the perception result and the wake-up request.
[0198] If the perception result includes the other intelligent device, determine the wake-up result according to the sound energy of the wake-up word in the wake-up request sent by the first intelligent device and the other intelligent device.
[0199] As to the apparatus in the above embodiments, the specific manners in which the respective modules perform operations have been described in detail in the embodiments about the method, and thus will not be described in detail here.
[0200] The present disclosure also provides a computer-readable storage medium having stored thereon computer program instructions, which, when executed by a processor, implement the steps of the device wake-up method applied to the first electronic device provided by the present disclosure.
[0201] The present disclosure also provides a computer-readable storage medium having stored thereon computer program instructions, which, when executed by a processor, implement the steps of the device wake-up method applied to the second electronic device provided by the present disclosure.
[0202] Figure 7 is a block diagram of an electronic device 800 according to an example embodiment. The electronic device 800 can be, for example, a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
[0203] Referring to Figure 7 , the electronic device 800 can include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.
[0204] The processing component 802 generally controls the overall operations of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 can include one or more processors 820 to execute instructions to complete all or a part of steps of the device wake-up method described above for the first electronic device. In addition, the processing component 802 can include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
[0205] The memory 804 is configured to store various types of data to support operations of the electronic device 800. Examples of these data include instructions to execute any applications or methods operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 can be implemented by any type of volatile or non-volatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory, magnetic disc or optical disc.
[0206] The power component 806 provides power to various components of the electronic device 800. The power component 806 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 800.
[0207] The multimedia component 808 includes a screen providing an output interface between the electronic device 800 and a user. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense a touch, a slide, and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touching or a sliding action, but also detect duration and pressure related to the touching or sliding action. In some embodiments, the multimedia component 808 includes a front camera and / or a back camera. The front camera and / or the back camera can receive external multimedia data when the electronic device 800 is in an operating mode, such as a shooting mode or a video mode. Each of the front camera and the back camera can be a fixed optical lens system or have a focal length and optical zoom capability.
[0208] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC) that is configured to receive an external audio signal when the electronic device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.
[0209] The I / O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which can include a keypad, a click wheel, buttons, and so on. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.
[0210] The sensor component 814 includes one or more sensors for providing status assessments of various aspects of the electronic device 800. For example, the sensor component 814 can detect an open / closed position of the electronic device 800, relative positioning of components, such as a display and a keypad of the electronic device 800, a change of position of the electronic device 800 or a component of the electronic device 800, presence or absence of user contact with the electronic device 800, orientation or acceleration / deceleration of the electronic device 800, and temperature changes of the electronic device 800. The sensor component 814 can include an orientation sensor, an acceleration sensor, a proximity sensor, a gesture sensor, a gravity sensor, a biometric sensor, a temperature / humidity sensor, a light sensor, and an ultraviolet (UV) sensor, an electrical-nose (e-nose) sensor, or an electronic-tongue (e-tongue) sensor.
[0211] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a corresponding communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an example embodiment, the communication component 816 receives broadcast signals or broadcast-related information from an external broadcasting management system via a broadcast channel. In an example embodiment, the communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technology.
[0212] In an exemplary embodiment, the electronic device 800 can be implemented with one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic elements for performing the above-described device wake-up method applied to the first electronic device.
[0213] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 804 including instructions, is also provided, which can be executed by the processor 820 of the electronic device 800 to complete the above-described device wake-up method applied to the first electronic device. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.
[0214] In another exemplary embodiment, a computer program product including a computer program executable by a programmable device is also provided, which has code portions for performing the above-described device wake-up method applied to the first electronic device when executed by the programmable device.
[0215] Figure 8 is a block diagram of an electronic device 900 according to an exemplary embodiment. For example, the electronic device 900 can be provided as a server. Referring to Figure 8 , the electronic device 900 includes a processing component 922 further including one or more processors, and a memory resource represented by a memory 932 for storing instructions, such as application programs, executable by the processing component 922. The application programs stored in the memory 932 can include one or more than one module each corresponding to a set of instructions. In addition, the processing component 922 is configured to execute the instructions to perform the steps of the above-described device wake-up method applied to the first electronic device.
[0216] The electronic device 900 can further include a power component 926 configured to perform power management of the electronic device 900, a wired or wireless network interface 950 configured to connect the electronic device 900 to a network, and an input / output (I / O) interface 958. The electronic device 900 can operate based on an operating system stored in the memory 932, such as Windows Server TM , Mac OS X TM , Unix TM , Linux TM , FreeBSD TM or the like.
[0217] Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
[0218] It will be understood that the present disclosure is not limited to the precise structures hereinbefore described and illustrated in the drawings, and that various modifications and changes can be made without departing from its scope. The scope of the present disclosure is limited only by the claims that follow.
Claims
1. A device wake-up method, the method comprising: The method is applied to a plurality of smart devices included in a smart home device, and the method comprises: In response to a target smart device detecting a wake-up word, determining whether a first space position where a user is located and a second space position where the target smart device is located are the same space position, wherein the first space position is obtained from data representing the space position where the user is located and sent to the target smart device by a server; If the first space position and the second space position are the same space position, the target smart device generates a wake-up request and sends it to the server, wherein the wake-up request includes the sound energy of the wake-up word detected by the target smart device; The target smart device receives a wake-up result fed back by the server, wherein the wake-up result includes performing wake-up or suppressing wake-up; The target smart device performs a wake-up operation corresponding to the wake-up result; The target smart device is a preset device for detecting the positional relationship between the user and the second space position; The method further comprises: The target smart device emits a second sound wave signal; The target smart device receives a third sound wave signal reflected by the second sound wave signal; The target smart device determines the positional relationship according to the emission frequency of the second sound wave signal and the reception frequency of the third sound wave signal, wherein the positional relationship includes the user moving away from the second space position or the user entering the second space position; The positional relationship is reported to the server, so that the first space position is determined by the server according to the positional relationship.
2. The method of claim 1, wherein, The method further comprises: If the first space position and the second space position are different space positions, the wake-up request is suppressed.
3. The method of claim 1, wherein, The method further comprises: The target smart device emits a first sound wave signal, wherein the first sound wave signal is used to sense whether other target smart devices capable of communicating with sound waves are included in the second space position; The target smart device obtains a sensing result according to the first sound wave signal; The sensing result is sent to the server, so that the wake-up result is determined by the server according to the wake-up request and the sensing result.
4. The method of claim 3, wherein, In the case where the second space position includes a plurality of target smart devices, the frequency of the second sound wave signal emitted by the target smart device in different second space positions is different.
5. The method of claim 1, wherein, The determination of whether the first space position where the user is located and the second space position where the target smart device is located are the same space position comprises: The target smart device determines the consistency between a first identifier of the first space position and a second identifier of the second space position stored; If consistent, it is determined that the first space position and the second space position are the same space position; If inconsistent, it is determined that the first space position and the second space position are different space positions.
6. A device wake-up method, comprising: The method is applied to a server, and the method comprises: obtaining a wake-up request, the wake-up request being sent by a first smart device located in a target spatial position, and including sound energy of a wake-up word detected by the first smart device, the target spatial position being a spatial position where a user is located, and the first smart device being one of a plurality of smart devices included in a smart home device; determining a wake-up result sent to the first smart device according to the wake-up request, the wake-up result including performing wake-up or inhibiting wake-up; sending the wake-up result to the first smart device located in the target spatial position; wherein the method further comprises: obtaining a position relationship between a user and a device spatial position sent by a second smart device, the second smart device being a device included in the smart home device for detecting a position relationship between a user and the device spatial position, the device spatial position being a spatial position where the second smart device is located, and the position relationship including the user being away from the device spatial position or the user entering the device spatial position, wherein the first smart device transmits a second sound wave signal, receives a third sound wave signal reflected after the second sound wave signal, and determines the position relationship according to a transmission frequency of the second sound wave signal and a reception frequency of the third sound wave signal; determining the target spatial position according to the position relationship; downloading data representing the target spatial position to a smart device included in the smart home device.
7. The method of claim 6, wherein, The device spatial position is a plurality of device spatial positions including at least a first device spatial position, and the determining the target spatial position according to the position relationship comprises: if the position relationship includes the user being away from the first device spatial position and not entering other device spatial positions, determining the target spatial position as the first device spatial position; if the position relationship includes the user being away from the first device spatial position and entering other device spatial positions, determining the user spatial position as the other device spatial positions.
8. The method of claim 6, wherein, The determining the wake-up result sent to the first smart device according to the wake-up request comprises: obtaining a perception result sent by a third smart device as a reporting party in the target spatial position, the perception result indicating whether the third smart device perceives other smart devices capable of communicating with sound waves in the target spatial position; determining the wake-up result according to the perception result and the wake-up request; wherein if the perception result does not include the other smart devices, the wake-up result of performing wake-up is determined according to the perception result and the wake-up request; if the perception result includes the other smart devices, the wake-up result is determined according to sound energy of a wake-up word in a wake-up request sent by the first smart device and the other smart devices.
9. A device wake-up device, characterized in that, The device is applied to a plurality of smart devices included in a smart home device, and the device comprises: The determining module is configured to determine whether a first space position where a user is located and a second space position where the target smart device is located are a same space position in response to the target smart device detecting the wake-up word, wherein the first space position is obtained from data representing the space position where the user is located and sent by a server to the target smart device; The generating module is configured to control the target smart device to generate a wake-up request and send the wake-up request to the server if the first space position and the second space position are the same space position, wherein the wake-up request includes sound energy of the voice of the target smart device detecting the wake-up word; The receiving module is configured to control the target smart device to receive a wake-up result fed back by the server, wherein the wake-up result includes performing wake-up or inhibiting wake-up; The executing module is configured to control the target smart device to perform a wake-up operation corresponding to the wake-up result; The target smart device is a preset device for detecting a positional relationship between the user and the second space position; The device further includes: The determining position module is configured to control the target smart device to emit a second sound wave signal, receive a third sound wave signal reflected from the second sound wave signal, and determine the positional relationship according to an emission frequency of the second sound wave signal and a reception frequency of the third sound wave signal, wherein the positional relationship includes the user moving away from the second space position or the user entering the second space position, and the positional relationship is reported to the server so as to determine the first space position according to the positional relationship.
10. A device wake-up device, characterized in that, The device applied to a server includes: The obtaining module is configured to obtain a wake-up request, wherein the wake-up request is sent by a first smart device located in a target space position, includes sound energy of a voice of the first smart device detecting a wake-up word, and the target space position is a space position where a user is located and stored on the first smart device, and the first smart device is one of a plurality of smart devices included in a smart home device; The processing module is configured to determine a wake-up result sent to the first smart device according to the wake-up request, wherein the wake-up result includes performing wake-up or inhibiting wake-up; The sending module is configured to send the wake-up result to the first smart device located in the target space position; The obtaining module is further configured to: Obtain a positional relationship between a user and a device space position sent by a second smart device, wherein the second smart device is a device included in the smart home device and used to detect a positional relationship between the user and the device space position, the device space position is a space position where the second smart device is located, and the positional relationship includes the user moving away from the device space position or the user entering the device space position, wherein the first smart device emits a second sound wave signal, receives a third sound wave signal reflected from the second sound wave signal, and determines the positional relationship according to an emission frequency of the second sound wave signal and a reception frequency of the third sound wave signal; Determine the target space position according to the positional relationship; The data representing the target space position is issued to a smart device included in the smart home device.
11. An electronic device, comprising: The application relates to a method for determining a target space position in a smart home device. a memory having stored thereon computer programs; a processor configured to execute the computer programs in the memory to implement the steps of the method according to any one of claims 1 to 5, or to implement the steps of the method according to any one of claims 6 to 8.
12. A non-transitory computer-readable storage medium having stored thereon a computer program, characterized in that, The program, when executed by a processor, implements the steps of the method according to any one of claims 1 to 5, or to implement the steps of the method according to any one of claims 6 to 8.
Citation Information
Patent Citations
Distributed terminal control method, device, and equipment and storage medium
CN111538249A
Method and device for detecting target object, and sound box
CN111901721A