Equipment awakening method and device, electronic equipment and storage medium

Abstract

The invention provides a device awakening method and device, an electronic device and a storage medium, the method is applied to a home host, and the method comprises the following steps: receiving a plurality of voiceprint features and a plurality of sound description information sent by a plurality of intelligent devices within a preset duration, the home host being connected with the plurality of intelligent devices; selecting a target voiceprint feature corresponding to the target user from the plurality of voiceprint features through a pre-stored voiceprint feature library; selecting multiple pieces of sound description information corresponding to the target voiceprint feature from the multiple pieces of sound description information; scoring the multiple pieces of sound description information according to a preset scoring rule to obtain a response score of each piece of sound description information; and determining a target device from the plurality of intelligent devices according to the response score, and sending a wake-up instruction to the target device, so that the target device responds to the wake-up voice information according to the wake-up instruction. The data processing process is transferred from the intelligent device to the home host side, and the response efficiency is improved.

Description

Technical Field

[0001] The present invention belongs to the field of smart home technology, and in particular relates to a device wake-up method, device, electronic device and storage medium. Background Art

[0002] Currently, voice recognition in home appliances usually adopts a combination of local recognition and cloud recognition. Local recognition requires home appliances to store a large instruction model library, which is costly and takes up a lot of memory, affecting processing efficiency. When local recognition cannot match, the audio file will be uploaded to the cloud, converted into text information through the cloud server, and then the corresponding control commands will be extracted and sent to the device to control the device.

[0003] However, this will be affected by the network, and the response time for the command cannot be guaranteed. Therefore, how to reduce the processing operations on the home appliance side to improve the response efficiency has become an urgent problem to be solved. Summary of the invention

[0004] The embodiments of the present application provide a device wake-up method, apparatus, electronic device and storage medium to solve the technical problem of low response efficiency of household electrical appliances.

[0005] In a first aspect, the present application provides a device wake-up method, which is applied to a home host, and the method includes:

[0006] Receiving multiple voiceprint features and multiple sound description information sent by multiple smart devices within a preset time period, wherein the multiple voiceprint features and the multiple sound description information are obtained by the smart devices through feature extraction of wake-up voice information, and the home host is connected to the multiple smart devices respectively;

[0007] Selecting a target voiceprint feature corresponding to a target user from multiple voiceprint features through a pre-stored voiceprint feature library;

[0008] Selecting multiple sound description information corresponding to the target voiceprint feature from the multiple sound description information;

[0009] Scoring the multiple sound description information according to a preset scoring rule to obtain a response score for each sound description information;

[0010] A target device is determined from the multiple smart devices according to the response score, and a wake-up instruction is sent to the target device, so that the target device responds to the wake-up voice information according to the wake-up instruction.

[0011] Optionally, the sound description information includes sound intensity, sound angle, receiving time and response mode, and scoring the multiple sound description information according to a preset scoring rule to obtain a response score for each sound description information includes:

[0012] sorting each of the sound description information according to the sound intensity, the sound angle, the receiving time, and the response mode to obtain a plurality of sorting results;

[0013] According to each ranking result and a preset score calculation rule, the response score of each sound description information is obtained.

[0014] Optionally, obtaining the response score of each sound description information according to each sorting result and a preset score calculation rule includes:

[0015] According to the correspondence between the preset order and the score, the sound intensity score, the sound angle score, the reception time score and the response mode score of each sound description information are obtained;

[0016] The sound intensity score, the sound angle score, the receiving time score and the response mode score are accumulated to obtain the response score of each sound description information.

[0017] Optionally, the method further comprises:

[0018] If there is no pre-stored voiceprint identical to the first voiceprint feature in the voiceprint feature library, generating a correspondence between the first voiceprint feature and user information, wherein the first voiceprint feature is any one of the multiple voiceprint features;

[0019] The corresponding relationship is stored in the voiceprint feature library.

[0020] Optionally, after determining a target device from the multiple smart devices according to the response score and sending a wake-up instruction to the target device, the method further includes:

[0021] Receiving target audio data sent by the target device, where the target audio data is audio data sent by the target user and collected by the target device;

[0022] Extracting features from the target audio data to obtain target feature information;

[0023] Compare the target feature information with the instruction feature values ​​stored in a pre-stored feature database to determine the target instruction corresponding to the target feature information;

[0024] The target instruction is sent to the target device so that the target device executes the target instruction.

[0025] In a second aspect, the present application provides a device wake-up method, which is applied to a smart device, and the method includes:

[0026] Obtain the wake-up voice message sent by the target user;

[0027] Extracting features of the wake-up voice information to obtain voiceprint features and voice description information, wherein the voice description information includes: voice intensity, voice angle, receiving time, and response mode;

[0028] Sending the voiceprint feature and the sound description information to the home host, so that the home host selects a target voiceprint feature corresponding to the target user from multiple voiceprint features according to the correspondence between the user information and the voiceprint feature, selects multiple sound description information corresponding to the target voiceprint feature from multiple sound description information, scores the multiple sound description information according to a preset scoring rule, obtains a response score for each sound description information, determines the target device according to the response score, and sends a wake-up instruction to the target device;

[0029] When the wake-up instruction sent by the home host is received, the wake-up voice information is responded to according to the wake-up instruction.

[0030] Optionally, the wake-up voice information includes first voice information and second voice information sent by the target user, and the step of extracting features from the wake-up voice information to obtain sound intensity and sound angle includes:

[0031] Analyze the first voice information and the second voice information to obtain a first voice intensity corresponding to the first voice information and a second voice intensity corresponding to the second voice information;

[0032] Performing root mean square processing on the first speech intensity and the second speech intensity to obtain the sound intensity;

[0033] The sound angle is determined according to a first receiving time of the first voice information, a second receiving time of the second voice information, the first voice intensity, and the second voice intensity.

[0034] Optionally, after responding to the wake-up voice information, the method further includes:

[0035] Collecting target audio data emitted by the target user;

[0036] Sending the target audio data to the home host so that the home host extracts features from the target audio data to obtain target feature information, and comparing the target feature information with a command feature value stored in a pre-stored feature database to determine a target command corresponding to the target feature information;

[0037] Receive the target instruction sent by the home host, and execute the target instruction.

[0038] In a third aspect, the present application provides a device for waking up a device, which is applied to a home host, and the device includes:

[0039] A first receiving module is configured to receive a plurality of voiceprint features and a plurality of sound description information sent by a plurality of smart devices within a preset time period, wherein the plurality of voiceprint features and the plurality of sound description information are obtained by the smart devices through feature extraction of wake-up voice information, and the home host is connected to the plurality of smart devices respectively;

[0040] A feature matching module is used to select a target voiceprint feature corresponding to a target user from multiple voiceprint features through a pre-stored voiceprint feature library;

[0041] An information selection module, used to select a plurality of sound description information corresponding to the target voiceprint feature from a plurality of sound description information;

[0042] A scoring module, used to score the plurality of sound description information according to a preset scoring rule to obtain a response score for each sound description information;

[0043] The first sending module is used to determine a target device from the multiple smart devices according to the response score, and send a wake-up instruction to the target device, so that the target device responds to the user's instruction according to the wake-up instruction.

[0044] In a fourth aspect, the present application provides a device waking up a device, which is applied to a smart device, and the device includes:

[0045] An acquisition module is used to acquire the wake-up voice information sent by the target user;

[0046] A feature extraction module is used to extract features from the wake-up voice information to obtain voiceprint features and voice description information, wherein the voice description information includes: voice intensity, voice angle, receiving time and response mode;

[0047] A second sending module is used to send the voiceprint feature and the sound description information to the home host, so that the home host selects a target voiceprint feature corresponding to the target user from the multiple voiceprint features according to the correspondence between the user information and the voiceprint feature, selects multiple sound description information corresponding to the target voiceprint feature from the multiple sound description information, scores the multiple sound description information according to a preset scoring rule, obtains a response score for each sound description information, and selects a smart device with a higher response score as the target device;

[0048] The second receiving module is used to respond to the wake-up voice information according to the wake-up instruction when receiving the wake-up instruction sent by the home host.

[0049] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned device wake-up method when executing the program.

[0050] In a sixth aspect, an embodiment of the present application provides a readable storage medium, which, when instructions in the readable storage medium are executed by a processor of an electronic device, enables the electronic device to execute the above-mentioned device wake-up method.

[0051] In summary, in the embodiment of the present application, the home host receives multiple voiceprint features and multiple sound description information sent by multiple smart devices within a preset time, and the multiple voiceprint features and multiple sound description information are obtained by the smart devices extracting features from the wake-up voice information, and the home host is connected to multiple smart devices respectively; through the pre-stored voiceprint feature library, the target voiceprint feature corresponding to the target user is selected from the multiple voiceprint features; multiple sound description information corresponding to the target voiceprint feature is selected from the multiple sound description information; the multiple sound description information is scored according to the preset scoring rules to obtain the response score of each sound description information; the target device is determined from the multiple smart devices according to the response score, and a wake-up instruction is sent to the target device, so that the target device responds to the wake-up voice information according to the wake-up instruction. Through the above technical solution, when there are multiple smart devices, the home host analyzes the user's wake-up voice to determine the device that needs to be awakened, and the smart device only performs voice collection and information transmission and reception. Through the processing, analysis and calculation of the voice on the home host side, the only wake-up function of the smart device is realized, and the data processing process is transferred from the smart device to the home host side, which can effectively shorten the response time of device wake-up and improve the response efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0053] Figure 1 This is a flowchart of a method for waking up a device provided in an embodiment of the present application;

[0054] Figure 2 is a flowchart of another method for waking up a device provided in an embodiment of the present application;

[0055] Figure 3 is a flowchart of another method for waking up a device provided in an embodiment of the present application;

[0056] Figure 4 is a flowchart of another method for waking up a device provided in an embodiment of the present application;

[0057] Figure 5 is a structural diagram of a device wake-up apparatus provided in an embodiment of the present application;

[0058] Figure 6 is a structural diagram of another device wake-up apparatus provided in an embodiment of the present application;

[0059] Figure 7 is a structural diagram of an electronic device provided in an embodiment of the present application;

[0060] Figure 8 It is a structural diagram of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.

[0062] Currently, voice recognition in home appliances is a combination of offline and online. When the offline terms cannot be matched, the audio file will be uploaded to the cloud for recognition, and the voice file will be converted into text information, and then converted into corresponding control commands and sent to the device for control. This solution is greatly affected by the network, the response time varies, and the user experience is not good. If all home appliances use offline voice and need to support free speech, automatic speech recognition (Automatic Speech Recognition, ASR), speech synthesis (Text To Speech, TTS), etc. need to be integrated locally, and each home appliance needs to save a large model library for voice training, which is too costly and will occupy device memory and affect response efficiency.

[0063] With the development of technology, smart devices are becoming more and more popular in people's lives. In order to control smart devices, users can wake up and control each smart device by touching the central control screen or speaking. If you call a smart device by voice, there may be a situation where multiple smart devices in the space respond at the same time. Therefore, a home host can be introduced to uniformly control various smart devices.

[0064] It should be noted that the home host can be understood as the core component of the smart home system, responsible for connecting and controlling various smart devices in the home. The home host can connect multiple smart devices to the network through wired or wireless means, and realize interconnection and intelligent control between devices. The home host usually has powerful processing capabilities and rich interfaces, can support a variety of communication protocols and device types, and can be remotely controlled through mobile phone applications (applications, APPs), voice assistants, etc., to achieve convenient operation of smart homes. In addition, the smart home host also has security and privacy protection functions to ensure the security and privacy of user data.

[0065] Among them, the home host and multiple smart devices are connected through a network, and the network may include: wired network, wireless network, wired network may include: wide area network, metropolitan area network, local area network, etc., and wireless network may include: wireless fidelity technology (Wireless Fidelity, WIFI), Bluetooth, etc.

[0066] Optionally, the home host includes relevant units with functions such as data synchronization, data forwarding, scene analysis, and protocol conversion, and can support unified control of smart devices with different protocols after completing protocol conversion through the home host. In this way, the protocol compatibility of different manufacturers can be improved. The home host is responsible for protocol conversion and data processing, and forwards it to different types of gateways to enable devices to perform corresponding actions, thereby achieving intercommunication between cross-category devices.

[0067] Smart devices specifically include: smart air conditioners, smart range hoods, smart refrigerators, smart ovens, smart stoves, smart washing machines, smart water heaters, smart washing equipment, smart dishwashers, smart projection equipment, smart TVs, smart clothes drying racks, smart curtains, smart audio and video, smart sockets, smart speakers, smart speakers, smart fresh air equipment, smart kitchen and bathroom equipment, smart bathroom equipment, smart sweeping robots, smart window cleaning robots, smart mopping robots, smart air purification equipment, smart steamers, smart microwave ovens, smart kitchen treasures, smart purifiers, smart water dispensers, smart cameras, etc.

[0068] The device wake-up method provided in the embodiment of the present application is described in detail below.

[0069] Figure 1 is a flowchart of a method for waking up a device provided in an embodiment of the present application. The execution subject of the method for waking up a device may be a home host. Figure 1 , the device wake-up method may include:

[0070] Step 101: Receive multiple voiceprint features and multiple sound description information sent by multiple smart devices within a preset time period.

[0071] In the embodiment of the present application, the home host and multiple smart devices are connected separately. When the home host and the smart devices exchange information, there will be a certain time difference between sending and receiving. In addition, there may be a time difference between each smart device sending information due to network and other reasons. Therefore, if multiple smart devices send information to the home host at the same time, the home host may not receive multiple messages at the same time. Therefore, a period of time can be set, and the information sent by each smart device received within the period of time is processed. The preset time length can be the time length set by the home host itself, such as: 1.5 seconds (s), 2s, 3s, etc., which is not specifically limited in the embodiment of the present application.

[0072] In some embodiments, the home host may start timing from the moment when the voiceprint features and sound description information sent by the first smart device is received, and after a preset time period, stop timing and stop receiving the voiceprint features and sound description information sent by the smart device. Subsequently, the home host may process multiple voiceprint features and multiple sound description information sent by the smart device within the preset time period, and the multiple voiceprint features and multiple sound description information received from the smart device outside the preset time period will not be processed.

[0073] It should be noted that the multiple voiceprint features and multiple sound description information received by the home host are obtained by extracting features from the wake-up voice information by the smart device. It can be understood that the user needs to wake up the smart device, so the wake-up voice information is sent in the form of voice. Multiple smart devices have received the wake-up voice information and processed the wake-up voice information respectively. Each smart device obtains the voiceprint features and sound description information corresponding to the wake-up voice information, and sends them to the home host respectively. As a result, the home host can receive multiple voiceprint features and multiple sound description information sent by multiple smart devices respectively. There is a one-to-one correspondence between the smart devices, voiceprint features and sound description information. That is, one smart device sends a voiceprint feature and a sound description information to the home host.

[0074] In some embodiments, a voiceprint is a sound wave spectrum that carries speech information and is displayed by an electroacoustic instrument. It is a biometric feature composed of more than 100 characteristic dimensions such as wavelength, frequency, and intensity. It is a general term for the voice features contained in the speech that can characterize and identify the speaker, as well as the speech model established based on these features (parameters). Each person's voiceprint spectrum is different due to their unique vocal organs and vocalization methods. This difference makes the voiceprint a unique biometric feature. Therefore, the user who is speaking can be determined by analyzing the voiceprint features. In the embodiment of the present application, since there may be more than one user in the room, the voices collected by multiple smart devices may not be emitted by the same user, so the specific user information can be determined by analyzing the voiceprint features.

[0075] In some embodiments, the sound description information may indicate relevant information of the speech collected by the smart device, such as sound intensity, spectrum, angle, and other information.

[0076] Step 102: Select a target voiceprint feature corresponding to a target user from a plurality of voiceprint features through a pre-stored voiceprint feature library.

[0077] It should be noted that multiple voiceprint features may be pre-stored in the pre-stored voiceprint feature library. Since the voiceprint features of each user are different, the voiceprint features and user information may be stored in the voiceprint feature library in correspondence. That is, the user information corresponding to a certain voiceprint feature may be found in the voiceprint feature library.

[0078] In the embodiment of the present application, when the user sends a wake-up voice message in the room, multiple smart devices can collect the wake-up voice information, but not necessarily collect the voice of only one user, and may collect other sounds sent by other users. Therefore, it can be screened by voiceprint features, that is, the target voiceprint feature corresponding to the target user is selected from multiple voiceprint features. It can also be understood that the target voiceprint feature corresponding to the same user is selected from multiple voiceprint features, that is, multiple voiceprint features corresponding to the same user are determined as target voiceprint features. There can be multiple smart devices corresponding to the target voiceprint feature, that is, multiple smart devices have collected the wake-up voice information of the target user.

[0079] Step 103: Select multiple sound description information corresponding to the target voiceprint features from the multiple sound description information.

[0080] In the embodiment of the present application, since there is a one-to-one correspondence between the voiceprint feature and the sound description information, after selecting the target voiceprint feature corresponding to the target user, multiple sound description information corresponding to the target voiceprint feature can be selected.

[0081] It should be noted that since there are multiple smart devices in the room, when the target user sends a wake-up voice message, there will definitely be multiple smart devices that collect the wake-up voice information, so that multiple smart devices detect the target voiceprint features and corresponding sound description information of the target user. Therefore, there are multiple sound description information corresponding to the target voiceprint features. If there is only one sound description information, it is impossible to determine whether the voice collected by the smart device corresponding to the sound description information is the wake-up voice information sent by the target user.

[0082] Step 104: score the multiple sound description information according to a preset scoring rule to obtain a response score for each sound description information.

[0083] In an embodiment of the present application, since multiple smart devices have collected the wake-up voice information issued by the target user, the home host needs to analyze which device the target user wants to wake up, so it can score each sound description information. The specific scoring rules can be pre-set preset scoring rules, which can be rules customized by the home host, so as to obtain a response score for each sound description information.

[0084] Step 105: determine a target device from multiple smart devices according to the response scores, and send a wake-up instruction to the target device, so that the target device responds to the wake-up voice information according to the wake-up instruction.

[0085] In an embodiment of the present application, after determining the response score of each sound description information, since there is a one-to-one correspondence between the sound description information and the smart device, the response score of the sound description information can also be considered as the response score of the smart device. Therefore, the target device can be determined from multiple smart devices according to the response score of each smart device. The target device can be considered as the device that the target user wants to wake up, so as to send a wake-up instruction to the target device. The wake-up instruction can instruct the target device to wake up and respond to the user. After receiving the wake-up instruction, the target device can respond to the wake-up voice information according to the wake-up instruction.

[0086] In summary, in the embodiment of the present application, when there are multiple smart devices, the home host analyzes the user's wake-up voice to determine the device that needs to be woken up. The smart device only needs to collect voice and send and receive information. The home host processes, analyzes and calculates the voice to realize the unique wake-up function of the smart device. The data processing process is transferred from the smart device to the home host, which can effectively shorten the response time of device wake-up and improve the response efficiency.

[0087] Figure 2 is a flowchart of another device wake-up method provided by the present application. The execution subject of the device wake-up method can be a home host. Figure 2 , the method may include the following steps:

[0088] Step 201: Receive multiple voiceprint features and multiple sound description information sent by multiple smart devices within a preset time period.

[0089] The method of this step has been described in the aforementioned step 101 and will not be repeated here.

[0090] Step 202: Select a target voiceprint feature corresponding to a target user from a plurality of voiceprint features through a pre-stored voiceprint feature library.

[0091] The method of this step has been described in the aforementioned step 102 and will not be repeated here.

[0092] In an embodiment of the present application, when screening multiple voiceprint features, each voiceprint feature can be matched with the voiceprint features in the pre-stored voiceprint feature library in turn. If a match is detected with a pre-stored voiceprint feature in the voiceprint feature library, the user information corresponding to the pre-stored voiceprint feature can be determined as the user information of the voiceprint feature.

[0093] In some embodiments, the user information can be represented by a user identity document (ID), that is, a pre-stored voiceprint feature library stores multiple user IDs and the voiceprint features corresponding to each user ID. If a voiceprint feature is detected to match a voiceprint in the pre-stored voiceprint feature library, the user ID corresponding to the matched voiceprint can be determined as the ID number of the voiceprint feature. In this way, after matching each voiceprint feature, the target voiceprint feature corresponding to the target user is multiple identical voiceprint features with the same ID number.

[0094] In some embodiments, of course, there may be a situation where no matching voiceprint is detected in the voiceprint feature library. Therefore, after selecting the target voiceprint feature corresponding to the target user from multiple voiceprint features through the pre-stored voiceprint feature library, step 202 may also include the following steps:

[0095] Sub-step 2021: if there is no pre-stored voiceprint identical to the first voiceprint feature in the voiceprint feature library, generate a correspondence between the first voiceprint feature and the user information, where the first voiceprint feature is any one of the multiple voiceprint features.

[0096] Sub-step 2022: storing the corresponding relationship in the voiceprint feature library.

[0097] It should be noted that there is no pre-stored voiceprint identical to the first voiceprint feature in the voiceprint feature library. It can also be understood that the home host has not received the voiceprint feature corresponding to the user sent by the smart device before. Therefore, a new correspondence between the user information and the first voiceprint feature can be created, that is, a corresponding user ID is created for the first voiceprint feature, and the correspondence is stored in the voiceprint feature library. In this way, if the user continues to wake up the smart device later, the home host can match the specific user ID after receiving the voiceprint feature sent by the smart device.

[0098] Step 203: Select multiple sound description information corresponding to the target voiceprint features from the multiple sound description information.

[0099] The method of this step has been described in the aforementioned step 103 and will not be repeated here.

[0100] In some embodiments, after selecting multiple sound description information corresponding to the target voiceprint feature, the sound description information, the voiceprint feature, and the smart device are all corresponding to each other, so the target voiceprint feature, multiple sound description information, and multiple smart devices can be stored correspondingly.

[0101] Exemplarily, the correspondence between the sound description information, the voiceprint features, and the smart device may be as shown in Table 1.

[0102] Table 1

[0103]

[0104] It can be seen from Table 1 that for the same user ID number: 0001, three identical voiceprint features are screened out: Feature 1, corresponding to three input devices: rice cooker, air purifier and air conditioner, among which the sound description information corresponding to the rice cooker includes: time: 15:47:30:30:301 milliseconds, sound intensity: 10, sound angle: 90 degrees, response mode: speaker; the sound description information corresponding to the air purifier includes: time: 15:47:30:500 milliseconds, sound intensity: 7, sound angle: 45 degrees, response mode: buzzer; the sound description information corresponding to the air conditioner includes: time: 15:47:31:100 milliseconds, sound intensity: 3, sound angle: 30 degrees, response mode: speaker.

[0105] Step 204: sort each sound description information according to sound intensity, sound angle, receiving time and response mode to obtain multiple sorting results.

[0106] It should be noted that the sound description information may specifically include sound intensity, sound angle, receiving time and response mode. That is to say, the home host can score multiple sound description information based on the four aspects of sound intensity, sound angle, receiving time and response mode.

[0107] In the embodiment of the present application, since the home host needs to select the device that the user wants to wake up from multiple smart devices, it can be understood that a comparison needs to be made between multiple smart devices. Therefore, the multiple sound description information can be sorted from the above four perspectives respectively. In other words, four sorting results can be obtained, and each sound description information corresponds to four orders.

[0108] In some embodiments, the sound intensity can indicate the distance between the target user and the smart device. The closer the target user is to the smart device, the greater the sound intensity, and the farther the target user is from the smart device, the smaller the sound intensity. The sound angle can indicate the angle between the target user and the smart device. The receiving time is the time when the smart device collects the wake-up voice information of the target user. The response mode is the way the smart device responds to the wake-up of the target user, which may include: speakers, buzzers, lights, vibrations, etc.

[0109] In some embodiments, when sorting sound intensity, sound angle, receiving time and response mode, the sorting can be performed according to certain sorting rules, among which the sound intensity and sound angle can be sorted in order of numerical value, the receiving time can be sorted in chronological order, and the response mode can be sorted according to custom rules.

[0110] Step 205: Obtain a response score for each sound description information according to each ranking result and a preset score calculation rule.

[0111] In an embodiment of the present application, after sorting is completed and multiple sorting results are obtained, points can be assigned to each sorting result. The points can be assigned according to a preset score calculation rule. The preset score calculation rule can be understood as the correspondence between the pre-selected sorting order and the score, so that the response score of each sound description information can be obtained.

[0112] Optionally, step 205 includes:

[0113] Sub-step 2051: According to the correspondence between the preset order and the score, the sound intensity score, the sound angle score, the receiving time score and the response mode score of each sound description information are obtained.

[0114] Sub-step 2052: Accumulate the sound intensity score, sound angle score, reception time score and response mode score to obtain a response score for each sound description information.

[0115] It should be noted that since the sound description information includes four dimensions: sound intensity, sound angle, receiving time and response mode, when scoring each sound description information, the sound intensity score, sound angle score, receiving time score and response mode score corresponding to each sound description information can be obtained, and the response score of the sound description information can be obtained by adding up the sound intensity score, sound angle score, receiving time score and response mode score.

[0116] In some embodiments, the score for sound intensity can be sorted in ascending order. Sound intensity is a numerical value between 1-10, so the score can be the same as the sound intensity. If the sound intensity is 1, then the corresponding score is 1, if the sound intensity is 2, then the corresponding score is 2, if the sound intensity is 3, then the corresponding score is 3, if the sound intensity is 10, then the corresponding score is 10, and so on to obtain the sound intensity score of each sound description information.

[0117] In some embodiments, the score for the sound angle can be sorted in ascending order. The sound angle is a numerical value between 0-90, so the score can be the same as the sound angle. If the sound angle is 0 degrees, the corresponding score is 0, if the sound angle is 30 degrees, the corresponding score is 30, if the sound angle is 45 degrees, the corresponding score is 45, and if the sound intensity is 90 degrees, the corresponding score is 90, and so on to obtain the sound angle score for each sound description information.

[0118] In some embodiments, the score of the receiving time can be sorted in order from the earliest time to the latest time, with the earliest receiving time having a score of 0, and the scores of other receiving times increasing for each certain number of milliseconds delayed, for example, the score increases by 10 for each 100 milliseconds (ms) delayed. The earliest receiving time is 15:47:30 0 milliseconds, with a score of 0, then 15:47:30 100 milliseconds has a score of 10, 15:47:30 200 milliseconds has a score of 20, 15:47:30 300 milliseconds has a score of 30, and so on, to obtain the receiving time score of each sound description information.

[0119] In some embodiments, the response mode can be scored according to preset rules, for example: the score corresponding to the speaker + LCD display is 50, the score corresponding to the speaker response is 45, the score corresponding to the buzzer response is 40, the score corresponding to the light response is 35, the score corresponding to the vibration response is 30, etc., and the scoring is performed based on this rule to obtain the response mode score of each sound description information.

[0120] Step 206: determine a target device from the multiple smart devices according to the response scores, and send a wake-up instruction to the target device, so that the target device responds to the wake-up voice information according to the wake-up instruction.

[0121] The method of this step has been described in the aforementioned step 105 and will not be repeated here.

[0122] In the embodiment of the present application, when determining a target device from a plurality of smart devices, the selection may be made based on the response score.

[0123] In some embodiments, the smart device corresponding to the sound description information with the highest response score may be determined as the target device.

[0124] In some embodiments, if there are multiple smart devices corresponding to the sound description information with the highest response scores, the sound description information with the same response score can be compared again in the order of sound intensity score, sound angle score, receiving time score and response mode score until unique sound description information is obtained, and the smart device corresponding to the unique sound description information is determined as the target device.

[0125] In some embodiments, a smart device corresponding to the sound description information having a response score greater than a preset threshold may be determined as a target device.

[0126] Optionally, if the response score of the sound description information corresponding to only one smart device is greater than a preset threshold, then the smart device can be directly determined as the target device.

[0127] Optionally, if there are multiple smart devices corresponding to the sound description information whose response scores are greater than a preset threshold, the sound description information corresponding to the multiple smart devices can be compared again in the order of sound intensity score, sound angle score, receiving time score and response mode score until unique sound description information is obtained, and the smart device corresponding to the unique sound description information is determined as the target device.

[0128] Optionally, if there are multiple smart devices whose corresponding sound description information response scores are greater than a preset threshold, then multiple smart devices can also be output to the user, and the user can select the target device to be awakened. Specifically, multiple smart devices can be controlled to respond, and the user's selection of the target device can be received, thereby determining the target device.

[0129] Step 207: Receive target audio data sent by the target device.

[0130] In an embodiment of the present application, the target audio data is audio data emitted by a target user and collected by a target device; after waking up the target device, the target user can perform voice command control on the target device, that is, the target device can collect the target audio data emitted by the target user and send the target audio data to the home host for analysis.

[0131] Step 208: extract features from the target audio data to obtain target feature information.

[0132] In the embodiment of the present application, since the target audio data may include the target user's instructions to the target device, the home host can extract features from the target audio data to obtain target feature information.

[0133] Step 209: Compare the target feature information with the instruction feature values ​​stored in the pre-stored feature database to determine the target instruction corresponding to the target feature information.

[0134] In an embodiment of the present application, a plurality of command feature values ​​may be stored in a pre-stored feature database, i.e., command feature values ​​of supported devices, such as air conditioners, fans, air purifiers, rice cookers, etc. The feature database contains the features of all possible commands of each device, such as turning on the air conditioner, turning on the air conditioner, turning on the air conditioner, or turning on the air purifier, turning off the rice cooker, etc., and comparing the target feature information with the pre-stored command feature values. If the same features exist, then the target command corresponding to the target feature information can be directly determined, i.e., the target command corresponding to the target audio data. For example, if the target feature information is matched with the command feature value of "turn on the air conditioner", then the home host can determine that the target audio data sent by the user is to turn on the air conditioner.

[0135] Step 210: Send the target instruction to the target device so that the target device executes the target instruction.

[0136] In the embodiment of the present application, after the target instruction is determined, the target instruction can be sent to the target device so that the target device executes the target instruction.

[0137] In some embodiments, the home host can also generate text data corresponding to the target instruction, and send the text data and the target instruction to the target device together, so that when the target device executes the target instruction, the text data is converted into audio data for playback. For example, the text data can be "OK, the air conditioner has been turned on for you", so that when the air conditioner is started, the audio "OK, the air conditioner has been turned on for you" can also be played.

[0138] In summary, in the embodiments of the present application, when there are multiple smart devices, the home host analyzes the user's wake-up voice to determine the device that needs to be woken up, and the smart device only needs to collect voice and send and receive information. The home host processes, analyzes and calculates parameters such as voiceprint features, sound intensity, sound angle, receiving time, response mode, etc. to realize the unique wake-up function of the smart device. The data processing process is transferred from the smart device to the home host side, which can effectively shorten the response time of device wake-up and improve the response efficiency and accuracy.

[0139] Figure 3 is a flowchart of another device wake-up method provided by the present application. The execution subject of the device wake-up method can be a smart device. Figure 3 , the method may include the following steps:

[0140] Step 301: Obtain a wake-up voice message sent by a target user.

[0141] In the embodiment of the present application, each smart device is provided with a microphone, which can collect the user's voice, and thus can collect the wake-up voice information issued by the target user.

[0142] Step 302: extract features from the wake-up voice information to obtain voiceprint features and sound description information.

[0143] In the embodiment of the present application, the sound description information includes: sound intensity, sound angle, receiving time and response mode. The specific description of the voiceprint features and the sound description information can refer to the above embodiment, which will not be repeated here.

[0144] It should be noted that when extracting features from the wake-up voice information, the wake-up voice information may also be preprocessed, such as filtering, denoising, etc., to improve the audio quality of the wake-up voice information and avoid extracting useless features.

[0145] Step 303: Send the voiceprint features and sound description information to the home host.

[0146] In an embodiment of the present application, the home host selects a target voiceprint feature corresponding to the target user from multiple voiceprint features based on the correspondence between user information and voiceprint features, selects multiple sound description information corresponding to the target voiceprint feature from multiple sound description information, scores the multiple sound description information according to preset scoring rules, obtains a response score for each sound description information, determines the target device based on the response score, and sends a wake-up command to the target device.

[0147] In an embodiment of the present application, each smart device can send voiceprint features and sound description information to the home host, so that the home host can receive multiple voiceprint features and multiple sound description information sent by multiple smart devices, and determine the target device according to the steps described in the above method.

[0148] Step 304: upon receiving the wake-up instruction sent by the home host, respond to the wake-up voice information according to the wake-up instruction.

[0149] In an embodiment of the present application, after the home host determines that the current smart device is the target device, the current smart device can receive the wake-up command sent by the home host, and can respond to the wake-up voice information. The response method can be a speaker, buzzer, light, vibration, etc., for example: outputting a voice "I'm here, please give instructions", etc., or emitting a red flashing light.

[0150] In summary, in the embodiment of the present application, the smart device obtains the wake-up voice information sent by the target user; extracts the features of the wake-up voice information to obtain voiceprint features and sound description information, and the sound description information includes: sound intensity, sound angle, receiving time and response mode; sends the voiceprint features and sound description information to the home host, so that the home host selects the target voiceprint features corresponding to the target user from multiple voiceprint features according to the correspondence between the user information and the voiceprint features, selects multiple sound description information corresponding to the target voiceprint features from multiple sound description information, scores the multiple sound description information according to the preset scoring rules, obtains the response score of each sound description information, determines the target device according to the response score, and sends a wake-up instruction to the target device; in the case of receiving the wake-up instruction sent by the home host, responds to the wake-up voice information according to the wake-up instruction. The smart device can only retain the voice collection, simple feature extraction and data sending and receiving functions, and transfer the specific data analysis, processing, calculation and other functions to the home host, which strengthens the role of the home host, reduces the steps on the smart device side, and improves the efficiency and accuracy of device wake-up.

[0151] Figure 4 is a flowchart of another device wake-up method provided by the present application. The execution subject of the device wake-up method can be a smart device. Figure 4 , the method may include the following steps:

[0152] Step 401: Acquire a wake-up voice message sent by a target user.

[0153] The method of this step has been described in the aforementioned step 301 and will not be repeated here.

[0154] Step 402: extract features from the wake-up voice information to obtain voiceprint features and sound description information.

[0155] The method of this step has been described in the aforementioned step 302 and will not be repeated here.

[0156] In the embodiment of the present application, the sound description information includes: sound intensity, sound angle, receiving time and response mode.

[0157] The method of this step has been described in the aforementioned step 302 and will not be repeated here.

[0158] Optionally, step 402 includes:

[0159] Sub-step 4021: Analyze the first voice information and the second voice information to obtain a first voice intensity corresponding to the first voice information and a second voice intensity corresponding to the second voice information.

[0160] It should be noted that, since it is necessary to determine the angle of the target user towards the smart device, at least two sets of audio are needed to compare and obtain the angle. Therefore, at least two microphones can be provided on the smart device. The wake-up voice information collected by the smart device can include the first voice information and the second voice information issued by the target user. When calculating the sound intensity, it can be obtained based on the voice intensity of each voice information. When calculating the sound angle, it is also necessary to integrate multiple voice intensities and multiple moments. Therefore, the voice intensity needs to be calculated for the first voice information and the second voice information to obtain the first voice intensity and the second voice intensity, respectively.

[0161] Sub-step 4022: Perform root mean square processing on the first speech intensity and the second speech intensity to obtain sound intensity.

[0162] It should be noted that the root mean square is a common mathematical calculation method, which can be understood as first calculating the square of the first voice intensity and the second voice intensity respectively, then calculating the average of the two square values, and then finding the square root of the average value. The result obtained is the sound intensity.

[0163] Sub-step 4023, determining the sound angle according to the first receiving time of the first voice information, the second receiving time of the second voice information, the first voice intensity and the second voice intensity.

[0164] It should be noted that since the position of the target user relative to the smart device is fixed, but the positions of the two microphones are different, there is a difference between the voice intensities of the two voice information collected. In addition, the times when the two microphones collect the voice information are also different. Therefore, the sound angle can be calculated based on the first receiving time of the first voice information, the second receiving time of the second voice information, the first voice intensity and the second voice intensity.

[0165] In some embodiments, the sound angle can be calculated using a mathematical formula commonly used in the prior art, which will not be described in detail here.

[0166] Step 403: Send the voiceprint features and sound description information to the home host.

[0167] The method of this step has been described in the aforementioned step 303 and will not be repeated here.

[0168] In an embodiment of the present application, the home host selects a target voiceprint feature corresponding to the target user from multiple voiceprint features based on the correspondence between user information and voiceprint features, selects multiple sound description information corresponding to the target voiceprint feature from multiple sound description information, scores the multiple sound description information according to preset scoring rules, obtains a response score for each sound description information, determines the target device based on the response score, and sends a wake-up command to the target device.

[0169] Step 404: upon receiving the wake-up instruction sent by the home host, respond to the wake-up voice information according to the wake-up instruction.

[0170] The method of this step has been described in the aforementioned step 304 and will not be repeated here.

[0171] Exemplarily, the device wake-up method provided in the embodiment of the present application is applied to a smart home scenario, which includes a home host, input device 1, input device 2, input device 3 and input device 4, wherein input device 1 is provided with a speaker, input device 2 is provided with a light, input device 3 is provided with a buzzer, and input device 4 is provided with a speaker. When the user utters the voice "xiaoge xiaoge", input device 1 receives the voice after time 1, input device 2 receives the voice after time 2, input device 3 receives the voice after time 3, and input device 4 receives the voice after time 4. Input device 1, input device 2, input device 3 and input device 4 respectively send information to the home host, and the home host calculates scores by sound intensity + sound angle + time interval + response mode, thereby determining that input device 1 responds.

[0172] Step 405: Collect target audio data sent by the target user.

[0173] In an embodiment of the present application, after determining that the current smart device is the target device, target audio data emitted by the target user may be collected.

[0174] Step 406: Send the target audio data to the home host so that the home host extracts features from the target audio data to obtain target feature information, compares the target feature information with command feature values ​​stored in a pre-stored feature database, and determines a target command corresponding to the target feature information.

[0175] In an embodiment of the present application, since the target audio data sent by the target user may include the target user's instructions to the target device, the target audio data can be sent to the home host so that the home host extracts features from the target audio data and then performs feature comparison to obtain the target instructions.

[0176] Step 407: Receive the target command sent by the home host and execute the target command.

[0177] In some embodiments, in addition to receiving the target command sent by the home host, text data sent by the home host may also be received, so the text data can also be converted into audio data. When executing the target command, the audio data can also be played. For example: the text data can be "OK, the air conditioner has been turned on for you", so when the air conditioner is started, the audio "OK, the air conditioner has been turned on for you" can also be played.

[0178] In summary, smart devices can only retain voice collection, simple feature extraction and data receiving and sending functions, and transfer specific data analysis, processing, calculation and other functions to the home host, thereby strengthening the role of the home host, reducing the steps on the smart device side, and improving the efficiency and accuracy of device wake-up.

[0179] Figure 5 : is a schematic diagram of a structure of a device awakening device provided in an embodiment of the present application. The device awakening device 500 can be applied to a home host. The device awakening device 500 can include:

[0180] The first receiving module 501 is used to receive multiple voiceprint features and multiple sound description information sent by multiple smart devices within a preset time period, where the multiple voiceprint features and multiple sound description information are obtained by the smart devices through feature extraction of wake-up voice information, and the home host is connected to the multiple smart devices respectively;

[0181] The feature matching module 502 is used to select a target voiceprint feature corresponding to a target user from a plurality of voiceprint features through a pre-stored voiceprint feature library;

[0182] An information selection module 503 is used to select a plurality of sound description information corresponding to the target voiceprint feature from a plurality of sound description information;

[0183] A scoring module 504 is used to score the multiple sound description information according to a preset scoring rule to obtain a response score for each sound description information;

[0184] The first sending module 505 is used to determine a target device from a plurality of smart devices according to the response scores, and send a wake-up instruction to the target device, so that the target device responds to the user's instruction according to the wake-up instruction.

[0185] Optionally, the sound description information includes sound intensity, sound angle, receiving time and response mode, and the scoring module may specifically include:

[0186] The sorting submodule is used to sort each sound description information according to the sound intensity, sound angle, receiving time and response mode to obtain multiple sorting results;

[0187] The score calculation submodule is used to obtain the response score of each sound description information according to each sorting result and a preset score calculation rule.

[0188] Optionally, the score calculation submodule may specifically include:

[0189] A scoring unit, used to obtain a sound intensity score, a sound angle score, a reception time score and a response mode score for each sound description information according to a correspondence between a preset order and a score;

[0190] The score accumulation unit is used to accumulate the sound intensity score, the sound angle score, the receiving time score and the response mode score to obtain the response score of each sound description information.

[0191] Optionally, the device waking up apparatus 500 may further include:

[0192] a corresponding relationship generating module, configured to generate a corresponding relationship between the first voiceprint feature and the user information when there is no pre-stored voiceprint identical to the first voiceprint feature in the voiceprint feature library, wherein the first voiceprint feature is any one of the plurality of voiceprint features;

[0193] The corresponding relationship storage module is used to store the corresponding relationship in the voiceprint feature library.

[0194] Optionally, the device waking up apparatus 500 may further include:

[0195] A third receiving module is used to receive target audio data sent by a target device, where the target audio data is audio data sent by a target user and collected by the target device;

[0196] The audio extraction module is used to extract features from the target audio data to obtain target feature information;

[0197] An instruction matching module is used to compare the target feature information with the instruction feature value stored in the pre-stored feature database to determine the target instruction corresponding to the target feature information;

[0198] The third sending module is used to send the target instruction to the target device so that the target device executes the target instruction.

[0199] Figure 6 6 is a schematic diagram of a device wake-up device provided in an embodiment of the present application. The device wake-up device 600 can be applied to a smart device. The device wake-up device 600 may include:

[0200] The acquisition module 601 is used to acquire the wake-up voice information sent by the target user;

[0201] The feature extraction module 602 is used to extract features from the wake-up voice information to obtain voiceprint features and voice description information, where the voice description information includes: voice intensity, voice angle, receiving time, and response mode;

[0202] The second sending module 603 is used to send the voiceprint feature and the sound description information to the home host, so that the home host selects a target voiceprint feature corresponding to the target user from multiple voiceprint features according to the correspondence between the user information and the voiceprint feature, selects multiple sound description information corresponding to the target voiceprint feature from multiple sound description information, scores the multiple sound description information according to a preset scoring rule, obtains a response score for each sound description information, determines a target device according to the response score, and sends a wake-up instruction to the target device;

[0203] The second receiving module 604 is used to respond to the wake-up voice information according to the wake-up instruction when receiving the wake-up instruction sent by the home host.

[0204] Optionally, the wake-up voice information includes first voice information and second voice information sent by the target user, and the feature extraction module may specifically include:

[0205] A speech analysis submodule, used to analyze the first speech information and the second speech information to obtain a first speech intensity corresponding to the first speech information and a second speech intensity corresponding to the second speech information;

[0206] A sound intensity determination module, used for performing root mean square processing on the first speech intensity and the second speech intensity to obtain the sound intensity;

[0207] The sound angle determination module is used to determine the sound angle according to the first receiving time of the first voice information, the second receiving time of the second voice information, the first voice intensity and the second voice intensity.

[0208] Optionally, the device waking up apparatus 600 may further include:

[0209] An audio collection module, used to collect target audio data emitted by a target user;

[0210] A fourth sending module, used to send the target audio data to the home host, so that the home host extracts features of the target audio data to obtain target feature information, compares the target feature information with the command feature value stored in a pre-stored feature database, and determines a target command corresponding to the target feature information;

[0211] The fourth receiving module is used to receive the target instruction sent by the home host and execute the target instruction.

[0212] Figure 7 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, see Figure 7, the electronic device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0213] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0214] The memory 704 is used to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, multimedia, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0215] The power supply component 706 provides power to the various components of the electronic device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0216] The multimedia component 708 includes an interface that provides an output interface between the electronic device 700 and the user. In some embodiments, the interface may include a liquid crystal display (LCD) and a touch panel (TP). If the interface includes a touch panel, the interface may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a multimedia mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0217] The audio component 710 is used to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is used to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0218] The input / output I / O interface 712 provides an interface between the processing component 702 and the peripheral interface module, which may be a keyboard, a click wheel, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0219] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 700, the relative positioning of components, such as the display and keypad of the electronic device 700, and the sensor assembly 714 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0220] The communication component 716 is used to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0221] In an exemplary embodiment, the electronic device 700 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to implement a method for displaying a vehicle-road collaborative scenario provided in an embodiment of the present application.

[0222] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by a processor 720 of an electronic device 700 to perform the above method. For example, the non-transitory storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0223] Figure 8 8 is a block diagram of an electronic device 800 according to another embodiment of the present invention. For example, the electronic device 800 may be provided as a server. Figure 8 The electronic device 800 includes a processing component 822, which further includes one or more processors, and a memory resource represented by a memory 832 for storing instructions executable by the processing component 822, such as an application. The application stored in the memory 832 may include one or more modules, each of which corresponds to a set of instructions. In addition, the processing component 822 is configured to execute instructions to execute a method for displaying a vehicle-road cooperative scenario provided in an embodiment of the present application.

[0224] The electronic device 800 may also include a power supply component 826 configured to perform power management of the electronic device 800, a wired or wireless network interface 850 configured to connect the electronic device 800 to a network, and an input / output (I / O) interface 858. The electronic device 800 may operate based on an operating system stored in the memory 832, such as Windows Server TM, Mac OS X TM, Unix TM, Linux TM, Free BSD TM or the like.

[0225] In an embodiment of the present application, the memory 832 may be used to store software programs and various data. The memory 832 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 832 may include a volatile memory or a non-volatile memory, or the memory 832 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 832 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0226] The processor may include one or more processing units; optionally, the processor integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor.

[0227] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned device wake-up method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0228] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0229] An embodiment of the present application also provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned device wake-up method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0230] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the application disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0231] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A device wake-up method, characterized in that: Applied to a home host, the method comprises: Receiving multiple voiceprint features and multiple sound description information sent by multiple smart devices within a preset time period, wherein the multiple voiceprint features and the multiple sound description information are obtained by the smart devices through feature extraction of wake-up voice information, and the home host is connected to the multiple smart devices respectively; Selecting a target voiceprint feature corresponding to a target user from multiple voiceprint features through a pre-stored voiceprint feature library; Selecting multiple sound description information corresponding to the target voiceprint feature from the multiple sound description information; Scoring the plurality of sound description information according to a preset scoring rule, to obtain a response score for each sound description information; A target device is determined from the multiple smart devices according to the response score, and a wake-up instruction is sent to the target device, so that the target device responds to the wake-up voice information according to the wake-up instruction.

2. The method according to claim 1, characterized in that The sound description information includes sound intensity, sound angle, receiving time and response mode, and scoring the multiple sound description information according to a preset scoring rule to obtain a response score for each sound description information includes: sorting each of the sound description information according to the sound intensity, the sound angle, the receiving time, and the response mode to obtain a plurality of sorting results; According to each ranking result and a preset score calculation rule, the response score of each sound description information is obtained.

3. The method according to claim 2, characterized in that The step of obtaining the response score of each sound description information according to each sorting result and a preset score calculation rule includes: According to the correspondence between the preset order and the score, the sound intensity score, the sound angle score, the reception time score and the response mode score of each sound description information are obtained; The sound intensity score, the sound angle score, the receiving time score and the response mode score are accumulated to obtain the response score of each sound description information.

4. The method according to claim 1, characterized in that: The method further comprises: If there is no pre-stored voiceprint identical to the first voiceprint feature in the voiceprint feature library, generating a correspondence between the first voiceprint feature and user information, wherein the first voiceprint feature is any one of the multiple voiceprint features; The corresponding relationship is stored in the voiceprint feature library.

5. The method according to claim 1, characterized in that After determining a target device from the plurality of smart devices according to the response score and sending a wake-up instruction to the target device, the method further includes: Receiving target audio data sent by the target device, where the target audio data is audio data sent by the target user and collected by the target device; Extracting features from the target audio data to obtain target feature information; Compare the target feature information with the instruction feature values ​​stored in a pre-stored feature database to determine the target instruction corresponding to the target feature information; The target instruction is sent to the target device so that the target device executes the target instruction.

6. A device wake-up method, characterized in that: Applied to a smart device, the method comprises: Obtain the wake-up voice message sent by the target user; Extracting features of the wake-up voice information to obtain voiceprint features and voice description information, wherein the voice description information includes: voice intensity, voice angle, receiving time, and response mode; Sending the voiceprint feature and the sound description information to the home host, so that the home host selects a target voiceprint feature corresponding to the target user from multiple voiceprint features according to the correspondence between the user information and the voiceprint feature, selects multiple sound description information corresponding to the target voiceprint feature from multiple sound description information, scores the multiple sound description information according to a preset scoring rule, obtains a response score for each sound description information, determines the target device according to the response score, and sends a wake-up instruction to the target device; When the wake-up instruction sent by the home host is received, the wake-up voice information is responded to according to the wake-up instruction.

7. The method according to claim 6, characterized in that The wake-up voice information includes first voice information and second voice information sent by the target user, and extracting features from the wake-up voice information to obtain sound intensity and sound angle includes: Analyze the first voice information and the second voice information to obtain a first voice intensity corresponding to the first voice information and a second voice intensity corresponding to the second voice information; Performing root mean square processing on the first speech intensity and the second speech intensity to obtain the sound intensity; The sound angle is determined according to a first receiving time of the first voice information, a second receiving time of the second voice information, the first voice intensity, and the second voice intensity.

8. The method according to claim 6, characterized in that After responding to the wake-up voice information, the method further includes: Collecting target audio data emitted by the target user; Sending the target audio data to the home host so that the home host extracts features from the target audio data to obtain target feature information, and comparing the target feature information with a command feature value stored in a pre-stored feature database to determine a target command corresponding to the target feature information; Receive the target instruction sent by the home host, and execute the target instruction.

9. A device waking up a device, characterized in that: Applied to a home host, the device waking up the device comprises: A first receiving module is configured to receive a plurality of voiceprint features and a plurality of sound description information sent by a plurality of smart devices within a preset time period, wherein the plurality of voiceprint features and the plurality of sound description information are obtained by the smart devices through feature extraction of wake-up voice information, and the home host is connected to the plurality of smart devices respectively; A feature matching module is used to select a target voiceprint feature corresponding to a target user from multiple voiceprint features through a pre-stored voiceprint feature library; An information selection module, used to select a plurality of sound description information corresponding to the target voiceprint feature from a plurality of sound description information; A scoring module, used to score the plurality of sound description information according to a preset scoring rule to obtain a response score for each sound description information; The first sending module is used to determine a target device from the multiple smart devices according to the response score, and send a wake-up instruction to the target device, so that the target device responds to the user's instruction according to the wake-up instruction.

10. A device waking up a device, characterized in that: Applied to a target device, the device waking up the device comprises: An acquisition module is used to acquire the wake-up voice information sent by the target user; A feature extraction module is used to extract features from the wake-up voice information to obtain voiceprint features and voice description information, wherein the voice description information includes: voice intensity, voice angle, receiving time and response mode; A second sending module is used to send the voiceprint feature and the sound description information to the home host, so that the home host selects a target voiceprint feature corresponding to the target user from multiple voiceprint features according to the correspondence between the user information and the voiceprint feature, selects multiple sound description information corresponding to the target voiceprint feature from multiple sound description information, scores the multiple sound description information according to a preset scoring rule, obtains a response score for each sound description information, determines the target device according to the response score, and sends a wake-up instruction to the target device; The second receiving module is used to respond to the wake-up voice information according to the wake-up instruction when receiving the wake-up instruction sent by the home host.

11. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the device wake-up method according to any one of claims 1 to 5 or 6 to 8 is implemented.

12. A readable storage medium, characterized in that: When the instructions in the readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the device wake-up method as described in any one of claims 1 to 5 or 6 to 8.

Images