Collaborative wakeup method, apparatus and device, and storage medium

Abstract

The invention provides a collaborative wakeup method and device, equipment and a storage medium, and belongs to the technical field of communication. The collaborative wake-up method comprises the steps that the terminal equipment is connected to a collaborative wake-up network; a terminal device sends a collaborative wake-up request message to a network device in a collaborative wake-up network, wherein the collaborative wake-up request message is used for requesting collaborative wake-up with other devices in the collaborative wake-up network; the terminal device receives a collaborative wake-up request response message sent by the network device, wherein the collaborative wake-up request response message carries a unified wake-up word; the terminal equipment generates voice prompt information based on the unified wake-up word and plays the voice prompt information, and the voice prompt information is used for prompting a user to wake up the terminal equipment through the unified wake-up word; and under the condition that the terminal equipment receives the wake-up instruction sent by the network equipment, executing a pickup operation. According to the method, the terminal equipment of different brands can be awakened through the unified awakening word, and the voice awakening interaction experience of the user is improved.

Description

Technical Field

[0001] This application relates to the field of communication technologies, and in particular, to a collaborative wake-up method, apparatus, device, and storage medium. Background Art

[0002] Currently, one solution for voice collaborative wake-up is to distinguish and wake up terminal devices by different wake-up words. Another solution is that a manufacturer uniformly defines a wake-up word, and then determines the terminal device to be woken up based on information such as distance and orientation. However, it is difficult to uniformly define a wake-up word by a manufacturer. Due to differences in brand promotion, product strategies, and core voice entrances among different manufacturers, it is difficult to reach a consensus on the wake-up word. This results in that after users purchase terminal devices of different brands, they need to remember the wake-up methods of different devices, and the interaction experience is poor. Summary of the Invention

[0003] This application provides a collaborative wake-up method, apparatus, device, and storage medium to solve the defect that in the prior art, due to differences in brand promotion, product strategies, and core voice entrances among different manufacturers, it is difficult to reach a consensus on the wake-up word, resulting in that after users purchase terminal devices of different brands, they need to remember the wake-up methods of different devices, and the interaction experience is poor.

[0004] In a first aspect, this application provides a collaborative wake-up method, which is executed by a terminal device. The method includes:

[0005] The terminal device connects to a collaborative wake-up network;

[0006] The terminal device sends a collaborative wake-up request message to a network device in the collaborative wake-up network. The collaborative wake-up request message is used to request collaborative wake-up with other devices in the collaborative wake-up network;

[0007] The terminal device receives a collaborative wake-up request response message sent by the network device. The collaborative wake-up request response message carries a unified wake-up word;

[0008] The terminal device generates voice prompt information based on the unified wake-up word, and plays the voice prompt information. The voice prompt information is used to prompt the user to wake up the terminal device by using the unified wake-up word;

[0009] When the terminal device receives a wake-up instruction sent by the network device, it performs a voice pickup operation.

[0010] In some embodiments, the information carried in the collaborative wake-up request message includes at least one of the following: the interaction token of the terminal device, the corresponding user identification information, the location information of the terminal device, the capability information of the terminal device, and the wake-up priority information.

[0011] In some embodiments, the terminal device sends a collaborative wake-up request message to a network device in the collaborative wake-up network, including:

[0012] The terminal device receives a first input determined by the user for collaborative wake-up;

[0013] In response to the first input, the terminal device sends a collaborative wake-up request message to a network device in the collaborative wake-up network.

[0014] In some embodiments, the method further includes:

[0015] When the terminal device receives a wake-up discrimination instruction sent by the cloud server, it performs a voice pickup operation and reports audio stream information obtained through voice pickup to the cloud server;

[0016] Alternatively, it reports service request voice information obtained through voice pickup to the network device.

[0017] In a second aspect, the present application provides a collaborative wake-up method, which is executed by a network device. The method includes:

[0018] The network device receives a collaborative wake-up request message sent by the terminal device, adds the terminal device to a collaborative wake-up list, and different devices in the collaborative wake-up list are woken up by a preset unified wake-up word;

[0019] The network device sends a collaborative wake-up request response message to the terminal device, and the unified wake-up word is carried in the collaborative wake-up request response message;

[0020] The network device receives the user's wake-up voice information, performs voice recognition on the wake-up voice information, and when the wake-up voice information matches the unified wake-up word, the network device locates the target wake-up device through end-side wake-up discrimination;

[0021] The network device sends a wake-up instruction to the target wake-up device, and the wake-up instruction is used to wake up the target wake-up device so that the target wake-up device performs a voice pickup operation.

[0022] In some embodiments, the network device locates the target wake-up device through end-side wake-up discrimination, including:

[0023] Calculating the wake-up discrimination values of each device in the collaborative wake-up list;

[0024] Determining the maximum value among the wake-up discrimination values of each device in the collaborative wake-up list;

[0025] If the maximum value is greater than or equal to a preset threshold, the device corresponding to the maximum value is determined as the target wake-up device.

[0026] In some embodiments, calculating the wake-up discrimination values of the devices in the collaborative wake-up list includes:

[0027] Calculating the similarity between the locations of the devices in the collaborative wake-up list and the orientation of the wake-up voice information;

[0028] Obtaining the intensity of the wake-up voice information collected by the devices in the collaborative wake-up list;

[0029] Calculating the wake-up discrimination values of the devices in the collaborative wake-up list according to the similarity, intensity, and preset wake-up discrimination parameters.

[0030] In some embodiments, the method further includes:

[0031] If the maximum value is less than the preset threshold, initiate wake-up discrimination on the cloud side to determine the target wake-up device.

[0032] In some embodiments, initiating wake-up discrimination on the cloud side includes:

[0033] The network device sends a wake-up discrimination request message to the cloud server, and the wake-up discrimination request message carries the location information, capability information, and wake-up priority information of the devices in the collaborative wake-up list, so that the cloud server determines the target wake-up device according to the location information, capability information, and wake-up priority information of the devices.

[0034] In some embodiments, the method further includes:

[0035] The network device receives the service request voice information obtained by voice pickup sent by the target wake-up device, and calculates the wake-up discrimination value of the target wake-up device;

[0036] If the wake-up discrimination value of the target wake-up device is greater than or equal to the preset threshold, perform the processing operation corresponding to the service request voice information;

[0037] If the wake-up discrimination value of the target wake-up device is less than the preset threshold, initiate wake-up discrimination on the cloud side to re-determine the target wake-up device.

[0038] In some embodiments, initiating wake-up discrimination on the cloud side includes:

[0039] The network device sends a wake-up discrimination request message to the cloud server, and the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list are carried in the wake-up discrimination request message, so that the cloud server re-determines the target wake-up device according to the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0040] In a third aspect, the present application provides a collaborative wake-up method, which is executed by a cloud server. The method includes:

[0041] The cloud server receives a wake-up discrimination request message sent by a network device, and the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list are carried in the wake-up discrimination request message;

[0042] The cloud server sends a wake-up discrimination instruction to each device in the collaborative wake-up list, and the wake-up discrimination instruction is used to instruct each device in the collaborative wake-up list to report audio stream information obtained by voice pickup;

[0043] The cloud server determines a target wake-up device according to the audio stream information reported by each device in the collaborative wake-up list and the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0044] In some embodiments, service request voice information is further carried in the wake-up discrimination request message; after the cloud server receives the wake-up discrimination request message sent by the network device, the method further includes:

[0045] The cloud server re-determines the target wake-up device according to the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0046] In a fourth aspect, the present application provides a collaborative wake-up device, including:

[0047] An access unit, configured to connect to a collaborative wake-up network;

[0048] A first sending unit, configured to send a collaborative wake-up request message to a network device in the collaborative wake-up network, and the collaborative wake-up request message is used to request collaborative wake-up with other devices in the collaborative wake-up network;

[0049] A first receiving unit, configured to receive a collaborative wake-up request response message sent by the network device, and a unified wake-up word is carried in the collaborative wake-up request response message;

[0050] A first generation unit, configured to generate a voice prompt message based on the unified wake-up word, play the voice prompt message, where the voice prompt message is used to prompt a user to wake up a terminal device by using the unified wake-up word;

[0051] A first processing unit, configured to perform a voice pickup operation when receiving a wake-up instruction sent by the network device.

[0052] In a fifth aspect, the present application provides a collaborative wake-up device, including:

[0053] A second receiving unit, configured to receive a collaborative wake-up request message sent by a terminal device, add the terminal device to a collaborative wake-up list, where different devices in the collaborative wake-up list are woken up by using a preset unified wake-up word;

[0054] A second sending unit, configured to send a collaborative wake-up request response message to the terminal device, where the collaborative wake-up request response message carries the unified wake-up word;

[0055] A first wake-up discrimination unit, configured to receive a user's wake-up voice information, perform voice recognition on the wake-up voice information, and locate a target wake-up device through end-side wake-up discrimination when the wake-up voice information matches the unified wake-up word;

[0056] A wake-up unit, configured to send a wake-up instruction to the target wake-up device, where the wake-up instruction is used to wake up the target wake-up device so that the target wake-up device performs a voice pickup operation.

[0057] In a sixth aspect, the present application provides a collaborative wake-up device, including:

[0058] A third receiving unit, configured to receive a wake-up discrimination request message sent by a network device, where the wake-up discrimination request message carries location information, capability information, and wake-up priority information of each device in the collaborative wake-up list;

[0059] A third sending unit, configured to send a wake-up discrimination instruction to each device in the collaborative wake-up list, where the wake-up discrimination instruction is used to instruct each device in the collaborative wake-up list to report audio stream information obtained through voice pickup;

[0060] A second wake-up discrimination unit, configured to determine a target wake-up device according to the audio stream information reported by each device in the collaborative wake-up list and the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0061] In a seventh aspect, the present application provides a terminal device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where when the processor executes the program, the collaborative wake-up method described in the first aspect above is implemented.

[0062] In an eighth aspect, the present application provides a network device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the collaborative wake-up method described in the second aspect above is implemented.

[0063] In a ninth aspect, the present application provides a cloud server, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the collaborative wake-up method described in the third aspect above is implemented.

[0064] In a tenth aspect, the present application provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the collaborative wake-up method described in the first aspect above is implemented, or the collaborative wake-up method described in the second aspect above is implemented, or the collaborative wake-up method described in the third aspect above is implemented.

[0065] In an eleventh aspect, the present application provides a computer program product, including a computer program. When the computer program is executed by a processor, the collaborative wake-up method described in the first aspect above is implemented, or the collaborative wake-up method described in the second aspect above is implemented, or the collaborative wake-up method described in the third aspect above is implemented.

[0066] For the collaborative wake-up method, device, equipment, and storage medium provided in the embodiments of the present application, the terminal device sends a collaborative wake-up request message to the network device in the collaborative wake-up network. The collaborative wake-up request message is used to request collaborative wake-up with other devices in the collaborative wake-up network. The network device receives the collaborative wake-up request, adds the terminal device to the collaborative wake-up list. Different devices in the collaborative wake-up list are woken up by a preset unified wake-up word, and a collaborative wake-up request response message is sent to the terminal device. The unified wake-up word is carried in the collaborative wake-up request response message. The terminal device generates voice prompt information based on the unified wake-up word and plays the voice prompt information. The voice prompt information is used to prompt the user to wake up the terminal device by the unified wake-up word. The network device receives the user's wake-up voice information, performs voice recognition on the wake-up voice information. When the wake-up voice information matches the unified wake-up word, the network device locates the target wake-up device through end-side wake-up discrimination and sends a wake-up instruction to the target wake-up device. The target wake-up device performs a voice pickup operation. Thus, different brand terminal devices can be woken up by a unified wake-up word, improving the user's voice wake-up interaction experience. Description of the Drawings

[0067] To more clearly illustrate the technical solutions in the present application or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0068] Figure 1 One of the schematic flowcharts of the collaborative wake-up method provided by an embodiment of the present application;

[0069] Figure 2 Another schematic flowchart of the collaborative wake-up method provided by an embodiment of the present application;

[0070] Figure 3 Another schematic flowchart of the collaborative wake-up method provided by an embodiment of the present application;

[0071] Figure 4 One of the schematic structural diagrams of the collaborative wake-up device provided by an embodiment of the present application;

[0072] Figure 5 Another schematic structural diagram of the collaborative wake-up device provided by an embodiment of the present application;

[0073] Figure 6 Another schematic structural diagram of the collaborative wake-up device provided by an embodiment of the present application;

[0074] Figure 7 The schematic hardware structure diagram of a terminal device for implementing an embodiment of the present application;

[0075] Figure 8 The schematic hardware structure diagram of a network device for implementing an embodiment of the present application;

[0076] Figure 9 The schematic structural diagram of a cloud server for implementing an embodiment of the present application. Detailed implementation manners

[0077] To make the objectives, technical solutions, and advantages of the present application clearer, the following will clearly and completely describe the technical solutions in the present application with reference to the drawings in the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present application.

[0078] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0079] The terms "first", "second", etc. in the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such terms can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are usually of the same type, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "or" in the present application means at least one of the connected objects. For example, "A or B" covers three scenarios, namely, Scenario 1: including A and not including B; Scenario 2: including B and not including A; Scenario 3: including both A and B. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0080] The term "indication" in the present application can be either a direct indication (or an explicit indication) or an indirect indication (or an implicit indication). Among them, a direct indication can be understood as that the sender clearly tells the receiver specific information, operations to be performed, or request results, etc. in the sent indication; an indirect indication can be understood as that the receiver determines the corresponding information according to the indication sent by the sender, or makes a judgment and determines the operations to be performed or request results, etc. according to the judgment result.

[0081] It is worth noting that the terms "system" and "network" in the embodiments of the present application are often used interchangeably, and the described technologies can be used not only for the systems and radio technologies mentioned above, but also for other systems and radio technologies. The following description describes the New Radio (NR) system for example purposes, and the NR terms are used in most of the following descriptions, but these technologies can also be applied to systems other than the NR system, such as the 6th Generation (6G) communication system.

[0082] The terminal device in the embodiments of this application may be a mobile phone, a tablet personal computer, a laptop computer, a notebook computer, a personal digital assistant (PDA), a handheld computer, a netbook, an ultra-mobile personal computer (UMPC), a mobile internet device (MID), an augmented reality (AR) device, a virtual reality (VR) device, a robot, a wearable device, a flight vehicle, a vehicle user equipment (VUE), a marine device, a pedestrian user equipment (PUE), a smart home device (a home device with wireless communication function, such as a refrigerator, a television, a washing machine, a stereo or furniture, etc.), a game console, a personal computer (PC), a projector, or other terminal-side devices. Wearable devices include: smart watches, smart bracelets, smart earphones, smart glasses, smart jewelry (smart bracelets, smart bracelets, smart rings, smart necklaces, smart anklets, smart ankle chains, etc.), smart wristbands, smart clothing, etc. Among them, the vehicle user equipment may also be referred to as a vehicle terminal, a vehicle controller, a vehicle module, a vehicle component, a vehicle chip, or a vehicle unit, etc. It should be noted that the specific type of the terminal device is not limited in the embodiments of this application.

[0083] The network device in the embodiments of this application may include: an access network device or a core network device. Among them, the access network device may also be referred to as a radio access network (RAN) device, a radio access network function, or a radio access network unit. The access network device may include a base station, a wireless local area network (WLAN) access point (AP), a wireless fidelity (WiFi) node, a gateway device, a router, etc. Among them, the base station may be referred to as Node B (NB), Evolved Node B (eNB), Next Generation Node B (gNB), New Radio Node B (NR Node B), access point, relay base station (RBS), serving base station (SBS), base transceiver station (BTS), radio base station, radio transceiver, basic service set (BSS), extended service set (ESS), home Node B (HNB), home evolved Node B, transmission reception point (TRP), or some other suitable term in the art. As long as the same technical effect is achieved, the base station is not limited to specific technical terms.

[0084] Figure 1 It is one of the schematic flowcharts of the collaborative wake-up method provided by the embodiments of this application. As Figure 1 shown, the method includes the following steps: Step 110, Step 120, Step 130, Step 140, and Step 150. The flow steps of this method are only a possible implementation manner of this application. The method includes:

[0085] Step 110, the terminal device connects to the collaborative wake-up network;

[0086] It can be understood that when the user carries the terminal device into the voice wake-up local area network established by network devices such as routers and gateways, after the terminal device is placed in the wake-up space and the networking function is turned on, the local area network or Bluetooth discovery function is actively started. The terminal device actively obtains the gateway connection information of this space, and after broadcasting to the user whether to join the local area network identifier, the local area network networking connection will be completed.

[0087] A collaborative wake-up network refers to a local area network capable of achieving collaborative wake-up. For example, the collaborative wake-up network can be a home local area network capable of achieving collaborative wake-up, or a vehicle local area network capable of achieving collaborative wake-up, etc.

[0088] In the embodiments of the present application, collaborative wake-up, which can also be referred to as collaborative voice wake-up, refers to a voice recognition technology used in a multi-device environment. When a user utters a wake-up word on one device, the system can intelligently select a suitable device among multiple devices to respond, avoiding the situation of one call being answered by all. The response strategy of collaborative wake-up can be the nearest strategy, or it can intelligently decide a suitable device to respond based on information such as distance, active status, and device category. In addition, the priorities and working states of devices in the collaborative wake-up network are considered during the collaborative wake-up process. For example, when the same type of devices (such as two mobile phones) are awakened simultaneously, the device closer to the user will respond first.

[0089] Step 120: The terminal device sends a collaborative wake-up request message to a network device in the collaborative wake-up network, and the collaborative wake-up request message is used to request collaborative wake-up with other devices in the collaborative wake-up network;

[0090] The terminal device sends a collaborative wake-up request message to a network device in the collaborative wake-up network to request collaborative wake-up with other devices in the collaborative wake-up network.

[0091] Optionally, the network device is a gateway in the collaborative wake-up network.

[0092] After receiving the collaborative wake-up request message sent by the terminal device, the network device adds the terminal device to the collaborative wake-up list. Different devices in the collaborative wake-up list are awakened by a preset unified wake-up word. Then, a collaborative wake-up request response message is sent to the terminal device, and the unified wake-up word is carried in the collaborative wake-up request response message.

[0093] Step 130: The terminal device receives the collaborative wake-up request response message sent by the network device, and the unified wake-up word is carried in the collaborative wake-up request response message.

[0094] The unified wake-up word is a pre-set wake-up word and can be set as needed.

[0095] Through the unified wake-up word, collaborative wake-up of each device in the collaborative wake-up network can be achieved.

[0096] Step 140: The terminal device generates voice prompt information based on the unified wake-up word and plays the voice prompt information, and the voice prompt information is used to prompt the user to wake up the terminal device by the unified wake-up word;

[0097] It can be understood that the terminal device generates a voice prompt message based on the unified wake-up word, and then the terminal device plays the voice prompt message to the user.

[0098] For example, the user brings a voice terminal such as a mobile phone or a smart speaker into the smart car. The smart terminal such as the mobile phone actively connects (via Bluetooth or wireless) to the in-vehicle local area network. After the in-vehicle local area network discovers the newly added wake-up terminal, it asks the user: You have a new device xx connected. Do you want to cooperate for wake-up? The user answers: Yes. Then the voice prompt message is played: Okay, the new device xx has been connected. You can wake me up by "Xiaohe Xiaohe / xxxx".

[0099] Step 150: When the terminal device receives the wake-up instruction sent by the network device, perform a voice pickup operation.

[0100] After the network device receives the user's wake-up voice message, it performs voice recognition on the wake-up voice message. When the wake-up voice message matches the unified wake-up word, the network device locates the target wake-up device through end-side wake-up discrimination.

[0101] The network device sends a wake-up instruction to the target wake-up device. The wake-up instruction is used to wake up the target wake-up device so that the target wake-up device performs a voice pickup operation.

[0102] If the terminal device receives the wake-up instruction sent by the network device, then this terminal device is the target wake-up device, and then this terminal device performs a voice pickup operation to obtain the user's service request voice message through voice pickup and further process it. Here, the service request voice message refers to the service request of the user for the terminal device through voice, such as playing music, making a call, opening a video software, etc.

[0103] It should be noted that if the terminal device cannot be connected to the cooperative wake-up network, it will voice broadcast to prompt the user whether the wake-up word is unified. If unified wake-up is required, the cloud server will send the unified wake-up word to this terminal device through the http interface. The subsequent wake-up of this terminal device will complete device wake-up using the received unified wake-up word and other information, but the priority of wake-up discrimination on the cloud side is lower than that of local area network wake-up.

[0104] After the user takes the terminal device out of the cooperative wake-up network, when the network device discovers that the list of devices hanging under it has been updated, it will actively update the cooperative wake-up list, that is, delete this terminal device from the cooperative wake-up list, and only select the terminal devices in the cooperative wake-up list for wake-up discrimination subsequently.

[0105] The collaborative wake-up method provided by the embodiments of the present application is such that the terminal device sends a collaborative wake-up request message to the network device in the collaborative wake-up network. The collaborative wake-up request message is used to request collaborative wake-up with other devices in the collaborative wake-up network. The network device receives the collaborative wake-up request, adds the terminal device to the collaborative wake-up list. Different devices in the collaborative wake-up list are woken up by a preset unified wake-up word, and a collaborative wake-up request response message is sent to the terminal device. The unified wake-up word is carried in the collaborative wake-up request response message. The terminal device generates voice prompt information based on the unified wake-up word and plays the voice prompt information. The voice prompt information is used to prompt the user to wake up the terminal device by the unified wake-up word. The network device receives the user's wake-up voice information, performs voice recognition on the wake-up voice information. In the case where the wake-up voice information matches the unified wake-up word, the network device locates the target wake-up device through end-side wake-up discrimination and sends a wake-up instruction to the target wake-up device. The target wake-up device performs a sound pickup operation, so that different brand terminal devices can be woken up by a unified wake-up word, improving the user's voice wake-up interaction experience.

[0106] It should be noted that each embodiment of the present application can be freely combined, the order can be swapped, or it can be executed independently, without relying on or depending on a fixed execution order.

[0107] In some embodiments, the information carried in the collaborative wake-up request message includes at least one of the following: the interaction token of the terminal device, the corresponding user identification information, the location information of the terminal device, the capability information of the terminal device, and the wake-up priority information.

[0108] It can be understood that the terminal device sends a collaborative wake-up request message to the network device in the collaborative wake-up network. The information carried in the collaborative wake-up request message includes at least one of the following: the interaction token of the terminal device, the corresponding user identification information, the location information of the terminal device, the capability information of the terminal device, and the wake-up priority information.

[0109] Among them, the interaction token of the terminal device is mainly used to verify the user's identity and permissions, as well as for secure data transmission, etc. The location information of the terminal device refers to the IP address of the terminal device. The capability information of the terminal device includes the microphone performance and hardware capabilities of the terminal itself. The hardware capabilities include: CPU, memory resources, etc., which are used for subsequent wake-up discrimination. The wake-up priority information defines the wake-up priority of the terminal device. For example, it can be preferential wake-up or collaborative wake-up. Here, preferential wake-up means that the wake-up priority of the terminal device is higher. The wake-up priority information can be set by the user.

[0110] The public interface for receiving instructions for wake-up on the terminal side and the cloud side is https: / / [ip:port|domain name:port] / skillopen / wakeUp. The information carried in the collaborative wake-up request message is shown in Table 1.

[0111] Table 1 Information Carried in the Collaborative Wake-up Request Message

[0112]

[0113] In the collaborative wake-up method provided by the embodiments of this application, the terminal device sends a collaborative wake-up request message to the network device in the collaborative wake-up network. The information carried in the collaborative wake-up request message includes at least one of the following: the interaction token of the terminal device, the corresponding user identification information, the location information of the terminal device, the capability information of the terminal device, and the wake-up priority information. Thus, the wake-up of terminal devices of different brands can be achieved through a unified wake-up word, improving the user voice wake-up interaction experience.

[0114] In some embodiments, the terminal device sending a collaborative wake-up request message to the network device in the collaborative wake-up network includes:

[0115] The terminal device receives a first input determined by the user to require collaborative wake-up;

[0116] The terminal device, in response to the first input, sends a collaborative wake-up request message to the network device in the collaborative wake-up network.

[0117] It can be understood that after the terminal device is connected to the collaborative wake-up network, the gateway in the collaborative wake-up network pushes a voice message to the terminal device, asking whether the user needs collaborative wake-up. If the user determines to need collaborative wake-up, the terminal device receives the first input determined by the user to require collaborative wake-up, and in response to this first input, sends a collaborative wake-up request message to the network device in the collaborative wake-up network. The information carried in the collaborative wake-up request message includes at least one of the following: the interaction token of the terminal device, the corresponding user identification information, the location information of the terminal device, the capability information of the terminal device, and the wake-up priority information.

[0118] In the collaborative wake-up method provided by the embodiments of this application, after the terminal device determines that the user needs collaborative wake-up, it sends a collaborative wake-up request message to the network device in the collaborative wake-up network, so that the wake-up of terminal devices of different brands can be achieved through a unified wake-up word, improving the user voice wake-up interaction experience.

[0119] In some embodiments, the method further includes:

[0120] When the terminal device receives the wake-up discrimination instruction sent by the cloud server, it performs a voice pickup operation and reports the audio stream information obtained through voice pickup to the cloud server;

[0121] Alternatively, it reports the service request voice information obtained through voice pickup to the network device.

[0122] In one embodiment, wake-up discrimination can be implemented through the cloud server to locate the target wake-up device. When the terminal device receives the wake-up discrimination instruction sent by the cloud server, it performs a voice pickup operation and reports the audio stream information obtained through voice pickup to the cloud server.

[0123] In another embodiment, the terminal device reports the service request voice information obtained through voice pickup to the network device for further corresponding processing. Here, the service request voice information refers to the service request of the user for the terminal device through voice, for example, playing music, making a call, opening a video software, etc.

[0124] For the collaborative wake-up method provided in the embodiments of the present application, when the terminal device receives the wake-up discrimination instruction sent by the cloud server, it performs a voice pickup operation and reports the audio stream information obtained through voice pickup to the cloud server; or, it reports the service request voice information obtained through voice pickup to the network device. Through a unified wake-up word, the wake-up of terminal devices of different brands can be realized, improving the user voice wake-up interaction experience.

[0125] Figure 2 This is the second schematic flowchart of the collaborative wake-up method provided in the embodiments of the present application. As Figure 2 shown, the method includes the following steps: Step 210, Step 220, Step 230, and Step 240. The process steps of the method are only a possible implementation manner of the present application. The method includes:

[0126] Step 210, the network device receives the collaborative wake-up request message sent by the terminal device, adds the terminal device to the collaborative wake-up list, and different devices in the collaborative wake-up list are woken up by a preset unified wake-up word;

[0127] In some embodiments, the information carried in the collaborative wake-up request message includes at least one of the following: the interaction token of the terminal device, the corresponding user identification information, the location information of the terminal device, the capability information of the terminal device, and the wake-up priority information.

[0128] After the user takes the terminal device out of the collaborative wake-up network, when the network device detects a change in the attached devices, it will actively update the collaborative wake-up list, that is, delete the terminal device from the collaborative wake-up list. Subsequently, only the terminal devices in the collaborative wake-up list will be selected during wake-up discrimination.

[0129] Step 220: The network device sends a collaborative wake-up request response message to the terminal device, and the unified wake-up word is carried in the collaborative wake-up request response message.

[0130] The unified wake-up word is a pre-set wake-up word and can be set according to needs.

[0131] Through the unified wake-up word, collaborative wake-up of each device in the collaborative wake-up network can be achieved.

[0132] The terminal device reports according to the location IP generated during network configuration for subsequent collaborative wake-up discrimination. And the user can customize the wake-up priority. After receiving the collaborative wake-up request message sent by the terminal device, the network device (such as the gateway or platform of the collaborative wake-up network) in the collaborative wake-up network feedbacks a collaborative wake-up request response message. The information carried in the collaborative wake-up request response message includes: interaction token, user unique identifier, unified wake-up word identifier, and wake-up discrimination identifier, as shown in Table 2.

[0133] Table 2 Information Carried in the Collaborative Wake-up Request Response Message

[0134]

[0135] Step 230: The network device receives the user's wake-up voice information, performs speech recognition on the wake-up voice information. When the wake-up voice information matches the unified wake-up word, the network device locates the target wake-up device through end-side wake-up discrimination.

[0136] The network device receives the user's wake-up voice information and performs speech recognition on the wake-up voice information. If the wake-up voice information matches the unified wake-up word, it is determined that the user wants to wake up a certain device in the collaborative wake-up network. Then the network device will first locate the target wake-up device through end-side wake-up discrimination.

[0137] Among them, end-side wake-up discrimination refers to performing collaborative wake-up discrimination locally on the network device to locate the target wake-up device, and the target wake-up device is the wake-up object targeted by the user's wake-up voice information.

[0138] The end - side wake - up discrimination can determine the target wake - up device according to information such as distance and orientation. For example, a device closer to the user will respond preferentially. In some embodiments of the present application, the end - side wake - up discrimination considers voice orientation and intensity. The advantage of end - side wake - up discrimination is that the discrimination speed is fast, which can ensure the user interaction experience. And for end - side discrimination, since only the network device needs to pick up sound daily, only the network device needs to be connected to the power supply for a long time, while other terminals do not turn on the wake - up discrimination. And other terminals can all adopt a low - power consumption method. Only after receiving the sound - picking notice from the gateway side, they start to pick up sound, which can greatly reduce the power consumption of the devices awakened in the local area network and meet the requirements of scenarios such as in - vehicle and outdoor.

[0139] Step 240, the network device sends a wake - up instruction to the target wake - up device, and the wake - up instruction is used to wake up the target wake - up device so that the target wake - up device performs a sound - picking operation.

[0140] The network device sends a wake - up instruction to the target wake - up device. After receiving the wake - up instruction, the target wake - up device performs a sound - picking operation.

[0141] In the collaborative wake - up method provided by the embodiments of the present application, the terminal device sends a collaborative wake - up request message to the network device in the collaborative wake - up network. The collaborative wake - up request message is used to request collaborative wake - up with other devices in the collaborative wake - up network. The network device receives the collaborative wake - up request, adds the terminal device to the collaborative wake - up list. Different devices in the collaborative wake - up list are awakened by a preset unified wake - up word, and a collaborative wake - up request response message is sent to the terminal device. The unified wake - up word is carried in the collaborative wake - up request response message. The network device receives the user's wake - up voice information, performs voice recognition on the wake - up voice information. When the wake - up voice information matches the unified wake - up word, the network device locates the target wake - up device through end - side wake - up discrimination, sends a wake - up instruction to the target wake - up device, and the target wake - up device performs a sound - picking operation. Thus, the wake - up of different brand terminal devices can be realized through a unified wake - up word, improving the user's voice wake - up interaction experience. And by adopting the method of low - power consumption wake - up discrimination, the portability of the awakened terminal is improved, and the requirements of different scenarios can be met, especially the requirements of scenarios such as enclosed spaces and internal network wake - up.

[0142] In some embodiments, the network device locates the target wake - up device through end - side wake - up discrimination, including:

[0143] Calculate the wake - up discrimination values of each device in the collaborative wake - up list;

[0144] Determine the maximum value among the wake - up discrimination values of each device in the collaborative wake - up list;

[0145] If the maximum value is greater than or equal to a preset threshold, the device corresponding to the maximum value is determined as the target wake - up device.

[0146] In some embodiments, calculating the wake-up discrimination values of the devices in the collaborative wake-up list includes:

[0147] Calculating the similarity between the location of each device in the collaborative wake-up list and the orientation of the wake-up voice information;

[0148] Obtaining the intensity of the wake-up voice information collected by each device in the collaborative wake-up list;

[0149] Calculating the wake-up discrimination values of the devices in the collaborative wake-up list according to the similarity, intensity, and preset wake-up discrimination parameters.

[0150] Specifically, the following formula is used to calculate the wake-up discrimination values of the devices in the collaborative wake-up list:

[0151]

[0152] Where K represents the number of devices in the collaborative wake-up network that need to perform wake-up discrimination, Q j represents the volume decibel value, that is, the intensity of the wake-up voice information collected by each device in the collaborative wake-up list, a and b represent preset wake-up discrimination parameters, and P j represents the similarity between the location of each device in the collaborative wake-up list and the orientation of the wake-up voice information.

[0153] After calculating the end-side wake-up discrimination values of the devices in the collaborative wake-up list, determine the maximum value among the wake-up discrimination values of the devices in the collaborative wake-up list. If the maximum value is greater than or equal to the preset threshold, determine the device corresponding to the maximum value as the target wake-up device.

[0154] For example, if the maximum value w > 0.5, determine the device corresponding to the maximum value as the target wake-up device.

[0155] The existing end-side wake-up word scheme only discriminates by judging the sound wave intensity, which is feasible in large-space rooms, but in enclosed spaces such as inside a vehicle, problems such as echoes and misidentifications are likely to occur, and volume and orientation have a heavy interference on collaborative wake-up in small spaces. In the embodiments of the present application, by calculating the wake-up discrimination values of the devices in the collaborative wake-up list, determining the maximum value among the wake-up discrimination values of the devices in the collaborative wake-up list, and if the maximum value is greater than or equal to the preset threshold, determining the device corresponding to the maximum value as the target wake-up device, the accuracy of wake-up discrimination in enclosed spaces or small-space scenarios can be effectively improved.

[0156] In some embodiments, the method further includes:

[0157] If the maximum value is less than the preset threshold, initiate cloud-side wake-up discrimination to determine the target wake-up device.

[0158] It can be understood that if the maximum value of the end - side wake - up discrimination values of each device in the collaborative wake - up list calculated by the end - side wake - up discrimination is less than the preset threshold, it means that the end - side wake - up cannot determine the target wake - up device, and the cloud - side wake - up discrimination needs to be started.

[0159] Among them, the cloud - side wake - up discrimination refers to performing wake - up discrimination through a cloud server. The cloud - side wake - up discrimination scheme has strong applicability and high discrimination accuracy.

[0160] In some embodiments, the starting of the cloud - side wake - up discrimination includes:

[0161] The network device sends a wake - up discrimination request message to the cloud server. The wake - up discrimination request message carries the location information, capability information, and wake - up priority information of each device in the collaborative wake - up list, so that the cloud server determines the target wake - up device according to the location information, capability information, and wake - up priority information of each device.

[0162] It can be understood that the network device sends a wake - up discrimination request message to the cloud server, and the cloud server receives the wake - up discrimination request message sent by the network device. The wake - up discrimination request message carries the location information, capability information, and wake - up priority information of each device in the collaborative wake - up list; the cloud server issues a wake - up discrimination instruction to each device in the collaborative wake - up list, and the wake - up discrimination instruction is used to instruct each device in the collaborative wake - up list to report the audio stream information obtained by voice pickup; the cloud server determines the target wake - up device according to the audio stream information reported by each device in the collaborative wake - up list and the location information, capability information, and wake - up priority information of each device in the collaborative wake - up list.

[0163] In the collaborative wake - up method provided by the embodiments of the present application, the network device sends a wake - up discrimination request message to the cloud server. After the cloud server receives the wake - up discrimination request message sent by the network device, it comprehensively determines the target wake - up device according to the location information, capability information, and wake - up priority information of each device in the collaborative wake - up list carried in the wake - up discrimination request message, which can effectively improve the wake - up accuracy.

[0164] In some embodiments, the method further includes:

[0165] The network device receives the service request voice information obtained by voice pickup sent by the target wake - up device and calculates the wake - up discrimination value of the target wake - up device;

[0166] If the wake - up discrimination value of the target wake - up device is greater than or equal to the preset threshold, the processing operation corresponding to the service request voice information is executed;

[0167] If the wake-up discrimination value of the target wake-up device is less than the preset threshold, cloud-side wake-up discrimination is initiated to re-determine the target wake-up device.

[0168] It can be understood that after the target wake-up device is determined, the present application embodiment provides a discrimination method correction ability, that is, it is determined whether the device continues to pick up sound according to the voice pickup effect and device function after waking up.

[0169] Specifically, the network device receives the service request voice information obtained by voice pickup sent by the target wake-up device, and calculates the wake-up discrimination value of the target wake-up device;

[0170] If the wake-up discrimination value of the target wake-up device is greater than or equal to the preset threshold, the processing operation corresponding to the service request voice information is executed. For example, playing music, making a call, opening a video software, etc.

[0171] If the wake-up discrimination value of the target wake-up device is less than the preset threshold, cloud-side wake-up discrimination is initiated to re-determine the target wake-up device.

[0172] In some embodiments, the initiation of cloud-side wake-up discrimination includes:

[0173] The network device sends a wake-up discrimination request message to the cloud server, and the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list are carried in the wake-up discrimination request message, so that the cloud server re-determines the target wake-up device according to the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0174] Specifically, the network device sends a wake-up discrimination request message to the cloud server, and the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list are carried in the wake-up discrimination request message; the cloud server re-determines the target wake-up device according to the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0175] The characteristic of cloud discrimination is that each terminal device needs to pick up sound and report to the cloud server at the beginning. The cloud server will provide a comprehensive evaluation result based on the audio acquisition situation, the capabilities of the device side, and the computing power of the device side. The evaluation algorithm is as follows:

[0176]

[0177] Among them, K represents the number of devices that need to perform wake-up discrimination in the collaborative wake-up network, s jRepresents the matching degree between the capabilities of the edge side itself (such as audio and video broadcasting, calls, etc.) and the semantic analysis results, e j Represents the weight of the computing power resources available on the edge side, z * Represents the quality of audio acquisition. a and b represent the collaborative wake-up correction parameters, T j Represents the audio signal-to-noise ratio.

[0178] The cloud server calculates the collaborative wake-up discrimination value index for each terminal through the above method, selects the terminal device for specific coordinated wake-up, and issues a wake-up instruction to perform subsequent wake-up operations. Cloud discrimination is only enabled when the edge-side wake-up discrimination value does not meet the requirements because of high power consumption and slow response.

[0179] The collaborative wake-up method provided in the embodiments of the present application combines the wake-up discrimination schemes of the edge side and the cloud side, which can not only solve the slow speed of cloud discrimination but also solve the poor applicability of edge-side discrimination.

[0180] Figure 3 This is the third schematic diagram of the process of the collaborative wake-up method provided in the embodiments of the present application. As Figure 3 shown, the method includes the following steps: Step 310, Step 320, and Step 330. The process steps of the method are only a possible implementation manner of the present application. The method includes:

[0181] Step 310: The cloud server receives a wake-up discrimination request message sent by a network device. The wake-up discrimination request message carries the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0182] Step 320: The cloud server issues a wake-up discrimination instruction to each device in the collaborative wake-up list. The wake-up discrimination instruction is used to instruct each device in the collaborative wake-up list to report the audio stream information obtained through sound pickup.

[0183] Step 330: The cloud server determines the target wake-up device according to the audio stream information reported by each device in the collaborative wake-up list and the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0184] In some embodiments, the wake-up discrimination request message further carries service request voice information. After the cloud server receives the wake-up discrimination request message sent by the network device, the method further includes:

[0185] The cloud server re-determines the target wake-up device according to the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0186] For the specific steps of wake-up determination for the cloud server, reference can be made to the description in the embodiments of the collaborative wake-up method for the foregoing terminal device and network device, which will not be elaborated herein.

[0187] The collaborative wake-up method provided by the embodiments of the present application combines the wake-up determination schemes on the terminal side and the cloud side according to the device wake-up situation, which can not only solve the problem of slow cloud discrimination speed, but also solve the problem of poor applicability of terminal-side discrimination, taking into account both discrimination speed and accuracy.

[0188] The following describes the collaborative wake-up device provided by the present application. The collaborative wake-up device described below can be correspondingly referred to the collaborative wake-up method described above.

[0189] Figure 4 is one of the structural schematic diagrams of the collaborative wake-up device provided by the embodiments of the present application. As Figure 4 shown, the collaborative wake-up device is applied to a terminal device and includes:

[0190] An access unit 410, configured to connect to a collaborative wake-up network;

[0191] A first sending unit 420, configured to send a collaborative wake-up request message to a network device in the collaborative wake-up network, where the collaborative wake-up request message is used to request collaborative wake-up with other devices in the collaborative wake-up network;

[0192] A first receiving unit 430, configured to receive a collaborative wake-up request response message sent by the network device, where the collaborative wake-up request response message carries a unified wake-up word;

[0193] A first generating unit 440, configured to generate voice prompt information based on the unified wake-up word and play the voice prompt information, where the voice prompt information is used to prompt a user to wake up the terminal device by using the unified wake-up word;

[0194] A first processing unit 450, configured to perform a voice pickup operation when receiving a wake-up instruction sent by the network device.

[0195] In some embodiments, the information carried in the collaborative wake-up request message includes at least one of the following: an interaction token of the terminal device, corresponding user identification information, location information of the terminal device, capability information of the terminal device, and wake-up priority information.

[0196] In some embodiments, the sending the collaborative wake-up request message to a network device in the collaborative wake-up network includes:

[0197] Receiving a first input determined by a user to require collaborative wake-up;

[0198] In response to the first input, send a collaborative wake-up request message to the network devices in the collaborative wake-up network.

[0199] In some embodiments, the device further includes: a second processing unit, configured to:

[0200] In the case of receiving a wake-up discrimination instruction sent by the cloud server, perform a voice pickup operation and report the audio stream information obtained through voice pickup to the cloud server;

[0201] Or, report the service request voice information obtained through voice pickup to the network device.

[0202] It should be noted here that the collaborative wake-up device provided in the embodiments of the present application can implement all the method steps implemented in the above-mentioned collaborative wake-up method embodiments on the terminal device side, and can achieve the same technical effects. The same parts and beneficial effects as those in the method embodiments will not be specifically described in this embodiment.

[0203] Figure 5 This is the second structural schematic diagram of the collaborative wake-up device provided in the embodiments of the present application. As Figure 5 shown, the collaborative wake-up device, applied to a network device, includes:

[0204] A second receiving unit 510, configured to receive a collaborative wake-up request message sent by a terminal device, add the terminal device to a collaborative wake-up list, and different devices in the collaborative wake-up list are woken up by a preset unified wake-up word;

[0205] A second sending unit 520, configured to send a collaborative wake-up request response message to the terminal device, where the collaborative wake-up request response message carries the unified wake-up word;

[0206] A first wake-up discrimination unit 530, configured to receive the user's wake-up voice information, perform voice recognition on the wake-up voice information, and in the case where the wake-up voice information matches the unified wake-up word, locate the target wake-up device through end-side wake-up discrimination;

[0207] A wake-up unit 540, configured to send a wake-up instruction to the target wake-up device, where the wake-up instruction is used to wake up the target wake-up device so that the target wake-up device performs a voice pickup operation.

[0208] In some embodiments, the locating the target wake-up device through end-side wake-up discrimination includes:

[0209] Calculate the wake-up discrimination values of each device in the collaborative wake-up list;

[0210] Determine the maximum value among the wake-up discrimination values of each device in the collaborative wake-up list;

[0211] If the maximum value is greater than or equal to a preset threshold, determine the device corresponding to the maximum value as the target wake-up device.

[0212] In some embodiments, calculating the wake-up discrimination values of the devices in the collaborative wake-up list includes:

[0213] Calculating the similarity between the locations of the devices in the collaborative wake-up list and the orientation of the wake-up voice information;

[0214] Obtaining the intensity of the wake-up voice information collected by the devices in the collaborative wake-up list;

[0215] Calculating the wake-up discrimination values of the devices in the collaborative wake-up list according to the similarity, intensity, and preset wake-up discrimination parameters.

[0216] In some embodiments, the device further includes:

[0217] A cloud wake-up discrimination start unit, configured to, if the maximum value is less than the preset threshold, start wake-up discrimination on the cloud side to determine the target wake-up device.

[0218] In some embodiments, the starting of the wake-up discrimination on the cloud side includes:

[0219] The network device sends a wake-up discrimination request message to the cloud server, and the wake-up discrimination request message carries the location information, capability information, and wake-up priority information of the devices in the collaborative wake-up list, so that the cloud server determines the target wake-up device according to the location information, capability information, and wake-up priority information of the devices.

[0220] In some embodiments, the device further includes: a third processing unit, configured to:

[0221] The network device receives the service request voice information obtained by picking up the sound sent by the target wake-up device, and calculates the wake-up discrimination value of the target wake-up device;

[0222] If the wake-up discrimination value of the target wake-up device is greater than or equal to the preset threshold, perform the processing operation corresponding to the service request voice information;

[0223] If the wake-up discrimination value of the target wake-up device is less than the preset threshold, start wake-up discrimination on the cloud side to re-determine the target wake-up device.

[0224] In some embodiments, the starting of the wake-up discrimination on the cloud side includes:

[0225] The network device sends a wake-up discrimination request message to the cloud server, and the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list are carried in the wake-up discrimination request message, so that the cloud server re-determines the target wake-up device according to the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0226] It should be noted here that the collaborative wake-up device provided in the embodiments of the present application can implement all the method steps implemented in the above-mentioned collaborative wake-up method embodiments on the network device side, and can achieve the same technical effects. The same parts and beneficial effects as those in the method embodiments will not be specifically described in this embodiment.

[0227] Figure 6 This is the third structural schematic diagram of the collaborative wake-up device provided in the embodiments of the present application. As Figure 6 shown, the collaborative wake-up device is applied to the cloud server and includes:

[0228] A third receiving unit 610, configured to receive a wake-up discrimination request message sent by a network device, where the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list are carried in the wake-up discrimination request message;

[0229] A third sending unit 620, configured to send a wake-up discrimination instruction to each device in the collaborative wake-up list, where the wake-up discrimination instruction is used to instruct each device in the collaborative wake-up list to report audio stream information obtained by voice pickup;

[0230] A second wake-up discrimination unit 630, configured to determine a target wake-up device according to the audio stream information reported by each device in the collaborative wake-up list and the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0231] In some embodiments, service request voice information is further carried in the wake-up discrimination request message; the device further includes:

[0232] A third wake-up discrimination unit, configured to re-determine the target wake-up device according to the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

[0233] It should be noted here that the collaborative wake-up device provided in the embodiments of the present application can implement all the method steps implemented in the above-mentioned collaborative wake-up method embodiments on the cloud server side, and can achieve the same technical effects. The same parts and beneficial effects as those in the method embodiments will not be specifically described in this embodiment.

[0234] An embodiment of the present application further provides a terminal device, including a processor and a communication interface, the communication interface being coupled to the processor, and the processor being configured to run programs or instructions to implement as Figure 1 the steps in the method embodiment shown. This terminal device embodiment corresponds to the above-mentioned terminal device side method embodiment. Each implementation process and implementation manner of the above method embodiment can be applied to this terminal device embodiment, and the same technical effects can be achieved. Specifically, Figure 7 FIG. is a schematic diagram of the hardware structure of a terminal device according to an embodiment of the present application.

[0235] The terminal device 700 includes, but is not limited to, at least some components such as a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, and a processor 710.

[0236] Those skilled in the art can understand that the terminal 700 may further include a power supply (such as a battery) for powering each component. The power supply may be logically connected to the processor 710 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 7 The terminal structure shown in does not constitute a limitation on the terminal. The terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0237] It should be understood that in the embodiment of the present application, the input unit 704 may include a graphics processing unit (GPU) 7041 and a microphone 7042. The graphics processor 7041 processes the image data of static pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 707 includes at least one of a touch panel 7071 and other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include two parts: a touch detection device and a touch controller. The other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated here.

[0238] In the embodiment of the present application, after the radio frequency unit 701 receives the downlink data from the network device, it can be transmitted to the processor 710 for processing; in addition, the radio frequency unit 701 can send the uplink data to the network device. Generally, the radio frequency unit 701 includes but is not limited to antennas, amplifiers, transceivers, couplers, low noise amplifiers, duplexers, etc.

[0239] The memory 709 can be used to store software programs or instructions and various data. The memory 709 mainly includes a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area can store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 709 can include volatile memory or non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 709 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0240] The processor 710 may include one or more first processing units; optionally, the processor 710 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor may not be integrated into the processor 710 either.

[0241] Among them, the radio frequency unit 701 is used to connect to the cooperative wake-up network;

[0242] A processor 710 is configured to: send a cooperative wake-up request message to network devices in the cooperative wake-up network, where the cooperative wake-up request message is used to request cooperative wake-up with other devices in the cooperative wake-up network; receive a cooperative wake-up request response message sent by the network device, where the cooperative wake-up request response message carries a unified wake-up word; generate a voice prompt message based on the unified wake-up word, and play the voice prompt message, where the voice prompt message is used to prompt the user to wake up the terminal device with the unified wake-up word; and perform a voice pickup operation when receiving a wake-up instruction sent by the network device.

[0243] It can be understood that the implementation processes of the implementation methods mentioned in this embodiment can refer to the relevant descriptions of the cooperative wake-up method in the method embodiment on the terminal device side, and achieve the same or corresponding technical effects. To avoid repetition, they will not be elaborated here.

[0244] An embodiment of the present application further provides a network device, including a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement the steps of the method embodiment as Figure 2 shown. This network device embodiment corresponds to the above-mentioned network device side method embodiment. Each implementation process and implementation method of the above method embodiment can be applied to this network device embodiment, and the same technical effects can be achieved.

[0245] Specifically, an embodiment of the present application further provides a network device. As Figure 8 shown, the network device 800 includes: an antenna 801, a radio frequency device 802, a baseband device 803, a processor 804, and a memory 805. The antenna 801 is connected to the radio frequency device 802. In the uplink direction, the radio frequency device 802 receives information through the antenna 801 and sends the received information to the baseband device 803 for processing. In the downlink direction, the baseband device 803 processes the information to be sent and sends it to the radio frequency device 802. The radio frequency device 802 processes the received information and then sends it out through the antenna 801.

[0246] The method executed by the network device in the above embodiments can be implemented in the baseband device 803, and the baseband device 803 includes a baseband processor.

[0247] The baseband device 803 may include, for example, at least one baseband board, and multiple chips are provided on the baseband board. As Figure 8 shown, one of the chips is, for example, a baseband processor, which is connected to the memory 805 through a bus interface to call a program in the memory 805 and execute the operations of the network device shown in the above method embodiments.

[0248] The network device may further include a network interface 806, such as a Common Public Radio Interface (CPRI).

[0249] Specifically, the network device 800 according to the embodiment of the present invention further includes instructions or programs stored on the memory 805 and executable on the processor 804. The processor 804 calls the instructions or programs in the memory 805 to execute the above-mentioned cooperative wake-up method and achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0250] Figure 9 A schematic structural diagram of a cloud server is illustrated, as Figure 9 shown. The cloud server may include: a processor 910, a communications interface 920, a memory 930, and a communication bus 940. Among them, the processor 910, the communications interface 920, and the memory 930 complete communication with each other through the communication bus 940. The processor 910 may call the logical instructions in the memory 930 to execute the Figure 3 cooperative wake-up method as shown.

[0251] In addition, when the logical instructions in the above-mentioned memory 930 are implemented in the form of software functional units and sold or used as independent products, they may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, may be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs, etc., which can store program codes.

[0252] The embodiment of the present application further provides a readable storage medium. Programs or instructions are stored on the readable storage medium. When the programs or instructions are executed by a processor, they implement each process of the above-mentioned embodiment of the cooperative wake-up method and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0253] Among them, the processor is the processor in the terminal described in the above embodiments. The readable storage medium includes computer-readable storage media such as computer read-only memory ROM, random access memory RAM, magnetic disks or optical discs, etc. In some examples, the readable storage medium may be a non-transitory readable storage medium.

[0254] Another embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement each process of the above embodiment of the collaborative wake-up method and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0255] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip.

[0256] Another embodiment of the present application provides a computer program / program product. The computer program / program product is stored in a storage medium. The computer program / program product is executed by at least one processor to implement each process of the above embodiment of the collaborative wake-up method and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0257] The embodiments of the present application further provide a collaborative wake-up system, including: a terminal device, a network device, and a cloud server. The terminal device can be used to execute steps such as Figure 1 shown in the collaborative wake-up method. The network device can be used to execute steps such as Figure 2 shown in the collaborative wake-up method. The cloud server can be used to execute steps such as Figure 3 shown in the collaborative wake-up method.

[0258] It should be noted that in this article, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the methods and devices in the embodiments of the present application are not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0259] Through the description of the above embodiments, those skilled in the art can clearly understand that the above method of the embodiments can be implemented by means of a computer software product plus a necessary general hardware platform, and of course, it can also be implemented by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.) and includes several instructions for causing a terminal or a network device to execute the methods described in various embodiments of the present application.

[0260] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms of embodiments without departing from the purpose of the present application and the scope protected by the claims. These embodiments are all within the protection scope of the present application.

Claims

1. A collaborative wake-up method, characterized in that, Applied to a terminal device, including: The terminal device is connected to a collaborative wake-up network; The terminal device sends a collaborative wake-up request message to a network device in the collaborative wake-up network, and the collaborative wake-up request message is used to request collaborative wake-up with other devices in the collaborative wake-up network; The terminal device receives a collaborative wake-up request response message sent by the network device, and the collaborative wake-up request response message carries a unified wake-up word; The terminal device generates voice prompt information based on the unified wake-up word and plays the voice prompt information, and the voice prompt information is used to prompt the user to wake up the terminal device through the unified wake-up word; When the terminal device receives a wake-up instruction sent by the network device, it performs a voice pickup operation.

2. The collaborative wake-up method according to claim 1, wherein The information carried in the collaborative wake-up request message includes at least one of the following: the interaction token of the terminal device, the corresponding user identification information, the location information of the terminal device, the capability information of the terminal device, and the wake-up priority information.

3. The collaborative wake-up method according to claim 1, wherein The terminal device sending a collaborative wake-up request message to a network device in the collaborative wake-up network includes: The terminal device receives a first input determined by the user to require collaborative wake-up; In response to the first input, the terminal device sends a collaborative wake-up request message to a network device in the collaborative wake-up network.

4. The collaborative wake-up method according to claim 1, wherein The method further includes: When the terminal device receives a wake-up discrimination instruction sent by a cloud server, it performs a voice pickup operation and reports audio stream information obtained through voice pickup to the cloud server; Or, report service request voice information obtained through voice pickup to the network device.

5. A collaborative wake-up method, characterized in that, Applied to a network device, including: The network device receives a collaborative wake-up request message sent by a terminal device, adds the terminal device to a collaborative wake-up list, and different devices in the collaborative wake-up list are woken up by a preset unified wake-up word; The network device sends a collaborative wake-up request response message to the terminal device, and the collaborative wake-up request response message carries the unified wake-up word; The network device receives the user's wake-up voice information, performs voice recognition on the wake-up voice information, and when the wake-up voice information matches the unified wake-up word, the network device locates the target wake-up device through end-side wake-up discrimination; The network device sends a wake-up instruction to the target wake-up device, and the wake-up instruction is used to wake up the target wake-up device so that the target wake-up device performs a voice pickup operation.

6. The collaborative wake-up method according to claim 5, wherein, The network device locating the target wake-up device through end-side wake-up discrimination includes: Calculating the wake-up discrimination value of each device in the collaborative wake-up list; Determining the maximum value among the wake-up discrimination values of each device in the collaborative wake-up list; If the maximum value is greater than or equal to a preset threshold, the device corresponding to the maximum value is determined as the target wake-up device.

7. The collaborative wake-up method according to claim 6, wherein The calculating the wake-up discrimination value of each device in the collaborative wake-up list includes: Calculating the similarity between the location of each device in the collaborative wake-up list and the orientation of the wake-up voice information; Obtaining the intensity of the wake-up voice information collected by each device in the collaborative wake-up list; Based on the similarity, intensity, and preset wake-up discrimination parameters, calculate the wake-up discrimination values of each device in the collaborative wake-up list.

8. The collaborative wake-up method according to claim 6, characterized in that, The method further includes: If the maximum value is less than the preset threshold, initiate wake-up discrimination on the cloud side to determine the target wake-up device.

9. The collaborative wake-up method according to claim 8, wherein The initiation of wake-up discrimination on the cloud side includes: The network device sends a wake-up discrimination request message to the cloud server, and the wake-up discrimination request message carries the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list, so that the cloud server determines the target wake-up device according to the location information, capability information, and wake-up priority information of each device.

10. The collaborative wake-up method according to claim 6, characterized in that The method further includes: The network device receives the service request voice information obtained by voice pickup sent by the target wake-up device, and calculates the wake-up discrimination value of the target wake-up device; If the wake-up discrimination value of the target wake-up device is greater than or equal to the preset threshold, perform the processing operation corresponding to the service request voice information; If the wake-up discrimination value of the target wake-up device is less than the preset threshold, initiate wake-up discrimination on the cloud side to re-determine the target wake-up device.

11. The collaborative wake-up method according to claim 10, wherein, The initiation of wake-up discrimination on the cloud side includes: The network device sends a wake-up discrimination request message to the cloud server, and the wake-up discrimination request message carries the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list, so that the cloud server re-determines the target wake-up device according to the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

12. A collaborative wake-up method, characterized in that, Applied to the cloud server, it includes: The cloud server receives the wake-up discrimination request message sent by the network device, and the wake-up discrimination request message carries the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list; The cloud server issues a wake-up discrimination instruction to each device in the collaborative wake-up list, and the wake-up discrimination instruction is used to instruct each device in the collaborative wake-up list to report the audio stream information obtained by voice pickup; The cloud server determines the target wake-up device according to the audio stream information reported by each device in the collaborative wake-up list and the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

13. The collaborative wake-up method according to claim 12, wherein The wake-up discrimination request message also carries the service request voice information; after the cloud server receives the wake-up discrimination request message sent by the network device, the method further includes: The cloud server re-determines the target wake-up device according to the service request voice information, the location information, capability information, and wake-up priority information of each device in the collaborative wake-up list.

14. A collaborative wake-up device, characterized in that, It includes: An access unit for connecting to the collaborative wake-up network; A first sending unit for sending a collaborative wake-up request message to the network device in the collaborative wake-up network, and the collaborative wake-up request message is used to request collaborative wake-up with other devices in the collaborative wake-up network. A first receiving unit, configured to receive the cooperative wake-up request response message sent by the network device, where the cooperative wake-up request response message carries a unified wake-up word; A first generating unit, configured to generate voice prompt information based on the unified wake-up word and play the voice prompt information, where the voice prompt information is used to prompt the user to wake up the terminal device by using the unified wake-up word; A first processing unit, configured to perform a voice pickup operation when receiving the wake-up instruction sent by the network device.

15. A collaborative wake-up device, characterized in that, Comprising: A second receiving unit, configured to receive the cooperative wake-up request message sent by the terminal device and add the terminal device to a cooperative wake-up list, where different devices in the cooperative wake-up list are woken up by using a preset unified wake-up word; A second sending unit, configured to send a cooperative wake-up request response message to the terminal device, where the cooperative wake-up request response message carries the unified wake-up word; A first wake-up discrimination unit, configured to receive the user's wake-up voice information, perform voice recognition on the wake-up voice information, and locate the target wake-up device through end-side wake-up discrimination when the wake-up voice information matches the unified wake-up word; A wake-up unit, configured to send a wake-up instruction to the target wake-up device, where the wake-up instruction is used to wake up the target wake-up device so that the target wake-up device performs a voice pickup operation.

16. A collaborative wake-up device, characterized in that, Comprising: A third receiving unit, configured to receive the wake-up discrimination request message sent by the network device, where the wake-up discrimination request message carries the location information, capability information, and wake-up priority information of each device in the cooperative wake-up list; A third sending unit, configured to send a wake-up discrimination instruction to each device in the cooperative wake-up list, where the wake-up discrimination instruction is used to instruct each device in the cooperative wake-up list to report the audio stream information obtained through voice pickup; A second wake-up discrimination unit, configured to determine the target wake-up device according to the audio stream information reported by each device in the cooperative wake-up list and the location information, capability information, and wake-up priority information of each device in the cooperative wake-up list.

17. A terminal device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the cooperative wake-up method according to any one of claims 1 to 4.

18. A network device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the cooperative wake-up method according to any one of claims 5 to 11.

19. A cloud server, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the cooperative wake-up method according to any one of claims 12 to 13.

20. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the cooperative wake-up method according to any one of claims 1 to 4, or implements the cooperative wake-up method according to any one of claims 5 to 11, or implements the cooperative wake-up method according to any one of claims 12 to 13.

Images