Equipment binding method, device and system based on voice interaction

Abstract

The invention provides an equipment binding method, device and system based on voice interaction. The method comprises the following steps: receiving a first voice instruction, and determining to-be-bound equipment in a target space according to the first voice instruction; broadcasting related information of the to-be-bound equipment through voice; receiving a second voice instruction, and verifying the identity of the user according to the voiceprint information of the second voice instruction; and when the identity verification of the user is successful, executing a binding operation of the to-be-bound device, and broadcasting a binding result of the to-be-bound device through voice. Therefore, the user can be guided to carry out equipment binding step by step in a voice interaction mode, and the complexity degree of equipment binding is reduced; meanwhile, the user identity is verified based on the voiceprint, the verification efficiency is improved, and the use experience of the user is improved.

Description

Technical Field

[0001] This application relates to the field of device control, and particularly to a device binding method, apparatus, and system based on voice interaction. Background Art

[0002] With the development of science and technology and urban construction, a large number of devices need to be installed in places such as office buildings, apartments, schools, shopping malls, etc., such as air conditioner indoor units. With the progress of intelligent technology, more and more devices can be connected to user terminals for various applications. For example, the installed devices can be controlled through an application program (APP) on the user terminal.

[0003] In order to enable the control of the installed devices through the user terminal, the user terminal and the installed devices need to be bound first. Currently, one existing device binding method is that the user terminal identifies the device to be bound and performs a binding operation after scanning the identification information such as a QR code on the device; another existing binding method is that the user terminal binds after connecting to the device to be bound through Bluetooth.

[0004] It should be noted that the above introduction to the technical background is only for the convenience of clearly and completely explaining the technical solution of this application and facilitating the understanding of those skilled in the art. It cannot be considered that the above technical solutions are well known to those skilled in the art just because these solutions are described in the background art part of this application. Summary of the Invention

[0005] The inventors found that in the above existing technologies, whether it is device binding by scanning a QR code or device binding through Bluetooth, the user needs to know which devices have been bound and which devices have not been bound. Currently, there is no effective means to easily let the user know which unbound devices there are, and the user needs to search by himself, resulting in inconvenient use;

[0006] In addition, the user needs to manually perform various operations related to binding on the terminal to complete the entire binding process. If the user is not familiar with the binding operations and processes, it may lead to problems such as binding errors and low binding efficiency.

[0007] To solve one or more of the above problems, embodiments of this application provide a device binding method, apparatus, and system based on voice interaction.

[0008] According to the first aspect of the embodiments of the present application, a device binding method based on voice interaction is provided. The method includes: receiving a first voice command, and determining a device to be bound in a target space according to the first voice command; announcing the relevant information of the device to be bound through voice; receiving a second voice command, and performing user authentication according to the voiceprint information of the second voice command; when the user authentication is successful, performing the binding operation of the device to be bound, and announcing the binding result of the device to be bound through voice.

[0009] According to the second aspect of the embodiments of the present application, a system for device binding based on voice interaction is provided. The system includes at least one device to be bound, a control device, and a voice interaction device. The control device is configured to determine a device to be bound in a target space according to a received first voice command; control the voice interaction device to announce the relevant information of the device to be bound through voice; perform user authentication according to the voiceprint information of a received second voice command; when the user authentication is successful, perform the binding operation of the device to be bound, and control the voice interaction device to announce the binding result of the device to be bound through voice. The voice interaction device is configured to receive the first voice command, the second voice command, and announce the relevant information of the device to be bound and the binding result of the device to be bound through voice.

[0010] According to the third aspect of the embodiments of the present application, a device binding device based on voice interaction is provided. The device includes: a first receiving unit, configured to receive a first voice command; a determining unit, configured to determine a device to be bound in a target space according to the first voice command; a first announcing unit, configured to announce the relevant information of the device to be bound through voice; a second receiving unit, configured to receive a second voice command; an authentication unit, configured to perform user authentication according to the voiceprint information of the second voice command; a binding unit, configured to perform the binding operation of the device to be bound when the user authentication is successful; a second announcing unit, configured to announce the binding result of the device to be bound through voice.

[0011] According to the fourth aspect of the embodiments of the present application, an electronic device is provided. The electronic device includes: a memory storing a computer program; and a processor that, when executing the computer program, implements the method described in the first aspect of the embodiments of the present application.

[0012] According to the fifth aspect of the embodiments of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method described in the first aspect of the embodiments of the present application is implemented.

[0013] One of the beneficial effects of the embodiments of the present application is that:

[0014] Through the user's voice command, the determination process of the device to be bound can be triggered, and the relevant information of the device to be bound can be announced by voice, enabling the user to conveniently understand the device to be bound;

[0015] Moreover, by performing identity verification according to the user's further voice command and directly executing the binding operation when the verification is successful, the operation steps for the user to bind the device can be reduced, guiding the user to easily complete the binding.

[0016] In addition, user identity verification based on the voiceprint information of the user's voice improves the efficiency of user identity verification and the security of device binding, and by announcing the binding result by voice, the user can timely understand the binding result, improving the user experience.

[0017] Referring to the following description and drawings, specific embodiments of the present application are disclosed in detail, indicating the ways in which the principles of the present application can be adopted. It should be understood that the embodiments of the present application are not limited thereby in scope. Within the spirit and terms of the appended claims, the embodiments of the present application include many changes, modifications, and equivalents.

[0018] The characteristic information described and illustrated for one embodiment can be used in the same or similar manner in one or more other embodiments, combined with the characteristic information in other embodiments, or replace the characteristic information in other embodiments.

[0019] It should be emphasized that the term "comprising / including" when used herein refers to the presence of characteristic information, whole, step, or component, but does not exclude the presence or addition of one or more other characteristic information, whole, step, or component. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Many aspects of the present application can be better understood with reference to the following drawings. The components in the drawings are not drawn to scale, but are only for showing the principles of the present application. For the convenience of showing and describing some parts of the present application, the corresponding parts in the drawings may be enlarged or reduced. The elements and characteristic information described in one drawing or one embodiment of the present application can be combined with the elements and characteristic information shown in one or more other drawings or embodiments. In addition, in the drawings, like reference numerals represent corresponding components in several drawings and can be used to indicate the corresponding components used in more than one embodiment.

[0021] In the drawings:

[0022] Figure 1 is a block diagram of a device binding method based on voice interaction according to an embodiment of the present application;

[0023] Figure 2It is another block diagram of the device binding method based on voice interaction according to an embodiment of the present application;

[0024] Figure 3 It is a flowchart of the device binding method based on voice interaction according to an embodiment of the present application;

[0025] Figure 4 It is a schematic diagram of a system for device binding based on voice interaction according to an embodiment of the present application;

[0026] Figure 5 It is a schematic diagram of a device binding device based on voice interaction according to an embodiment of the present application;

[0027] Figure 6 It is a schematic block diagram of the system composition of an electronic device according to an embodiment of the present application. Detailed implementation manners

[0028] The preferred implementation manners of the present application will be described below with reference to the accompanying drawings.

[0029] Embodiment 1

[0030] Embodiment 1 of the present application provides a device binding method based on voice interaction.

[0031] Figure 1 It is a block diagram of the device binding method based on voice interaction according to an embodiment of the present application. As Figure 1 shown, the method includes:

[0032] Step 101: Receive a first voice command, and determine a device to be bound in the target space according to the first voice command;

[0033] Step 102: Announce the relevant information of the device to be bound through voice;

[0034] Step 103: Receive a second voice command, and perform user identity verification according to the voiceprint information of the second voice command; and

[0035] Step 104: When the user identity verification is successful, perform the binding operation of the device to be bound, and announce the binding result of the device to be bound through voice.

[0036] Thus, through the user's voice command, the determination process of the device to be bound can be triggered, and by announcing the relevant information of the device to be bound through voice, the user can conveniently understand the device to be bound;

[0037] Moreover, performing identity verification according to the user's further voice command and directly performing the binding operation when the verification is successful can reduce the operation steps for the user to bind the device and guide the user to easily complete the binding.

[0038] In addition, user authentication based on the voiceprint information of the user's voice improves the efficiency of user authentication and the security of device binding. By announcing the binding result through voice, the user can promptly learn about the binding result, enhancing the user experience.

[0039] In some embodiments, the device to be bound can be various devices that need to be bound to a control device such as a user terminal.

[0040] For example, the device to be bound can be various controllable devices controlled by a control device. For instance, the controllable device can be a household device, an office device, an industrial device, etc. Among them, household devices can be, for example, at least one of an air conditioner, a sensor, fresh air, floor heating, a television, a washing machine, a refrigerator, a water heater, a smart curtain, a chandelier, a wall lamp, a ceiling lamp, a smart socket; office devices can be, for example, at least one of a computer, a projector, a printer, a scanner, a fax machine, a telephone; industrial devices can be, for example, at least one device related to industrial production, etc.

[0041] For example, the device includes at least one of an air handling device and a smart device.

[0042] In some embodiments, the air handling device includes at least one of an indoor unit, a air supply device, a humidity control device, a floor heating device, and a sensor.

[0043] In some embodiments, the indoor unit is the indoor unit in an air conditioning system, and the air conditioning system can be a commercial air conditioning system or a household air conditioning system.

[0044] In some embodiments, the air conditioning system can include at least one set of outdoor units and at least one indoor unit connected to each set of outdoor units. That is to say, in the air conditioning system, there can be one or more sets of outdoor units, and each set of outdoor units includes at least one outdoor unit; for one set of outdoor units, this set of outdoor units is connected to at least one indoor unit.

[0045] For example, the air conditioning system includes one outdoor unit and one indoor unit connected to this outdoor unit.

[0046] For example, the air conditioning system includes one outdoor unit and at least two indoor units connected to this outdoor unit.

[0047] For example, the air conditioning system includes at least two outdoor units and at least two indoor units connected to the at least two outdoor units.

[0048] For example, one set of outdoor units and at least one indoor unit connected to this set of outdoor units form a refrigerant system, or multiple sets of outdoor units and at least one indoor unit connected to each of the multiple sets of outdoor units form multiple refrigerant systems. Thus, the air conditioning system can include one refrigerant system or multiple refrigerant systems.

[0049] In some embodiments, the outdoor unit and the indoor unit can be air conditioning devices of various models, types, forms, and capacities. For example, the form of the indoor unit can be all-round air outlet, two-sided air outlet, duct machine, floor air outlet, or skirting air outlet, etc.; the form of the outdoor unit can be single-fan top air outlet, double-fan top air outlet, single-fan front air outlet, or double-fan front air outlet, etc.

[0050] In some embodiments, the air supply device includes at least one of a fresh air treatment device, a total heat exchange device (for example, with or without an internal circulation function), and a ventilation device (for example, with or without an internal circulation function).

[0051] In some embodiments, the humidity control device has at least one of a humidifying function and a dehumidifying function. For example, the humidity control device is arranged on the output side of the air supply device to adjust the humidity of the air output by the air supply device. For example, humidify or dehumidify the air output by the air supply device, and introduce the humidified or dehumidified air into the indoor space. For example, the humidity control device has a heat exchanger, and the heat exchanger can operate as an evaporator.

[0052] In some embodiments, the floor heating device is connected to the outdoor unit through a refrigerant pipeline, and the floor heating device is connected to the floor heating pipeline in the indoor space through a floor heating water pipeline. For example, the outdoor unit and the floor heating device form an air source heat pump water heater, which uses the heat in the air and the operation of the compressor to heat water; the floor heating device may include a water heat exchange unit, and the refrigerant flowing out of the compressor of the outdoor unit enters the water heat exchange unit of the floor heating device through the refrigerant pipeline to exchange heat with water, so as to achieve the purpose of heating water, and introduce the heated water into the floor heating pipeline in the indoor space through the floor heating water pipeline to supply heat to the indoor space. In some embodiments, the outdoor unit and the floor heating device are split-type or integrated.

[0053] In some embodiments, the intelligent device includes at least one of an intelligent socket, intelligent lighting equipment, and intelligent curtains.

[0054] In some embodiments, the device to be bound is arranged in the target space, and the target space refers to the space where the user is located, or the space belonging to the user. For example, the user's home or the company where the user is located, etc.

[0055] In some embodiments, the user refers to a person in the target space, for example, a person at home.

[0056] The following specifically describes each step of the device binding method according to the embodiments of the present invention.

[0057] In step 101, a first voice command is received, and a device to be bound in the target space is determined according to the first voice command.

[0058] In some embodiments, the first voice command is a voice command for triggering a device binding process. In this application, the first voice command can be received by a centralized controller, a voice control device, a wired controller, a remote controller, a smart controller, a user terminal, and a smart device, etc. Among them, the user terminal can be various terminal devices used by the user, such as a smart phone, a smart wearable device, etc., and the smart device includes, for example, a smart TV, a smart screen, etc.

[0059] In some embodiments, the first voice command is a voice command issued by a user in the target space.

[0060] Thus, the user can quickly trigger the device binding process through the voice command, and the operation is simple and efficient.

[0061] When the control device is a device with a voice receiving function, the control device can directly receive the first voice command from the user; when the control device is a device without a voice receiving function, the control device can indirectly receive the first voice command through other devices with a voice receiving function.

[0062] In some embodiments, the first voice command can be a preset fixed voice, such as "perform device binding", or a voice expressing the intention of wanting to perform device binding, such as "I want to bind a device", "Are there any unbound devices", etc. This application does not limit this.

[0063] In some embodiments, determining the device to be bound in the target space according to the first voice command includes:

[0064] The control device listens for device identification information sent by devices in the target space in a broadcast manner, uploads the device identification information to the server for querying device binding relationships; and determines whether the device is a device to be bound according to the result feedback by the server.

[0065] In some embodiments, devices in the target space perform broadcasts in a short-range communication manner. For example, the short-range communication includes at least one of Bluetooth, NFC, Wi-Fi, Zigbee, infrared data transmission (IrDA), and ultra-wideband (UBW). This application does not limit the specific manner of short-range communication.

[0066] In some embodiments, after being powered on, the devices in the target space activate the short-range communication function and send out short-range communication signals, and the short-range communication signals include the device identification information of the devices.

[0067] In some embodiments, the device identification information includes at least one of the device's MAC address, device name, IMEI number, or product serial number.

[0068] In some embodiments, after the control device monitors the device identification information of one or more devices in the target space, it uploads the device identification information of the one or more devices to the server of the Internet of Things platform, and the server of the Internet of Things platform queries the binding relationships of the device identification information of the one or more devices. For devices that have been bound, the server of the Internet of Things platform stores the binding relationships of the device identification information corresponding to the devices; for devices that have not been bound, that is, devices to be bound, the server of the Internet of Things platform does not store the binding relationships of the device identification information corresponding to the devices. After the server of the Internet of Things platform finishes querying the binding relationships of the device identification information uploaded by the control device in sequence, it feeds back the query results of the binding relationships of the device identification information it uploaded to the control device.

[0069] In some embodiments, the control device determines the devices to be bound according to the results fed back by the Internet of Things platform. For example, if the results fed back by the server of the Internet of Things platform include the device identification information of the devices that have been bound, at this time, the control device compares the device identification information it reported with the device identification information in the results fed back by the server, and determines the devices corresponding to the inconsistent device identification information as the devices to be bound. For another example, if the results fed back by the server of the Internet of Things platform include the device identification information of the devices that have not been bound, at this time, the control device determines the devices corresponding to the device identification information in the results fed back by the server as the devices to be bound.

[0070] Thus, by using the server to manage the device binding relationships of the bound devices and querying the device binding relationships according to the device identification information through the server, the determination efficiency and accuracy of the devices to be bound can be improved.

[0071] In some embodiments, there are one or more devices to be bound in the target space.

[0072] In step 102, the relevant information of the device to be bound is broadcast by voice.

[0073] In some embodiments, the control device broadcasts by voice the relevant information of all the devices to be bound in the target space that it determines.

[0074] When the control device is a device with a voice broadcast function, the control device can directly perform the voice broadcast; when the control device is a device without a voice broadcast function, the control device can indirectly perform the voice broadcast through other devices with a voice broadcast function.

[0075] In some embodiments, the relevant information of the device to be bound can be information that facilitates the user to determine the device to be bound. The relevant information includes, for example, at least one of the name of the device and the space where it is located (such as the living room, bedroom, etc.). Thus, it is convenient for the user to quickly understand which space in the target space has a device to be bound and which specific device or devices it is.

[0076] In step 103, receive the second voice command and perform user authentication based on the voiceprint information of the second voice command.

[0077] In some embodiments, the second voice command is a voice command used to indicate a device binding operation. The reception of the second voice command is similar to that of the first voice command. The above content is combined here and will not be repeated.

[0078] In some embodiments, the second voice command is a voice command issued by a user in the target space. In some embodiments, the second voice command can be a preset fixed voice, such as "Bind device", or a voice expressing the intention of determining the device to be bound, such as "Bind", "Perform binding operation", etc. The present application does not limit this.

[0079] In some embodiments, the control device performs user authentication based on the voiceprint information of the second voice command, that is, authenticates the identity of the user who instructs to perform the device binding operation. Using voiceprint information to perform user authentication during the voice interaction process eliminates the need to collect other identity information of the user, reduces user operations, simplifies the binding process, and improves the user experience.

[0080] In some embodiments, the voiceprint information of one or more users is stored in advance, and at least one of them is preset to have the device binding permission. After the control device receives the second voice command, it compares the voiceprint information of the second voice command with the voiceprint information of the users stored in advance. If the voiceprint information of the second voice command is consistent with the voiceprint information of the user with the device binding permission, the user authentication is successful. If the voiceprint information of the second voice command is inconsistent with the voiceprint information of the user with the device binding permission, the user authentication fails.

[0081] In step 104, when the user authentication is successful, perform the binding operation of the device to be bound and announce the binding result of the device to be bound through voice.

[0082] Thus, before performing the binding operation of the device to be bound, authenticate the user who issues the second voice command; when the user authentication is successful, perform the binding operation of the device to be bound, which can avoid accidental or malicious binding of the device and improve the security of device binding.

[0083] In some embodiments, when the user's authentication is successful, the binding operation of the device to be bound is automatically performed. In this way, the binding operation can be automatically performed based on voice commands and voiceprint verification, thereby improving the binding efficiency and enhancing the user experience.

[0084] For example, performing the binding operation of the device to be bound includes: associating and storing the device identification information of the device to be bound with the user's account in the server, thereby establishing a device binding relationship between the device to be bound and the user account, and completing the binding operation of the device to be bound.

[0085] Among them, the device identification information of the device to be bound is as described above and will not be repeated here.

[0086] In some embodiments, the user's account is, for example, the user's APP account. The APP account refers to the account registered by the user in the APP that can perform operations such as device binding and control. In addition, a user can have one or more APP accounts.

[0087] In some implementations, after completing the binding operation between the device to be bound and the user's account, the voice broadcasts that the device to be bound is successfully bound.

[0088] In some embodiments, when the binding operation between the device to be bound and the user's account fails, the voice broadcasts that the binding of the device to be bound fails.

[0089] In some embodiments, when the binding operation between the device to be bound and the user's account fails, the voice broadcasts the reason for the failure of the binding of the device to be bound and suggestions regarding the binding operation.

[0090] The reason for the binding failure is, for example, "weak signal connection", and the corresponding suggestion regarding the binding operation is, for example, "Please get closer to the device to be bound". In this way, it is possible to prompt or guide the user's binding operation and improve the user experience.

[0091] In some embodiments, the device binding method based on voice interaction further includes:

[0092] Receiving a third voice command and performing a binding transfer operation of the already bound device according to the third voice command.

[0093] In some embodiments, the already bound device is a device that has been bound to the user's identification information, such as a device bound to the user's account.

[0094] In some embodiments, the binding transfer operation refers to an operation of changing the account to which a bound device is bound. For example, if device E1 is bound to the user's first account, then device E1 is a bound device; the binding transfer operation means unbinding device E1 from the first account and binding the unbound device E1 to the user's second account. Herein, the first account and the second account are different accounts of the user.

[0095] Thus, the binding transfer operation of the bound device is automatically executed according to the user's voice command, thereby improving the binding transfer efficiency and enhancing the user experience.

[0096] In some embodiments, performing the binding transfer operation of the bound device according to the third voice command includes:

[0097] Performing user authentication according to the voiceprint information of the third voice command;

[0098] When the user authentication is successful, performing the unbinding operation of the bound device from the user's first account and the binding operation to the user's second account.

[0099] Thus, authenticating the user based on the voice command and voiceprint verification and performing the binding transfer operation when the user authentication is successful can improve the security of the binding transfer, avoid malicious or accidental re-binding, and enhance the user experience.

[0100] In some embodiments, the third voice command may be a preset voice for authentication; or the third voice command may also be any voice command issued by the user, such as a command for the user to instruct binding the bound device to the second account, and the present application does not limit this.

[0101] In some embodiments, performing user authentication according to the voiceprint information of the third voice command includes:

[0102] Determining whether the voiceprint information of the third voice command is the voiceprint information pre-stored for the first account and the second account;

[0103] If so, determining that the user authentication is successful.

[0104] For each account, it may pre-store the voiceprint information of the corresponding user for user authentication. Thus, judging whether the user is a user with unbinding and binding permissions according to the user's voiceprint information, and performing the binding transfer operation of the bound device when the user has unbinding and binding permissions, avoiding mis-unbinding and mis-binding of the device, and improving the security of device binding.

[0105] In some embodiments, when the identity authentication of the user is successful, performing an unbinding operation of the bound device from the first account of the user and a binding operation of the bound device with the second account of the user includes:

[0106] Deleting the binding relationship between the bound device and the first account stored in the server; and

[0107] The device identification information of the unbound device is associated with the second account and stored in the server.

[0108] In some embodiments, when the voiceprint information of the third voice command is not the voiceprint information pre-stored by the first account or is not the voiceprint information pre-stored by the second account, it is determined that the identity authentication of the user has failed.

[0109] In some embodiments, when the identity authentication of the user fails, the method further comprises:

[0110] At least one of a reason for failure of the binding transfer operation of the bound device and a suggestion on the binding transfer operation is announced by voice.

[0111] The reason for the failure of the binding operation may be, for example, "no unbinding permission", "no binding permission", etc., and the suggestion for the binding operation may be, for example, "suggest binding other devices". Thus, the user's binding transfer operation can be prompted and guided, thereby improving the user experience.

[0112] The following is a further explanation of the "binding transfer operation" through an example.

[0113] For example, user A has multiple residences, and he has registered an account for each residence to facilitate binding and controlling the devices in the corresponding residence. An air sensor is installed in the user's residence 1, and the air sensor is bound to account 1 corresponding to residence 1. At this time, the user wants to install the air sensor in residence 2 for use. In order to facilitate the control of the air sensor, the user wants to bind the air sensor to account 2 corresponding to residence 2. This involves the binding transfer operation of the air sensor from the user's account 1 to account 2.

[0114] Through this application, after the user issues a voice command, the user's identity verification is performed based on the voiceprint information of the voice command; if the user's voiceprint information is stored in both account 1 and account 2, the user's identity verification is successful, and the air sensor is automatically unbound from account 1 and bound to account 2 after unbinding. If at least one of account 1 and account 2 does not store the user's voiceprint information, the user's identity verification fails. At this time, the binding transfer operation of the air sensor is not performed, and the reason for the binding transfer failure and the suggestion for the binding transfer operation are announced by voice.

[0115] Through the present application, device re - binding can be achieved according to the user's voice command, simplifying the process of re - binding operations and improving the user experience. At the same time, user identity verification is performed based on the voiceprint information of the user's voice command, and the device re - binding operation is executed when the user identity verification is successful, avoiding errors in device binding.

[0116] In some embodiments, in step 104, there may be multiple devices to be bound in the target space determined according to the first voice command. In this case, the binding operations for all the determined devices to be bound can be executed.

[0117] For example, when step 101 determines that there are N (N is a positive integer greater than 1) devices to be bound, after the user's identity verification is successful in step 103, the binding operations for all N devices to be bound are respectively executed.

[0118] Thus, through voice interaction, the binding operations for multiple devices to be bound can be executed at one time, reducing the user's repeated operations and improving the binding efficiency.

[0119] In some embodiments, there may be multiple devices to be bound in the target space determined according to the first voice command, and for multiple devices to be bound, which devices to bind can be determined according to the user's instructions. A specific description is given for this case.

[0120] Figure 2 It is another block diagram of the device binding method based on voice interaction in the embodiments of the present application. In some embodiments, as Figure 2 shown, the method includes:

[0121] Step 201: Receive a first voice command and determine multiple devices to be bound in the target space according to the first voice command;

[0122] Step 202: Announce the relevant information of the multiple devices to be bound through voice;

[0123] Step 203: Receive a second voice command and perform user identity verification based on the voiceprint information of the second voice command; and

[0124] Step 204: When the user identity verification is successful, send an inquiry message to the user, and the inquiry message is used to inquire about the devices that need to be bound among the multiple devices to be bound by the user;

[0125] Step 205: Receive the confirmation information sent by the user, and the confirmation information is used to indicate the devices that need to be bound among the multiple devices to be bound;

[0126] Step 206: Execute the binding operations for the devices indicated in the confirmation information.

[0127] For the specific implementation of steps 201-203, reference can be made to Figure 1 the relevant steps in, which will not be elaborated here.

[0128] In some embodiments, the confirmation information indicates that the device that needs to perform the binding operation is part or all of the multiple devices to be bound. The confirmation information is, for example, the user's voice command. The confirmation information indicates the relevant information of part or all of the devices to be bound that need to perform the binding operation among the multiple devices to be bound. The relevant information of the device to be bound is, for example, the relevant information of the device to be bound announced by the control device by voice in step 202.

[0129] Thus, when there are multiple devices to be bound, the user can select by himself / herself the devices to be bound that need to perform the binding operation, further improving the user experience. In addition, by sending an inquiry message to prompt the user to select the devices to be bound that need to perform the binding operation, the user experience is further improved.

[0130] In some embodiments, the second voice command received by the control device includes the confirmation information, that is, the confirmation information is included in the second voice command received by the control device. For example, the second voice command is "Bind XXX (the relevant information of the device to be bound)". At this time, the control device first receives the second voice command including the confirmation information, and performs user authentication according to the voiceprint information of the second voice command. When the user authentication passes, the control device determines the device to be bound according to the relevant information of the device to be bound indicated in the confirmation information, and performs the binding operation on the device to be bound that needs to be bound.

[0131] In some embodiments, the control device receives the confirmation information separately. At this time, the second control command is only used for user authentication.

[0132] In some embodiments, the user who issues the second voice command may be one or more users, that is, one or more people in the target space issue the second voice command. For example, there are multiple people at home. After hearing the relevant information of the device to be bound announced by voice, if there are multiple devices to be bound and different people want to bind different devices, then multiple people may issue voice commands respectively with the intention of binding different devices.

[0133] In some embodiments, the second voice command received in step 103 includes the voice commands of multiple users; and in step 103, performing user authentication according to the voiceprint information of the second voice command correspondingly includes:

[0134] Performing authentication on each user according to the voiceprint information of the voice command of each user included in the second voice command respectively.

[0135] For example, assume that there are four users in the target space, represented as User 1, User 2, User 3, and User 4. After the control device broadcasts the relevant information of the device to be bound through voice, User 1, User 2, User 3, and User 4 all issue their respective instructions, and the second voice instructions received by the control device include the voice instructions of these four users. At this time, the control device recognizes that the second voice instructions include the voice instructions of four different users, and respectively performs identity verification for each user based on the voiceprint information of the voice instructions of these four different users. The process of using the voiceprint information of the voice instructions for user identity verification is as described above and will not be repeated here.

[0136] Correspondingly, in step 104, the control device performs the binding operation of the device to be bound only according to the voice instructions of the users whose identity verification is successful. For example, assume that the identity verification of User 1, User 2, and User 3 is successful, and the identity verification of User 4 fails. Then the control device performs the binding operation of the device to be bound only according to the voice instructions of User 1, User 2, and User 3, and does not perform the binding operation of the device to be bound according to the voice instructions of User 4.

[0137] In some embodiments, when the second voice instructions include the voice instructions of multiple users, and the identity verification of at least two users is successful, when the devices to be bound indicated by the voice instructions of the at least two users whose identity verification is successful are different devices, that is, when the devices to be bound indicated by the at least two users whose identity verification is successful do not repeat, the control device respectively performs the binding operations of the devices to be bound indicated by the voice instructions of the at least two users whose identity verification is successful.

[0138] For example, assume that the second voice instructions include the voice instructions of four users, namely User 1, User 2, User 3, and User 4, and the identity verification of User 1, User 2, and User 3 is successful, while the identity verification of User 4 fails; the devices to be bound controlled by the control device include Device to be Bound 1, Device to be Bound 2, Device to be Bound 3, and Device to be Bound 4.

[0139] When the voice instruction of User 1 indicates binding Device to be Bound 1, the voice instruction of User 2 indicates binding Device to be Bound 2, the voice instruction of User 3 indicates binding Device to be Bound 3, and the voice instruction of User 4 indicates binding Device to be Bound 4, the devices to be bound indicated by the voice instructions of User 1, User 2, User 3, and User 4 are all different devices. However, since the identity verification of User 4 fails, the control device respectively performs the binding operations of Device to be Bound 1, Device to be Bound 2, and Device to be Bound 3 according to the voice instructions of User 1, User 2, and User 3.

[0140] Thus, at least two users with successful authentication respectively indicate binding operations for different devices to be bound. At this time, according to the voice commands of the at least two users, the binding operations for the corresponding devices to be bound are respectively executed, and the binding operations do not affect each other, which can improve the binding efficiency and enhance the user experience.

[0141] In some embodiments, when the second voice command includes voice commands of multiple users and the authentication of at least two users is successful, when the devices to be bound indicated by the voice commands of the at least two users with successful authentication are the same device, that is, the at least two users with successful authentication both indicate the same one or more devices to be bound, the binding operation of the device to be bound is executed according to the voice command of the user with the highest priority among the at least two users with successful authentication.

[0142] For example, continuing with the above example, when the voice command of user 1 indicates binding the device to be bound 4, the voice command of user 2 indicates binding the device to be bound 4, the voice command of user 3 indicates binding the device to be bound 4, and the voice command of user 4 indicates binding the device to be bound 4, the devices to be bound indicated by the voice commands of user 1, user 2, user 3, and user 4 are all the same device, that is, the device to be bound 4. However, since the authentication of user 4 fails, the control device only executes the binding operation of the device to be bound 4 according to the voice command of the user with the highest priority among user 1, user 2, and user 3. For example, when the priority of user 1 is higher than that of user 2, and the priority of user 2 is higher than that of user 3, the binding operation of the device to be bound 4 is executed according to the voice command of user 1.

[0143] Thus, at least two users with successful authentication indicate the binding operation of the same device to be bound. At this time, the binding operation of the device to be bound is executed according to the voice command of the user with the highest priority among the at least two users, which can avoid the failure of the binding operation caused by voice command conflicts and enhance the user experience.

[0144] In some embodiments, when the second voice command includes voice commands of multiple users and the authentication of at least two users is successful, when the parts of the devices to be bound indicated by the voice commands of the at least two users whose authentication is successful are the same device, that is, when the parts of the devices to be bound indicated by the at least two users whose authentication is successful are repeated, for the device to be bound that is repeatedly indicated (hereinafter referred to as the first device to be bound), the binding operation of the first device to be bound is performed according to the voice command of the user with the highest priority among the at least two users whose authentication is successful and who indicated the first device to be bound; for the device to be bound that is not repeatedly indicated (hereinafter referred to as the second device to be bound), the binding operation of the second device to be bound is performed according to the voice command of the user who indicated the second device to be bound among the at least two users whose authentication is successful.

[0145] For example, continuing with the above example, when the voice command of user 1 indicates binding device to be bound 1 and device to be bound 4, the voice command of user 2 indicates binding device to be bound 3, the voice command of user 3 indicates binding device to be bound 4, and user 4 indicates binding device to be bound 2 and device to be bound 3, user 1 and user 3 repeatedly indicate device to be bound 4, user 2 and user 4 repeatedly indicate device to be bound 3, and device to be bound 1 and device to be bound 2 are not repeatedly indicated.

[0146] For the repeatedly indicated device to be bound 4, since the authentication of both user 1 and user 3 who indicated device to be bound 4 is successful, the binding operation of device to be bound 4 is performed according to the voice command of the user with the highest priority among user 1 and user 3;

[0147] For the repeatedly indicated device to be bound 3, since the authentication of user 2 who indicated device to be bound 3 is successful while the authentication of user 4 fails, the binding operation of device to be bound 3 is performed according to the voice command of the successful authenticated user 2;

[0148] For the non-repeatedly indicated device to be bound 1, since the authentication of user 1 who indicated device to be bound 1 is successful, the binding operation of device to be bound 1 is performed according to the voice command of user 1;

[0149] For the non-repeatedly indicated device to be bound 2, since the authentication of user 4 who indicated device to be bound 2 fails, the binding operation of device to be bound 2 is not performed.

[0150] In some embodiments, the priority of the user can be set in advance.

[0151] In some embodiments, for all devices within the target space, the user priorities are the same. For example, for all devices within the target space, including the device to be bound, the priority of User 1 is always higher than that of User 2, and the priority of User 2 is always higher than that of User 3.

[0152] In some embodiments, as Figure 1 shown, the user authentication in step 103 may fail. Therefore, after step 103, the method further includes:

[0153] Step 105: When the user authentication fails, do not perform the binding operation on the device to be bound.

[0154] Thus, by not performing the binding operation on the device to be bound when the user authentication fails, it is possible to avoid incorrect or malicious binding of the device, improving the security of device binding.

[0155] In some embodiments, after step 105, the reason for not performing the binding operation on the device to be bound is also announced by voice.

[0156] For example, if the voiceprint information of the second voice command is consistent with the voiceprint information of a user who does not have the permission to bind the device stored in advance, a prompt such as "The user does not have the corresponding permission" can be announced by voice; if the voiceprint information of the second voice command is inconsistent with the voiceprint information of all users stored in advance, a prompt such as "The user's voiceprint information has not been entered" can be announced by voice.

[0157] Thus, by informing the user of the reason for not performing the binding operation on the device to be bound by voice, it is possible to avoid the user's dissatisfaction due to the inability to bind the device, improving the user experience.

[0158] Figure 3 is a flowchart of the device binding method based on voice interaction according to an embodiment of the present application. As Figure 3 shown, the method includes:

[0159] Step 301: Receive a first voice command and determine the device to be bound within the target space according to the first voice command;

[0160] Step 302: Announce the relevant information of the device to be bound by voice;

[0161] Step 303: Receive a second voice command and perform user authentication according to the voiceprint information of the second voice command;

[0162] Step 304: Determine whether the user authentication is successful. When the judgment result is "yes", proceed to step 305; when the judgment result is "no", proceed to step 306;

[0163] Step 305: Perform the binding operation of the device to be bound, and announce the binding result of the device to be bound through voice broadcast;

[0164] Step 306: Do not perform the binding operation of the device to be bound.

[0165] For the specific implementation of Steps 301-306, reference can be made to Figure 1 the relevant steps therein, which will not be elaborated here.

[0166] According to the above embodiments, the present application can trigger the determination process of the device to be bound through the user's voice command, and announce the relevant information of the device to be bound through voice broadcast, so that the user can conveniently understand the device to be bound; moreover, according to the user's further voice command, identity verification is performed and the binding operation is directly executed when the verification is successful, which can reduce the operation steps for the user to bind the device and guide the user to easily complete the binding.

[0167] In addition, user identity verification is performed based on the voiceprint information of the user's voice, which improves the efficiency of user identity verification and the security of device binding, and the binding result is announced through voice broadcast, enabling the user to timely understand the binding result and improving the user experience.

[0168] Embodiment 2

[0169] Embodiment 2 of the present application provides a system for device binding based on voice interaction. This system corresponds to the method described in Embodiment 1, and the specific content can be referred to the description in Embodiment 1.

[0170] Figure 4 is a schematic diagram of the system for device binding based on voice interaction according to an embodiment of the present application. As Figure 4 shown, the system 10 for device binding based on voice interaction includes at least one device 11 to be bound, a control device 12, and a voice interaction device 13.

[0171] The control device 12 determines the device 11 to be bound in the target space according to the received first voice command; controls the voice interaction device 13 to announce the relevant information of the device 11 to be bound through voice broadcast; performs user identity verification according to the voiceprint information of the received second voice command; when the user's identity recognition is passed, performs the binding operation of the device 11 to be bound, and controls the voice interaction device 13 to announce the binding result of the device 11 to be bound through voice broadcast.

[0172] The voice interaction device 13 receives the first voice command, the second voice command, and announces the relevant information of the device 11 to be bound and the binding result of the device 11 to be bound through voice broadcast.

[0173] In some embodiments, the device to be bound 11 includes at least one of an air handling device and a smart device.

[0174] In some embodiments, the air handling device includes at least one of an indoor unit, a ventilation device, a humidity control device, and a floor heating device. The smart device includes at least one of a smart socket, a smart lighting device, and a smart curtain.

[0175] In some embodiments, the control device 12 includes at least one of a server, a gateway device, a central controller, a wired controller, a remote controller, a user terminal, and a control board.

[0176] The voice interaction device 13 includes at least one of a central controller, a wired controller, a remote controller, a user terminal, and a smart speaker.

[0177] In some embodiments, the control device 12 has the function of receiving a user's voice command and broadcasting through voice. At this time, the voice interaction device 13 and the control device 12 can be the same device, and the functions implemented by the voice interaction device 13 in this application are implemented by the control device 12.

[0178] For example, both the control device 12 and the voice interaction device 13 are central controllers.

[0179] The specific processing procedures of the above-mentioned various devices can refer to the relevant records in Embodiment 1, which will not be elaborated here.

[0180] According to the above embodiments, the present application can trigger the determination process of the device to be bound through the user's voice command, and broadcast the relevant information of the device to be bound through voice, so that the user can conveniently understand the device to be bound; and, perform identity verification according to the user's further voice command and directly execute the binding operation when the verification is successful, which can reduce the operation steps for the user to bind the device and guide the user to easily complete the binding.

[0181] In addition, user identity verification based on the voiceprint information of the user's voice improves the efficiency of user identity verification and the security of device binding, and by broadcasting the binding result through voice, the user can timely understand the binding result, improving the user experience.

[0182] Embodiment 3

[0183] Embodiment 3 of the present application provides a device binding device based on voice interaction. The device binding device based on voice interaction corresponds to the device binding method based on voice interaction described in Embodiment 1, and the specific content can refer to the records in Embodiment 1.

[0184] Figure 5It is a schematic diagram of a device binding device based on voice interaction according to an embodiment of the present application. As Figure 5 shown, the device 20 includes:

[0185] A first receiving unit 21, which is used to receive a first voice command;

[0186] A determining unit 22, which is used to determine a device to be bound in a target space according to the first voice command;

[0187] A first broadcasting unit 23, which is used to broadcast relevant information of the device to be bound by voice;

[0188] A second receiving unit 24, which is used to receive a second voice command;

[0189] An identity authentication unit 25, which is used to perform user identity authentication according to the voiceprint information of the second voice command;

[0190] A binding unit 26, which is used to perform the binding operation of the device to be bound when the user's identity authentication is successful;

[0191] A second broadcasting unit 27, which is used to broadcast the binding result of the device to be bound by voice.

[0192] For the specific functions of the above respective units, reference can be made to the relevant steps in Embodiment 1, which will not be elaborated here.

[0193] In some embodiments, the first receiving unit 21 and the second receiving unit 24 may be the same receiving unit, and the first broadcasting unit 23 and the second broadcasting unit 27 may be the same broadcasting unit.

[0194] According to the above embodiment, the present application can trigger the determination process of the device to be bound through the user's voice command, and broadcast the relevant information of the device to be bound by voice, so that the user can conveniently understand the device to be bound; and, perform identity authentication according to the user's further voice command and directly perform the binding operation when the authentication is successful, which can reduce the operation steps for the user to bind the device and guide the user to easily complete the binding.

[0195] In addition, performing user identity authentication based on the voiceprint information of the user's voice improves the efficiency of user identity authentication and the security of device binding, and broadcasting the binding result by voice enables the user to timely understand the binding result and improves the user experience.

[0196] Embodiment 4

[0197] Embodiment 4 of the present application provides an electronic device. The steps executed by the processor of the electronic device correspond to all or part of the steps of the device binding method based on voice interaction described in Embodiment 1, and the specific content can be referred to the description in Embodiment 1.

[0198] Figure 6 FIG. is a schematic block diagram of the system composition of the electronic device according to an embodiment of the present application. As Figure 6 shown, the electronic device 300 may include a processor 310 and a memory 320; the memory 320 is coupled to the processor 310. It should be noted that this figure is exemplary; other types of structures can also be used to supplement or replace this structure to achieve telecommunication functions or other functions.

[0199] In one embodiment, the processor 310 may be configured to: receive a first voice instruction, and determine a device to be bound in the target space according to the first voice instruction; broadcast relevant information of the device to be bound through voice; receive a second voice instruction, and perform user authentication according to the voiceprint information of the second voice instruction; when the user authentication is successful, perform the binding operation of the device to be bound, and broadcast the binding result of the device to be bound through voice.

[0200] As Figure 6 shown, the electronic device 300 may further include: a communication module 330, an input unit 340, a display 350, a speaker 360, a microphone 370, and a power supply 380. It should be noted that the electronic device 300 does not necessarily have to include Figure 6 all the components shown in; in addition, the electronic device 300 may further include Figure 6 components not shown in, and reference can be made to the related art.

[0201] As Figure 6 shown, the processor 310 is sometimes also referred to as a controller or an operation control, and may include a microprocessor or other processor devices and / or logic devices. The processor 310 receives inputs and controls the operations of the various components of the electronic device 300.

[0202] Among them, the memory 320 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory, or other suitable devices. Various data can be stored, and in addition, programs for executing relevant information can also be stored. And the processor 310 can execute the program stored in the memory 320 to achieve information storage or processing, etc. The functions of other components are similar to those in the prior art and will not be described in detail here. The various components of the electronic device 300 can be implemented by dedicated hardware, firmware, software, or a combination thereof without departing from the scope of the present invention.

[0203] According to the above embodiments, through the voice command of the user, the present application can trigger the determination process of the device to be bound, and through voice broadcast of the relevant information of the device to be bound, the user can conveniently understand the device to be bound; moreover, according to the further voice command of the user, identity verification is performed and the binding operation is directly executed when the verification is successful, which can reduce the operation steps for the user to bind the device and guide the user to easily complete the binding.

[0204] In addition, user identity verification is performed based on the voiceprint information of the user's voice, which improves the efficiency of user identity verification and the security of device binding. By voice broadcasting the binding result, the user can timely understand the binding result, improving the user experience.

[0205] The embodiment of the present application also provides a computer-readable program, when the program is executed, the program causes the computer to execute the device binding method based on voice interaction described in the embodiment of the present application.

[0206] The embodiment of the present application also provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer-readable program causes the computer to execute the device binding method based on voice interaction described in the embodiment of the present application.

[0207] The above devices and methods of the embodiment of the present application can be implemented by hardware, or can be implemented by a combination of hardware and software. The present application relates to such a computer-readable program, when the program is executed by a logic component, it can cause the logic component to implement the above device or component, or cause the logic component to implement the above various methods or steps.

[0208] The embodiment of the present application also relates to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, etc.

[0209] It should be noted that the limitations of the various steps involved in the present application, without affecting the implementation of the specific solution, are not considered as limiting the order of the steps. The steps written in the front can be executed first, or can be executed later, or even can be executed simultaneously, as long as the solution can be implemented, it should be regarded as falling within the protection scope of the present application.

[0210] The above describes the present application in combination with specific implementation manners, but those skilled in the art should understand that these descriptions are exemplary and not a limitation on the protection scope of the present application. Those skilled in the art can make various variations and modifications to the present application according to the spirit and principle of the present application, and these variations and modifications are also within the scope of the present application.

Claims

1. A device binding method based on voice interaction, characterized in that, The method includes: Receiving a first voice command and determining a device to be bound in a target space according to the first voice command; Announcing the relevant information of the device to be bound through voice; Receiving a second voice command and authenticating the user according to the voiceprint information of the second voice command; When the user authentication is successful, performing the binding operation of the device to be bound and announcing the binding result of the device to be bound through voice.

2. The method according to claim 1, characterized in that, When the user authentication fails, the binding operation of the device to be bound is not performed.

3. The method according to claim 1, wherein Performing the binding operation of the device to be bound includes: When there are multiple devices to be bound, performing the binding operations of all the devices to be bound.

4. The method according to claim 1, wherein The method further includes: When there are multiple devices to be bound, sending an inquiry message to the user, where the inquiry message is used to inquire the user about the devices that need to perform the binding operation among the multiple devices to be bound.

5. The method according to claim 4, characterized in that, The method further includes: Receiving the confirmation message fed back by the user based on the inquiry message, where the confirmation message is used to indicate the devices that need to perform the binding operation among the multiple devices to be bound; And, performing the binding operation of the device to be bound includes: Performing the binding operation of the device indicated in the confirmation message.

6. The method according to claim 1, characterized in that, The second voice command includes voice commands of multiple users; and Authenticating the user according to the voiceprint information of the second voice command includes: Respectively authenticating the identities of each user according to the voiceprint information of the voice commands of each user among the multiple users included in the second voice command.

7. The method according to claim 6, wherein The identities of at least two users among the multiple users are authenticated successfully; Wherein, when the devices to be bound indicated by the voice commands of the at least two users whose identities are authenticated successfully are different devices, respectively performing the binding operations of the devices to be bound indicated by the voice commands of the at least two users; When the devices to be bound indicated by the voice commands of the at least two users whose identities are authenticated successfully are the same device, performing the binding operation of the device to be bound according to the voice command of the user with the highest priority among the at least two users whose identities are authenticated successfully.

8. The method according to claim 1, wherein Determining the device to be bound in the target space according to the first voice command includes: After the first voice command, listening for the device identification information sent in a broadcast manner by the devices in the target space; Uploading the device identification information to the server for querying the device binding relationship; Determining whether the device is a device to be bound according to the result fed back by the server.

9. The method according to claim 8, wherein The device performs broadcasting in a short-range communication manner; The short-range communication includes at least one of Bluetooth, NFC, Wi-Fi, Zigbee, infrared data transmission, and ultra-wideband.

10. The method according to claim 1, characterized in that At least one of the first voice command and the second voice command is received through at least one of a user terminal, a centralized controller, a voice control device, and a smart device.

11. The method according to claim 1, wherein The method further includes: When the binding operation of the device to be bound is successful, upload the corresponding device binding relationship to the server for storage, and voice broadcast the information indicating the successful binding of the device to be bound.

12. The method according to claim 1, characterized in that, The method further includes: When the binding operation of the device to be bound fails, broadcast the reason for the failure of the binding of the device to be bound and suggestions regarding the binding operation.

13. The method according to claim 1, characterized in that, The method further includes: Receive a third voice command, and perform a binding transfer operation on the bound device according to the third voice command.

14. The method according to claim 13, wherein Performing a binding transfer operation on the bound device according to the third voice command includes: Authenticate the user according to the voiceprint information of the third voice command; When the authentication of the user is successful, perform an unbinding operation of the bound device from the first account of the user and a binding operation with the second account of the user.

15. A system for device binding based on voice interaction, characterized in that, The system includes at least one device to be bound, a control device, and a voice interaction device; The control device is configured to determine the device to be bound in the target space according to the received first voice command; control the voice interaction device to voice broadcast the relevant information of the device to be bound; authenticate the user according to the voiceprint information of the received second voice command; when the authentication of the user is successful, perform the binding operation of the device to be bound, and control the voice interaction device to voice broadcast the binding result of the device to be bound; The voice interaction device is configured to receive the first voice command, the second voice command, and voice broadcast the relevant information of the device to be bound and the binding result of the device to be bound.

16. The system according to claim 15, wherein The device to be bound includes at least one of an air handling device and a smart device; The air handling device includes at least one of an indoor unit, a air supply device, a humidity control device, a floor heating device, and a sensor; The smart device includes at least one of a smart socket, a smart lighting device, and a smart curtain.

17. The system according to claim 15, wherein The control device includes at least one of a server, a gateway device, a centralized controller, a wired controller, a remote controller, a user terminal, and a control board; The voice interaction device includes at least one of a centralized controller, a wired controller, a remote controller, a user terminal, and a smart speaker.

18. A device binding device based on voice interaction, characterized in that The apparatus includes: A first receiving unit, configured to receive a first voice command; A determining unit, configured to determine the device to be bound in the target space according to the first voice command; A first broadcasting unit, configured to voice broadcast the relevant information of the device to be bound; A second receiving unit, configured to receive a second voice command; An authentication unit, configured to authenticate the user according to the voiceprint information of the second voice command; A binding unit, configured to perform the binding operation of the device to be bound when the authentication of the user is successful; A second broadcasting unit, configured to voice broadcast the binding result of the device to be bound.

19. An electronic device, characterized in that, The electronic device includes: A memory, which stores a computer program; and A processor, which implements the method according to any one of claims 1-13 when executing the computer program.

20. A computer-readable storage medium having a computer program stored thereon, characterized in that, The computer program implements the method according to any one of claims 1-13 when executed by a processor.

Images