Audio pairing method and system

Abstract

The embodiment of the invention discloses an audio pairing method and system and a medium, and the method comprises the steps: responding to a condition that a triggering condition is satisfied, entering a pairing mode, and generating pairing information; generating an audio sound wave signal based on the pairing information; and playing the audio sound wave signal through the loudspeaker device so as to send the audio sound wave signal to the to-be-paired device.

Description

Technical Field

[0001] The present invention relates to the technical field of audio equipment pairing, and in particular to an audio pairing method and system. Background Art

[0002] With the continuous development of science and technology, the application of audio pairing technology is becoming more and more extensive. When using science and technology, people are paying more and more attention to information security issues. However, the existing audio pairing technology generally uses wireless signals for transmission. The encoding and decoding of the signal depends on a specific protocol stack, and the signal is easily obtained by attackers. The specific protocol stack may have unknown security vulnerabilities, or the encryption algorithm of the protocol stack may be cracked, resulting in information leakage. Therefore, the transmission security of wireless signals is not high.

[0003] Therefore, it is necessary to provide an audio pairing method and system to ensure the security of information during audio transmission and provide a safer usage environment for users. Summary of the invention

[0004] One or more embodiments of the present specification provide an audio pairing method, which is executed by a pairing initiating device. The audio pairing method includes: in response to a trigger condition being met, entering a pairing mode and generating pairing information; based on the pairing information, generating an audio sound wave signal; playing the audio sound wave signal through an external speaker to send the audio sound wave signal to a device to be paired.

[0005] One or more embodiments of the present specification provide an audio pairing receiving method, which is executed by a device to be paired, and the audio pairing method includes: receiving an audio sound wave signal, obtaining pairing information based on the audio sound wave signal, and verifying the pairing information; in response to the verification passing, entering a pairing mode.

[0006] One or more embodiments of the present specification provide an audio pairing system, the system comprising a pairing initiating device and a device to be paired; the pairing initiating device is configured to: in response to a trigger condition being met, enter a pairing mode and generate pairing information; based on the pairing information, generate an audio sound wave signal; play the audio sound wave signal through an external device to send the audio sound wave signal to the device to be paired; the device to be paired is configured to: receive the audio sound wave signal, obtain the pairing information based on the audio sound wave signal, and verify the pairing information; in response to the verification being passed, enter the pairing mode based on the pairing process.

[0007] One or more embodiments of the present specification provide a computer-readable storage medium, wherein the storage medium stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes an audio pairing method. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] This specification will be further described in the form of exemplary embodiments, which will be described in detail by the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:

[0009] Figure 1 is a schematic diagram of an application scenario of an audio pairing system according to some embodiments of this specification;

[0010] Figure 2 is an exemplary flow chart of an audio pairing method according to some embodiments of this specification;

[0011] Figure 3 is an exemplary flow chart of generating an audio sound wave signal according to some embodiments of this specification;

[0012] Figure 4 is an exemplary flow chart of generating audio sound wave signals according to other embodiments of this specification;

[0013] Figure 5 is an exemplary flow chart of a coding effect determination model according to some embodiments of this specification;

[0014] Figure 6 is a schematic diagram of a sound wave band generation model according to some embodiments of this specification;

[0015] Figure 7 It is a schematic diagram of the pairing process shown in some embodiments of this specification. DETAILED DESCRIPTION

[0016] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0017] It should be understood that the "system", "device", "unit" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

[0018] As shown in this specification and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0019] Figure 1 Schematic diagram of application scenarios of the audio pairing system according to some embodiments of this specification. Figure 1 As shown, the application scenario 100 of the audio pairing system may include a pairing device, a processor 120, a network 130, a storage device 140, and an external speaker 150, etc. The pairing device includes a pairing initiating device 110 and a to-be-paired device 160.

[0020] The pairing initiating device 110 refers to a device that actively initiates pairing when a trigger condition is met. The pairing initiating device 110 may include a smart terminal or other device that can initiate audio pairing. For a detailed description of the pairing initiating device 110, trigger conditions, and sound wave pairing mode, refer to Figure 2 The corresponding content.

[0021] The processor 120 can be used to manage data resources and process data and / or information from at least one component or external data source involved in the application scenario 100 of the audio pairing system. The processor 120 can be partially or completely integrated into the pairing initiating device 110, the external speaker device 150, the device to be paired 160, etc. The processor 120 can execute program instructions based on these data, information and / or processing results, thereby performing one or more functions described in this specification. For more information, please refer to Figures 2 to 6 Related description.

[0022] In some embodiments, the processor 120 may obtain information and / or data from the pairing initiating device 110 , the device to be paired 160 , etc. through the network 130 , or may send information and / or data to the storage device 140 , the external device 150 through the network 130 .

[0023] In some embodiments, one or more components in the application scenario 100 of the audio pairing system can transmit data to other components through the network 130. The network 130 can be any one or more of a wired network or a wireless network. For example, the network 130 may include a cable network, an optical fiber network, etc. or any combination thereof. The network connection between the various parts can be in one of the above-mentioned ways or in multiple ways. There are multiple ways for the network 130 to exchange data, for example, Bluetooth communication, infrared communication, communication through a local area network, etc.

[0024] The storage device 140 may be used to store data and / or instructions. For example, the storage device 140 may be used to store pairing instructions transmitted by the user terminal via the network. In some embodiments, the storage device 140 and the processor 120 may communicate data via the network 130, and the storage device 140 may also be a part of the processor 120. The storage device 140 may also be partially or completely integrated into the pairing initiating device 110, the external speaker 150, the device to be paired 160, etc.

[0025] The external speaker 150 refers to a device that plays audio sound wave signals. In some embodiments, the external speaker 150 can send audio sound wave signals to the to-be-paired device 160. For example, the external speaker 150 includes but is not limited to a speaker, earphones, and a stereo.

[0026] For more information about external speakers, see Figure 2 and its related description.

[0027] The device to be paired 160 refers to a device that can receive and process pairing information and enter pairing mode. The device to be paired 160 may include a smart speaker, a smart terminal, a smart home device, etc. In some embodiments, the number of the device to be paired 160 may be one or more. For more information about the device to be paired 160, see Figure 2 and its related description.

[0028] Figure 2 is an exemplary flow chart of an audio pairing method according to some embodiments of this specification. Figure 2 As shown, process 200 includes the following steps. In some embodiments, process 200 may be performed by a pairing initiating device. For a description of the pairing initiating device, see Figure 1 Corresponding description.

[0029] Step 210: In response to the trigger condition being met, entering a pairing mode and generating pairing information.

[0030] The trigger condition refers to the condition that triggers the pairing initiator device to enter the pairing mode. The trigger condition may include a triggering Event.

[0031] Triggering an Event means when a specific event occurs.

[0032] In some embodiments, the Event event may be a manual operation, for example, manually pressing a corresponding button in the pairing initiating device.

[0033] Pairing mode refers to a mode that a pairing initiating device enters after a trigger condition is met so that it can pair with another device.

[0034] In some embodiments, the pairing initiating device may enter pairing mode in response to an Event event trigger.

[0035] Pairing information refers to information generated by the pairing initiating device during the device pairing process for establishing a secure connection between devices. For example, the pairing information includes a dynamic key, device information of the pairing initiating device, etc.

[0036] In some embodiments, the pairing information is generated by a pairing initiating device.

[0037] A dynamic key is a temporary encryption key generated when pairing devices. It uses asymmetric encryption technology. The dynamic key can encrypt pairing information to ensure the security of the pairing process. The dynamic key can be represented in different bases, such as binary, hexadecimal, or Base64.

[0038] Device information refers to the device information of the pairing initiating device. For example, the device information may include device ID, MAC address, Bluetooth address, etc. In some embodiments, the device ID refers to the ID of a device in the same ecosystem. The same ecosystem refers to a collection of hardware and software products that can interoperate seamlessly, and these products share common technical standards, protocols, and design concepts to provide a consistent and coordinated user experience.

[0039] In some embodiments, the pairing information also includes the protocol header information used to establish a connection channel after pairing, and the pairing sound wave signal also includes the sound wave signal corresponding to the device information, the sound wave signal corresponding to the dynamic key, and the sound wave signal corresponding to the protocol header information. In some embodiments, the protocol header information and the dynamic key can be represented in the same base. For example, both the protocol header information and the dynamic key can be represented in hexadecimal format, thereby simplifying the pairing process. For more information about the protocol header information, see Figure 3 and its related description.

[0040] In some embodiments, after the pairing initiator enters the pairing mode, a dynamic key is generated. The dynamic key is generated by a function in a standard encryption library, for example, based on an RSA algorithm (Rivest-Shamir-Adleman, RSA), an Elliptic Curve Diffie-Hellman algorithm (Elliptic Curve Diffie-Hellman, ECDH), an Elliptic Curve Digital Signature Algorithm (Elliptic Curve Digital Signature Algorithm, ECDSA) and other algorithms.

[0041] Step 220: Generate an audio sound wave signal based on the pairing information.

[0042] The audio sound wave signal refers to a sound wave signal containing pairing information, and the frequency of the audio sound wave signal may be in a frequency range audible to human ears. For example, the audio sound wave signal includes a sound wave signal corresponding to a dynamic key, a pairing sound wave signal corresponding to device information, etc. The dynamic key is a dynamic key obtained after being encoded by an encoding algorithm.

[0043] The pairing sound wave signal refers to an audio signal transmitted when devices are paired. For example, the pairing sound wave signal includes a sound wave signal corresponding to a dynamic key and device information.

[0044] In some embodiments, the audio sound wave signal also includes a trigger signal and a coding signal corresponding to the target coding algorithm. For more information about the trigger signal and the coding signal, see Figure 3 and its related description.

[0045] In some embodiments, the pairing initiating device generates a pairing sound wave signal based on the pairing information using a coding algorithm, for example, the coding algorithm includes an information-sound wave conversion algorithm, etc.

[0046] The information-sound wave conversion algorithm is an algorithm for converting the pairing information into a sound wave signal. For example, the information-sound wave conversion algorithm may include direct frequency modulation (DFM), phase encoding (PE), amplitude keying (AK), etc.

[0047] In some embodiments, the pairing initiating device may also call the audio library based on the pairing information to generate a pairing sound wave signal. For more information about the audio library and how to generate a pairing sound wave signal, see Figure 3 and Figure 4 Related description.

[0048] Step 230: Play the audio sound wave signal through the external speaker to send the audio sound wave signal to the device to be paired.

[0049] For instructions on external speakers, see Figure 1 Corresponding description.

[0050] In some embodiments, the pairing initiating device plays the generated audio sound wave signal through an external speaker.

[0051] For instructions on the device to be paired, see Figure 1 The corresponding description.

[0052] In some embodiments, the pairing initiating device includes one or more devices to be paired with.

[0053] In some embodiments, a device can be both a pairing initiating device and a device to be paired. That is, devices can be paired bidirectionally. Devices can initiate pairing requests and responses to each other. For example, a device can become a pairing initiating device, and at a certain point in time, it can actively initiate a pairing request and send pairing information to another device. At the same time, this device can become a device to be paired at another point in time, waiting for other devices to initiate pairing requests and respond. This pairing method ensures that each device can actively initiate a pairing request and establish a stable two-way communication connection.

[0054] By pairing with one or more devices to be paired, a pairing initiating device can be paired with multiple devices to be paired at the same time, thereby significantly enhancing the flexibility of pairing, reducing the time and steps of pairing one by one, and improving the efficiency of the pairing process.

[0055] In some embodiments, the pairing initiating device plays an audio sound wave signal through an external speaker and sends the audio sound wave signal to the device to be paired.

[0056] In some embodiments of the present specification, audio codec technology is used with audio sound wave signals as carriers, and combined with dynamic keys and encryption technology, the pairing process is effectively prevented from being attacked by man-in-the-middle attacks (MITM attacks), thereby establishing a secure and reliable pairing channel, greatly improving the security of pairing between devices.

[0057] In some embodiments, after the device to be paired receives the audio sound wave signal, it obtains pairing information based on the audio sound wave signal and verifies the pairing information; in response to the verification passing, it enters the pairing mode.

[0058] In some embodiments, the pairing initiating device plays the generated audio sound wave signal through an external speaker, and the device to be paired can receive the audio sound wave signal through a sound collecting device.

[0059] For example, during the device pairing process, after the pairing initiator enters the pairing mode, it generates a dynamic key and uses a coding algorithm to encode the key into an audio sound wave signal. The pairing initiator can play the generated audio sound wave signal through a speaker; the device to be paired can receive the audio sound wave signal through a sound collection device, such as a microphone.

[0060] In some embodiments, after receiving the audio sound wave signal, the sound collecting device of the device to be paired decodes the audio sound wave signal to obtain pairing information.

[0061] For example, during the device pairing process, since the pairing initiator and the device to be paired use the same audio library, the device to be paired can perform a reverse search of the received sound wave signal in the audio library, and decode the original pairing information by matching the mapping relationship in the audio library. For more information about the audio library, see Figure 3 and its related description.

[0062] In some embodiments, obtaining pairing information also includes the device to be paired determining whether there is trigger information based on the acquired audio sound wave signal; in response, obtaining a coding signal from the audio sound wave signal, and obtaining a target coding algorithm based on the coding signal to decode the audio sound wave signal to obtain pairing information.

[0063] Trigger information refers to information that triggers the device to be paired to enter the pairing process. For example, trigger information includes trigger signals, etc. For more information about the pairing process, see Figure 3 and its related description.

[0064] In some embodiments, the pairing initiating device sends a trigger message as a trigger mechanism to switch the to-be-paired device to pairing mode. After receiving the audio sound wave signal, the to-be-paired device decodes the signal and searches the audio library to determine whether the signal contains valid trigger information. For more information about whether the audio sound wave signal contains trigger information, see Figure 3 and its related description.

[0065] The coding signal is a signal indicating a decoding algorithm, which is used to instruct the paired device to use a target coding algorithm to decode the audio sound wave signal. The coding signal is a part of the audio sound wave signal.

[0066] In some embodiments, when the pairing initiating device generates an audio sound wave signal, the coded signal is synthesized into the audio sound wave signal. After the paired device receives the audio sound wave signal, the coded signal can be decoded to determine the target coding algorithm to decode the audio sound wave signal. For more information about the coded signal, see Figure 3 and its related description.

[0067] The target encoding algorithm refers to the encoding algorithm selected when obtaining pairing information.

[0068] In some embodiments, after entering the pairing process, the device to be paired can obtain the target encoding algorithm used by the pairing initiating device by decoding the audio sound wave signal.

[0069] For example, a separate audio library can be constructed, and the device to be paired can determine the target encoding algorithm by querying the audio library based on the audio sound wave signal. The separate audio library can be used to store the mapping relationship between the encoding algorithm and the sound wave band. The separate audio library can be pre-constructed based on historical data or prior knowledge.

[0070] In some embodiments, because the pairing initiating device and the device to be paired use the same audio library, the device to be paired can perform decoding using the encoding method corresponding to the pairing initiating device.

[0071] For example, the pairing initiating device uses a specific audio library 1 to encode when generating an audio sound wave signal, and the device to be paired can use the same audio library 1 for decoding.

[0072] In some embodiments, the device to be paired further decodes the audio sound wave signal according to the target encoding algorithm to obtain pairing information.

[0073] In some embodiments of this specification, by detecting the trigger information in the audio sound wave signal, it is ensured that the device will enter the pairing process only when valid trigger information is received, thereby improving the accuracy of pairing.

[0074] In some embodiments, after the sound collection device of the device to be paired receives the audio sound wave signal, the audio sound wave signal is decoded using an audio library to obtain pairing information, and the pairing information is verified.

[0075] For example, during the pairing process, after the sound collection device of the device to be paired receives the audio sound wave signal, it calls the audio library to decode the audio sound wave signal to obtain the dynamic key information and the device information of the pairing initiating device, and the device to be paired verifies the pairing information. For example, check the format and length of the dynamic key, whether the device information of the pairing initiating device is compliant, verify the compatibility of the protocol header information, etc. For more information about the protocol header information, see Figure 3 .

[0076] In some embodiments, if the pairing information verification passes, the device to be paired enters the pairing mode; otherwise, the device to be paired does not enter the pairing mode.

[0077] In some embodiments of the present specification, by verifying the pairing information, it is ensured that only the corresponding pairing information can enter the pairing mode, thereby improving the security of the pairing process.

[0078] Figure 3 is an exemplary flow chart of generating an audio sound wave signal according to some embodiments of the present specification.

[0079] In some embodiments, the pairing initiating device calls the audio library based on the pairing information 310 to generate an audio sound wave signal 330 .

[0080] In some embodiments, the pairing information 310 includes a dynamic key 311 and paired device information 312 .

[0081] In some embodiments, the pairing information also includes protocol header information 313 used to establish a connection channel after pairing, and the pairing sound wave signal 333 also includes a sound wave signal corresponding to the protocol header information.

[0082] The connection channel refers to the communication path established between two devices, which is used for data transmission and communication after the devices are successfully paired.

[0083] The protocol header information 313 refers to the part describing the control information and management information during the device pairing process. The protocol header information 313 is used to control the transmission of data between devices. For example, the protocol header information 313 may include a protocol identifier, version information, a serial number, a confirmation number, and the like.

[0084] A protocol identifier is a special identifier in a communication protocol that is used to identify the type of communication protocol used, such as a Bluetooth protocol identifier, a Wi-Fi protocol identifier, a ZigBee protocol identifier, etc.

[0085] In some embodiments, the paired devices support multiple communication protocols. During the pairing process, different protocol identifiers can be used to identify and select a suitable communication protocol according to specific needs.

[0086] A communication protocol refers to a set of rules and standards that both parties must follow when pairing devices.

[0087] Version information refers to a set of data or identifiers used to identify a specific version in a communication protocol. Version information can ensure that both paired devices use compatible protocol versions during pairing. For example, version information can include version number, revision number, release date, and other related information.

[0088] A sequence number is an identifier that marks the order in which packets are sent.

[0089] The confirmation number is an identifier used by the receiving device to confirm that the data packet has been successfully received. The sequence number and confirmation number can ensure the orderly transmission and retransmission mechanism of the data.

[0090] A data packet is a structured unit that encapsulates data and is used for transmission between devices. For example, a data packet may include information such as a protocol header, dynamic key information, and device information.

[0091] In some embodiments, the protocol header information 313 may be represented in different bases, such as hexadecimal, Base64, and ASCII.

[0092] In some embodiments, the protocol header information 313 is encoded and transmitted via the audio sound wave signal 330 to ensure that after successful pairing, the devices can use the connection channel established by the protocol header information to achieve subsequent data transmission between the successfully paired devices.

[0093] In some embodiments, during the device pairing process, the pairing initiating device sends information including the protocol header information 313 to the device to be paired to initialize the connection channel. After receiving the protocol header information 313, the device to be paired parses the data packet, extracts the protocol header information 313, and confirms the protocol header information 313 to ensure that the communication protocol and version used match, and confirms information such as the serial number and protocol identifier.

[0094] For example, the device to be paired checks the serial number in the protocol header information to ensure that the order of the data packets is correct and there is no packet loss or retransmission; or checks the communication protocol type and version information in the protocol header information to ensure that it matches the protocol and version supported by itself. After the device to be paired confirms that the protocol header information 313 is correct, the device to be paired will send a confirmation message back to the device initiating the pairing, indicating that the protocol header information has been received and confirmed. After the pairing initiating device receives the confirmation message, it confirms that the connection channel is officially established.

[0095] In some embodiments of the present specification, by introducing protocol header information, the pairing process between devices can be a seamless process from initial pairing to establishing a secure connection, thereby improving the security and efficiency of pairing between devices.

[0096] The audio library refers to an audio processing library file. The audio library can be used to encode or decode the audio sound wave signal 330.

[0097] In some embodiments, the audio library can be constructed by preselecting different implementation forms, such as middleware, library files, or soft links.

[0098] In some embodiments, the paired device may call the audio library to encode and decode the protocol packet header information 313 .

[0099] In some embodiments, the audio library uses a noise reduction algorithm to remove the received noise signal when decoding the audio sound wave signal 330. For example, the noise reduction algorithm may include spectral subtraction, Wiener filter, Kalman filter, etc.

[0100] In some embodiments, during the pairing process, the pairing initiating device and the device to be paired may share the same audio library or use different audio libraries.

[0101] In some implementations, the audio library stores the correspondence between key characters and sound waves.

[0102] In some embodiments, the audio library may be constructed in advance through steps S1-S3.

[0103] Step S1, determining the key characters generated by the key generation algorithm.

[0104] For example, the key generated by the elliptic curve Diffie-Hellman algorithm can be expressed in hexadecimal as: 0x9DDEF3B55A5382B0A4B0E1CB5E5C5C5B, so the paired device needs an audio library that can cover the values ​​0 to 9 and the letters A to F; if expressed in Base64 format, it can be: gB9b+pX5LcU6EiKjMqJDHYjC1U3NZH / 5k=, then it is necessary to create a larger audio library, and there is no limit on the range of values ​​and letters covered by the audio library.

[0105] Step S2, generating a sound wave segment corresponding to each key character in the audio library.

[0106] In some embodiments, for different dynamic keys 311, the audio library can design a unique corresponding sound wave segment for each key character in the key, so that during subsequent encoding, a paired sound wave signal 333 containing different key characters is generated.

[0107] The design rules of the sound wave band are: friendly to the human ear, avoiding sharp or harsh frequencies. At the same time, the frequency of the sound wave changes smoothly to avoid sudden jumps that cause hearing discomfort.

[0108] In some embodiments, after the sound wave band is designed, the experimenter listens to it. If the experimenter finds it harsh or uncomfortable, the sound wave band is redesigned.

[0109] In some embodiments, the design of the sound band can also be generated by a sound band generation model. For more information about the sound band generation model and how to use the sound band generation model to generate a sound band, see Figure 6 and its related description.

[0110] Step S3, all key characters and their corresponding sound wave bands are stored in the audio library, and the establishment of the audio library is completed.

[0111] In some embodiments, the paired device information 312 can be converted to the same base representation as the dynamic key 311, so as to share the same audio library for encoding. If not converted, different audio libraries can also be used to encode the paired device information 312 and the dynamic key 311 respectively.

[0112] In some embodiments, once the audio library is built, it can be installed on a paired device.

[0113] In some embodiments, after the pairing initiating device enters the pairing mode, it generates a dynamic key 311, calls the audio library, encodes the dynamic key 311, and generates an audio sound wave signal.

[0114] In some embodiments, the audio sound wave signal 330 further includes a sound wave signal 331 corresponding to the dynamic key, a trigger signal 332, and a pairing sound wave signal 333. The trigger signal 332 is used to trigger the device to be paired to enter the pairing process.

[0115] The trigger signal 332 refers to a signal used to trigger the to-be-paired device to enter a pairing mode during the device pairing process.

[0116] In some embodiments, when the pairing initiating device generates an audio sound wave signal 330, a trigger signal 332 can be selected from the audio library and synthesized in front of the audio sound wave signal 330, and the audio sound wave signal 330 can be played through an external speaker to send the audio sound wave signal 330 to the device to be paired.

[0117] Exemplarily, when two devices need to establish a connection, they may be in different states. For example, the device initiating pairing may be in an active state, while the device to be paired may be in a low-power standby state. The device initiating pairing generates and sends an audio sound wave signal 330 containing a trigger signal 332. This sound wave trigger signal 332 can be used as a wake-up mechanism. When the device to be paired receives the audio sound wave signal 330, after detecting the trigger signal 332, the device wakes up from the low-power mode and activates the pairing-related components to enter the pairing process.

[0118] The pairing process refers to a series of processes to establish a connection and pair devices.

[0119] In some embodiments, when the sound collection device of the device to be paired receives the audio sound wave signal 330, the device to be paired will search the front signal of the received audio sound wave signal 330 in the audio library. If there is a match, the device confirms that it has received a valid trigger signal 332 and enters the pairing process with the pairing initiating device.

[0120] In some embodiments, when the device to be paired receives a non-valid trigger signal 332, it is regarded as a non-pairing audio sound wave signal 330, such as environmental noise, the sound of people talking, etc. The device to be paired will decode the audio sound wave signal 330 through the audio library. If the decoding fails, it is considered that the sound does not contain valid pairing information and the pairing process will not be entered.

[0121] In some embodiments, the audio sound wave signal 330 also includes a coding signal corresponding to a target coding algorithm, so that the device to be paired can know how to perform decoding.

[0122] Exemplarily, before entering the pairing process, the pairing initiating device uses a target coding algorithm in a specific audio library (such as audio library 1) to generate an audio sound wave signal 330. At the same time, the pairing initiating device can select a coding signal corresponding to the coding algorithm from the audio library 1 and synthesize it in front of the audio sound wave signal 330. When the device to be paired receives the audio sound wave signal 330, it can use the same audio library 1 for decoding according to the read coding signal, thereby entering the pairing process. Among them, the device to be paired can obtain a specific audio library for decoding based on the coding signal.

[0123] In some embodiments, the complete audio sound wave signal may include a trigger signal, a coding signal, a paired sound wave signal, etc. For example, the trigger signal and the coding signal may be added before the paired sound wave signal to form a complete audio sound wave signal.

[0124] In some embodiments of the present specification, by introducing a trigger signal 332, it is possible to ensure that both devices are synchronized and ready to start the pairing process. The trigger signal 332 can be used as a wake-up mechanism. Only when the signal is received will the device activate its pairing-related components, thereby reducing unnecessary energy consumption.

[0125] In some embodiments, the pairing initiating device may generate an audio sound wave signal 330 by querying an audio library based on the pairing information.

[0126] For example, after the pairing initiating device uses the key generation algorithm, it generates a key: ab24c. By querying the audio library, you can query the audio library to obtain the sound wave band 1 corresponding to the character "a", the sound wave band 2 corresponding to the character "b", the sound wave band 9 corresponding to the character "2", the sound wave band 7 corresponding to the character "4", and the sound wave band 3 corresponding to the character "c". These sound wave bands can then be combined to obtain the pairing sound wave signal 333 (12973) corresponding to the key (ab24c).

[0127] The length of each sound wave segment may be the same.

[0128] In some embodiments, when the pairing initiating device and the device to be paired are in the same ecosystem, the audio sound wave signal emitted by the pairing initiating device can be received by the device to be paired, and after entering the pairing process, the pairing initiating device and the device to be paired can exchange data. The data exchange method includes Bluetooth communication, infrared communication, communication through a local area network, etc.

[0129] In some embodiments of the present specification, by calling a pre-built audio library, it is ensured that the generated audio sound wave signal 330 has a high degree of accuracy and consistency, thereby improving the reliability of the pairing signal.

[0130] Figure 4 It is an exemplary flow chart of generating audio sound wave signals according to other embodiments of this specification.

[0131] In some embodiments, the pairing initiating device determines a candidate coding algorithm based on the pairing information; based on the candidate coding algorithm, scene data, ambient noise data, ambient sensor data and external speaker data, obtains anti-interference effect parameters corresponding to the candidate coding algorithm through a coding effect determination model; wherein the coding effect determination model is a machine learning model; based on the anti-interference effect parameters, determines a target coding algorithm; based on the target coding algorithm and the pairing information, obtains an audio sound wave signal.

[0132] Step 410: Determine a candidate encoding algorithm based on the pairing information. For more information about pairing information, see Figure 2 and its related description.

[0133] The candidate encoding algorithms refer to multiple groups of algorithms for encoding information pre-stored in the device.

[0134] In some embodiments, the device pre-stores multiple groups of different types of encoding algorithms, such as frequency modulation, phase encoding, amplitude keying, etc., which serve as candidate encoding algorithms.

[0135] In some embodiments, in the audio library construction phase, multiple audio libraries are pre-created and stored. These audio libraries are used as backups, and one audio library is equal to one encoding algorithm candidate encoding algorithm.

[0136] In some embodiments, the pairing initiating device may select based on the characteristics of the dynamic key, device information, or protocol header information: for example, a longer and more complex dynamic key may require a more efficient encoding algorithm. For example, different devices may support different communication protocols, and the corresponding candidate encoding algorithm is selected according to the protocol type and version supported by the device.

[0137] In some embodiments, the pairing initiating device may determine the candidate encoding algorithm by random selection.

[0138] In some embodiments, the pairing initiating device may also obtain a candidate encoding algorithm from the encoding algorithm set. For more information about the encoding algorithm set, see Figure 6 and its related description.

[0139] Step 420, based on the candidate coding algorithm, scene data, environmental noise data, environmental sensor data and external speaker data, obtain the anti-interference effect parameters corresponding to the candidate coding algorithm through the coding effect determination model.

[0140] Scenario data refers to the data in the scenario where the device is located during the pairing process, including but not limited to the situation where the paired device is located indoors or outdoors, and the situation where wall transmission is required in indoor situations.

[0141] Environmental noise data refers to the noise information about the current environment collected by the microphone of the device to be paired during the device pairing process.

[0142] Environmental sensor data refers to information related to the current environment collected by the sensors of the paired device during the device pairing process. For example, environmental sensor data includes data such as temperature and humidity in the environment.

[0143] The anti-interference effect parameter refers to a scoring indicator for evaluating the anti-interference ability of different coding algorithms in the current environment during the device pairing process, such as the anti-interference effect score. The anti-interference effect parameter is used to help the device select the most suitable coding algorithm.

[0144] In some embodiments, the pairing initiating device can obtain the anti-interference effect parameters corresponding to the candidate coding algorithm through the coding effect determination model based on the candidate coding algorithm, scene data, environmental noise data, environmental sensor data and external speaker data. For more information about the coding effect determination model, please refer to Figure 5 and its related description.

[0145] Step 430: determine a target encoding algorithm based on the anti-interference effect parameter.

[0146] In some embodiments, the pairing initiating device selects a coding algorithm with the highest parameter value as the target coding algorithm according to the anti-interference effect parameter.

[0147] Step 440: Acquire an audio sound wave signal based on the target coding algorithm and the pairing information.

[0148] In some embodiments, the pairing initiating device first selects a target encoding algorithm that best suits the current conditions based on anti-interference effect parameters, then uses the selected target encoding algorithm to encode the pairing information, and synthesizes the encoded pairing information into an audio sound wave signal.

[0149] In some embodiments, determining the target coding algorithm also includes: obtaining an alternative coding algorithm based on anti-interference effect parameters; generating an alternative audio sound wave signal based on the alternative coding algorithm and pairing information; obtaining hearing parameters (for example, hearing scores) corresponding to the alternative audio sound wave signal based on the alternative audio sound wave signal, and obtaining the audio sound wave signal based on the hearing parameters and anti-interference effect parameters.

[0150] The candidate coding algorithm refers to a group of algorithms with higher anti-interference effect parameter values ​​selected from the candidate coding algorithms. After preliminary evaluation and screening, the candidate coding algorithms have better anti-interference capabilities and perform well under the current environmental conditions.

[0151] In some embodiments, a candidate coding algorithm whose anti-interference effect parameter is greater than a preset threshold may be used as an alternative coding algorithm.

[0152] The preset threshold refers to a threshold used to determine whether a candidate coding algorithm exceeds a numerical standard.

[0153] The alternative audio sound wave signals refer to multiple audio sound wave signals generated by encoding the same pairing information using different alternative coding algorithms. During the actual pairing process, the pairing initiating device can evaluate the alternative audio sound wave signals to select the audio signal that best suits the current environmental conditions for transmission.

[0154] In some embodiments, the pairing initiating device may encode the pairing information using an alternative encoding algorithm to generate an alternative audio sound wave signal. For example, the pairing initiating device may encode the pairing information using DFM, AK, etc. to generate an alternative audio sound wave signal.

[0155] In some embodiments, the pairing initiating device may also use multiple alternative audio libraries to generate alternative audio sound wave signals. The multiple alternative audio libraries may be generated by a sound wave band generation model. For more information about the sound wave band generation model and how to generate multiple alternative audio libraries, as well as generating audio sound wave signals based on the audio library, please refer to Figure 3 and Figure 6 Related description.

[0156] Hearing parameters refer to the subjective evaluation index of audio sound wave signals in human ear perception. Hearing parameters are used to evaluate the quality of audio sound wave signals, such as sound quality, clarity, noise interference, etc.

[0157] In some embodiments, the pairing initiating device may calculate the smoothness of the candidate audio sound wave signal to obtain the hearing parameter, and considers that the higher the smoothness, the higher the hearing parameter.

[0158] For example, the volume and frequency changes of a smooth sound wave signal are relatively smooth, without sudden ups and downs, so it sounds more comfortable and will not cause discomfort to the listeners due to sudden changes in volume or frequency.

[0159] The degree of smoothness can be quantified by calculating the spectrum characteristics, signal-to-noise ratio or peak factor of the audio sound wave signal.

[0160] In some embodiments, the pairing initiating device may also construct an auditory feature vector based on alternative audio sound wave signals, scene data, and environmental sensor data, and determine auditory parameters based on the auditory feature vector using a vector database.

[0161] The auditory feature vector refers to a vector constructed based on the audio feature information of each audio sound wave signal, which is used to comprehensively evaluate the auditory quality. For example, the audio feature (x0, y0, z0) based on the corresponding audio sound wave signal can indicate that the flatness of the corresponding audio sound wave signal is x0, the signal-to-noise ratio is y0, and the peak factor is z0.

[0162] The database includes multiple reference vectors, and each of the multiple reference vectors has a corresponding reference hearing parameter, which is obtained based on historical data, actual experience, etc.

[0163] The reference vector is constructed based on the audio feature information corresponding to each audio sound wave signal, and the reference hearing parameter corresponding to the reference vector is the hearing parameter of the corresponding audio sound wave signal. The construction method of the vector to be matched is similar to that of the reference vector.

[0164] In some embodiments, the pairing initiating device can determine the auditory parameters of the audio sound wave signal corresponding to the vector to be matched based on the similarity between the vector to be matched and multiple reference vectors in the database. For example, a reference vector whose similarity with the vector to be matched meets a preset condition is used as a target vector, and the auditory parameters corresponding to the target vector are used as the auditory parameters of the corresponding audio sound wave signal. The preset conditions can be set according to the situation. For example, the similarity is maximum, or the similarity is greater than a threshold, etc.

[0165] In some embodiments, the pairing initiating device may calculate a comprehensive parameter for each candidate audio sound wave signal, and then select a candidate audio sound wave signal with the highest comprehensive parameter as the audio sound wave signal.

[0166] In some embodiments, the comprehensive parameter can be calculated by multiplying the product of coefficient 1 and the anti-interference effect parameter plus the product of coefficient 2 and the hearing parameter. Coefficient 1 and coefficient 2 are preset weights, indicating the importance of the anti-interference effect parameter and the hearing parameter in the comprehensive parameter. Coefficient 1 and coefficient 2 can be preset manually according to specific application scenarios and requirements.

[0167] In some embodiments of this specification, the target coding algorithm is determined by combining the anti-interference effect parameter and the auditory perception parameter to ensure that the generated audio sound wave signal not only has a strong anti-interference ability but also ensures good auditory comfort, thereby improving the overall quality of the audio signal.

[0168] In some embodiments of this specification, by combining scene data, environmental noise data and environmental sensor data, the device can adapt to different usage environments during pairing, thereby improving adaptability in complex environments.

[0169] Figure 5 This is an exemplary flow chart of determining a model for coding effects according to some embodiments of this specification.

[0170] The coding effect determination model 520 refers to a model used to determine the anti-interference effect parameters corresponding to the coding algorithm. In some embodiments, the coding effect determination model 520 can be a machine learning model, such as a recurrent neural network (RNN).

[0171] In some embodiments, the input of the coding effect determination model 520 may include candidate coding algorithms 514, historical environmental noise data 512, environmental sensor data 513, scene data 516, and external speaker data 515, and the output may include anti-interference effect parameters 530. For a description of candidate coding algorithms, historical environmental noise data, environmental sensor data, scene data, external speaker data, and anti-interference effect parameters, see Figure 4 and its contents.

[0172] In some embodiments, the coding effect determination model 520 is obtained based on training of a training sample set; the training sample set includes training samples and their corresponding labels; the training samples include sample coding algorithms, sample environmental noise data, sample environmental sensor data, sample external speaker data and sample scene data, and the labels are the actual anti-interference effects corresponding to the training samples; the labels are obtained based on multiple tests on the same set of training samples.

[0173] In some embodiments, multiple tests include testing based on different test distances; the test distance refers to the distance between the sample pairing initiating device and the sample device to be paired; and the same sample encoding algorithm can be combined with different sample environmental noise data, sample environmental sensor data, sample external speaker data and sample scene data to form multiple groups of training samples.

[0174] In some embodiments, the coding effect determination model 520 can be obtained by training with labeled training data. In some embodiments, the training data can be obtained based on historical data. The labels of each group of training samples can be obtained by performing multiple tests on the group of training samples, testing based on different test distances, and calculating the mean or weighted mean of the transmission accuracy to determine the labels of the group of training samples.

[0175] In some embodiments, the processor may perform multiple tests on the group of training samples and take the average of the transmission accuracy. For example, the group of training samples may be tested 100 times to obtain the transmission accuracy of each test, and the average of the transmission accuracy of each test may be calculated, and the average may be determined as the label of the group of training samples.

[0176] In some embodiments, the processor may perform multiple tests on the group of training samples at different test distances and take a weighted mean of the transmission accuracy. For example, if the group of training samples is expected to be tested 100 times, 20 tests may be performed at a test distance of 5m, 20 tests may be performed at a test distance of 10m, 30 tests may be performed at a test distance of 15m, and 30 tests may be performed at a test distance of 20m to obtain the transmission accuracy of each test, and different weights may be set based on different test distances, and the weighted sum of the transmission accuracy of each test may be divided by the number of tests to obtain a weighted mean of the transmission accuracy, and the weighted mean may be determined as the label of the group of training samples. The weights may be determined based on historical data and / or manually labeled.

[0177] The transmission accuracy rate refers to the ratio of correct characters to all characters obtained by using a coding algorithm to encode the original pairing information multiple times to generate an audio sound wave signal and transmit it, and then decoding the audio sound wave signal on the paired device to obtain the transmitted pairing information, and then comparing the transmitted pairing information with the original pairing information. For example, the original pairing information has 20 characters, and the transmitted pairing information is compared with the original pairing information, and it is found that 2 characters are wrong, so the transmission accuracy rate is (20-2) / 20=90%.

[0178] In some embodiments, the coding effect determination model 520 can be trained in the following manner: multiple labeled first samples are input into the initial coding effect determination model, a loss function is constructed through the labels and the output results of the initial coding effect determination model, the initial coding effect determination model is updated based on the iteration of the loss function, and the coding effect determination model training is completed when the loss function of the initial coding effect determination model meets the iteration termination condition, wherein the iteration termination condition may be that the loss function converges, the number of iterations reaches a set value, etc.

[0179] In some embodiments of the present specification, by setting the number of tests at different test distances to obtain a coding effect determination model label, a more comprehensive label can be obtained. Among them, the propagation and anti-interference ability of the acoustic signal will be affected by the distance. During long-distance transmission, factors such as signal attenuation, multipath effect, reflection and diffraction will more significantly affect the quality and anti-interference of the signal. Therefore, different test distances are adopted to obtain labels, and a coding effect determination model 520 with better comprehensive performance at each distance under multiple conditions can be obtained.

[0180] In some embodiments of the present specification, collecting data at a single distance may result in the coding effect determination model being over-adapted to that specific condition and performing poorly at other distances. By collecting data at multiple distances, the learning process of the model is more comprehensive, reducing the risk of overfitting and improving the stability and reliability of the model.

[0181] In some embodiments, the coding effect determination model 520 includes a noise prediction layer 521. The noise prediction layer 521 can be a machine learning model, for example, a long short-term memory network (LSTM). The noise prediction layer 521 is used to predict future environmental noise data 522 based on historical environmental noise data 512, environmental sensor data 513, and time data 511.

[0182] The historical environmental noise data 512 refers to environmental noise data when or before the device to be paired generates an audio sound wave signal.

[0183] Time data 511 refers to relevant data that can represent time. For example, time data 511 may include season data, specific time, etc.

[0184] The future environmental noise data 522 refers to the environmental noise data when the to-be-paired device 160 acquires the audio sound wave signal after the external speaker plays the audio sound wave signal.

[0185] In some embodiments, the noise prediction layer 521 can be trained by training data with labels. Each set of training data may include historical environmental noise data 512, environmental sensor data 513, time data 511, etc. In some embodiments, the training data can be obtained based on historical data. The label of each set of training data can be the future environmental noise data 522 corresponding to the set of training data, which can be determined based on historical data and / or manually labeled.

[0186] In some embodiments, the noise prediction layer 521 can be trained in the following manner: multiple labeled training data are input into the initial noise prediction layer, a loss function is constructed through the labels and the output results of the initial noise prediction layer, the initial noise prediction layer is updated based on the iteration of the loss function, and the noise prediction layer training is completed when the loss function of the initial condition generation model meets the iteration termination condition, wherein the iteration termination condition may be the convergence of the loss function, the number of iterations reaching a set value, etc.

[0187] In some embodiments, the coding effect determination model 520 further includes a determination layer 523. The determination layer may be a machine learning model, such as RNN. The determination layer 523 is used to determine the anti-interference effect parameter 530 based on the candidate coding algorithm 514, the future environmental noise data 522, the environmental sensor data 513, the scene data 516, and the external speaker data 515.

[0188] The model training of the determination layer is consistent with the training process of the coding effect determination model, where the training data may include sample environmental noise data, sample environmental sensor data, sample candidate coding algorithms, sample external speaker data, sample scene data, etc. The label is the actual anti-interference effect parameter corresponding to the training sample.

[0189] The coding effect determination model can be trained on other servers or computers with higher computing power, and then installed on the paired device after completion. For more information about the training process of the coding effect determination model 520, see Figure 4 and its related description.

[0190] In some embodiments of the present specification, future environmental noise data is predicted based on historical environmental noise data, environmental sensor data, and time data. By predicting future environmental noise data, the impact of environmental noise during device pairing is taken into account, the anti-interference effect is further improved, and the accuracy of audio pairing is further improved.

[0191] Figure 6 It is a schematic diagram of a sound wave band generation model shown in some embodiments of this specification.

[0192] In some embodiments, the candidate encoding algorithm 514 is obtained from a set of encoding algorithms; the encoding algorithm set includes an audio library, and the method of obtaining the audio library includes: based on the key parameter 610 and the sound wave parameter range 611, through the sound wave band generation model 620, a sound wave band set 630 is generated, and the audio library is determined; wherein, the sound wave band generation model 620 is a machine learning model.

[0193] The candidate encoding algorithm 514 may encode the same pairing information to obtain at least one candidate audio sound wave signal. In some embodiments, the candidate encoding algorithm 514 is randomly obtained from the encoding algorithm set.

[0194] The coding algorithm set includes multiple coding algorithms. For example, the coding algorithm set may include direct frequency modulation (DFM), amplitude keying (AK), etc.

[0195] In some embodiments, the set of encoding algorithms includes at least one audio library.

[0196] In some embodiments, the processor can use the sound wave band generation model 620 to generate corresponding sound wave bands based on the sound wave parameter range 611 and the key parameter 610 to build multiple diversified audio libraries. The sound wave parameter range 611 and the key parameter 610 are input into the sound wave band generation model 620, and the sound wave band generation model 620 generates a sound wave band set that conforms to the sound wave parameter range 611 and the key parameter 610, and the generated sound wave band set and the corresponding relationship between the sound wave band set and the key character are stored in the audio library, so that when the device to be paired enters the pairing process, the processor calls from the audio library.

[0197] The sound band generation model 620 refers to a model for generating sound bands. In some embodiments, the sound band generation model can be a machine learning model, such as a generative adversarial network (GAN) or other customized model structures, or any combination thereof.

[0198] In some embodiments, the processor 120 may generate a sound wave band set 630 based on the input key parameters 610 and the sound wave parameter range 611 through the sound wave band generation model 620 .

[0199] The key parameter 610 refers to the total number of characters representing the key. In some embodiments, the key parameter 610 can be expressed in hexadecimal. For example, the total number of characters corresponding to the hexadecimal expression key is 0 to 9 and a to z, and the total number of characters is 36 bits. If the 36 bits of characters are input into the generator, 36 sound wave segments are generated.

[0200] The sound wave parameter range 611 refers to the data parameter range of the sound wave band, such as frequency, amplitude, pitch change, waveform type, etc. When generating an audio library, different sound wave parameter ranges are input, and different audio libraries are generated.

[0201] In some embodiments, the sound wave band generation model 620 is composed of a generator and a discriminator, wherein the generator can input a key parameter and a sound wave parameter range to generate a sound wave band, and the discriminator can be used to determine whether the sound wave band synthesized and output by the generator is similar to a real sound wave sample in a data set. The data set can store real sound wave samples.

[0202] The sound wave bands input to the discriminator are real samples or pseudo samples synthesized by the generator.

[0203] Real samples refer to the collected sound wave samples of different frequencies, amplitudes, pitch changes and waveform types. Real samples need to be samples that will not cause auditory stimulation to users.

[0204] The pseudo sample refers to the sound wave segment generated by the generator based on the key parameter and the sound wave parameter range as input.

[0205] In some embodiments, the acoustic band generation model 620 may be trained based on pseudo samples and real samples, wherein the training of the acoustic band generation model 620 may include a first stage and a second stage.

[0206] Phase 1: Fix the parameters of the generator and train the discriminator. The parameters of the generator may include weights and biases obtained by random initialization. Input the key parameter 610 and the acoustic wave parameter range 611 into the generator model to generate pseudo samples, and then select the real samples corresponding to the key parameter 610 and the acoustic wave parameter range 611. Use the pseudo samples and the real samples as the training samples of the first phase, and train the discriminator based on the data types corresponding to the pseudo samples and the real samples, so that the discriminator can distinguish pseudo samples from real samples as much as possible.

[0207] The second stage: fix the parameters of the discriminator and train the generator. The generator and the discriminator obtained in the first stage are combined into a composite model, in which the data output by the generator can be input into the discriminator for judgment. The key parameters 610 and the sound wave parameter range 611 are input into the generator to generate pseudo samples, and the pseudo samples are input into the composite model as training samples for the second stage for training. With the continuous training in the second stage, the generator's ability to output pseudo samples similar to real samples becomes stronger and stronger, and the similarity between the pseudo samples output by the generator and the real samples continues to increase until the discriminator judges the pseudo samples as real samples.

[0208] Then the first stage and the second stage are cycled, and finally, through continuous cycles, the parameters of the generator and the discriminator are updated according to the feedback of the discriminator until a preset training round is reached or certain convergence conditions are met, thereby obtaining a trained sound wave band generation model 620.

[0209] The sound wave band set 630 refers to a set of sound wave bands generated by the sound wave band generation model 620 that conform to the sound wave parameter range 611 and the key parameter 610 .

[0210] In some embodiments of the present specification, the sound wave band generation model 620 is used to generate the sound wave band corresponding to the key parameter 610 based on the reference sound wave to construct multiple diversified audio libraries. The sound wave band generation model 620 designs multiple audio libraries, eliminating the workload of manually designing audio libraries and saving labor costs; a large number of audio libraries provide more choices, and the most suitable audio library can be selected according to the performance of the audio library in different environments, providing more choices for candidate encoding algorithms; the sound wave bands in the audio library generated by the sound wave band generation model are sound waves that can make customers feel comfortable, which improves the user experience; using a diversified audio library has higher security than a single audio library, which can further reduce the probability of being deciphered.

[0211] Figure 7 is a schematic diagram of a pairing process according to some embodiments of this specification. Figure 7 As shown, the pairing process may include encoding 701, requesting pairing 702, playing 703, capturing 704, decoding 705, pairing information sharing, invoking pairing 707, pairing verification 708, pairing feedback 709, and pairing completion 7110. Among them, the pairing information sharing includes the pairing information sharing A706-1, pairing information sharing B706-2...pairing information sharing N706-n and other sharing processes corresponding to the to-be-paired device A, the to-be-paired device B...the to-be-paired device N, respectively.

[0212] Encoding 701 and decoding 705 mean that the paired device can call the audio library to encode or decode the audio sound wave signal. For more information about audio library, encoding and decoding, please refer to Figure 3 and its related description.

[0213] Requesting pairing 702 means that the pairing initiating device requests pairing with the device to be paired by transmitting pairing information.

[0214] In some implementations, the pairing initiating device encodes the generated pairing information through an audio library to generate an audio sound wave signal. The encoded audio signal is played through an ALSA device in the pairing initiating device in step 703 to transmit the audio sound wave signal to the device to be paired.

[0215] ALSA device refers to Advanced Linux Sound Architecture device (ALSA). ALSA device is a component for processing audio input and output in Linux operating system. In some embodiments, ALSA device is integrated in paired device.

[0216] Capture 704 means that the device to be paired can capture the audio sound wave signal played from the ALSA device through the sound collection device. For more information about the sound collection device, see Figure 2 Corresponding description.

[0217] In some embodiments, devices are not limited to pairing via audio sound wave signals, but can also transmit network configuration information via network protocols, allowing devices to communicate and collaborate in the same network.

[0218] The network protocol refers to the communication protocol used to transmit and share pairing information between the pairing initiator and the device to be paired. The network protocol is used to transmit pairing information between devices, feedback pairing results, and achieve collaborative work between devices. For example, network protocols include WIFI, Bluetooth, BitTorrent (BT), etc.

[0219] Network configuration information refers to network configuration information. For example, network configuration information may include Wi-Fi password, IP address, subnet mask, gateway information, etc.

[0220] In some embodiments, the pairing initiating device can perform one-way pairing with multiple devices to be paired at the same time.

[0221] Pairing information sharing means that during the pairing process, when one of the devices to be paired decodes the pairing information, it can share the information with other devices to be paired through the network protocol. Figure 7 As shown, the to-be-paired device A, the to-be-paired device B ... the to-be-paired device N respectively implement pairing information sharing A 706 - 1 , pairing information sharing B 706 - 2 ... pairing information sharing N 706 - n through the network protocol.

[0222] Exemplarily, when one of the devices to be paired receives the audio sound wave signal, the audio library can be used to decode the audio sound wave signal, wherein the decoded dynamic key and pairing information can be shared with other devices to be paired via a network protocol.

[0223] Invoking pairing 707 means that the pairing initiating device can play an audio sound wave signal through the ALSA device to wake up the device to be paired in the audio ecosystem for pairing.

[0224] An audio ecosystem is a network of paired devices working together. These paired devices communicate and collaborate through audio sound wave signals.

[0225] In some embodiments, each paired device can join the system through a pairing process and cooperate with other devices.

[0226] Pairing verification 708 refers to the verification of the received pairing information by the to-be-paired device to ensure the integrity and correctness of the pairing information.

[0227] In some embodiments, the pairing information further includes a timestamp, an environmental noise level, and a cyclic redundancy check (CRC).

[0228] In some embodiments, the devices to be paired can avoid expired requests and ensure the timeliness of pairing by checking the timestamp. A timestamp refers to a unique identifier generated by the pairing initiating device during the device pairing process. The timestamp is used to record a specific time point. For example, if the time period between the timestamp in a pairing information and the time when the pairing request is initiated exceeds a certain time window, the device to be paired can reject the pairing request. The time window can be set manually, such as within 5 minutes after the pairing request is initiated.

[0229] In some embodiments, the pairing initiating device can select a suitable frequency band for sound wave signal transmission according to the ambient noise level. The ambient noise level refers to the intensity or level of background noise in the current environment. The ambient noise level information can help the paired device optimize the decoding process of the audio sound wave signal.

[0230] Exemplarily, the pairing initiating device can collect noise signals in the current environment through sensors, and perform spectrum analysis on the captured noise signals to obtain noise intensity distribution diagrams on various frequency bands. The spectrum diagram is analyzed, and according to the frequency band selection strategy, a suitable frequency band is determined for audio sound wave signal transmission to avoid noise interference. The pairing initiating device adjusts the frequency parameters of the audio sound wave signal according to the selected frequency band, and performs signal encoding and transmission. Among them, the frequency band selection strategy can be preset manually, for example, selecting the frequency band with the lowest noise intensity, or selecting one of several low-noise frequency bands.

[0231] In some embodiments, when decoding the audio sound wave signal, the device to be paired will check the frequency band information of the signal to ensure that the frequency band used by the signal is the optimal frequency band selected according to the ambient noise level.

[0232] In some embodiments, the pairing initiating device may add frequency band information to the header or a specific position of the audio sound wave signal.

[0233] Frequency band information refers to the specific frequency range used by the audio sound wave signal during transmission. Frequency band information can indicate the frequency band used by the current audio sound wave signal and provide information for the paired device to dynamically switch the frequency band. For example, when the paired device detects that the noise interference in the current frequency band increases, the pairing initiator device and the paired device can dynamically switch to a new frequency band to avoid the new noise interference and ensure the transmission quality and reliability of the signal.

[0234] In some embodiments, the pairing initiating device may perform CRC calculation on the pairing information to generate a CRC check code. The CRC check code is a check mechanism used to check the transmission of pairing information.

[0235] In some embodiments, the pairing initiating device can transmit the pairing information and CRC check code to the device to be paired by playing an audio sound wave signal through the ALSA device. After the device to be paired captures the audio sound wave signal, it can extract the pairing information and CRC check code, perform the same CRC calculation on the pairing information, and compare it with the received CRC check code to verify whether the pairing information is correct. When the CRC check code matches, it indicates that the pairing information is correct and the device to be paired enters the pairing mode; when the CRC check code does not match, it indicates that the pairing information is incorrect, and the retransmission mechanism is immediately triggered, requesting the pairing initiating device to resend the pairing information until the device to be paired receives the correct pairing information.

[0236] Pairing feedback 709 means that after the to-be-paired device verifies the pairing information, the verification result can be fed back to the pairing initiating device through the network protocol.

[0237] In some embodiments, if the result obtained by the pairing initiating device through the network protocol is verification success (Y), it indicates that the pairing is completed; if the result is verification failure (N) or verification timeout (Time out), the pairing initiating device will trigger a retransmission mechanism and resend the pairing information.

[0238] Pairing completed 7110 means that if the pairing feedback is verification success (Y), it means that the pairing is completed and the pairing relationship has been successfully established between the paired devices.

[0239] In some embodiments of the present specification, by sharing dynamic keys and pairing information, each device does not need to perform repeated operations. Information sharing reduces the time for each device to process independently, making the entire pairing process faster, improving the real-time performance of the pairing, and ensuring the consistency and synchronization of the pairing process.

[0240] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0241] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

Claims

1. An audio pairing method, characterized in that: The method is performed by a pairing initiating device, and includes: In response to a trigger condition being met, entering a pairing mode and generating pairing information; Based on the pairing information, generate an audio sound wave signal; The audio sound wave signal is played through an external speaker to send the audio sound wave signal to the device to be paired.

2. The method according to claim 1, characterized in that The generating an audio sound wave signal based on the pairing information comprises: Based on the pairing information, an audio library is called to generate the audio sound wave signal.

3. The method according to claim 1, characterized in that The generating an audio sound wave signal based on the pairing information further comprises: Based on the pairing information, determining a candidate encoding algorithm; Based on the candidate coding algorithm, scene data, environmental noise data, environmental sensor data and external speaker data, an anti-interference effect parameter corresponding to the candidate coding algorithm is obtained through a coding effect determination model; wherein the coding effect determination model is a machine learning model; Determining a target encoding algorithm based on the anti-interference effect parameter; Based on the target coding algorithm and the pairing information, the audio sound wave signal is acquired.

4. The method according to claim 3, characterized in that The candidate encoding algorithm is obtained from an encoding algorithm set; the encoding algorithm set includes an audio library, and the audio library is obtained in the following manner: Based on the key parameters and the sound wave parameter range, the audio library is determined through a sound wave band generation model; wherein the sound wave band generation model is a machine learning model.

5. An audio pairing receiving method, characterized in that: The method is performed by a device to be paired, and includes: receiving an audio sound wave signal, obtaining pairing information based on the audio sound wave signal, and verifying the pairing information; In response to the verification passing, entering pairing mode.

6. An audio pairing system, characterized in that: The system includes a pairing initiating device and a device to be paired; The pairing initiating device is configured as: In response to a trigger condition being met, entering a pairing mode and generating pairing information; Based on the pairing information, generate an audio sound wave signal; Playing the audio sound wave signal through an external speaker to send the audio sound wave signal to the device to be paired; The device to be paired is configured as: Receiving the audio sound wave signal, acquiring the pairing information based on the audio sound wave signal, and verifying the pairing information: In response to the verification passing, entering pairing mode.

7. The system according to claim 6, characterized in that The pairing initiating device is further configured to: Based on the pairing information, an audio library is called to generate the audio sound wave signal.

8. The system according to claim 6, characterized in that The pairing initiating device is further configured to: Based on the pairing information, determining a candidate encoding algorithm; Based on the candidate coding algorithm, scene data, environmental noise data, environmental sensor data and external speaker data, an anti-interference effect parameter corresponding to the candidate coding algorithm is obtained through a coding effect determination model; wherein the coding effect determination model is a machine learning model; Determining a target encoding algorithm based on the anti-interference effect parameter; Based on the target coding algorithm and the pairing information, the audio sound wave signal is acquired.

9. The system according to claim 8, characterized in that The candidate encoding algorithm is obtained from an encoding algorithm set; the encoding algorithm set includes an audio library, and the audio library is obtained in the following manner: Based on the key parameters and the sound wave parameter range, the audio library is determined through a sound wave band generation model; wherein the sound wave band generation model is a machine learning model.

10. A computer-readable storage medium, characterized in that: The storage medium stores computer instructions. When the computer reads the computer instructions in the storage medium, the computer executes the audio pairing method according to any one of claims 1 to 5.

Images