Audio-based device commissioning method and apparatus, storage medium, and electronic device

Abstract

The application discloses an audio-based device network configuration method and system, a storage medium and an electronic device. The method comprises the following steps: obtaining first network configuration information to be transmitted to a device to be configured, the device to be configured being a device to be configured, and the first network configuration information being a to-be-transmitted character sequence, each to-be-transmitted character being a preset character in a preset character group; selecting a target frequency group from a plurality of preset frequency groups corresponding to the preset character group according to the noise frequency of the current environmental noise, the frequency segments corresponding to different preset frequency groups being non-overlapping, and different preset characters corresponding to different preset frequencies in each preset frequency group; generating an audio signal corresponding to each to-be-transmitted character according to a target frequency corresponding to each to-be-transmitted character in the target frequency group in the to-be-transmitted character sequence; and playing the audio signal corresponding to each to-be-transmitted character in sequence through an audio playing component to transmit the first network configuration information to the device to be configured.

Description

Technical Field

[0001] This application relates to the field of smart home / intelligent home technology, and more specifically, to an audio-based device network configuration method and apparatus, storage medium and electronic device. Background Technology

[0002] Currently, to configure devices for network distribution, it is necessary to transmit distribution information between the devices. This transmission involves first establishing a wireless network data connection between the devices, and then transmitting the distribution information based on that connection. However, the connection process is limited by physical hardware chips and operating systems, resulting in a low success rate. Furthermore, the connection process is relatively complex and specialized, requiring users to possess certain technical knowledge, making it user-unfriendly.

[0003] To address this, distribution network information can be transmitted via audible audio waveform carrier waves. Since no connection needs to be established between the two devices, problems that may arise during the connection process can be avoided. Furthermore, transmitting distribution network information by directly sending a ciphertext carrier wave with a specific waveform is more intuitive, secure, and less susceptible to data interception.

[0004] However, current audible speech waveform carriers have drawbacks such as weak anti-interference ability and poor spectrogram readability. The audio transmission and reception process is easily affected by noise, resulting in a low resolution and recognition rate of the received audio by the receiving device.

[0005] Therefore, it can be seen that the audio-based device network configuration method in the relevant technology has the problem of low audio recognition rate due to weak anti-interference ability against noise. Summary of the Invention

[0006] This application provides an audio-based device network configuration method and apparatus, storage medium and electronic device, to at least solve the problem of low audio recognition rate caused by weak noise resistance in related technologies.

[0007] According to one aspect of the embodiments of this application, an audio-based device network configuration method is provided, comprising: acquiring first network configuration information to be transmitted to a device to be configured, wherein the device to be configured is a device to be configured, the first network configuration information is a character sequence to be transmitted, and each character to be transmitted in the character sequence is a preset character in a preset character group; selecting a target frequency group from a plurality of preset frequency groups corresponding to the preset character group according to the noise frequency of the current ambient noise, wherein the frequency bands corresponding to different preset frequency groups in the plurality of preset frequency groups do not overlap, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group of the plurality of preset frequency groups; generating an audio signal corresponding to each character to be transmitted according to the target frequency in the target frequency group corresponding to each character to be transmitted in the character sequence; and sequentially playing the audio signal corresponding to each character to be transmitted through an audio playback component to transmit the first network configuration information to the device to be configured.

[0008] According to another aspect of the embodiments of this application, an audio-based device network configuration system is also provided, comprising: a target device, configured to acquire first network configuration information to be transmitted to a device to be configured, wherein the device to be configured is a device to be configured, the first network configuration information is a character sequence to be transmitted, and each character to be transmitted in the character sequence is a preset character in a preset character group; selecting a target frequency group from a plurality of preset frequency groups corresponding to the preset character group according to the noise frequency of the current ambient noise, wherein the frequency bands corresponding to different preset frequency groups in the plurality of preset frequency groups do not overlap, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group of the plurality of preset frequency groups; generating an audio signal corresponding to each character to be transmitted according to the target frequency in the target frequency group corresponding to each character to be transmitted in the character sequence; and sequentially playing the audio signal corresponding to each character to be transmitted through an audio playback component to transmit the first network configuration information to the device to be configured; the device to be configured... A network device is used to segment an audio signal to be parsed according to a preset duration to obtain a set of audio signal segments to be parsed. The audio signal to be parsed is the audio signal acquired by the audio acquisition component of the network device, corresponding to each character to be transmitted. A time-frequency domain transformation is performed on each audio signal segment to obtain the spectrum data corresponding to each audio signal segment. Based on the spectrum data corresponding to each audio signal segment, a matching frequency is determined for each audio signal segment to obtain a matching frequency sequence. The matching frequency of each audio signal segment is the frequency with the largest amplitude-frequency characteristic in the spectrum data corresponding to each audio signal segment. Based on the matching relationship between the matching frequency in the matching frequency sequence and the target frequency in the target frequency group, and the correspondence between the target frequency in the target frequency group and the preset character in the preset character group, the matching frequency sequence is parsed into a target character sequence to obtain second network distribution information. Each target character in the target character sequence is a preset character in the preset character group.

[0009] According to another aspect of the embodiments of this application, a computer-readable storage medium is also provided, wherein a computer program is stored in the computer program, and the computer program is configured to execute the above-described audio-based device network configuration method when it is run.

[0010] According to another aspect of the embodiments of this application, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the above-described audio-based device network configuration method through the computer program.

[0011] In this embodiment, the method of generating audio of characters to be transmitted by combining the current ambient noise is adopted to obtain the first network distribution information to be transmitted to the device to be networked. The device to be networked is the device to which network distribution is to be performed, and the first network distribution information is a sequence of characters to be transmitted. Each character to be transmitted in the sequence is a preset character in a preset character group. Based on the noise frequency of the current ambient noise, a target frequency group is selected from multiple preset frequency groups corresponding to the preset character group. The frequency bands corresponding to different preset frequency groups in the multiple preset frequency groups do not overlap, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group of the multiple preset frequency groups. The target frequency group is then used to select the character to be transmitted. The target frequency corresponding to each character to be transmitted in the character sequence is used to generate an audio signal corresponding to each character to be transmitted. The audio signal corresponding to each character to be transmitted is played sequentially by the audio playback component to transmit the first distribution network information to the device to be distributed. Since the frequency of the current ambient noise is fully considered when determining the frequency of the audio to be played, the frequency of the current ambient noise can be effectively avoided. Thus, the influence of the current ambient noise on the audio is reduced during the transmission and reception of the audio, which can improve the anti-interference ability against noise and achieve the technical effect of improving the audio recognition rate. This solves the problem of low audio recognition rate caused by weak anti-interference ability against noise in the audio-based device distribution method in related technologies. Attached Figure Description

[0012] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0013] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0014] Figure 1 This is a schematic diagram of the hardware environment for an audio-based device network configuration method according to an embodiment of this application;

[0015] Figure 2 This is a schematic flowchart of an optional audio-based device network configuration method according to an embodiment of this application;

[0016] Figure 3 This is a flowchart illustrating an optional device network configuration method according to an embodiment of this application;

[0017] Figure 4 This is a schematic diagram of an optional forward error correction according to an embodiment of this application;

[0018] Figure 5 This is a schematic diagram of an optional voiceprint distribution network system according to an embodiment of this application;

[0019] Figure 6 This is a schematic flowchart of another optional audio-based device network configuration method according to an embodiment of this application;

[0020] Figure 7 This is a schematic diagram of an optional mobile terminal performing voiceprint network configuration according to an embodiment of this application;

[0021] Figure 8 This is a schematic diagram of another optional mobile terminal performing voiceprint network configuration according to an embodiment of this application;

[0022] Figure 9 This is a structural block diagram of an optional electronic device according to an embodiment of this application. Detailed Implementation

[0023] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0024] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0025] According to one aspect of the embodiments of this application, an audio-based device configuration method is provided, which can be applied to smart devices. This audio-based device configuration method is widely used in whole-house intelligent digital control application scenarios such as smart homes, smart home ecosystems, and intelligence house ecosystems. Optionally, in this embodiment, the above-mentioned audio-based device configuration method can be applied to, for example... Figure 1 The hardware environment shown consists of terminal device 102 and server 104. For example... Figure 1 As shown, server 104 is connected to terminal device 102 via a network and can be used to provide services (such as application services) to the terminal or clients installed on the terminal. A database can be set up on the server or independently of the server to provide data storage services for server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data processing services for server 104.

[0026] The aforementioned network may include, but is not limited to, at least one of the following: wired network, wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: wide area network, metropolitan area network, local area network. The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity), Bluetooth. Terminal device 102 may not be limited to PCs, mobile phones, tablets, smart air conditioners, smart range hoods, smart refrigerators, smart ovens, smart stoves, smart washing machines, smart water heaters, smart washing equipment, smart dishwashers, smart projectors, smart TVs, smart clothes racks, smart curtains, smart audio-visual equipment, smart sockets, smart speakers, smart speakers, smart fresh air systems, smart kitchen and bathroom equipment, smart bathroom equipment, smart robot vacuum cleaners, smart window cleaning robots, smart mopping robots, smart air purifiers, smart steam ovens, smart microwave ovens, smart water heaters, smart air purifiers, smart water dispensers, smart door locks, and other voice-interactive devices.

[0027] The audio-based device configuration method of this application embodiment can be executed by server 104, terminal device 102, or jointly by server 104 and terminal device 102. Alternatively, the terminal device 102 can execute the audio-based device configuration method of this application embodiment by a client installed on it.

[0028] Taking the audio-based device network configuration method in this embodiment as an example, which is executed by terminal device 102, Figure 2 This is a schematic flowchart of an optional audio-based device network configuration method according to an embodiment of this application, such as... Figure 2 As shown, the process of this method may include the following steps:

[0029] Step S202: Obtain the first network configuration information to be transmitted to the device to be configured, wherein the device to be configured is the device to be configured, the first network configuration information is a character sequence to be transmitted, and each character to be transmitted in the character sequence is a preset character in a preset character group.

[0030] The audio-based device network configuration method in this embodiment can be applied to scenarios where network configuration information is transmitted between two devices via an audio carrier. The audio carrier can be an audible voice audio waveform carrier, which can carry text information, such as network configuration information. The network configuration information is transmitted between the two devices by having the sending end (e.g., the target device) play the audio and the receiving end (e.g., the device to be configured) receive the audio. The device can be one or more of the aforementioned terminal devices, and can be equipped with a microphone (MIC) and a speaker.

[0031] The aforementioned network configuration information can be used for network configuration, and the corresponding network can be either a wired network or a wireless network. Taking the configuration of a Wi-Fi network in a smart home system as an example, currently, smart devices such as Wi-Fi doorbells, Wi-Fi cameras, and Wi-Fi voice assistants all use Wi-Fi networks. However, since many smart devices lack touchscreens and displays, configuring the Wi-Fi router's SSID (Service Set Identifier) ​​and password can be confusing for users.

[0032] The distribution network solutions provided in related technologies can be as follows: Figure 3 As shown, the device actively turns on the Wi-Fi hotspot, and the user completes the Wi-Fi connection. For example, the user disconnects the phone's current Wi-Fi network and connects to the Wi-Fi hotspot, thereby establishing a TCP / IP connection between the mobile application and the device. Then, the user sends the Service Set Identifier and password to the device. The device connects to the home router, and the mobile application connects to the home network to verify the validity of the connection.

[0033] If the device fails to connect to the home network after turning off its hotspot, it will repeatedly try to connect. This entire process requires a high level of user expertise and necessitates matching the QR code key printed on the device. However, storing this QR code key is extremely difficult; if lost, the device will be permanently disabled.

[0034] It is evident that configuring a Wi-Fi hotspot is a relatively complex and difficult process for users to understand (most users lack professional network knowledge). In contrast, voiceprint configuration (i.e., audio-based configuration) only requires one device to "speak" and another device to "listen," making it as simple and easy to learn and understand as human communication, without the need for repeated network switching and attempts.

[0035] With the development of audio carrier and audio speech recognition, there are currently two methods for audio recognition: speech semantic recognition and audio carrier modulation and demodulation. The former has a larger error rate and is unsuitable for applications requiring high accuracy, such as passwords and login data. Audio carrier modulation and demodulation, on the other hand, has relatively high accuracy due to its controllable frequency and timing. Therefore, it is commonly used when transmitting distribution network information. However, due to the uncertainty of external noise, and because audio carriers are based on microphones and speakers to simulate hearing, they are sensitive to noise, especially co-channel noise interference, which is almost ineffective. For example, co-channel interference is very significant in radios, leading to a high error rate in data transmission. While time-frequency ripple can improve noise immunity, co-channel noise remains difficult to handle.

[0036] To at least partially solve the above problems, the current ambient noise can be collected before generating the audio signal used to transmit distribution network information. The frequency of the audio signal to be generated can be determined by combining the frequency of the ambient noise. This improves the difference between the distribution network information carrying text information and the current ambient noise, enabling the device to be distributed to distinguish between the audio signal carrying distribution network information and the ambient noise, thereby improving the accuracy of audio recognition.

[0037] When configuring a device for network distribution, the configuration can be initiated via voice or other means. At this time, the user can input network configuration information on the target device or its application (e.g., the target application). The target device can respond to the detected input and obtain the input network configuration information. In scenarios where information encryption or other processing is not required, the input network configuration information is the first network configuration information to be transmitted to the device. In cases where information encryption or other processing is required, the first network configuration information to be transmitted to the device is obtained by encrypting or processing the input network configuration information. Through this method, the target device can obtain the first network configuration information to be transmitted to the device. Here, the first network configuration information is a sequence of characters to be transmitted, and each character in the sequence is a preset character from a preset character group.

[0038] The preset characters in the preset character group here can be characters that constitute the input network distribution information, or characters that constitute the network distribution information obtained after encrypting or otherwise processing the input network distribution information. For example, the preset character group can be a set of pre-defined ciphertext characters, such as 0-15 SSID@Password (Service Set Identifier and Password) ASCII (American Standard Code for Information Interchange). By using the preset characters in the preset character group to represent text information, the encryption of text information can be achieved.

[0039] Step S204: Select a target frequency group from multiple preset frequency groups corresponding to the preset character group based on the noise frequency of the current ambient noise.

[0040] To reduce encoding complexity and improve speed and readability, multiple preset frequency groups can be pre-defined. Each preset frequency group contains the same number of preset frequencies, and the frequency interval between adjacent preset frequencies within the same preset frequency group is the same. To eliminate co-channel interference and increase the signal-to-error ratio, the frequency interval between adjacent preset frequencies within each preset frequency group can be defined as greater than 100Hz. For example, the audio carrier arbitration interval frequency can be defined as 100Hz, the amplifier (speaker) as -100dB, and the sampling frequency interval as fs = 23.4375Hz. The interval frequency can also be 200Hz. Furthermore, to save bandwidth, under a fixed interval, only numbers from 0 to 15, or 4 bits, can be transmitted at a time.

[0041] Each preset frequency group corresponds to a preset character group. Different preset characters within a preset character group can correspond to different preset frequencies within each preset frequency group. In other words, a preset frequency within a preset frequency group corresponds to a preset character within a preset character group. The frequency bands corresponding to different preset frequency groups do not need to overlap, and the frequency band corresponding to a preset frequency group can be a range from the minimum preset frequency to the maximum preset frequency within that preset frequency group.

[0042] In this embodiment, a target frequency group can be selected from multiple preset frequency groups corresponding to a preset character group based on the noise frequency of the current ambient noise. This target frequency group is the preset frequency group used to generate the audio signal. The noise frequency of the current ambient noise can be obtained by performing spectral analysis on the current ambient noise, representing the noise frequency range of the current ambient noise (which can be an approximate range). Optionally, the method for selecting the target frequency group can be: selecting a frequency group from multiple preset frequency groups that differs significantly from the noise frequency of the current ambient noise as the target frequency group, thereby increasing the difference between the target frequency and the noise frequency of the current ambient noise, and thus improving the audio recognition rate.

[0043] Step S206: Generate an audio signal corresponding to each character to be transmitted according to the target frequency corresponding to each character to be transmitted in the character sequence to be transmitted in the target frequency group.

[0044] Since each character in the sequence to be transmitted is a preset character in a preset character group, and there is a corresponding target frequency in the target frequency group, in order to transmit each character to be transmitted via an audio signal, the target frequency corresponding to each character to be transmitted in the target frequency group can be determined first.

[0045] An audio signal corresponding to each character to be transmitted can be generated according to the target frequency. Here, the audio signal corresponding to each character can be sine wave data, and the volume of the audio signal can be determined based on the current ambient noise, for example, by determining the volume of each character based on the current ambient noise according to a preset signal-to-noise ratio. The audio duration of the audio signal corresponding to each character can be preset; the audio duration of different characters to be transmitted can be the same or different.

[0046] Since there may be multiple different characters to be transmitted in the group of characters to be transmitted, the target frequencies corresponding to different characters can be different. When there are multiple characters to be transmitted, the generated audio signal can contain multiple sine wave data of different frequencies.

[0047] In step S208, the audio signal corresponding to each character to be transmitted is played sequentially through the audio playback component to transmit the first distribution network information to the device to be distributed.

[0048] In this embodiment, when the group of characters to be transmitted contains multiple characters to be transmitted, the audio playback component can sequentially play the audio signal corresponding to each character to be transmitted to transmit the text to the receiving end. Here, after generating the audio signals corresponding to all characters to be transmitted, a complete audio signal can be synthesized and played; alternatively, the generated audio signal can be played directly after generating the audio signal corresponding to each character to be transmitted. Optionally, an intervening audio signal can be inserted between the audio signals corresponding to two adjacent characters to be transmitted to distinguish the audio signals corresponding to different characters to be transmitted.

[0049] Through steps S202 to S208, first network distribution information to be transmitted to the device to be networked is obtained. The device to be networked is the device to which network distribution is performed, and the first network distribution information is a sequence of characters to be transmitted. Each character in the sequence is a preset character from a preset character group. Based on the noise frequency of the current ambient noise, a target frequency group is selected from multiple preset frequency groups corresponding to the preset character group. The frequency bands corresponding to different preset frequency groups within the multiple preset frequency groups do not overlap, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group. An audio signal corresponding to each character to be transmitted is generated according to the target frequency in the target frequency group corresponding to the target frequency of each character in the sequence. The audio signal corresponding to each character to be transmitted is played sequentially through an audio playback component to transmit the first network distribution information to the device to be networked. This solves the problem of low audio recognition rate due to weak noise resistance in related audio-based network distribution methods, thus improving the audio recognition rate.

[0050] In one exemplary embodiment, obtaining first distribution network information to be transmitted to the device to be distributed includes:

[0051] S11, in response to the input operation of the detected distribution network information, obtain the initial distribution network information input by the input operation;

[0052] S12, information encoding is performed on the initial distribution network information to obtain the first distribution network information, wherein one character in the initial distribution network information is encoded into at least two characters to be transmitted in the character sequence to be transmitted.

[0053] In this embodiment, the first distribution network information to be transmitted to the target distribution network device is obtained by encoding the input initial distribution network information. In response to the input operation of the detected distribution network information, the target device can obtain the initial distribution network information input by the input operation, such as the SSID and password; by encoding the initial distribution network information, the first distribution network information can be obtained. Here, one character in the initial distribution network information is encoded into at least two characters in the character sequence to be transmitted. For example, one character can be encoded into a two-digit hexadecimal ASCII code.

[0054] The above information encoding method not only improves the security of information transmission, but also reduces the need for the number of preset characters in the preset character group by using multiple characters to identify one character in the configuration information, and reduces the frequency band corresponding to the preset frequency group, thereby reducing the demand for bandwidth resources.

[0055] In this embodiment, by encoding the distribution network information, the frequency bands corresponding to the preset frequency group can be reduced, thereby reducing the demand for bandwidth resources.

[0056] In one exemplary embodiment, before selecting a target frequency group from a plurality of preset frequency groups corresponding to a preset character group based on the noise frequency of the current ambient noise, the method further includes:

[0057] S21, send the current ambient noise to the server, wherein the current ambient noise is obtained by recording the ambient noise through the recording component;

[0058] S22, receive noise frequency indication information returned by the server in response to the received current ambient noise, wherein the noise frequency indication information is used to indicate the noise frequency of the current ambient noise.

[0059] The noise frequency of the current ambient noise can be detected locally on the target device; that is, the target device identifies the noise frequency of the current ambient noise. To reduce the hardware and software requirements of the target device, the noise frequency identification can be performed by a server. For example, the server can analyze the collected ambient noise spectrogram to determine the noise frequency. Here, the noise spectrogram can be a spectrum graph with frequency and time as coordinates obtained by processing the time-domain signal of the noise.

[0060] In this embodiment, when text information needs to be transmitted, the acquired current ambient noise can be sent to the server. Here, the current ambient noise can be obtained by recording ambient noise through a recording component (e.g., a microphone, microphone array, or other sound pickup component). Considering that small current and voltage fluctuations generated inside electronic devices can easily cause electrical noise, the ambient noise can include noise in the environment in which the device is located and electrical noise.

[0061] The server can identify and analyze the received ambient noise, generate a noise spectrogram, and determine the range of noise frequencies based on the spectrogram. Simultaneously, based on the determined noise frequencies, the server can generate noise frequency indication information. Correspondingly, the target device can receive the noise frequency indication information returned by the server in response to the received ambient noise. Here, the noise frequency indication information can be used to indicate the noise frequency of the current ambient noise.

[0062] This embodiment improves the accuracy of noise frequency identification and reduces the hardware and software requirements of the target device by determining the noise frequency of the current environment through the server.

[0063] In one exemplary embodiment, selecting a target frequency group from multiple preset frequency groups corresponding to a preset character group based on the noise frequency of the current ambient noise includes:

[0064] S31, determine the preset frequency group that does not overlap with the noise frequency of the current ambient noise among multiple preset frequency groups;

[0065] S32, if there is a preset frequency group among multiple preset frequency groups that does not intersect with the noise frequency of the current ambient noise, then a preset frequency group is determined as the target frequency group.

[0066] S33, if there are at least two preset frequency groups among multiple preset frequency groups that do not intersect with the noise frequency of the current ambient noise, the preset frequency group with the smallest corresponding frequency band among the at least two preset frequency groups shall be determined as the target frequency group.

[0067] When selecting the target frequency group, it is considered that the device to be distributed will simultaneously receive the audio signal played by the target device and the ambient noise. The effective audio signal and noise data are mixed together and difficult to distinguish. In order to improve the anti-interference capability of the audio signal against noise, in this embodiment, the target frequency group can be obtained by selecting the corresponding frequency band that does not intersect with the noise frequency of the current ambient noise from multiple preset frequency groups.

[0068] If there is a preset frequency group among multiple preset frequency groups that does not intersect with the noise frequency of the current ambient noise, this preset frequency group can be directly determined as the target frequency group. If there are at least two preset frequency groups among multiple preset frequency groups that do not intersect with the noise frequency of the current ambient noise, considering that low-frequency signals have a better frequency response for microphones and speakers, in order to maximize the device's ability to process audio signals, the preset frequency group with the smallest corresponding frequency band among the at least two preset frequency groups can be determined as the target frequency group.

[0069] In this embodiment, by selecting the frequency group with the smallest frequency band as the target frequency group, the frequency response of the microphone and speaker to audio signals can be improved, thereby improving the efficiency of audio signal transmission.

[0070] In one exemplary embodiment, before sequentially playing the audio signal corresponding to each character to be transmitted via the audio playback component, the method further includes:

[0071] S41, play a preset duration of initial audio signal at the starting frequency, wherein the initial audio signal is used to indicate that the audio signal following the initial audio signal is a valid audio signal.

[0072] To avoid the situation where the device to be configured on the network fails to receive and recognize the audio signal in a timely manner, resulting in the omission of audio signal, in this embodiment, the audio signal played by the target device can simultaneously include the initial audio segment and the audio signal corresponding to each character to be transmitted.

[0073] The aforementioned starting audio segment can be a specific frequency signal, that is, a signal pulse with a fixed frequency maintained for a certain period of time, which can be used to indicate that the audio signal following the starting audio segment is a valid audio signal. Before the audio signal corresponding to each character to be transmitted is played sequentially by the audio playback component, the starting audio segment of a preset duration can be played at the starting frequency. The preset duration here can be a pre-set duration, for example, 1000ms.

[0074] Optionally, the frequency of the starting audio segment can correspond to the current ambient noise. If the frequency of the current ambient noise is high, a high frequency can be selected as the frequency of the starting audio segment.

[0075] In this embodiment, by playing a starting audio segment to indicate that the audio signal following the starting audio segment is a valid audio signal, the sensitivity of the device to be configured on the network to the valid audio signal can be improved, and situations such as incomplete audio signal reception can be avoided.

[0076] In one exemplary embodiment, during the process of sequentially playing the audio signal corresponding to each character to be transmitted via the audio playback component, the above method further includes:

[0077] S51, after the audio signal corresponding to one of the characters to be transmitted in the character group is played by the audio playback component, the interval audio signal is played according to the target interval frequency. The target interval frequency is the interval frequency that does not overlap with the frequency band corresponding to the target frequency group among a plurality of preset interval frequencies. The target interval frequency is positively correlated with the noise frequency of the current ambient noise.

[0078] Considering that continuous audio signal carriers have very limited ability to identify and process signal distortion and noise abrupt changes, in this embodiment, frequency separation can be performed on the audio signal corresponding to each character to be transmitted, using either high-frequency separation or low-frequency separation, based on the noise frequency of the current ambient noise.

[0079] After the audio signal corresponding to each character in the character group to be transmitted is played by the audio playback component, interval audio signals can be played at target interval frequencies. Here, the target interval frequency can be an interval frequency that does not overlap with the frequency band corresponding to the target frequency group from among a plurality of preset interval frequencies. The target interval frequency can be positively correlated with the noise frequency of the current ambient noise.

[0080] For example, after acquiring the current ambient noise, noise frequency learning is completed by detecting the noise signal waveform. When the noise frequency is high (greater than 2kHz), a high-frequency interval method can be used, where the signal interval is high-frequency and high-volume, which has a good denoising effect on high-frequency noise. The low-frequency interval method is basically the same as the high-frequency interval method, where the signal interval is low-frequency and low-volume, which has a good denoising effect on low-frequency noise.

[0081] Optionally, the target interval frequency can be selected from a set of interval frequencies based on the noise frequency of the current ambient noise, and the interval frequency with the smallest frequency difference from the noise frequency of the current ambient noise. For example, a corresponding high-frequency or low-frequency frequency can be selected based on the noise frequency of the current ambient noise, and the noise recognition rate can be improved by using a fixed time-domain signal interval. The playback time of the interval audio signal played according to the target interval frequency can be a preset fixed interval time.

[0082] In this embodiment, by dividing the audio corresponding to the character to be transmitted into corresponding frequencies according to the noise frequency of the current ambient noise, the impact of noise on the transmitted audio carrier can be reduced, thereby improving the recognition rate of audio by the network device.

[0083] In one exemplary embodiment, after the audio signal corresponding to each character to be transmitted is played sequentially by the audio playback component, the method further includes:

[0084] S61, the audio signal corresponding to each of the at least one first verification character in the at least one first verification character is played sequentially by the audio playback component, wherein the at least one first verification character is a preset character generated according to the character group to be transmitted and used to verify the character group to be transmitted, and the audio signal corresponding to each first verification character is an audio signal generated according to the target frequency corresponding to each first verification character in the target frequency group.

[0085] Considering that data packet errors may occur during audio signal transmission, leading to a low audio signal recognition rate, forward error correction (FEC) processing can be added to the audio signal to be transmitted in order to improve the accuracy of audio signal transmission. This allows the network device to rebuild the data even if data packet errors occur during audio signal transmission, thereby improving the accuracy of data transmission.

[0086] Here, forward error correction (FEC) codes and channel coding are techniques used to control the bit error rate (packet loss, garbled characters) of received data packets when transmitting data in channels with low reliability and strong noise interference. FEC technology incorporates concatenated channel coding and gain coding techniques, offering the advantage of automatically correcting bit errors during data transmission. The software implementation principle can be described as follows: Figure 4 As shown.

[0087] In the development of wavelength division multiplexing (WDM) technology, Field Error Correction (FEC) technology, as a key to achieving reliable information transmission, has become the mainstream technology for data anti-interference in wireless communication. FEC technology utilizes data to transmit redundant information, allowing the receiver to reconstruct the data when errors occur in the data packet during transmission. As an error control method, it refers to the technology of pre-encoding signals according to a certain algorithm before they are sent into the transmission channel, adding redundant codes with the characteristics of the signal itself. At the receiving end (e.g., the equipment to be distributed), the received signal is decoded according to the corresponding algorithm to identify and correct the error codes generated during transmission.

[0088] In this embodiment, the audio signal corresponding to each of the at least one check character can be played sequentially by the audio playback component. Here, the at least one check character can be a preset character generated based on the character group to be transmitted and used to check the character group to be transmitted. The audio signal corresponding to each check character can be an audio signal generated according to the target frequency corresponding to each check character in the target frequency group.

[0089] In this embodiment, by generating a verification character for a preset signal in the character group to be transmitted for verification, and playing it together with the audio signal corresponding to the character to be transmitted, the accuracy of audio signal transmission can be improved.

[0090] In one exemplary embodiment, after the audio signal corresponding to each character to be transmitted is played sequentially by the audio playback component, the method further includes:

[0091] S71, the audio signal corresponding to each of the at least one first verification character in the at least one first verification character is played sequentially by the audio playback component, wherein the at least one first verification character is a preset character generated according to the character group to be transmitted and used to verify the character group to be transmitted, and the audio signal corresponding to each first verification character is an audio signal generated according to the target frequency corresponding to each first verification character in the target frequency group.

[0092] In one exemplary embodiment, after the audio signal corresponding to each character to be transmitted is played sequentially by the audio playback component, the method further includes:

[0093] S81, the audio signal to be parsed is segmented according to a preset duration to obtain a set of audio signal segments to be parsed, wherein the audio signal to be parsed is the audio signal collected by the audio acquisition component of the network device and corresponds to each character to be transmitted;

[0094] S82, perform time-frequency domain transformation on each audio signal segment in a set of audio signal segments to obtain the spectrum data corresponding to each audio signal segment, and determine the matching frequency of each audio signal segment based on the spectrum data corresponding to each audio signal segment to obtain the matching frequency sequence, wherein the matching frequency of each audio signal segment is the frequency with the largest amplitude-frequency characteristic in the spectrum data corresponding to each audio signal segment.

[0095] S83, based on the matching relationship between the matching frequency in the matching frequency sequence and the target frequency in the target frequency group, and the correspondence between the target frequency in the target frequency group and the preset character in the preset character group, the matching frequency sequence is parsed into a target character sequence to obtain the second distribution network information, wherein each target character in the target character sequence is a preset character in the preset character group.

[0096] In one exemplary embodiment, after parsing the matching frequency sequence into a target character sequence to obtain the second distribution network information, the above method further includes:

[0097] S91, use the second distribution network information to perform equipment distribution on the equipment to be distributed, and obtain the distribution result of the equipment to be distributed;

[0098] S92, when the network distribution result of the device to be distributed is used to indicate that the device to be distributed has successfully distributed, a network distribution confirmation message is sent to the target device, wherein the target device is the device that transmits the second network distribution information to the device to be distributed, and the network distribution confirmation message is used to indicate that the device to be distributed has successfully distributed.

[0099] In an exemplary embodiment, before segmenting the audio signal to be parsed according to a preset duration to obtain a set of audio signal segments to be parsed, the above method further includes:

[0100] S101, when a starting segment audio signal is identified in the audio signal acquired by the audio acquisition unit, the audio signal located after the starting segment audio signal in the audio signal acquired by the audio acquisition unit is determined as the audio signal to be parsed, wherein the starting segment audio signal is used to indicate that the audio signal after the starting segment audio signal is a valid audio signal.

[0101] In an exemplary embodiment, before segmenting the audio signal to be parsed according to a preset duration to obtain a set of audio signal segments to be parsed, the above method further includes at least one of the following:

[0102] S111, perform noise attenuation processing on the audio signal to be analyzed to obtain the audio signal to be analyzed after noise attenuation;

[0103] S112, based on the centroid frequency and root mean square frequency of the audio signal to be analyzed, a target frequency group is determined from multiple preset frequency groups. The target frequency group is a preset frequency group whose corresponding frequency band matches the centroid frequency and root mean square frequency among the multiple preset frequency groups. The filter parameters of the preset bandpass filter are configured according to the target frequency in the target frequency group to obtain the target bandpass filter. The target bandpass filter is used to perform bandpass filtering on the spectrum data of the audio signal to be analyzed to obtain the filtered audio signal to be analyzed.

[0104] In an exemplary embodiment, the audio signal to be parsed is spaced apart from the audio signal corresponding to the adjacent preset character by an interval audio signal corresponding to the target interval frequency, and the target interval frequency and the frequency segment corresponding to the target frequency group do not intersect.

[0105] Based on the matching relationship between the matching frequency in the matching frequency sequence and the target frequency in the target frequency group, and the correspondence between the target frequency in the target frequency group and the preset character in the preset character group, the matching frequency sequence is parsed into a target character sequence to obtain the second distribution network information, including:

[0106] S121, when the target interval frequency is less than the frequency band corresponding to the target frequency group, the step frequencies in the matching frequency sequence are determined sequentially to obtain the step frequency sequence. The step frequency is the matching frequency in the matching frequency sequence that is greater than the previous matching frequency and whose frequency difference with the previous matching frequency is greater than or equal to the first frequency difference threshold. Each step frequency in the step frequency sequence is parsed into a preset character corresponding to the target frequency that matches each step frequency to obtain the target character sequence. The target frequency that matches each step frequency is the target frequency in the target frequency group that has the smallest frequency difference with each step frequency.

[0107] S122, when the target interval frequency is greater than the frequency band corresponding to the target frequency group, the reduced frequency in the matching frequency sequence is determined sequentially to obtain the reduced frequency sequence. The reduced frequency is the matching frequency in the matching frequency sequence that is less than the previous matching frequency and whose frequency difference with the previous matching frequency is greater than or equal to the second frequency difference threshold. Each reduced frequency in the reduced frequency sequence is parsed into a preset character corresponding to the target frequency that matches each reduced frequency to obtain the target character sequence. The target frequency that matches each reduced frequency is the target frequency in the target frequency group with the smallest frequency difference from each reduced frequency.

[0108] In one exemplary embodiment, a time-frequency domain transformation is performed on each audio signal segment in a set of audio signal segments to obtain spectral data corresponding to each audio signal segment, including:

[0109] S131, Perform the following transformation operation on each audio signal segment as the current audio signal to obtain the spectrum data corresponding to each audio signal segment:

[0110] The current audio signal is sampled according to a preset sampling frequency to obtain N sampling points corresponding to the current audio signal, where N is a positive integer greater than or equal to 2;

[0111] Based on each of the N sampling points, generate a cosine basis signal corresponding to each sampling point to obtain N cosine basis signals, and calculate the similarity between the current audio signal and the N cosine basis signals in turn to obtain N cosine similarity values.

[0112] Based on each of the N sampling points, a sinusoidal base signal corresponding to each sampling point is generated to obtain N sinusoidal base signals. Then, the similarity between the current audio signal and the N sinusoidal base signals is calculated in turn to obtain N sinusoidal similarity values.

[0113] The discrete Fourier transform of the current audio signal is performed based on N cosine similarity values ​​and N sine similarity values ​​to obtain the spectrum data corresponding to the current audio signal.

[0114] In one exemplary embodiment, after determining the matching frequency of each audio signal segment based on the spectral data corresponding to each audio signal segment to obtain a matching frequency sequence, the above method further includes:

[0115] S141, the matching frequency sequence is windowed using a preset window function to obtain an updated matching frequency sequence. The preset window function is a window function whose duration is an integer multiple of the preset signal duration of the audio signal corresponding to a preset character and whose pulse width is the preset signal duration.

[0116] In one exemplary embodiment, the above method further includes:

[0117] S151, the target character sequence is verified using at least one second check character to obtain the verified target character sequence, wherein the at least one second check character is a preset character parsed from the verification audio signal after the audio signal to be parsed, and the at least one second check character is used to verify the target character sequence.

[0118] The following explanation, using optional examples, illustrates the audio-based device network configuration method in this embodiment. This optional example provides a voiceprint carrier encrypted text lossless transmission management scheme. By combining the voiceprint network configuration system with an IoT cloud platform, device electrical characteristics, and device processing capabilities, different voiceprint network configuration protocols and algorithms are employed. Furthermore, different voiceprint network configuration algorithms and frequencies are matched to the CPU processing capabilities and electrical performance of different devices. Utilizing IoT cloud platform cloud computing and cloud storage, combined with a mobile APP and devices, the voiceprint network configuration function is implemented more accurately and effectively. Compared to simple voiceprint recognition, by relying on an IoT cloud platform, voiceprint recognition + voiceprint encryption + embedded device electrical performance, a powerful data support system is formed, providing more comprehensive technical support for voiceprint network configuration.

[0119] In this optional example, by combining the cloud computing capabilities and cloud storage technology of the IoT cloud platform, an adaptive carrier system is provided for different noise scenarios. Based on the different environmental noise, algorithms such as arbitration frequency decision, high-frequency separation method, and low-frequency separation method are added to optimize the processing, which greatly improves the accuracy of the algorithm. At the same time, forward error correction and subsequent correction algorithms are added, so that the accuracy of audio carrier data reaches a high level.

[0120] like Figure 5 As shown, a voiceprint-based network distribution system can include an IoT platform layer, a home app application center, and smart devices, among which...

[0121] An IoT platform may include: a whole-house smart management system for managing smart devices throughout the house; a noise learning module for learning environmental noise; device authentication for authenticating connected smart devices; an IoT platform for cloud computing and cloud storage; state machine management for managing the transmission state machine; and persistence technology for maintaining persistent data transmission.

[0122] Here, through the front-end smart home APP and smart device hardware, the persistent big data cloud platform and artificial intelligence (AI) technology are used to learn the front-end noise environment, intelligently select audio carrier mode and frequency band, and effectively avoid environmental noise problems such as co-channel interference.

[0123] The home application center can include: login authentication for authenticating users when logging into the application; a voiceprint encoder for encoding voiceprint data; encryption key management for managing encryption keys used in transmission; forward error correction management for performing forward error correction on data to obtain the corresponding verification code; audio playback management for managing the playback of transmitted audio; an audio acquisition module for acquiring transmitted audio data; a voiceprint decoder for decoding voiceprint data; a window function for windowing transmitted data; a noise reduction and anti-interference algorithm module for reducing noise and enhancing anti-interference capabilities of transmitted data; noise self-learning management for managing noise self-learning; carrier management for managing the generation of carriers; and a filter module for filtering and reducing noise in transmitted data.

[0124] Smart devices such as home IPs, cameras, Wi-Fi doorbells, and monitors can include: login authentication for user login to the application; a voiceprint encoder for encoding voiceprint data; encryption key management for managing encryption keys used in transmission; forward error correction management for performing forward error correction on data to obtain the corresponding verification code; audio playback management for managing the playback of transmitted audio; an audio acquisition module for acquiring transmitted audio data; a voiceprint decoder for decoding voiceprint data; a window function for windowing transmitted data; and a noise reduction and anti-interference algorithm module for reducing noise and enhancing anti-interference capabilities of transmitted data.

[0125] Here, the voiceprint distribution system in this optional example utilizes a mobile app + microphone + cloud computing to avoid co-channel interference based on the device's microphone characteristics and computing power. Simultaneously, due to the use of time-frequency window functions, high-frequency separation, and low-frequency separation methods for the audio data carrier, data transmission accuracy is significantly increased. Relying on an optimized forward error correction algorithm, data can be sent to the device almost without loss to complete the voiceprint distribution process. The final data verification process relies on a big data IoT cloud platform, the mobile app, and device security authentication information, enabling fully intelligent and seamless data correction for the user. This completes the entire distribution process.

[0126] Compared to other voiceprint systems, this system does not rely on a "quiet" environment provided by the user and can still function perfectly even with better sound and lower ambient noise. Especially in noisy scenarios where music noise, Brownian noise, pink noise, and white noise are intertwined, significantly impacting data, the voiceprint system in this optional example can effectively provide sufficient means to ensure the accuracy of data transmission and solve the problem of weak anti-interference capability of audio data carriers, especially weak anti-interference capability at the same frequency.

[0127] like Figure 6 As shown, the audio-based device configuration method in this optional example may include the following steps:

[0128] S601, the WIFI device begins voiceprint network configuration;

[0129] S602, users enter the SSID and password in the mobile application;

[0130] S603, record ambient noise on mobile device;

[0131] S604: The mobile device sends the recorded environmental noise to the IoT platform and AI platform.

[0132] S605, AI platform for calculating ambient noise frequency;

[0133] S606 controls the playback frequency band selection on the mobile device via the IoT platform;

[0134] S607, the mobile device encrypts information;

[0135] S608, the mobile device performs forward error correction encryption on the information;

[0136] S609, audio carrier generated on the mobile device;

[0137] S610, mobile devices use high-frequency / low-frequency separation filling;

[0138] S611: The mobile phone transmits information to the WIFI device by playing an audio carrier wave through the speaker.

[0139] S612, WIFI devices use a microphone to receive audio carriers;

[0140] S613, the WIFI device reduces noise in the received information based on the signal-to-noise ratio;

[0141] S614, the WIFI device uses an FIR bandpass filter to reduce noise in the received information;

[0142] S615, the WIFI device performs a short-time Fourier transform on the received information;

[0143] S616, the WIFI device performs high-frequency / low-frequency decoding on the received information;

[0144] S617, the WIFI device performs windowing operation on the received information;

[0145] S618, the WIFI device performs forward error correction decoding on the received information;

[0146] S619, the WIFI device decrypts the received information;

[0147] S620, WIFI devices transmit carrier data in plaintext;

[0148] S621, WIFI devices connect to the WIFI router;

[0149] S622, the router transmits an ACK to the WIFI device;

[0150] S623, WIFI devices complete login / registration based on IoT platform and AI platform;

[0151] S624, completes voiceprint network configuration.

[0152] Taking voiceprint network configuration via mobile terminals as an example, such as Figure 7 As shown, Android and iOS phones can interact with the microphones of monitors, cameras, and Wi-Fi doorbells via speakers to achieve voiceprint network configuration. Monitors, cameras, and Wi-Fi doorbells can establish connections through a Wi-Fi router, obtaining device registration information based on the IoT platform. On the other hand, Android and iOS phones can obtain device voiceprint encoding data information through the network and the IoT platform. For example... Figure 7 As can be seen, even if the mobile phone and the device are not on the same data network, voiceprint network configuration can still be completed quickly.

[0153] Taking the interaction between mobile phones and devices in a voiceprint-based network configuration system as an example, see... Figure 8For the mobile phone transmitter, the ASCII code can be converted into an audio signal to generate an audio data stream, which can then be played through the speaker. For the receiving device, the audio data played by the mobile phone transmitter can be collected through the microphone, and then PCM sampling, combined with audio noise reduction, noise thresholding, and noise filtering, can be used to decode the audio data into an ASCII string. After protocol parsing, the data can be connected to a Wi-Fi router to achieve voiceprint network configuration.

[0154] This optional example, combining audio carrier data arbitration, high-frequency separation, low-frequency separation, window functions, audio noise reduction filtering for audio carriers, forward error correction and backward correction, security and verification, login and confirmation, and other system methods, provides a complete closed-loop voiceprint carrier encrypted text lossless transmission management system, offering customers a superior user experience. The voiceprint distribution network system relies on IoT cloud platform cloud computing and cloud storage, utilizing a mobile app to achieve scene noise self-learning. It determines the voiceprint carrier mode based on the scene rather than a fixed voiceprint carrier mode and algorithm, effectively avoiding data errors caused by co-channel interference and greatly improving transmission accuracy. The time-frequency window function, noise reduction algorithm, and high-frequency and low-frequency interval audio carrier methods, combined with encryption and forward error correction algorithms, not only significantly improve accuracy but also prevent hacker eavesdropping and tampering.

[0155] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0156] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM (Read-Only Memory) / RAM (Random Access Memory), magnetic disk, optical disk), and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.

[0157] According to another aspect of the embodiments of this application, an audio-based device network configuration system for implementing the above-described audio-based device network configuration method is also provided. This audio-based device network configuration system can be applied to smart devices and may include:

[0158] The target device is used to acquire first network distribution information to be transmitted to the device to be networked, wherein the device to be networked is the device to which network distribution is to be performed, the first network distribution information is a sequence of characters to be transmitted, and each character to be transmitted in the sequence of characters to be transmitted is a preset character in a preset character group; based on the noise frequency of the current ambient noise, a target frequency group is selected from multiple preset frequency groups corresponding to the preset character group, wherein the frequency bands corresponding to different preset frequency groups in the multiple preset frequency groups do not overlap, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group of the multiple preset frequency groups; an audio signal corresponding to each character to be transmitted is generated according to the target frequency in the target frequency group corresponding to each character to be transmitted in the sequence of characters to be transmitted; and the audio signal corresponding to each character to be transmitted is played sequentially through an audio playback component to transmit the first network distribution information to the device to be networked.

[0159] The device to be configured for network distribution is used to segment the audio signal to be parsed according to a preset duration to obtain a set of audio signal segments to be parsed. The audio signal to be parsed is the audio signal acquired by the audio acquisition component of the device to be configured for each character to be transmitted. The device performs time-frequency domain transformation on each audio signal segment to obtain the spectrum data corresponding to each audio signal segment. Based on the spectrum data corresponding to each audio signal segment, the matching frequency of each audio signal segment is determined to obtain a matching frequency sequence. The matching frequency of each audio signal segment is the frequency with the largest amplitude-frequency characteristic in the spectrum data corresponding to each audio signal segment. Based on the matching relationship between the matching frequency in the matching frequency sequence and the target frequency in the target frequency group, and the correspondence between the target frequency in the target frequency group and the preset character in the preset character group, the matching frequency sequence is parsed into a target character sequence to obtain the second network distribution information. Each target character in the target character sequence is a preset character in the preset character group.

[0160] The above-described audio-based device network configuration system acquires first network configuration information to be transmitted to the device to be configured. The device to be configured is the device undergoing network configuration, and the first network configuration information is a sequence of characters to be transmitted. Each character in the sequence is a preset character from a preset character group. Based on the noise frequency of the current ambient noise, a target frequency group is selected from multiple preset frequency groups corresponding to the preset character group. The frequency bands corresponding to different preset frequency groups within the multiple preset frequency groups do not overlap, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group. An audio signal corresponding to each character to be transmitted is generated according to the target frequency in the target frequency group corresponding to the target frequency of each character in the sequence. The audio signal corresponding to each character to be transmitted is played sequentially through an audio playback component to transmit the first network configuration information to the device to be configured. This solves the problem of low audio recognition rate due to weak noise interference resistance in related audio-based device network configuration methods, thus improving the audio recognition rate.

[0161] In one exemplary embodiment, the target device is further configured to, in response to an input operation of detected distribution network information, acquire initial distribution network information input by the input operation; encode the initial distribution network information to obtain first distribution network information, wherein one character in the initial distribution network information is encoded into at least two characters to be transmitted in a character sequence to be transmitted.

[0162] In one exemplary embodiment, the target device is further configured to send the current ambient noise to a server before selecting a target frequency group from a plurality of preset frequency groups corresponding to a preset character group based on the noise frequency of the current ambient noise, wherein the current ambient noise is obtained by recording the ambient noise through a recording component; and to receive noise frequency indication information returned by the server in response to the received current ambient noise, wherein the noise frequency indication information is used to indicate the noise frequency of the current ambient noise.

[0163] In one exemplary embodiment, the target device is further configured to determine a preset frequency group among a plurality of preset frequency groups that does not intersect with the noise frequency of the current ambient noise; if there is a preset frequency group among the plurality of preset frequency groups that does not intersect with the noise frequency of the current ambient noise, the preset frequency group with the smallest corresponding frequency band among the at least two preset frequency groups is determined as the target frequency group.

[0164] In one exemplary embodiment, the target device is further configured to play a starting segment audio signal of a preset duration at a starting frequency before sequentially playing audio signals corresponding to each character to be transmitted via the audio playback component, wherein the starting segment audio signal is used to indicate that the audio signals following the starting segment audio signal are valid audio signals; the device to be configured to, when the starting segment audio signal is identified in the audio signals acquired by the audio acquisition component, determine the audio signals located after the starting segment audio signal in the audio signals acquired by the audio acquisition component as audio signals to be parsed, wherein the starting segment audio signal is used to indicate that the audio signals following the starting segment audio signal are valid audio signals.

[0165] In an exemplary embodiment, the target device is further configured to, during the process of sequentially playing audio signals corresponding to each character to be transmitted via an audio playback component, after each audio signal corresponding to one character to be transmitted in the character group is played via the audio playback component, play interval audio signals at a target interval frequency, wherein the target interval frequency is an interval frequency among a plurality of preset interval frequencies that does not intersect with the frequency band corresponding to the target frequency group, and the target interval frequency is positively correlated with the noise frequency of the current ambient noise; the device to be configured is further configured to, when the target interval frequency is less than the frequency band corresponding to the target frequency group, sequentially determine the step frequency in the matching frequency sequence to obtain a step frequency sequence, wherein the step frequency is a matching frequency in the matching frequency sequence that is greater than the previous matching frequency and whose frequency difference with the previous matching frequency is greater than or equal to a first frequency difference threshold; and to set the step frequency to a specific frequency. Each step frequency in the frequency sequence is parsed into a preset character corresponding to the target frequency that matches each step frequency, resulting in a target character sequence. The target frequency matching each step frequency is the target frequency in the target frequency group with the smallest frequency difference from each step frequency. When the target interval frequency is greater than the frequency band corresponding to the target frequency group, the reduced-order frequencies in the matching frequency sequence are determined sequentially, resulting in a reduced-order frequency sequence. The reduced-order frequency is the matching frequency in the matching frequency sequence that is less than the previous matching frequency and whose frequency difference with the previous matching frequency is greater than or equal to a second frequency difference threshold. Each reduced-order frequency in the reduced-order frequency sequence is parsed into a preset character corresponding to the target frequency that matches each reduced-order frequency, resulting in a target character sequence. The target frequency matching each reduced-order frequency is the target frequency in the target frequency group with the smallest frequency difference from each reduced-order frequency.

[0166] In one exemplary embodiment, the target device is further configured to, after sequentially playing an audio signal corresponding to each character to be transmitted via an audio playback component, sequentially play an audio signal corresponding to each of the at least one first verification characters via an audio playback component, wherein the at least one first verification character is a preset character generated based on the character group to be transmitted and used to verify the character group to be transmitted, and the audio signal corresponding to each first verification character is an audio signal generated according to the target frequency corresponding to each first verification character in the target frequency group; the network distribution device is further configured to use at least one second verification character to verify the target character sequence to obtain a verified target character sequence, wherein the at least one second verification character is a preset character parsed from the verification audio signal after the audio signal to be parsed, and the at least one second verification character is used to verify the target character sequence.

[0167] In one exemplary embodiment, the device to be configured is further configured to, after parsing the matching frequency sequence into a target character sequence to obtain the second network configuration information, use the second network configuration information to configure the device to be configured, and obtain the network configuration result of the device to be configured; if the network configuration result of the device to be configured is used to indicate that the device to be configured has been configured successfully, send a network configuration confirmation message to the target device, wherein the network configuration confirmation message is used to indicate that the device to be configured has been configured successfully.

[0168] In an exemplary embodiment, the device to be configured is further configured to perform noise attenuation processing on the audio signal to be analyzed before segmenting the audio signal to be analyzed according to a preset duration to obtain a set of audio signal segments to be analyzed, so as to obtain the audio signal to be analyzed after noise attenuation.

[0169] In an exemplary embodiment, the device to be configured is further configured to, before segmenting the audio signal to be analyzed according to a preset duration to obtain a set of audio signal segments to be analyzed, determine a target frequency group from a plurality of preset frequency groups based on the centroid frequency and root mean square frequency of the audio signal to be analyzed, wherein the target frequency group is a preset frequency group in which the corresponding frequency segment matches the centroid frequency and root mean square frequency among the plurality of preset frequency groups; configure the filter parameters of a preset bandpass filter according to the target frequency in the target frequency group to obtain a target bandpass filter; and use the target bandpass filter to perform bandpass filtering processing on the spectrum data of the audio signal to be analyzed to obtain the filtered audio signal to be analyzed.

[0170] In an exemplary embodiment, the device to be distributed is further configured to perform the following transformation operation on each audio signal segment as the current audio signal to obtain the spectrum data corresponding to each audio signal segment: sampling the current audio signal according to a preset sampling frequency to obtain N sampling points corresponding to the current audio signal, where N is a positive integer greater than or equal to 2; generating a cosine basis signal corresponding to each sampling point based on each of the N sampling points to obtain N cosine basis signals, and sequentially calculating the similarity between the current audio signal and the N cosine basis signals to obtain N cosine similarity values; generating a sine basis signal corresponding to each sampling point based on each of the N sampling points to obtain N sine basis signals, and sequentially calculating the similarity between the current audio signal and the N sine basis signals to obtain N sine similarity values; performing a discrete Fourier transform on the current audio signal based on the N cosine similarity values ​​and the N sine similarity values ​​to obtain the spectrum data corresponding to the current audio signal.

[0171] In an exemplary embodiment, the device to be configured is further configured to, after determining the matching frequency of each audio signal segment based on the spectrum data corresponding to each audio signal segment and obtaining the matching frequency sequence, apply a preset window function to the matching frequency sequence to obtain an updated matching frequency sequence, wherein the preset window function is a window function whose duration is an integer multiple of the preset signal duration of the audio signal corresponding to a preset character and whose pulse width is the preset signal duration.

[0172] It should be noted that the examples and application scenarios implemented by the above modules and corresponding steps are the same, but are not limited to the content disclosed in the above embodiments. It should also be noted that the above modules, as part of a device, can operate in situations such as... Figure 1 The hardware environment shown can be implemented through software or hardware, and the hardware environment includes the network environment.

[0173] According to another aspect of the embodiments of this application, a storage medium is also provided, which can be located on a smart device. Optionally, in this embodiment, the storage medium can be used to execute the program code of any of the audio-based device network configuration methods described above in the embodiments of this application.

[0174] Optionally, in this embodiment, the storage medium may be located on at least one of the network devices in the network shown in the above embodiment.

[0175] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps:

[0176] S1, Obtain the first network configuration information to be transmitted to the device to be configured, wherein the device to be configured is the device to be configured, the first network configuration information is a character sequence to be transmitted, and each character to be transmitted in the character sequence is a preset character in a preset character group;

[0177] S2, based on the noise frequency of the current ambient noise, select a target frequency group from multiple preset frequency groups corresponding to the preset character group. The frequency bands corresponding to different preset frequency groups in the multiple preset frequency groups do not overlap, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group of the multiple preset frequency groups.

[0178] S3, generate an audio signal corresponding to each character to be transmitted according to the target frequency corresponding to each character to be transmitted in the character sequence to be transmitted in the target frequency group;

[0179] S4, the audio signal corresponding to each character to be transmitted is played sequentially through the audio playback component to transmit the first distribution network information to the device to be distributed.

[0180] Optionally, specific examples in this embodiment can refer to the examples described in the above embodiments, and will not be repeated in this embodiment.

[0181] Optionally, in this embodiment, the storage medium may include, but is not limited to, various media capable of storing program code, such as USB flash drives, ROMs, RAMs, portable hard drives, magnetic disks, or optical disks.

[0182] According to another aspect of the embodiments of this application, an electronic device for implementing the above-described audio-based device network configuration method is also provided. The electronic device may be a smart device, a server, a terminal, or a combination thereof.

[0183] Figure 9 This is a structural block diagram of an optional electronic device according to an embodiment of this application, such as... Figure 9 As shown, it includes a processor 902, a communication interface 904, a memory 906, and a communication bus 908. The processor 902, communication interface 904, and memory 906 communicate with each other via the communication bus 908.

[0184] Memory 906 is used to store computer programs;

[0185] When processor 902 executes a computer program stored in memory 906, it performs the following steps:

[0186] S9, Obtain the first network configuration information to be transmitted to the device to be configured, wherein the device to be configured is the device to be configured, the first network configuration information is a character sequence to be transmitted, and each character to be transmitted in the character sequence is a preset character in a preset character group;

[0187] S2, based on the noise frequency of the current ambient noise, select a target frequency group from multiple preset frequency groups corresponding to the preset character group. The frequency bands corresponding to different preset frequency groups in the multiple preset frequency groups do not overlap, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group of the multiple preset frequency groups.

[0188] S3, generate an audio signal corresponding to each character to be transmitted according to the target frequency corresponding to each character to be transmitted in the character sequence to be transmitted in the target frequency group;

[0189] S4, the audio signal corresponding to each character to be transmitted is played sequentially through the audio playback component to transmit the first distribution network information to the device to be distributed.

[0190] Optionally, the communication bus can be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 9 The symbol is represented by a single thick line, but this does not indicate that there is only one bus or one type of bus. The communication interface is used for communication between the aforementioned electronic device and other devices.

[0191] The memory may include RAM, or non-volatile memory, such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.

[0192] The processors mentioned above can be general-purpose processors, including but not limited to: CPU (Central Processing Unit), NP (Network Processor), etc.; they can also be DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0193] Optionally, specific examples in this embodiment can refer to the examples described in the above embodiments, and will not be repeated here.

[0194] Those skilled in the art will understand that Figure 9 The structure shown is for illustrative purposes only. The device implementing the above-described audio-based device network configuration method can be a terminal device, such as a smartphone (e.g., an Android phone, an iOS phone), a tablet computer, a PDA, a mobile Internet device (MID), a PAD, or other terminal devices. Figure 9 This does not limit the structure of the aforementioned electronic device. For example, the electronic device may also include components that are more... Figure 9 The more or fewer components shown (such as network interfaces, display devices, etc.), or having the same Figure 9 The different configurations shown.

[0195] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing the hardware related to the terminal device. The program can be stored in a computer-readable storage medium, which may include: flash drive, ROM, RAM, disk or optical disk, etc.

[0196] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0197] If the integrated units in the above embodiments are implemented as software functional units and sold or used as independent products, they can be stored in the aforementioned computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application.

[0198] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0199] In the several embodiments provided in this application, it should be understood that the disclosed client can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between units or modules, and may be electrical or other forms.

[0200] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the solution provided in this embodiment, depending on actual needs.

[0201] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or at least two units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0202] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. An audio-based device commissioning method, the method comprising: The method comprises: obtaining first network configuration information to be transmitted to a device to be configured, wherein the device to be configured is a device to be configured, the first network configuration information is a to-be-transmitted character sequence, and each to-be-transmitted character in the to-be-transmitted character sequence is a preset character in a preset character group; selecting a target frequency group from a plurality of preset frequency groups corresponding to the preset character group according to a noise frequency of a current environmental noise, wherein different preset frequency groups in the plurality of preset frequency groups correspond to non-overlapping frequency segments, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group of the plurality of preset frequency groups; generating an audio signal corresponding to each to-be-transmitted character in the to-be-transmitted character sequence according to a target frequency corresponding to the to-be-transmitted character in the target frequency group; transmitting the first network configuration information to the device to be configured by sequentially playing the audio signal corresponding to each to-be-transmitted character through an audio playing component; after the step of transmitting the first network configuration information to the device to be configured by sequentially playing the audio signal corresponding to each to-be-transmitted character through the audio playing component, the method further comprises: segmenting a to-be-analyzed audio signal according to a preset time length to obtain a group of to-be-analyzed audio signal segments, wherein the to-be-analyzed audio signal is an audio signal corresponding to each to-be-transmitted character collected by an audio collecting component of the device to be configured; performing time-frequency domain transformation on each audio signal segment in the group of to-be-analyzed audio signal segments to obtain frequency spectrum data corresponding to each audio signal segment, and determining a matching frequency of each audio signal segment according to the frequency spectrum data corresponding to each audio signal segment to obtain a matching frequency sequence, wherein the matching frequency of each audio signal segment is a frequency with the maximum amplitude-frequency characteristic in the frequency spectrum data corresponding to each audio signal segment; based on a matching relationship between the matching frequencies in the matching frequency sequence and the target frequencies in the target frequency group and a corresponding relationship between the target frequencies in the target frequency group and the preset characters in the preset character group, analyzing the matching frequency sequence into a target character sequence to obtain second network configuration information, wherein each target character in the target character sequence is a preset character in the preset character group.

2. The method of claim 1, wherein, The step of obtaining the first network configuration information to be transmitted to the device to be configured comprises: in response to a detected input operation of network configuration information, obtaining initial network configuration information input by the input operation; performing information encoding on the initial network configuration information to obtain the first network configuration information, wherein one character in the initial network configuration information is encoded into at least two to-be-transmitted characters in the to-be-transmitted character sequence.

3. The method of claim 1, wherein, Before the step of selecting a target frequency group from a plurality of preset frequency groups corresponding to the preset character group according to a noise frequency of a current environmental noise, the method further comprises: sending the current environmental noise to a server, wherein the current environmental noise is obtained by recording environmental noise through a recording component; receive noise frequency indication information returned by the server in response to the received current environmental noise, wherein the noise frequency indication information is used to indicate a noise frequency of the current environmental noise.

4. The method of claim 1, wherein, The target frequency group is selected from a plurality of preset frequency groups corresponding to the preset character group according to the noise frequency of the current environmental noise, comprising: determining a preset frequency group in the plurality of preset frequency groups that has no intersection with the noise frequency of the current environmental noise; in the case that there is one preset frequency group in the plurality of preset frequency groups that has no intersection with the noise frequency of the current environmental noise, determining the one preset frequency group as the target frequency group; in the case that there are at least two preset frequency groups in the plurality of preset frequency groups that have no intersection with the noise frequency of the current environmental noise, determining the preset frequency group corresponding to the smallest frequency segment among the at least two preset frequency groups as the target frequency group.

5. The method of claim 1, wherein, Before the audio playback component sequentially plays the audio signal corresponding to each to-be-transmitted character, the method further comprises: playing a starting segment audio signal of a preset time length according to a starting frequency, wherein the starting segment audio signal is used to indicate that the audio signal after the starting segment audio signal is a valid audio signal.

6. The method of claim 1, wherein, During the process of sequentially playing the audio signal corresponding to each to-be-transmitted character by the audio playback component, the method further comprises: after playing the audio signal corresponding to one to-be-transmitted character in the to-be-transmitted character group by the audio playback component, playing an interval audio signal according to a target interval frequency, wherein the target interval frequency is an interval frequency in a plurality of preset interval frequencies that has no intersection with the frequency segment corresponding to the target frequency group, and the target interval frequency is positively correlated with the noise frequency of the current environmental noise.

7. The method according to any one of claims 1 to 6, characterized in that, After sequentially playing the audio signal corresponding to each to-be-transmitted character by the audio playback component, the method further comprises: sequentially playing, by the audio playback component, an audio signal corresponding to each first check character in at least one first check character, wherein the at least one first check character is a preset character generated according to the to-be-transmitted character group and used to check the to-be-transmitted character group, and the audio signal corresponding to each first check character is an audio signal generated according to a target frequency corresponding to each first check character in the target frequency group.

8. The method of claim 7, wherein, After the matching frequency sequence is parsed into a target character sequence to obtain second network configuration information, the method further comprises: using the second network configuration information to perform device network configuration on the to-be-network-configured device to obtain a network configuration result of the to-be-network-configured device; in the case that the network configuration result of the to-be-network-configured device indicates that the to-be-network-configured device is successfully network configured, sending a network configuration confirmation message to a target device, wherein the target device is a device that transmits the second network configuration information to the to-be-network-configured device, and the network configuration confirmation message is used to indicate that the to-be-network-configured device is successfully network configured.

9. The method of claim 7, wherein, Before the segmenting the to-be-resolved audio signal according to the preset time length to obtain a group of to-be-resolved audio signal segments, the method further comprises: In a case where a starting segment audio signal is identified in the audio signal collected by the audio collection component, audio signals in the audio signal collected by the audio collection component, located after the starting segment audio signal, are determined as the to-be-resolved audio signal, wherein the starting segment audio signal is used to indicate that the audio signals after the starting segment audio signal are valid audio signals.

10. The method of claim 7, wherein, Before the segmenting the to-be-resolved audio signal according to the preset time length to obtain a group of to-be-resolved audio signal segments, the method further comprises at least one of the following: performing noise attenuation processing on the to-be-resolved audio signal to obtain the to-be-resolved audio signal after noise attenuation; determining the target frequency group from the plurality of preset frequency groups according to a center of gravity frequency of the to-be-resolved audio signal and a root mean square frequency of the to-be-resolved audio signal, wherein the target frequency group is a preset frequency group in the plurality of preset frequency groups, a corresponding frequency segment of which matches the center of gravity frequency and the root mean square frequency; performing filter parameter configuration on a preset band-pass filter according to a target frequency in the target frequency group to obtain a target band-pass filter; and performing band-pass filtering processing on spectral data of the to-be-resolved audio signal using the target band-pass filter to obtain the to-be-resolved audio signal after filtering.

11. The method of claim 7, wherein, The to-be-resolved audio signal has interval audio signals corresponding to a target interval frequency between audio signals corresponding to adjacent preset characters, the target interval frequency and a frequency segment corresponding to the target frequency group are disjointed; The second network configuration information is obtained by resolving the matching frequency sequence into a target character sequence based on a matching relationship between a matching frequency in the matching frequency sequence and a target frequency in the target frequency group and a corresponding relationship between the target frequency in the target frequency group and a preset character in the preset character group, comprising: In a case where the target interval frequency is less than the frequency segment corresponding to the target frequency group, a step frequency in the matching frequency sequence is sequentially determined to obtain a step frequency sequence, wherein the step frequency is a matching frequency in the matching frequency sequence, greater than a previous matching frequency, and a frequency difference between the step frequency and the previous matching frequency is greater than or equal to a first frequency difference threshold; each step frequency in the step frequency sequence is resolved into a preset character corresponding to a target frequency matched with the each step frequency to obtain the target character sequence, wherein the target frequency matched with the each step frequency is a target frequency in the target frequency group, having a minimum frequency difference with the each step frequency. In a case where the target interval frequency is greater than a frequency range corresponding to the target frequency group, sequentially determine a descending order frequency in the matching frequency sequence, to obtain a descending order frequency sequence, wherein the descending order frequency is a matching frequency in the matching frequency sequence, which is less than a previous matching frequency, and a frequency difference between the descending order frequency and the previous matching frequency is greater than or equal to a second frequency difference threshold; and parse each descending order frequency in the descending order frequency sequence into a preset character corresponding to a target frequency matching the each descending order frequency, to obtain the target character sequence, wherein the target frequency matching the each descending order frequency is a target frequency in the target frequency group, which has a minimum frequency difference with the each descending order frequency.

12. An audio-based device commissioning system, the system comprising: Comprise: A target device configured to obtain first network configuration information to be transmitted to a device to be configured, wherein the device to be configured is a device to be configured, the first network configuration information is a to-be-transmitted character sequence, and each to-be-transmitted character in the to-be-transmitted character sequence is a preset character in a preset character group; select a target frequency group from a plurality of preset frequency groups corresponding to the preset character group according to a noise frequency of a current environmental noise, wherein different preset frequency groups in the plurality of preset frequency groups do not overlap between frequency ranges corresponding to the different preset frequency groups, and different preset characters in the preset character group correspond to different preset frequencies in each preset frequency group of the plurality of preset frequency groups; generate an audio signal corresponding to each to-be-transmitted character in the to-be-transmitted character sequence according to a target frequency corresponding to the each to-be-transmitted character in the target frequency group; and sequentially play the audio signal corresponding to the each to-be-transmitted character through an audio playing component, to transmit the first network configuration information to the device to be configured; The device to be configured is configured to segment a to-be-parsed audio signal according to a preset time length, to obtain a group of to-be-parsed audio signal segments, wherein the to-be-parsed audio signal is an audio signal corresponding to the each to-be-transmitted character collected by an audio collecting component of the device to be configured; perform time-frequency domain transformation on each audio signal segment in the group of audio signal segments, to obtain frequency spectrum data corresponding to the each audio signal segment, and determine a matching frequency of the each audio signal segment according to the frequency spectrum data corresponding to the each audio signal segment, to obtain a matching frequency sequence, wherein the matching frequency of the each audio signal segment is a frequency with a maximum amplitude-frequency characteristic in the frequency spectrum data corresponding to the each audio signal segment; parse the matching frequency sequence into a target character sequence based on a matching relationship between the matching frequencies in the matching frequency sequence and target frequencies in the target frequency group, and a corresponding relationship between the target frequencies in the target frequency group and preset characters in the preset character group, to obtain second network configuration information, wherein each target character in the target character sequence is a preset character in the preset character group.

13. A computer readable storage medium, characterized in that, The computer-readable storage medium comprises a stored program, wherein the program, when executed, performs the method of any one of claims 1 to 11. 14.An electronic device comprising a memory and a processor, the electronic device characterized by, The memory stores a computer program, and the processor is configured to execute the method of any one of claims 1 to 11 by using the computer program. The memory stores a computer program, and the processor is configured to execute the method of any one of claims 1 to 11 by using the computer program.

Images