Intelligent audio equipment control method based on intelligent terminal and related device

Abstract

The invention discloses an intelligent audio equipment control method based on an intelligent terminal and a related device, and the method comprises the steps: controlling a carried Bluetooth module to enter a process of scanning and discovering equipment in real time through a control APP, and discovering equipment broadcast information transmitted by intelligent audio equipment through low-power-consumption Bluetooth BLE broadcast based on real-time scanning; after Bluetooth communication connection with the intelligent audio equipment is established based on the equipment broadcast information, the control APP controls the Bluetooth module to be bound with the intelligent audio equipment as point-to-point connection; and after point-to-point connection is bound, interaction control is executed on the intelligent audio equipment based on the control APP, and the interaction control comprises key function control, sound effect control, light effect control and equipment OTA management control. According to the embodiment of the invention, the wireless remote control of the intelligent audio equipment through the intelligent equipment is realized, the safety in the control data transmission process is ensured, and the interactive control of the intelligent audio equipment of a user is met.

Description

Technical Field

[0001] The present invention relates to the field of intelligent control technologies, and particularly to a method and related device for controlling an intelligent audio device based on an intelligent terminal. Background Art

[0002] With the rapid development of Internet technologies, digitization and networking have become the main features of modern society. Consumers increasingly rely on smart phones and the Internet to complete daily tasks, such as communication, payment, entertainment, etc. Therefore, the combination of consumer electronics products and mobile phone APPs can make the products break away from isolation and seamlessly access the AIoT family, while enabling users to more conveniently access digital life. As a traditional consumer electronics product and an indispensable category of modern electronic consumer products, how to endow audio products with intelligent capabilities so that they can access the Internet and provide richer and more personalized experiences is an issue that every audio product manufacturer must keep up with the times and consider.

[0003] The existing technical difficulties lie in how to ensure stable connection in various complex environments and ensure that control data will not be tampered with or lost during transmission. Summary of the Invention

[0004] The purpose of the present invention is to overcome the deficiencies of the prior art. The present invention provides a method and related device for controlling an intelligent audio device based on an intelligent terminal, realizing wireless remote control of the intelligent audio device through the intelligent device, ensuring the security of the control data transmission process, and meeting the interactive control of the user's intelligent audio device.

[0005] To solve the above technical problems, an embodiment of the present invention provides a method for controlling an intelligent audio device based on an intelligent terminal, the method comprising:

[0006] The intelligent device controls the Bluetooth module carried by the control APP to enter the process of real-time scanning to discover devices. Based on the real-time scanning, the intelligent device discovers the device broadcast information sent by the intelligent audio device through low-power Bluetooth (BLE) broadcast. When the BLE is in the broadcast mode, it will periodically send broadcast packets on each broadcast channel, and the time interval between every two groups of broadcast packets consists of a fixed interval and a random delay;

[0007] After the intelligent device establishes a Bluetooth communication connection with the intelligent audio device based on the device broadcast information, the control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection;

[0008] After the Bluetooth module is bound to the smart audio device for a point-to-point connection, interactive control is performed on the smart audio device based on the control APP, and the interactive control includes button function control, sound effect control, light effect control, and device OTA management control.

[0009] Optionally, the smart device controls the Bluetooth module carried by it to enter the process of real-time scanning and discovering devices through the control APP, including:

[0010] When the control APP is started on the smart device, the control APP will control the Bluetooth module carried by the smart device to enter the process of real-time scanning and discovering devices.

[0011] Optionally, after the device broadcast information sent by the smart audio device through low-power Bluetooth BLE broadcast is discovered based on real-time scanning, it further includes:

[0012] The Bluetooth module generates a connection request to establish a Bluetooth connection with the smart audio device, and transmits the connection request back to the smart audio device based on the device broadcast information;

[0013] The smart audio device configures the parameter of the maximum transmission unit MTU of the BLE when communicating with the Bluetooth module based on the connection request, and returns the configured MTU parameter value to the Bluetooth module;

[0014] After receiving the configured MTU parameter, the Bluetooth module enters the discovery process of discovering services / characteristics / descriptors, and establishes a Bluetooth communication connection with the BLE after completing the discovery process.

[0015] Optionally, the control APP controls the Bluetooth module to be bound to the smart audio device for a point-to-point connection, including:

[0016] After the Bluetooth module establishes a Bluetooth communication connection with the smart audio device, the control APP controls the Bluetooth module to send a binding request to the smart audio device;

[0017] The smart audio device responds to the binding request, performs characteristic exchange processing with the Bluetooth module, and obtains a pairing method suitable for the Bluetooth module and the BLE of the smart audio device based on the characteristic exchange. The characteristic exchange includes the exchange of encryption algorithms supported by the Bluetooth module and the BLE respectively, whether out-of-band pairing is supported, the maximum encryption key length, the authentication security level, and the IO capability;

[0018] After the characteristic exchange is completed, the Bluetooth module and the BLE use the Security Manager Protocol SMP to generate an encryption key and establish an encrypted connection using the encryption key.

[0019] The Bluetooth module and the BLE perform a key distribution action based on the encrypted connection, save the received keys locally respectively, and complete the binding between the Bluetooth module and the BLE of the intelligent audio device as a point-to-point connection based on the keys saved locally.

[0020] Optionally, the performing of interactive control on the intelligent audio device based on the control APP includes:

[0021] When the interactive control is sound effect control, the control APP enters the sound effect control interface, selects a custom equalizer sound effect in the sound effect control interface, and customizes the parameters in the custom equalizer sound effect;

[0022] After the parameters of the custom equalizer sound effect are set, the set parameters are transmitted to the intelligent audio device based on the communication link of the point-to-point connection, and the intelligent audio device is controlled to switch to the custom equalizer sound effect mode to save the received parameters and apply them.

[0023] Optionally, the performing of interactive control on the intelligent audio device based on the control APP includes:

[0024] When the interactive control is light effect control, the control APP enters the light effect control interface, selects the custom color and brightness options in the light effect control interface, enters the custom color and brightness configuration page to configure the light effect control parameters, and the control APP sends the light effect control parameters to the intelligent audio device;

[0025] After the intelligent audio device receives the light effect control parameters, it controls the light effect of the intelligent audio device by using the pulse width modulation PWM combined with the direct memory access DMA method with the light effect control parameters, where the data input pin of the light strip on the intelligent audio device is connected to the output pin of the timer channel of the single-chip microcomputer, the working mode of the timer is configured as the PWM mode, and the period and duty cycle of the PWM are set to match the timing requirements of the light strip; the DMA is configured to read data from the RGB data buffer in the memory and transmit the read data to the output buffer of the PWM.

[0026] Optionally, the performing of interactive control on the intelligent audio device based on the control APP includes:

[0027] When the interactive control is device OTA management control, the control APP reads the current system version number of the intelligent audio device and determines whether the current system version number is the latest system version;

[0028] When it is not the latest system version, the control APP will perform OTA system upgrade control on the intelligent audio device.

[0029] In addition, an embodiment of the present invention further provides a control device for an intelligent audio device based on an intelligent terminal. The device includes:

[0030] A first control module: configured to enable the intelligent device to control the carried Bluetooth module to enter the process of real-time scanning to discover devices through the control APP, and based on the real-time scanning, discover the device broadcast information sent by the intelligent audio device through Bluetooth Low Energy (BLE) broadcast. When the BLE is in the broadcast mode, it will periodically send broadcast packets on each broadcast channel, and the time interval between every two groups of broadcast packets consists of a fixed interval and a random delay.

[0031] A second control module: configured to, after the intelligent device establishes a Bluetooth communication connection with the intelligent audio device based on the device broadcast information, the control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection.

[0032] A third control module: configured to, after the Bluetooth module is bound to the intelligent audio device as a point-to-point connection, perform interactive control on the intelligent audio device based on the control APP. The interactive control includes button function control, sound effect control, light effect control, and device OTA management control.

[0033] In addition, an embodiment of the present invention further provides a control system for an intelligent audio device based on an intelligent terminal. The system includes an intelligent device and one or more intelligent audio devices. The intelligent device is connected to the intelligent audio device through Bluetooth communication, and the system is configured to implement the intelligent audio device control method as described in any one of the above.

[0034] In addition, an embodiment of the present invention further provides a computer-readable storage medium for storing a computer program or code. When the computer program or code is executed by a processor, it implements the intelligent audio device control method as described in any one of the above.

[0035] In an embodiment of the present invention, the Bluetooth module carried by the control APP is controlled to enter the process of real-time scanning to discover devices, and based on the real-time scanning, the device broadcast information sent by the intelligent audio device through low-power Bluetooth (BLE) broadcast is discovered; after establishing a Bluetooth communication connection with the intelligent audio device based on the device broadcast information, the control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection; after being bound as a point-to-point connection, the intelligent audio device is interactively controlled based on the control APP; realizing wireless remote control of the intelligent audio device by the intelligent device, and in a complex environment, by setting the time interval between every two groups of broadcast messages during BLE broadcast, interference caused by two devices possibly broadcasting simultaneously for a long time is avoided, and the security during the control data transmission process is ensured, and the interactive control of the user's intelligent audio device is satisfied. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0037] Figure 1 is a schematic flowchart of a method for controlling an intelligent audio device based on an intelligent terminal in an embodiment of the present invention;

[0038] Figure 2 is a schematic flowchart of the process of being bound as a point-to-point connection in an embodiment of the present invention;

[0039] Figure 3 is a schematic flowchart of the interactive control process during sound effect control in an embodiment of the present invention;

[0040] Figure 4 is a schematic flowchart of the interactive control process during light effect control in an embodiment of the present invention;

[0041] Figure 5 is a schematic diagram of the structural composition of a device for controlling an intelligent audio device based on an intelligent terminal in an embodiment of the present invention;

[0042] Figure 6 is a schematic diagram of the structural composition of a system for controlling an intelligent audio device based on an intelligent terminal in an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0043] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0044] Embodiment 1. Please refer to Figure 1 , Figure 1 which is a schematic flowchart of a method for controlling an intelligent audio device based on an intelligent terminal in an embodiment of the present invention.

[0045] As Figure 1 shown, a method for controlling an intelligent audio device based on an intelligent terminal, the method includes:

[0046] S101: The intelligent device controls the Bluetooth module carried by it through the control APP to enter the process of real-time scanning and discovering devices. Based on the real-time scanning, the device broadcast information sent by the intelligent audio device through low-power Bluetooth (BLE) broadcast is discovered. When the BLE is in the broadcast mode, it will periodically send broadcast packets on each broadcast channel, and the time interval between every two groups of broadcast packets consists of a fixed interval and a random delay.

[0047] In the specific implementation process of the present invention, the intelligent device controls the Bluetooth module carried by it through the control APP to enter the process of real-time scanning and discovering devices, including: when the control APP is started on the intelligent device, the control APP will control the Bluetooth module carried by the intelligent device to enter the process of real-time scanning and discovering devices.

[0048] Further, after discovering the device broadcast information sent by the intelligent audio device through low-power Bluetooth (BLE) broadcast based on the real-time scanning, it further includes: the Bluetooth module generates a connection request to establish a Bluetooth connection with the intelligent audio device, and based on the device broadcast information, the connection request is sent back to the intelligent audio device; the intelligent audio device configures the parameter of the maximum transmission unit (MTU) of the BLE when communicating with the Bluetooth module based on the connection request, and returns the configured MTU parameter value to the Bluetooth module; after receiving the configured MTU parameter, the Bluetooth module enters the discovery process of services / characteristics / descriptors, and after completing the discovery process, it establishes a Bluetooth communication connection with the BLE.

[0049] Specifically, after the intelligent device starts and runs the control APP, the control APP will control the Bluetooth module carried on the intelligent device to enter the process of real-time scanning and discovering devices, and then will identify the device broadcast information broadcast by the low-energy Bluetooth (BLE) through the process of real-time scanning and discovering devices; then control the intelligent device to establish a Bluetooth communication connection with the intelligent audio device; in this embodiment, the intelligent audio device can be an intelligent speaker device for playing audio.

[0050] That is, after scanning the device broadcast information broadcast by the BLE, the control APP will control the Bluetooth module to generate a connection request to establish a Bluetooth connection with the intelligent audio device, and then transmit the connection request back to the intelligent audio device through the device broadcast information; after receiving the connection request, the intelligent audio device will configure the parameter of the maximum transmission unit MTU when communicating with the Bluetooth module, and return the configured MTU parameter value to the Bluetooth module; and after the Bluetooth module receives the configured MTU parameter, it will enter the discovery process of discovering services / characteristics / descriptors, and establish a Bluetooth communication connection with the BLE after completing the discovery process.

[0051] To solve the possible signal interference problem caused by BLE broadcasting, it will be solved by setting a time interval; that is, the BLE has 40 channels, namely 0-39, the channel bandwidth is 1MHz, and three channels 37, 38 and 39 are dedicated to BLE broadcasting; when the speaker is in the BLE broadcasting mode, it will periodically send broadcast packets on each broadcast channel, and the time interval between every two groups of broadcast packets consists of a fixed interval and a random delay, that is: T_AdvEvent = advInterval + advDelay, advInterval must be an integer multiple of 0.625ms, the range is 20ms - 10.24s, advDelay is a pseudo-random number assigned by the link layer, and the range is 0-10ms; the reason for adding the random delay is that due to different degrees of clock drift between different devices, to avoid possible interference caused by two devices broadcasting simultaneously for a long time; the BLE data packet format is as follows:

[0052]

[0053] Device information such as the Bluetooth name, Bluetooth address, status, etc. can be added to the broadcast payload (PDU Payload), so that the APP can identify the speaker device after scanning the broadcast; the PDU Payload data format is as follows:

[0054]

[0055] S102: After the smart device establishes a Bluetooth communication connection with the smart audio device based on the device broadcast information, the control APP controls the Bluetooth module to be bound to the smart audio device as a point-to-point connection;

[0056] In the specific implementation process of the present invention, the control APP controls the Bluetooth module to be bound to the smart audio device as a point-to-point connection, including: after the Bluetooth module establishes a Bluetooth communication connection with the smart audio device, the control APP controls the Bluetooth module to initiate a binding request to the smart audio device; the smart audio device responds to the binding request, performs characteristic exchange processing with the Bluetooth module, and obtains a pairing method suitable for the Bluetooth module and the BLE of the smart audio device based on the characteristic exchange. The characteristic exchange includes the exchange of encryption algorithms supported by the Bluetooth module and the BLE, whether out-of-band pairing is supported, the maximum encryption key length, the authentication security level, and the IO capabilities; after the characteristic exchange is completed, the Bluetooth module and the BLE use the Security Manager Protocol (SMP) to generate an encryption key, and establish an encrypted connection using the encryption key; the Bluetooth module and the BLE perform a key distribution action based on the encrypted connection, save the received keys locally respectively, and complete the binding of the Bluetooth module and the BLE of the smart audio device as a point-to-point connection based on the keys saved locally.

[0057] Specifically, after the smart device and the smart audio device establish a Bluetooth communication connection, it is necessary to perform characteristic exchange, key generation, and key distribution, and then establish an encrypted link to realize the binding of the smart device and the smart audio device as a point-to-point connection; for details, please refer to Figure 2 ;

[0058] such as Figure 2 shown:

[0059] S1021: After the Bluetooth module establishes a Bluetooth communication connection with the smart audio device, the control APP controls the Bluetooth module to initiate a binding request to the smart audio device;

[0060] Specifically, after the Bluetooth module establishes a Bluetooth communication connection with the smart audio device, and when it is confirmed that there is no point-to-point binding between the Bluetooth module of the smart device and the smart audio device, point-to-point binding needs to be performed; at this time, the control APP will control the Bluetooth module to send a point-to-point binding request to the smart audio device.

[0061] S1022: The intelligent audio device responds to the binding request, performs characteristic exchange processing with the Bluetooth module, and obtains a pairing method suitable for the Bluetooth module and the BLE of the intelligent audio device based on the characteristic exchange. The characteristic exchange includes the exchange of encryption algorithms supported by the Bluetooth module and the BLE respectively, whether out-of-band pairing is supported, the maximum encryption key length, the authentication security level, and the IO capabilities.

[0062] Specifically, after the intelligent audio device receives the binding request, it responds to the corresponding binding request and performs characteristic exchange processing with the Bluetooth module. The characteristic exchange mainly includes the encryption algorithms supported by the two devices respectively, whether out-of-band pairing is supported, the maximum encryption key length, the authentication security level, and the IO capabilities. And it will determine a pairing method suitable for the Bluetooth module and the BLE of the intelligent audio device through the characteristic exchange, that is, through the information of the characteristic exchange, so as to determine the most suitable pairing method between the two devices.

[0063] S1023: After the characteristic exchange is completed, the Bluetooth module and the BLE use the Security Manager Protocol (SMP) to generate an encryption key, and establish an encrypted connection using the encryption key.

[0064] Specifically, after the characteristic exchange is completed, the Bluetooth module and the BLE will generate an encryption key through the SMP, and then use this encryption key to encrypt the communication link between the Bluetooth module and the BLE, so as to establish an encrypted connection.

[0065] S1024: The Bluetooth module and the BLE perform a key distribution action based on the encrypted connection, save the received keys locally respectively, and complete the binding of the Bluetooth module and the BLE of the intelligent audio device as a point-to-point connection based on the keys saved locally.

[0066] Specifically, after the encrypted connection is established, the Bluetooth module and the BLE enter the key distribution action, that is, distribute the corresponding keys to the local of the Bluetooth module and the BLE for storage respectively, so as to complete the binding of the Bluetooth module and the BLE as a point-to-point connection; thus, when reconnecting later, the pairing process can be omitted.

[0067] S103: After the Bluetooth module and the intelligent audio device are bound as a point-to-point connection, perform interactive control on the intelligent audio device based on the control APP. The interactive control includes button function control, sound effect control, light effect control, and device OTA management control.

[0068] In the specific implementation process of the present invention, after the Bluetooth module is bound to the smart audio device for a point-to-point connection, the control APP will perform interactive control on the smart audio device, such as button function control, sound effect control, light effect control, and device OTA management control; as Figure 3 shown:

[0069] S1031: When the interactive control is sound effect control, the control APP enters the sound effect control interface, selects a custom equalizer sound effect in the sound effect control interface, and customizes the parameters in the custom equalizer sound effect;

[0070] Specifically, when the interactive control is sound effect control, it is necessary to enter the sound effect control interface through the control APP, select a custom equalizer sound effect in the sound effect control interface, and then customize the parameters in the custom equalizer sound effect. The parameters in the equalizer sound effect mainly include the center frequency point f, gain g, and bandwidth b. The bandwidth is often described using its reciprocal factor q; generally, 6-10 frequency points will be opened for the user to make custom settings; therefore, the parameters of 6-10 frequency points are custom-set.

[0071] S1032: After completing the parameter setting of the custom equalizer sound effect, the set parameters will be transmitted to the smart audio device based on the communication link of the point-to-point connection, and the smart audio device will be controlled to switch to the custom equalizer sound effect mode to save the received parameters and apply them.

[0072] Specifically, after completing the parameter setting of the custom equalizer sound effect, it is necessary to transmit the set parameters to the smart audio device according to the communication link of the point-to-point connection, and then control the smart audio device to switch to the custom equalizer sound effect mode to save the received parameters and apply them; the user can very intuitively hear the sound effect formulated by himself; and these parameters can be repeatedly debugged until the user adjusts to a satisfactory effect.

[0073] When the interactive control is equivalent control, please refer to Figure 4 :

[0074] S1033: When the interactive control is light effect control, the control APP enters the light effect control interface, selects the custom color and brightness options in the light effect control interface, enters the custom color and brightness configuration page to configure the light effect control parameters, and the control APP will send the light effect control parameters to the smart audio device;

[0075] Specifically, the light effect control is to control the color and brightness of the light beads carried by the intelligent audio device; in this embodiment, it is assumed that the light bead product carried on the intelligent audio device is a WS2812B RGB LED light bead. By sending 24-bit PWM data to the light bead in the RGB format according to a specific timing sequence, the color and blinking mode of the LED light bead can be controlled; the WS2812B can be cascaded and serially controlled, and each light bead is independent of each other, and can display the brightness of three colors, red, green, and blue, with 256 levels of brightness. By adjusting the brightness of these 3 colors, a rich and colorful effect can be achieved.

[0076] That is, the light effect control interface can be entered through the control APP. In the light effect control interface, select the custom color and brightness options, enter the custom color and brightness configuration page to configure the light effect control parameters, and finally send the light effect control parameters to the intelligent audio device through the control APP.

[0077] S1034: After the intelligent audio device receives the light effect control parameters, call the method of combining Pulse Width Modulation (PWM) with Direct Memory Access (DMA) to control the light effect of the intelligent audio device using the light effect control parameters. The data input pin of the light strip on the intelligent audio device is connected to the output pin of the timer channel of the single-chip microcomputer. The working mode of the timer is configured as the PWM mode, and the period and duty cycle of the PWM are set to match the timing requirements of the light strip; configure the DMA to read data from the RGB data buffer in the memory and transfer the read data to the output buffer of the PWM.

[0078] Specifically, after the intelligent audio device receives the light effect control parameters, call the method of combining Pulse Width Modulation (PWM) with Direct Memory Access (DMA) to control the light effect of the intelligent audio device using the light effect control parameters; that is, use the PWM+DMA method to drive the data transmission and color control of the light beads; combining the precise time control of PWM and the high-efficiency data transmission ability of DMA, it is particularly suitable for application scenarios that require dynamic control of a large number of LED light beads; specific control principle:

[0079] PWM control: The data communication of the WS2812B is based on the high and low level changes of time, that is, the duration of each binary bit (bit) determines whether it is "0" or "1"; PWM can generate a precisely controlled square wave signal, and by adjusting the duty cycle of the square wave (the proportion of the high-level time in the whole cycle), the timing required by the WS2812B can be simulated.

[0080] DMA Data Transfer: DMA allows data to be directly transferred between memory and peripherals (such as SPI, UART, etc.) without CPU intervention; when driving WS2812B, RGB data can be stored in memory and transferred to the output buffer of the PWM generator through DMA, thus achieving fast and continuous data transmission.

[0081] In implementation, it is necessary to connect the output pin of a certain timer channel of the microcontroller to the data input pin (DI) of WS2812B; ensure that the power supply and ground wire of WS2812B are correctly connected; select a timer channel and configure its working mode as PWM mode; set the period and duty cycle of PWM to match the timing requirements of WS2812B; specifically, it is necessary to generate the high and low level times that meet the "0" and "1" bit code requirements of WS2812B; configure DMA to read data from the RGB data buffer in memory and transfer it to the output buffer of the timer PWM; set the transfer parameters of DMA, including the amount of data to be transferred, the source address (the starting address of the RGB data buffer) and the destination address (the address of the timer PWM output buffer); configure the trigger condition of DMA, which can usually be a timer overflow or update event; write code to initialize the timer, PWM and DMA; prepare an RGB data buffer in memory, which contains the RGB values to be sent to WS2812B; start the DMA transfer to transfer data from the memory buffer to the timer PWM output buffer; use a timer interrupt or software timer to periodically update the RGB data buffer and re-trigger the DMA transfer to achieve dynamic color changes; an 800ms timer interrupt can be set, and new RGB values are randomly generated and the data buffer is updated each time an interrupt occurs; use a logic analyzer or oscilloscope to check whether the waveform of the PWM output meets the timing requirements of WS2812B; observe the display of the WS2812B LED beads to ensure that the color change is correct.

[0082] When the user customizes the light effect, they only need to transmit the RGB values and brightness values of the color to the speaker via Bluetooth to control the light effect change of the light ring.

[0083] Furthermore, the interactive control of the smart audio device based on the control APP includes: when the interactive control is device OTA management control, the control APP reads the current system version number of the smart audio device and determines whether the current system version number is the latest system version; if it is not the latest system version, the control APP will perform OTA system upgrade control on the smart audio device.

[0084] Specifically, when the interaction control is the device OTA management control, it is necessary to obtain the current system version number of the intelligent audio device currently running through the control APP, and determine whether the current system version number is the latest system version; if it is not the latest system version, the control APP needs to perform OTA system upgrade control on the intelligent audio device.

[0085] In the embodiment of the present invention, the control APP controls the carried Bluetooth module to enter the process of real-time scanning to discover devices, and based on the real-time scanning, discovers the device broadcast information sent by the intelligent audio device through low-power Bluetooth BLE broadcast; after establishing a Bluetooth communication connection with the intelligent audio device based on the device broadcast information, the control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection; after being bound as a point-to-point connection, the control APP performs interaction control on the intelligent audio device; realizes wireless remote control of the intelligent audio device through the intelligent device, and in a complex environment, avoids interference caused by two devices possibly broadcasting simultaneously for a long time by setting the time interval between every two groups of broadcast packets during BLE broadcast, and ensures the security during the control data transmission process, and meets the interaction control of the user's intelligent audio device.

[0086] Embodiment 2, please refer to Figure 5 , Figure 5 It is a schematic structural composition diagram of an intelligent audio device control device based on an intelligent terminal in the embodiment of the present invention.

[0087] As Figure 5 shown, an intelligent audio device control device based on an intelligent terminal, the device includes:

[0088] The first control module 501: is used for the intelligent device to control the carried Bluetooth module to enter the process of real-time scanning to discover devices through the control APP, and based on the real-time scanning, discovers the device broadcast information sent by the intelligent audio device through low-power Bluetooth BLE broadcast, where when the BLE is in the broadcast mode, it will periodically send broadcast packets on each broadcast channel, and the time interval between every two groups of broadcast packets consists of a fixed interval and a random delay;

[0089] In the specific implementation process of the present invention, the intelligent device controls the carried Bluetooth module to enter the process of real-time scanning to discover devices through the control APP, including: when starting the control APP on the intelligent device, the control APP will control the Bluetooth module carried by the intelligent device to enter the process of real-time scanning to discover devices.

[0090] Further, after discovering the device broadcast information sent by the smart audio device via Bluetooth Low Energy (BLE) broadcast based on real-time scanning, the following steps are also included: The Bluetooth module generates a connection request to establish a Bluetooth connection with the smart audio device, and transmits the connection request back to the smart audio device based on the device broadcast information; The smart audio device configures the parameter of the maximum transmission unit (MTU) of the BLE when communicating with the Bluetooth module based on the connection request, and returns the configured MTU parameter value to the Bluetooth module; After receiving the configured MTU parameter, the Bluetooth module enters the discovery process of services / characteristics / descriptors, and establishes a Bluetooth communication connection with the BLE after completing the discovery process.

[0091] Specifically, after the smart device starts and runs the control APP, the control APP will control the Bluetooth module carried on the smart device to enter the process of real-time scanning to discover devices, and then identify the device broadcast information broadcast by Bluetooth Low Energy (BLE) through the process of real-time scanning to discover devices; Then control the smart device to establish a Bluetooth communication connection with the smart audio device; In this embodiment, the smart audio device can be a smart speaker device for playing audio.

[0092] That is, after scanning the device broadcast information broadcast by the BLE, the control APP will control the Bluetooth module to generate a connection request to establish a Bluetooth connection with the smart audio device, and then transmit the connection request back to the smart audio device through the device broadcast information; After receiving the connection request, the smart audio device will configure the parameter of the maximum transmission unit (MTU) of the BLE when communicating with the Bluetooth module, and return the configured MTU parameter value to the Bluetooth module; And after the Bluetooth module receives the configured MTU parameter, it enters the discovery process of services / characteristics / descriptors, and establishes a Bluetooth communication connection with the BLE after completing the discovery process.

[0093] To solve the possible signal interference problem caused by BLE during broadcasting, it will be solved by setting a time interval; that is, BLE has 40 channels, namely 0 - 39, the channel bandwidth is 1MHz, and three channels 37, 38, and 39 are dedicated to BLE broadcasting; when the speaker is in the BLE broadcasting mode, broadcast packets will be periodically sent on each broadcasting channel. The time interval between every two groups of broadcast packets consists of a fixed interval and a random delay, that is: T_AdvEvent = advInterval + advDelay, where advInterval must be an integer multiple of 0.625ms, and the range is 20ms - 10.24s. advDelay is a pseudo-random number allocated by the link layer, and the range is 0 - 10ms; the reason for adding the random delay is that there will be different degrees of clock drift between different devices. To avoid interference caused by two devices broadcasting simultaneously for a long time; the BLE data packet format is as follows:

[0094]

[0095] Device information such as Bluetooth name, Bluetooth address, status, etc. can be added to the broadcast payload (PDU Payload), so that the APP can identify the speaker device after scanning the broadcast; the PDU Payload data format is as follows:

[0096]

[0097] The second control module 502: After the smart device establishes a Bluetooth communication connection with the smart audio device based on the device broadcast information, the control APP controls the Bluetooth module to be bound to the smart audio device as a point-to-point connection;

[0098] In the specific implementation process of the present invention, the control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection, including: after the Bluetooth module establishes a Bluetooth communication connection with the intelligent audio device, the control APP controls the Bluetooth module to send a binding request to the intelligent audio device; the intelligent audio device responds to the binding request, performs characteristic exchange processing with the Bluetooth module, and obtains a pairing method suitable for the BLE between the Bluetooth module and the intelligent audio device based on the characteristic exchange. The characteristic exchange includes the exchange of encryption algorithms supported by the Bluetooth module and the BLE respectively, whether out-of-band pairing is supported, the maximum encryption key length, the authentication security level, and the IO capabilities; after the characteristic exchange is completed, the Bluetooth module and the BLE use the Security Manager Protocol (SMP) to generate an encryption key, and establish an encrypted connection using the encryption key; the Bluetooth module and the BLE perform a key distribution operation based on the encrypted connection, save the received keys locally respectively, and complete the binding of the Bluetooth module and the BLE of the intelligent audio device as a point-to-point connection based on the keys saved locally.

[0099] Specifically, after the intelligent device establishes a Bluetooth communication connection with the intelligent audio device, it is necessary to perform characteristic exchange, key generation, and key distribution, and then establish an encrypted link to implement the binding of the intelligent device and the intelligent audio device as a point-to-point connection; for details, please refer to Figure 2 ;

[0100] Such as Figure 2 shown:

[0101] S1021: After the Bluetooth module establishes a Bluetooth communication connection with the intelligent audio device, the control APP controls the Bluetooth module to send a binding request to the intelligent audio device;

[0102] Specifically, after the Bluetooth module establishes a Bluetooth communication connection with the intelligent audio device, and when it is confirmed that there is no point-to-point binding between the Bluetooth module of the intelligent device and the intelligent audio device, it is necessary to perform point-to-point binding; at this time, the control APP will control the Bluetooth module to send a point-to-point binding request to the intelligent audio device.

[0103] S1022: The intelligent audio device responds to the binding request, performs characteristic exchange processing with the Bluetooth module, and obtains a pairing method suitable for the BLE between the Bluetooth module and the intelligent audio device based on the characteristic exchange. The characteristic exchange includes the exchange of encryption algorithms supported by the Bluetooth module and the BLE respectively, whether out-of-band pairing is supported, the maximum encryption key length, the authentication security level, and the IO capabilities;

[0104] Specifically, after the smart audio device receives a binding request, it performs characteristic exchange processing on the corresponding binding request with the Bluetooth module. The characteristic exchange mainly includes the encryption algorithms supported by each of the two devices, whether out-of-band pairing is supported, the maximum encryption key length, the authentication security level, and the IO capabilities. And it determines the pairing method between the Bluetooth module and the BLE of the smart audio device through the characteristic exchange, that is, through the information of the characteristic exchange, so as to determine the most suitable pairing method between the two devices.

[0105] S1023: After the characteristic exchange is completed, the Bluetooth module and the BLE use the Security Manager Protocol (SMP) to generate an encryption key, and establish an encrypted connection using the encryption key.

[0106] Specifically, after the characteristic exchange is completed, the Bluetooth module and the BLE will generate an encryption key through SMP, and then use this encryption key to encrypt the communication link between the Bluetooth module and the BLE, thereby establishing an encrypted connection.

[0107] S1024: The Bluetooth module and the BLE perform a key distribution action based on the encrypted connection, save the received keys locally respectively, and complete the binding between the Bluetooth module and the BLE of the smart audio device as a point-to-point connection based on the keys saved locally.

[0108] Specifically, after the encrypted connection is established, the Bluetooth module and the BLE enter the key distribution action, that is, distribute the corresponding keys to the local corresponding to the Bluetooth module and the BLE for storage respectively, thereby completing the binding between the Bluetooth module and the BLE as a point-to-point connection; thus, when re-establishing a connection later, the pairing process can be omitted.

[0109] The third control module 503: is used to perform interactive control on the smart audio device based on the control APP after the Bluetooth module and the smart audio device are bound as a point-to-point connection. The interactive control includes button function control, sound effect control, light effect control, and device OTA management control.

[0110] In the specific implementation process of the present invention, after the Bluetooth module and the smart audio device are bound as a point-to-point connection, interactive control will be performed on the smart audio device through the control APP, such as button function control, sound effect control, light effect control, and device OTA management control; as Figure 3 shown:

[0111] S1031: When the interactive control is sound effect control, the control APP enters the sound effect control interface, selects a custom equalizer sound effect in the sound effect control interface, and customizes the parameters in the custom equalizer sound effect.

[0112] Specifically, when the interaction control is sound effect control, it is necessary to enter the sound effect control interface through the control APP, select the custom equalizer sound effect in the sound effect control interface, and then customize the parameters in the custom equalizer sound effect. The parameters in the custom equalizer sound effect mainly include the center frequency point f, the gain g, and the bandwidth b. The bandwidth is often described by its reciprocal factor q; generally, 6-10 frequency points will be opened for the user to make custom settings; therefore, the parameters of 6-10 frequency points are customized.

[0113] S1032: After completing the parameter setting of the custom equalizer sound effect, the set parameters are transmitted to the intelligent audio device based on the point-to-point connection communication link, and the intelligent audio device is controlled to switch to the custom equalizer sound effect mode to save the received parameters and apply them.

[0114] Specifically, after completing the parameter setting of the custom equalizer sound effect, it is necessary to transmit the set parameters to the intelligent audio device according to the point-to-point connection communication link, and then control the intelligent audio device to switch to the custom equalizer sound effect mode to save the received parameters and apply them; the user can very intuitively hear the sound effect formulated by himself; and these parameters can be repeatedly debugged until the user adjusts to a satisfactory effect.

[0115] When the interaction control is equivalent control, please refer to Figure 4 :

[0116] S1033: When the interaction control is light effect control, the control APP enters the light effect control interface, selects the custom color and brightness options in the light effect control interface, enters the custom color and brightness configuration page to configure the light effect control parameters, and the control APP issues the light effect control parameters to the intelligent audio device;

[0117] Specifically, the light effect control is to control the color and brightness of the lamp beads carried by the intelligent audio device; in this embodiment, it is assumed that the lamp bead product carried on the intelligent audio device is a WS2812B RGB LED lamp bead. By sending 24-bit PWM data in the RGB format to the lamp beads according to a specific timing, the color and blinking mode of the LED lamp beads can be controlled; the WS2812B can be cascaded and serially controlled, and each lamp bead is independent of each other, and can display 256 levels of brightness of the three colors of red, green, and blue. By adjusting the brightness of these 3 colors, a rich and colorful effect can be achieved.

[0118] That is, the control APP can enter the light effect control interface, select the custom color and brightness options in the light effect control interface, enter the custom color and brightness configuration page to configure the light effect control parameters, and finally issue the light effect control parameters to the intelligent audio device through the control APP.

[0119] S1034: After the intelligent audio device receives the light effect control parameter, it controls the light effect of the intelligent audio device by using Pulse Width Modulation (PWM) combined with Direct Memory Access (DMA) with the light effect control parameter. The data input pin of the light strip on the intelligent audio device is connected to the output pin of the timer channel of the single-chip microcomputer. The working mode of the timer is configured as the PWM mode, and the period and duty cycle of the PWM are set to match the timing requirements of the light strip; configure the DMA to read data from the RGB data buffer in the memory and transfer the read data to the output buffer of the PWM.

[0120] Specifically, after the intelligent audio device receives the light effect control parameter, it controls the light effect of the intelligent audio device by using Pulse Width Modulation (PWM) combined with Direct Memory Access (DMA); that is, it uses the PWM+DMA method to drive the data transmission and color control of the lamp beads; it combines the precise time control of PWM and the high-efficiency data transmission ability of DMA, which is especially suitable for application scenarios that require dynamic control of a large number of LED lamp beads; the specific control principle is as follows:

[0121] PWM control: The data communication of WS2812B is based on the high and low level changes of time, that is, the duration of each binary bit (bit) determines whether it is "0" or "1"; PWM can generate a precisely controlled square wave signal, and simulate the timing required by WS2812B by adjusting the duty cycle of the square wave (the proportion of the high-level time in the whole cycle).

[0122] DMA data transmission: DMA allows data to be directly transmitted between the memory and peripherals (such as SPI, UART, etc.) without the intervention of the CPU; when driving WS2812B, the RGB data can be stored in the memory and transferred to the output buffer of the PWM generator through DMA, so as to realize the fast and continuous sending of data.

[0123] In implementation, it is necessary to connect the output pin of a certain timer channel of the microcontroller to the data input pin (DI) of the WS2812B; ensure that the power supply and ground wire of the WS2812B are correctly connected; select a timer channel and configure its working mode as PWM mode; set the period and duty cycle of the PWM to match the timing requirements of the WS2812B; specifically, it is necessary to generate the high and low level times that meet the "0" and "1" bit code requirements of the WS2812B; configure the DMA to read data from the RGB data buffer in the memory and transfer it to the output buffer of the timer PWM; set the transfer parameters of the DMA, including the amount of data to be transferred, the source address (the starting address of the RGB data buffer) and the destination address (the address of the timer PWM output buffer); configure the trigger condition of the DMA, which can usually be a timer overflow or update event; write code to initialize the timer, PWM and DMA; prepare an RGB data buffer in the memory, which contains the RGB values to be sent to the WS2812B; start the DMA transfer to transfer the data from the memory buffer to the timer PWM output buffer; use the timer interrupt or software timer to periodically update the RGB data buffer and re-trigger the DMA transfer to achieve dynamic color changes; a timer interrupt of 800ms can be set, and new RGB values are randomly generated and the data buffer is updated each time an interrupt occurs; use a logic analyzer or oscilloscope to check whether the waveform of the PWM output meets the timing requirements of the WS2812B; observe the display of the WS2812B LED beads to ensure that the color change is correct.

[0124] When the user customizes the light effect, they only need to transmit the RGB values and brightness values of the color to the speaker via Bluetooth to control the light effect change of the light ring.

[0125] Furthermore, the interactive control of the intelligent audio device based on the control APP includes: when the interactive control is device OTA management control, the control APP reads the current system version number of the intelligent audio device and determines whether the current system version number is the latest system version; if it is not the latest system version, the control APP will perform OTA system upgrade control on the intelligent audio device.

[0126] Specifically, when the interactive control is device OTA management control, it is necessary to obtain the current system version number of the intelligent audio device running currently through the control APP and determine whether the current system version number is the latest system version; if it is not the latest system version, then the control APP will perform OTA system upgrade control on the intelligent audio device.

[0127] In an embodiment of the present invention, the Bluetooth module carried by the control APP is controlled to enter the process of real-time scanning to discover devices, and based on the real-time scanning, the device broadcast information sent by the intelligent audio device through Bluetooth Low Energy (BLE) broadcast is discovered; after establishing a Bluetooth communication connection with the intelligent audio device based on the device broadcast information, the control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection; after being bound as a point-to-point connection, the intelligent audio device is interactively controlled based on the control APP; realizing wireless remote control of the intelligent audio device by the intelligent device, and in a complex environment, by setting the time interval between every two groups of broadcast messages during BLE broadcast, interference caused by two devices possibly broadcasting simultaneously for a long time is avoided, and the security during the control data transmission process is ensured, and the interactive control of the user's intelligent audio device is satisfied.

[0128] A computer-readable storage medium provided by an embodiment of the present invention, on which a computer program is stored, and when the program is executed by a processor, it implements the intelligent audio device control method of any one of the above embodiments. Among them, the computer-readable storage medium includes, but is not limited to, any type of disk (including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic cards or optical cards. That is, the storage device includes any medium that can store or transmit information in a readable form by a device (such as a computer, mobile phone), and can be a read-only memory, a magnetic disk or an optical disk, etc.

[0129] An embodiment of the present invention also provides a computer application program, which runs on a computer and is used to execute the intelligent audio device control method of any one of the above.

[0130] In addition, Figure 6 is a schematic diagram of the structural composition of the intelligent audio device control system based on an intelligent terminal in an embodiment of the present invention.

[0131] As an embodiment, the system includes an intelligent device 601 and one or more intelligent audio devices 602. The intelligent device 601 is connected to the intelligent audio device 602 through Bluetooth communication, and the system is configured to implement the intelligent audio device control method described in any one of the above.

[0132] In an embodiment of the present invention, the Bluetooth module carried by the control APP is controlled to enter the process of real-time scanning to discover devices. Based on the real-time scanning, the device broadcast information sent by the intelligent audio device through Bluetooth Low Energy (BLE) broadcast is discovered. After establishing a Bluetooth communication connection with the intelligent audio device based on the device broadcast information, the control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection. After being bound as a point-to-point connection, the intelligent audio device is interactively controlled based on the control APP. The wireless remote control of the intelligent audio device by the intelligent device is realized. In a complex environment, the time interval between every two groups of broadcast packets during BLE broadcast is set to avoid interference caused by two devices possibly broadcasting simultaneously for a long time, ensure the security during the control data transmission process, and satisfy the interactive control of the user's intelligent audio device.

[0133] In addition, the above has introduced in detail a method and related device for controlling an intelligent audio device based on an intelligent terminal. In this article, specific examples have been used to elaborate on the principle and implementation manner of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention. At the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present invention.

Claims

1. An intelligent audio device control method based on an intelligent terminal, characterized in that, The method includes: The intelligent device controls the Bluetooth module it carries through the control APP to enter the process of real-time scanning to discover devices. Based on the real-time scanning, it discovers the device broadcast information sent by the intelligent audio device through low-power Bluetooth (BLE) broadcast. When the BLE is in the broadcast mode, it will periodically send broadcast packets on each broadcast channel, and the time interval between every two groups of broadcast packets consists of a fixed interval and a random delay. After the intelligent device establishes a Bluetooth communication connection with the intelligent audio device based on the device broadcast information, the control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection. After the Bluetooth module is bound to the intelligent audio device as a point-to-point connection, based on the control APP, interactive control is performed on the intelligent audio device. The interactive control includes button function control, sound effect control, light effect control, and device OTA management control.

2. The intelligent audio device control method according to claim 1, wherein The intelligent device controls the Bluetooth module it carries through the control APP to enter the process of real-time scanning to discover devices, including: When the control APP is started on the intelligent device, the control APP will control the Bluetooth module carried by the intelligent device to enter the process of real-time scanning to discover devices.

3. The intelligent audio device control method according to claim 1, characterized in that, After discovering the device broadcast information sent by the intelligent audio device through low-power Bluetooth (BLE) broadcast based on the real-time scanning, it further includes: The Bluetooth module generates a connection request to establish a Bluetooth connection with the intelligent audio device, and based on the device broadcast information, the connection request is sent back to the intelligent audio device. The intelligent audio device configures the parameter of the maximum transmission unit (MTU) of the BLE when communicating with the Bluetooth module based on the connection request, and returns the configured MTU parameter value to the Bluetooth module. After the Bluetooth module receives the configured MTU parameter, it enters the discovery process of discovering services / characteristics / descriptors, and after completing the discovery process, it establishes a Bluetooth communication connection with the BLE.

4. The intelligent audio device control method according to claim 1, wherein The control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection, including: After the Bluetooth module establishes a Bluetooth communication connection with the intelligent audio device, the control APP controls the Bluetooth module to send a binding request to the intelligent audio device. The intelligent audio device responds to the binding request, performs characteristic exchange processing with the Bluetooth module, and obtains a pairing method suitable for the Bluetooth module and the BLE of the intelligent audio device based on the characteristic exchange. The characteristic exchange includes the exchange of encryption algorithms supported by the Bluetooth module and the BLE respectively, whether out-of-band pairing is supported, the maximum encryption key length, the authentication security level, and the IO capability. After completing the characteristic exchange, the Bluetooth module and the BLE use the Security Manager Protocol (SMP) to generate an encryption key and establish an encrypted connection using the encryption key. The Bluetooth module and the BLE perform a key distribution operation based on the encrypted connection, save the received keys locally respectively, and complete the binding between the Bluetooth module and the BLE of the intelligent audio device as a point-to-point connection based on the keys saved locally.

5. The intelligent audio device control method according to claim 1, wherein, The interactive control of the intelligent audio device based on the control APP includes: When the interactive control is sound effect control, the control APP enters the sound effect control interface, selects a custom equalizer sound effect in the sound effect control interface, and customizes the parameters in the custom equalizer sound effect; After completing the parameter setting of the custom equalizer sound effect, the set parameters are transmitted to the intelligent audio device based on the communication link of the point-to-point connection, and the intelligent audio device is controlled to switch to the custom equalizer sound effect mode to save the received parameters and apply them.

6. The intelligent audio device control method according to claim 1, wherein The interactive control of the intelligent audio device based on the control APP includes: When the interactive control is light effect control, the control APP enters the light effect control interface, selects the custom color and brightness options in the light effect control interface, enters the custom color and brightness configuration page to configure the light effect control parameters, and the control APP sends the light effect control parameters to the intelligent audio device; After the intelligent audio device receives the light effect control parameters, it calls the pulse width modulation (PWM) combined with direct memory access (DMA) method to control the light effect of the intelligent audio device using the light effect control parameters. The data input pin of the light strip on the intelligent audio device is connected to the output pin of the timer channel of the single-chip microcomputer. The working mode of the timer is configured as the PWM mode, and the period and duty cycle of the PWM are set to match the timing requirements of the light strip; the DMA is configured to read data from the RGB data buffer in the memory and transmit the read data to the output buffer of the PWM.

7. The intelligent audio device control method according to claim 1, characterized in that The interactive control of the intelligent audio device based on the control APP includes: When the interactive control is device OTA management control, the control APP reads the current system version number of the intelligent audio device and determines whether the current system version number is the latest system version; If it is not the latest system version, the control APP will perform OTA system upgrade control on the intelligent audio device.

8. An intelligent audio device control device based on an intelligent terminal, characterized in that, The device includes: The first control module: used for the intelligent device to control the carried Bluetooth module to enter the process of real-time scanning to discover devices through the control APP, and discover the device broadcast information sent by the intelligent audio device through low-power Bluetooth (BLE) broadcast based on real-time scanning. When the BLE is in the broadcast mode, it will periodically send broadcast messages on each broadcast channel, and the time interval between every two groups of broadcast messages consists of a fixed interval and a random delay; The second control module: used for the intelligent device to establish a Bluetooth communication connection with the intelligent audio device based on the device broadcast information, and the control APP controls the Bluetooth module to be bound to the intelligent audio device as a point-to-point connection; Third control module: After the Bluetooth module is bound to the smart audio device for a point-to-point connection, it performs interactive control on the smart audio device based on the control APP. The interactive control includes button function control, sound effect control, light effect control, and device OTA management control.

9. An intelligent audio device control system based on an intelligent terminal, characterized in that The system includes a smart device and one or more smart audio devices. The smart device is connected to the smart audio device through Bluetooth communication. The system is configured to implement the smart audio device control method as described in any one of claims 1 to 7.

10. A computer-readable storage medium for storing a computer program or code, characterized in that, When the computer program or code is executed by a processor, the smart audio device control method as described in any one of claims 1 to 7 is implemented.

Images