Multi-device intelligent interaction method and system and storage medium

Through the electrical connection between the smart speaker and the terminal device and the pre-save sound data set, the problem of the smart speaker being unable to play when the network signal is poor is solved, and the user experience is improved.

CN119031307APending Publication Date: 2024-11-26JIANGXI TAIDE INTELLIGENCE TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411125032.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-16
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Smart speakers cannot obtain sound files in scenarios with poor network signals, resulting in unplayable playback, seriously affecting the user experience.

Method used

The smart speaker establishes an electrical connection with the terminal device, and pre-receives and saves the sound data set when the network signal is good, and then plays the pre-save sound data set even when the network signal is bad.

Benefits of technology

By pre-saving the sound data set, smart speakers can still play sound files when the network signal is poor, improving the user experience and avoiding playback interruptions caused by network signal influence.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119031307A_ABST
    Figure CN119031307A_ABST
Patent Text Reader

Abstract

The invention is suitable for the technical field of sound boxes, and provides a multi-device intelligent interaction method and system and a storage medium. The multi-device intelligent interaction method comprises the following steps: an intelligent sound box establishes electric connection with a first terminal; when the intelligent sound box is in the first state, the intelligent sound box receives and stores a sound data set generated by the first terminal; and when the intelligent sound box is in the second state and the intelligent sound box receives the first control instruction, the intelligent sound box executes a corresponding playing strategy according to the sound data set. According to the embodiment of the invention, when the network signal is good, the intelligent sound box can pre-receive and store the sound data set generated by the first terminal, so that when the network signal is poor, the intelligent sound box can play the sound file in the pre-stored sound data set without being influenced by the network signal, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of speaker technology, and in particular relates to a multi-device intelligent interaction method, system and storage medium. Background Art

[0002] As people's leisure activities become more and more diverse, more and more users are using speakers to play music or sing karaoke. When using a speaker, users generally need to insert a storage device (such as a USB memory) into the speaker first. Therefore, users need to pre-download sound files to the storage device, which is cumbersome and cannot download new sound files in real time.

[0003] With the continuous development of speaker technology, smart speakers have emerged. Smart speakers can directly connect to users' terminal devices (such as smartphones) and access massive amounts of music files through the terminal devices, improving the user experience.

[0004] However, in related technologies, a good network signal is required to connect smart speakers to terminal devices. In some usage scenarios, such as outdoors and in the mountains, the network signal is often poor. At this time, the smart speaker may not be able to obtain the sound file due to signal problems, which may lead to the inability to play, seriously affecting the user experience. Summary of the Invention

[0005] The embodiments of the present application provide a multi-device intelligent interaction method, system and storage medium, which can solve the problem in the related art that when the network signal is poor, the smart speaker cannot obtain the sound file, which leads to the inability to play, seriously affecting the user experience.

[0006] In a first aspect, an embodiment of the present application provides a multi-device intelligent interaction method, which is applied to a multi-device intelligent interaction system, the system including: a smart speaker, a smart microphone, and a first terminal, the method including:

[0007] The smart speaker establishes an electrical connection with the first terminal;

[0008] When the smart speaker is in a first state, the smart speaker receives and stores a sound data set generated by the first terminal;

[0009] When the smart speaker is in the second state and receives a first control instruction, the smart speaker executes a corresponding playback strategy according to the sound data set.

[0010] In a second aspect, an embodiment of the present application provides a multi-device intelligent interaction system, the system comprising: an intelligent speaker, an intelligent microphone, and a first terminal;

[0011] The smart speaker is used to establish an electrical connection with the first terminal;

[0012] The smart speaker is further configured to receive and store a sound data set generated by the first terminal;

[0013] When the smart speaker receives the first control instruction, the smart speaker is further configured to execute a corresponding playback strategy according to the sound data set.

[0014] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the steps of the above-mentioned multi-device intelligent interaction method.

[0015] In a fourth aspect, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute the above-mentioned multi-device intelligent interaction method.

[0016] The beneficial effects of the embodiments of the present application compared to the prior art are as follows: the embodiments of the present application establish an electrical connection with the first terminal via a smart speaker; when the smart speaker is in a first state, the smart speaker receives and stores a sound data set generated by the first terminal; and when the smart speaker is in a second state and receives a first control instruction, the smart speaker executes a corresponding playback strategy based on the sound data set. In the embodiments of the present application, when the network signal is good, the smart speaker can pre-receive and store the sound data set generated by the first terminal; therefore, when the network signal is poor, the smart speaker can play the sound files in the pre-stored sound data set without being affected by the network signal, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0018] Figure 1 This is a schematic diagram of the implementation process of a multi-device intelligent interaction method provided in an embodiment of the present application;

[0019] Figure 2 This is one of the schematic diagrams of a multi-device intelligent interaction system provided in an embodiment of the present application;

[0020] Figure 3 This is a second schematic diagram of a multi-device intelligent interaction system provided in an embodiment of the present application;

[0021] Figure 4 This is a schematic diagram of the positions of an in-vehicle terminal and a smart speaker in a multi-device intelligent interaction system provided by an embodiment of the present application;

[0022] Figure 5 This is a schematic diagram of the optimal placement position of a smart speaker and the optimal standing position of a user in a multi-device intelligent interaction system provided by an embodiment of the present application;

[0023] Figure 6 This is a schematic diagram of the placement of multiple smart speakers in a multi-device intelligent interaction system provided by an embodiment of the present application.

[0024] The accompanying figures are as follows:

[0025] 1. In-vehicle terminal; 2. Smart speaker; A. Optimal standing position for the user; a. User standing position. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solutions and advantages of this application more clear, the application is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without making any creative work are protected by this application.

[0027] It should be noted that the terms "include", "comprising" and "having" and any variations thereof in the specification and claims of this application and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, terminal, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices. In the claims, specification and drawings of this application, relational terms such as "first" and "second" are merely used to distinguish one entity / operation / object from another entity / operation / object, and do not necessarily require or imply any such real-time relationship or order between these entities / operations / objects.

[0028] References to "embodiments" herein mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0029] As people's leisure activities become more and more diverse, more and more users are using speakers to play music or sing karaoke. When using a speaker, users generally need to insert a storage device (such as a USB memory) into the speaker first. Therefore, users need to pre-download sound files to the storage device, which is cumbersome and cannot download new sound files in real time.

[0030] With the continuous development of speaker technology, smart speakers 2 have emerged. Smart speakers 2 can be directly connected to user terminal devices (such as smartphones) to obtain massive music files through the terminal devices, thereby improving the user experience.

[0031] However, in related technologies, a good network signal is required for the smart speaker 2 to be connected to the terminal device. In some usage scenarios, such as outdoors, in the mountains, etc., the network signal is often poor. At this time, the smart speaker 2 may not be able to obtain the sound file due to signal problems, and thus cannot be played, seriously affecting the user experience.

[0032] In view of this, an embodiment of the present application provides a multi-device intelligent interaction method. When the network signal is good, the smart speaker 2 can pre-receive and save the sound data set generated by the first terminal. Therefore, when the network signal is poor, the smart speaker 2 can play the sound files in the pre-saved sound data set without being affected by the network signal, thereby improving the user experience.

[0033] In order to illustrate the technical solution of the present application, specific embodiments are provided below.

[0034] Figure 1 The following is a schematic diagram showing the implementation process of a multi-device intelligent interaction method provided by an embodiment of the present application. The method can be applied to a multi-device intelligent interaction system. Figure 2 As shown, the multi-device intelligent interactive system may include an intelligent speaker 2, an intelligent microphone, and a first terminal. The first terminal may be a mobile phone, a vehicle-mounted system, a tablet computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, etc.

[0035] Specifically, the above-mentioned multi-device intelligent interaction method may include the following steps S101 to S103.

[0036] Step S101: The smart speaker 2 establishes an electrical connection with the first terminal.

[0037] In the embodiment of the present application, the smart speaker 2 may be provided with a communication module, such as a Bluetooth module, a 4G module, a 5G module, a Wi-Fi module, an NFC module, a data transmission interface, etc. The smart speaker 2 may establish an electrical connection with the first terminal through the communication module to facilitate data transmission between the two.

[0038] Step S102: When the smart speaker 2 is in the first state, the smart speaker 2 receives and saves the sound data set generated by the first terminal.

[0039] The first state may correspond to a good network signal. The sound data set may be a collection of a series of sound files or audio data, such as a playlist, and the audio data may be music, voice, sound effects, and the like.

[0040] In an embodiment of the present application, the first terminal may generate or select a sound data set and transmit the data set to the smart speaker 2 through the established electrical connection. When the smart speaker 2 is in a good network signal state, the smart speaker 2 may receive the sound data set and save the sound data set in an internal memory for subsequent use.

[0041] Step S103, when the smart speaker 2 is in the second state and the smart speaker 2 receives the first control instruction, the smart speaker 2 executes the corresponding playback strategy according to the sound data set.

[0042] The second state may correspond to a good network signal or a poor network signal. The first control instruction is generated by the smart speaker 2 and is used to instruct the smart speaker 2 to execute a corresponding playback strategy.

[0043] In the embodiment of the present application, since the smart speaker 2 has saved the sound data set in the first state, the smart speaker 2 can play according to the pre-saved sound data set regardless of the network status of the smart speaker 2. When receiving the first control instruction from the user (such as playing music, adjusting the volume, etc.), the smart speaker 2 can interpret the instruction and perform the corresponding operation according to the preset playback strategy.

[0044] In some application scenarios, such as camping in mountainous areas, users can bring their smart speaker 2 for entertainment. For example, they can play music while driving or sing karaoke while camping. When the user is in an area with a good network signal (such as an urban area), the user can first send a sound dataset to the smart speaker 2 using a first terminal (such as a smartphone). Due to the good network signal, the smart speaker 2 can successfully receive and save the sound dataset. When the user is on the road (the smart speaker 2 may be in the first or second state) or arrives in a mountainous area (the smart speaker 2 may be in the second state), the user can turn on the smart speaker 2. The smart speaker 2 can then receive the received sound dataset and prompt the user whether to interact with the music according to the sound dataset. When the user sends a first control command to the smart speaker 2 using a physical button on the smart speaker 2 or other means, the smart speaker 2 can receive the first control command and play the sound dataset according to the corresponding playback policy. This allows users to use the smart speaker 2 to play sound datasets even in mountainous areas with poor network signals, greatly improving the user experience in scenarios with poor network signals.

[0045] It is understood that the first state may also be a state that is not suitable for the speaker to operate, such as on an airplane or when starting a car. The second state may be a state that is suitable for the speaker to operate, such as when the plane arrives at the destination or the car is in a stable driving state. In the first state, the network communication signal may also be poor. In this case, audio files can be transmitted between the speaker and the first terminal via Bluetooth or a data cable.

[0046] The beneficial effects of the embodiments of the present application compared to the prior art are as follows: the embodiments of the present application establish an electrical connection with the first terminal via the smart speaker 2. When the smart speaker 2 is in a first state, the smart speaker 2 receives and stores a sound data set generated by the first terminal. When the smart speaker 2 is in a second state and receives a first control instruction, the smart speaker 2 executes a corresponding playback strategy based on the sound data set. In the embodiments of the present application, when the network signal is good, the smart speaker 2 can pre-receive and store the sound data set generated by the first terminal. Therefore, when the network signal is poor, the smart speaker 2 can play the sound files in the pre-stored sound data set without being affected by the network signal, thereby improving the user experience.

[0047] In some embodiments of the present application, the above-mentioned sound data set includes a playlist, sound files, and sound effect modes. When the smart speaker 2 is in the first state, the smart speaker 2 receives and saves the sound data set generated by the first terminal, which may specifically include steps S401 to S403.

[0048] A playlist is a collection of sound files, organized according to a theme or style, allowing users to play multiple sound files at once. Sound files contain audio data, such as music, voice, or other sound materials in formats like MP3 and WAV. Sound effects modes process or enhance sound files, changing their quality, volume, timbre, and other characteristics to achieve a specific auditory effect.

[0049] Step S401: The first terminal performs spectrum analysis on each sound file to obtain spectrum information of all sound files.

[0050] Among them, spectrum information can be used to describe the frequency characteristics of sound files, such as pitch, timbre, etc.

[0051] In the embodiments of the present application, the first terminal may have a built-in or call a professional audio processing library to perform spectrum analysis on the sound file. Specifically, the sound file may be converted from the time domain to the frequency domain, and the energy or amplitude of each frequency component may be calculated to obtain spectrum information, such as high frequency, medium frequency, and low frequency.

[0052] In step S402, the first terminal determines the sound effect mode of the playlist based on the spectrum information, and generates a sound data set by combining the playlist, the sound file, and the sound effect mode.

[0053] In an embodiment of the present application, the first terminal can analyze the overall audio characteristics of the sound files in the playlist based on the spectrum information, such as average pitch, timbre distribution, etc. Then, according to the analysis results, a suitable sound effect mode is selected to enhance or adjust the auditory effect of the playlist. Among them, the sound effect mode can be preset or dynamically generated based on the spectrum information. Then, the first terminal can associate and integrate the sound files in the playlist, the corresponding spectrum information and the determined sound effect mode to form a complete sound data set. The sound data set can include information such as the path of the sound file, spectrum information data and parameters of the sound effect mode.

[0054] Step S403: When the smart speaker 2 is in the first state, the smart speaker 2 receives and saves the sound data set generated by the first terminal.

[0055] In an embodiment of the present application, when the smart speaker 2 is in a first state with a good network signal, the smart speaker 2 can establish an electrical connection with the first terminal. The smart speaker 2 then receives the sound data set sent by the first terminal and stores it in its internal memory. At this point, the smart speaker 2 can subsequently play audio based on the sound data set when needed.

[0056] The present embodiment generates a sound dataset containing spectrum information and sound effect patterns by performing in-depth analysis and personalized processing of sound files. This helps improve the quality of audio playback and user experience, while also enabling the smart speaker 2 to intelligently play audio based on user preferences and scenario requirements even when offline.

[0057] It is understood that in some scenarios, when the sound data set includes multiple playlists, or multiple playlists are stored in the smart speaker 2, the smart speaker 2 can prompt the user to select a playlist through voice prompts or screen displays, or prompt the user to combine the playlists to obtain a combined playlist. When the smart speaker 2 receives the corresponding selection instruction from the user, it plays the corresponding playlist according to the selection instruction.

[0058] In some specific embodiments of the present application, when the smart speaker 2 is in the second state and receives the first control instruction, the smart speaker 2 executes the corresponding playback strategy according to the sound data set, and the above method may further include steps S501 to S503.

[0059] Step S501: The smart speaker 2 establishes an electrical connection with the smart microphone.

[0060] In the embodiment of the present application, the smart speaker 2 and the smart microphone can be electrically connected via a wireless connection (such as Bluetooth, Wi-Fi) or a wired connection (such as USB, audio cable). After the connection is established, the two can communicate with each other and transmit data.

[0061] Step S502: The first terminal or smart speaker 2 sends a playlist to the smart microphone.

[0062] In the embodiments of the present application, it is understood that a display screen may be provided on the microphone, and the user may use the display screen on the microphone to learn about the song or playlist currently being played by the smart speaker 2. Therefore, the first terminal or the smart speaker 2 may send the playlist to the smart microphone, and after receiving the playlist, the smart microphone may display the corresponding playlist information on its own display screen.

[0063] Step S503, when the smart speaker 2 receives the second control instruction sent by the smart microphone, the smart speaker 2 executes the corresponding control strategy according to the second control instruction.

[0064] Among them, the second control instruction is generated by the smart microphone and is used to instruct the smart speaker 2 to execute the corresponding control strategy.

[0065] In the embodiments of the present application, when a user wants to control smart speaker 2, they can use voice commands or touch controls to cause the smart microphone to generate a second control command. The second control command can include operations such as play, pause, skip, change sound effects, or mute. The smart microphone can send the second control command to smart speaker 2. After receiving the second control command from the smart microphone, smart speaker 2 can execute the corresponding control strategy based on the second control command, such as playing a specified song or adjusting the volume.

[0066] Specifically, in some specific embodiments of the present application, one or more function buttons may be provided on the smart microphone. When the function button on the smart microphone is triggered, the smart microphone may generate a corresponding second control instruction to control the smart speaker 2 to execute the corresponding control strategy.

[0067] For example, the smart microphone can be equipped with a one-touch switch button. When the user presses the one-touch switch button, the function and mode of the smart speaker 2 can be switched with one click. In addition, the smart microphone can also be equipped with a sound effect selection button. When the user presses and holds or clicks the sound effect selection button, the smart microphone can generate corresponding control instructions to control the smart speaker 2 to switch the sound effect. The smart microphone can also be equipped with a mute button. When the user presses and holds or clicks the mute button, the smart microphone or smart speaker 2 can be muted to prevent howling.

[0068] In addition, the smart microphone can also be equipped with a voice control module that can collect and analyze the user's voice commands and generate corresponding control instructions to control the smart speaker 2. Furthermore, the smart microphone can also be equipped with a motion control module that can collect its own posture and motion information in real time and generate corresponding control instructions to control the sound effects, lighting, and playlist switching of the smart speaker 2. For example, if the user uses the smart microphone to draw a circle, the smart speaker 2 will play the next song, and if the user uses the smart microphone to draw a cross, the smart speaker 2 will play the previous song.

[0069] The implementation method of the present application realizes the collaborative work between the smart speaker 2, the smart microphone and the first terminal, further enriching the functions and application scenarios of multi-device interaction.

[0070] When the user wants to use the smart speaker 2 in the car, the smart speaker 2 can be linked with the car audio to obtain a better playback effect. Figure 3 and Figure 4As shown, the above system also includes a second terminal, which is a vehicle-mounted terminal 1, and the second terminal is the same as or different from the first terminal. When the smart speaker 2 is in the second state and the smart speaker 2 receives the first control instruction, the smart speaker 2 executes the corresponding playback strategy according to the sound data set. The above method can also include steps S601 to S605.

[0071] Step S601: The second terminal establishes an electrical connection with the smart speaker 2.

[0072] In the embodiment of the present application, the vehicle terminal 1 (ie, the second terminal) can establish a connection with the smart speaker 2 via Bluetooth, Wi-Fi or other wireless communication technologies. Once the connection is established, the two can communicate with each other and transmit data.

[0073] In step S602, after the second terminal receives the third control instruction, the second terminal obtains the first location information of the smart speaker 2 and the second location information of the vehicle audio system on the vehicle corresponding to the second terminal.

[0074] Among them, the third control instruction is generated by the second terminal and is used to instruct the smart speaker 2 and the car audio to adjust the corresponding playback characteristics.

[0075] In an embodiment of the present application, a user may issue a third control instruction through the control interface of the second terminal or a voice command to adjust the playback characteristics of the smart speaker 2 and the vehicle audio system. After receiving the third control instruction, the second terminal may obtain the location information of the vehicle and the smart speaker 2 through a location module such as GPS or internal vehicle sensors.

[0076] Step S603: The second terminal generates a first control parameter and a second control parameter according to the first location information and the second location information.

[0077] In an embodiment of the present application, the second terminal can calculate the relative position relationship between the smart speaker 2 and the car audio based on the acquired position information, and generate corresponding control parameters based on the relative position relationship, which may include volume, sound quality adjustment, balance setting, etc., to achieve balanced distribution of sound in the car space and optimal auditory effect.

[0078] In step S604, the second terminal sends the first control parameter to the smart speaker 2, so that the smart speaker 2 adjusts the playback characteristics of the smart speaker 2 according to the first control parameter.

[0079] In an embodiment of the present application, the second terminal can send the first control parameter to the smart speaker 2 through the established electrical connection. After receiving the parameters, the smart speaker 2 adjusts its playback characteristics according to these parameters, such as increasing or decreasing the volume, increasing the playback power, etc., to adapt to the needs of the in-car environment.

[0080] In step S605, the second terminal sends the second control parameter to the car audio system, so that the car audio system adjusts the playing characteristics of the car audio system according to the second control parameter.

[0081] In an embodiment of the present application, the second terminal may send the second control parameters to the car audio system. After receiving the second control parameters, the car audio system may adjust its playback characteristics according to these parameters, such as increasing or decreasing the volume, increasing the playback power, etc., to ensure that it is coordinated with the sound output of the smart speaker 2 to create a comfortable listening experience.

[0082] The embodiments of this application can achieve the coordinated operation of the smart speaker 2 and the car audio in the car environment, adjust the playback characteristics according to the position relationship between the vehicle and the smart speaker 2, and obtain a better listening experience. It optimizes the distribution of sound in the car space and the sound quality performance.

[0083] It is understandable that, in addition to Figure 3 In addition to the connection relationships between the devices shown, each device can transmit information with other devices.

[0084] In the related art, when a user wants to sing karaoke in a moving car, the sound produced by the karaoke will affect the driver's driving of the vehicle, posing a safety hazard. In view of this, in some specific embodiments of the present application, such as Figure 3 and Figure 4 As shown, the above system also includes a second terminal, which is a vehicle-mounted terminal 1, and the second terminal is the same as or different from the first terminal. When the smart speaker 2 is in the second state and the smart speaker 2 receives the first control instruction, the smart speaker 2 executes the corresponding playback strategy according to the sound data set. The above method can also include steps S701 to S703.

[0085] Step S701: The second terminal establishes an electrical connection with the smart speaker 2.

[0086] In the embodiment of the present application, the vehicle terminal 1 (second terminal) can establish a connection with the smart speaker 2 via Bluetooth, Wi-Fi or other wireless communication technologies. Once the connection is established, the two can communicate with each other and transmit data.

[0087] Step S702: After the second terminal receives the fourth control instruction, the second terminal receives the in-car sound information collected by the smart speaker 2.

[0088] The sound information includes phase and loudness.

[0089] In an embodiment of the present application, a user may issue a fourth control command through the interactive interface or voice command of the second terminal to activate the noise cancellation function. At this point, the microphone built into or connected to the smart speaker 2 may begin collecting in-vehicle sound information, including the phase and loudness of the sound, and transmit this information to the second terminal. The second terminal may then receive the in-vehicle sound information collected by the smart speaker 2.

[0090] In step S703, the second terminal generates playback parameters based on the phase and loudness, and sends the playback parameters to the smart speaker 2, so that the smart speaker 2 emits corresponding sound waves to offset the sound corresponding to the sound information in the car.

[0091] In the embodiments of the present application, after receiving the sound information, the second terminal can use a noise cancellation algorithm to calculate and generate playback parameters based on the phase and loudness of the sound. The second terminal transmits the playback parameters to the smart speaker 2 via the established electrical connection. After receiving the parameters, the smart speaker 2 can adjust its sound output accordingly, emitting sound waves with opposite phase and equal loudness to the noise inside the vehicle. These sound waves can cancel out the noise inside the vehicle, effectively reducing or eliminating the noise and improving the comfort of the vehicle interior.

[0092] The implementation methods of the present application can effectively eliminate the noise inside the car, improve the quietness of the car environment, eliminate the safety hazards caused by the noise generated by karaoke during driving, and improve the user experience.

[0093] When users use multiple smart speakers 2 outdoors, they often do not know how to place these smart speakers 2, resulting in poor playback effect. In view of this, in some specific implementations of this application, such as Figure 3 As shown, the above system also includes a second terminal, which is a vehicle-mounted terminal 1, and the second terminal is the same as or different from the first terminal. When the smart speaker 2 is in the second state and the smart speaker 2 receives the first control instruction, the smart speaker 2 executes the corresponding playback strategy according to the sound data set. The above method can also include steps S801 to S804.

[0094] Step S801: The second terminal establishes an electrical connection with the smart speaker 2.

[0095] In the embodiment of the present application, the vehicle terminal 1 (second terminal) can establish a connection with the smart speaker 2 via Bluetooth, Wi-Fi or other wireless communication technologies. Once the connection is established, the two can communicate with each other and transmit data.

[0096] In step S802 , the second terminal obtains the current smart speaker 2 location information, smart speaker 2 device information, and environmental information collected by the smart speaker 2 of all smart speakers 2 .

[0097] In the embodiments of the present application, the second terminal can obtain the current location information of the smart speaker 2 through the positioning module of the smart speaker 2 or other positioning technology. Device information can also be obtained by querying the built-in information of the smart speaker 2 or communicating with it. Environmental information can also be obtained through environmental sensors or data collected by the smart speaker 2. Specifically, the smart speaker 2 can emit detection sound waves in all directions. Obstacles around the smart speaker 2 reflect the detection sound waves back. The smart speaker 2 receives these reflected sound waves and uses them to calculate information such as the distance and size of the surrounding obstacles. Then, the surrounding environmental information is determined based on the obstacle information.

[0098] In step S803, the second terminal calculates the optimal placement position information of each smart speaker 2 and the user's optimal standing position A based on the current smart speaker 2 position information, smart speaker 2 device information, and environmental information.

[0099] In an embodiment of the present application, the second terminal can use an algorithm to analyze and process the collected information to calculate the optimal placement position and the user's standing position a. Specifically, the second terminal can obtain the correspondence between the preset environmental information and the placement position of the smart speaker 2, and then generate the initial placement position information of each smart speaker 2 based on the correspondence, the position information of the smart speaker 2, and the environmental information. The initial placement position information of each smart speaker 2 is then adjusted based on the device information of the smart speaker 2 to obtain the optimal placement position information of each smart speaker 2. Finally, the optimal standing position can be calculated based on the optimal placement position information of each smart speaker 2 and the preset correspondence between the speaker position and the standing position.

[0100] Step S804: The second terminal generates corresponding prompt information according to the optimal placement position information and the user's optimal standing position A.

[0101] like Figure 5 As shown, in the implementation mode of the present application, after calculating the optimal placement position information of each smart speaker 2 and the user's optimal standing position A, the second terminal can generate corresponding image prompt information on the interactive interface, and can also generate corresponding voice prompt information and play it through the car audio, and can also project relevant prompt information through digital laser lights, windshield projectors, car projectors, etc.

[0102] In some more specific embodiments of the present application, after calculating the optimal placement position information of the smart speaker 2 and the user's optimal standing position A, the above method may further include steps S901 to S903.

[0103] Step S901: The second terminal establishes an electrical connection with the smart microphone.

[0104] In step S902, the second terminal obtains the movement trajectory of the smart microphone and calculates the adjustment parameters for the smart speaker 2 based on the movement trajectory.

[0105] In step S903, the second terminal generates a fifth control instruction according to the adjustment parameters, and sends the fifth control instruction to the smart speaker 2, so that the smart speaker 2 adjusts the parameters according to the fifth control instruction.

[0106] Among them, the fifth control finger is generated by the second terminal and is used to instruct the smart speaker 2 to adjust parameters.

[0107] In an embodiment of the present application, the second terminal can establish a stable electrical connection with the smart microphone via Bluetooth, Wi-Fi, or other wireless communication technologies. This connection allows the second terminal to exchange data and transmit commands with the smart microphone. It is understood that the smart microphone can be equipped with a positioning module that can record its movement trajectory in real time. The second terminal can obtain this trajectory data through the electrical connection and, based on the movement trajectory of the smart microphone, use a built-in algorithm to calculate adjustment parameters that can optimize the sound effect and adjust the directionality of the smart speaker 2, and generate a fifth control instruction. Specifically, the second terminal can identify the user's movement pattern, such as speed and direction of movement, and calculate the optimal directionality settings for the smart speaker 2 based on the user's movement pattern and current environment. Specifically, this includes adjusting the speaker's beamforming direction and calculating volume and equalization adjustments to ensure a clear voice signal regardless of the user's location. The fifth control instruction may include adjusting volume, adjusting power, changing equalization settings, optimizing directionality control, etc. The second terminal can send these instructions to the smart speaker 2 via the previously established electrical connection. After receiving the fifth control instruction, the smart speaker 2 can make corresponding parameter adjustments based on the instruction content. This can include adjusting the speaker's directivity to better cover the user's position, or optimizing the sound effects to improve sound quality and clarity.

[0108] In some embodiments of the present application, after the smart speaker 2 receives the first control instruction and executes the corresponding playback strategy according to the sound data set, the method may further include the following steps:

[0109] When the smart speakers 2 receive the sixth control instruction, different smart speakers 2 execute corresponding playback strategies according to the corresponding sixth control instruction.

[0110] like Figure 6As shown, in the embodiment of the present application, in the use scenario of multiple smart speakers 2, the smart terminal (such as a smart microphone, a first terminal, a second terminal, etc.) can send control instructions to different smart speakers 2 respectively, and after receiving the sixth control instruction, different smart speakers 2 can execute different playback strategies to achieve mutual cooperation between multiple smart speakers 2 and achieve the best playback experience. For example, when the sixth control instruction is to switch to a live effect, after different smart speakers 2 receive the sixth control instruction, the sound files played or the playback parameters played by smart speakers 2 in different locations are different, thereby achieving a live playback effect.

[0111] In another embodiment of the present application, a multi-device intelligent interaction system is proposed, which includes: an intelligent speaker 2, an intelligent microphone and a first terminal.

[0112] The smart speaker 2 is used to establish an electrical connection with the first terminal.

[0113] The smart speaker 2 is further configured to receive and store the sound data set generated by the first terminal.

[0114] When the smart speaker 2 receives the first control instruction, the smart speaker 2 is further configured to execute a corresponding playback strategy according to the sound data set.

[0115] The beneficial effects of the embodiments of the present application compared to the prior art are as follows: the embodiments of the present application establish an electrical connection with the first terminal via the smart speaker 2. When the smart speaker 2 is in a first state, the smart speaker 2 receives and stores a sound data set generated by the first terminal. When the smart speaker 2 is in a second state and receives a first control instruction, the smart speaker 2 executes a corresponding playback strategy based on the sound data set. In the embodiments of the present application, when the network signal is good, the smart speaker 2 can pre-receive and store the sound data set generated by the first terminal. Therefore, when the network signal is poor, the smart speaker 2 can play the sound files in the pre-stored sound data set without being affected by the network signal, thereby improving the user experience.

[0116] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0117] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it can implement the steps in the above-mentioned multi-device intelligent interaction method.

[0118] An embodiment of the present application provides a computer program product, which, when executed on a mobile terminal, enables the mobile terminal to implement the steps in the above-mentioned multi-device intelligent interaction method.

[0119] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0120] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0121] In the embodiments provided in this application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0122] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0123] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0124] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the process in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0125] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A multi-device intelligent interaction method, characterized in that: The multi-device intelligent interaction method is applied to a multi-device intelligent interaction system, the system comprising: an intelligent speaker, an intelligent microphone and a first terminal, and the method comprises: The smart speaker establishes an electrical connection with the first terminal; When the smart speaker is in the first state, the smart speaker receives and stores the sound data set generated by the first terminal; When the smart speaker is in the second state and receives a first control instruction, the smart speaker executes a corresponding playback strategy according to the sound data set.

2. The multi-device intelligent interaction method according to claim 1, characterized in that: The sound data set includes a playlist, a sound file, and a sound effect mode. When the smart speaker is in the first state, the smart speaker receives and saves the sound data set generated by the first terminal, including: The first terminal performs spectrum analysis on each of the sound files to obtain spectrum information of all the sound files; The first terminal determines the sound effect mode of the song list according to the spectrum information, and generates the sound data set by combining the song list, the sound file and the sound effect mode; When the smart speaker is in the first state, the smart speaker receives and saves the sound data set generated by the first terminal.

3. The multi-device intelligent interaction method according to claim 2, characterized in that: When the smart speaker is in the second state and receives the first control instruction, after the smart speaker executes the corresponding playback strategy according to the sound data set, the method further includes: The smart speaker is electrically connected to the smart microphone; The first terminal or the smart speaker sends the song list to the smart microphone; When the smart speaker receives the second control instruction sent by the smart microphone, the smart speaker executes the corresponding control strategy according to the second control instruction.

4. The multi-device intelligent interaction method according to claim 1, characterized in that: The system further includes a second terminal, the second terminal is a vehicle-mounted terminal, and the second terminal is the same as or different from the first terminal. When the smart speaker is in the second state and receives the first control instruction, after the smart speaker executes the corresponding playback strategy according to the sound data set, the method further includes: The second terminal establishes an electrical connection with the smart speaker; When the second terminal receives the third control instruction, the second terminal obtains the first location information of the smart speaker and the second location information of the vehicle audio system on the vehicle corresponding to the second terminal; The second terminal generates a first control parameter and a second control parameter according to the first location information and the second location information; The second terminal sends the first control parameter to the smart speaker, so that the smart speaker adjusts the playback characteristics of the smart speaker according to the first control parameter; The second terminal sends the second control parameter to the vehicle audio system, so that the vehicle audio system adjusts the playing characteristics of the vehicle audio system according to the second control parameter.

5. The multi-device intelligent interaction method according to claim 1, characterized in that: The system further includes a second terminal, the second terminal is a vehicle-mounted terminal, and the second terminal is the same as or different from the first terminal. When the smart speaker is in the second state and receives the first control instruction, after the smart speaker executes the corresponding playback strategy according to the sound data set, the method further includes: The second terminal establishes an electrical connection with the smart speaker; When the second terminal receives the fourth control instruction, the second terminal receives the in-vehicle sound information collected by the smart speaker, where the sound information includes phase and loudness; The second terminal generates a playback parameter according to the phase and the loudness, and sends the playback parameter to the smart speaker, so that the smart speaker emits a corresponding sound wave to offset the sound corresponding to the in-vehicle sound information.

6. The multi-device intelligent interaction method according to claim 1, characterized in that: The system further includes a second terminal, the second terminal is a vehicle-mounted terminal, and the second terminal is the same as or different from the first terminal. When the smart speaker is in the second state and receives the first control instruction, after the smart speaker executes the corresponding playback strategy according to the sound data set, the method further includes: The second terminal establishes an electrical connection with the smart speaker; The second terminal obtains current smart speaker location information, smart speaker device information, and environmental information collected by the smart speakers of all the smart speakers; The second terminal calculates the optimal placement position information of each smart speaker and the optimal standing position of the user according to the current smart speaker position information, the smart speaker device information and the environmental information; The second terminal generates corresponding prompt information according to the optimal placement position information and the user's optimal standing position.

7. The multi-device intelligent interaction method according to claim 6, characterized in that: After calculating the optimal placement position information of the smart speaker and the optimal standing position of the user, the method further includes: The second terminal establishes an electrical connection with the smart microphone; The second terminal obtains a moving trajectory of the smart microphone, and calculates an adjustment parameter for the smart speaker according to the moving trajectory; The second terminal generates a fifth control instruction according to the adjustment parameter, and sends the fifth control instruction to the smart speaker, so that the smart speaker adjusts the parameters according to the fifth control instruction.

8. The multi-device intelligent interaction method according to claim 1, characterized in that: After the smart speaker executes a corresponding playback strategy according to the sound data set when the smart speaker receives the first control instruction, the method further includes: When the smart speakers receive the sixth control instruction, different smart speakers execute corresponding playback strategies according to the corresponding sixth control instruction.

9. A multi-device intelligent interactive system, characterized in that: The system includes: a smart speaker, a smart microphone and a first terminal; The smart speaker is used to establish an electrical connection with the first terminal; The smart speaker is also used to receive and save the sound data set generated by the first terminal; When the smart speaker receives the first control instruction, the smart speaker is further configured to execute a corresponding playback strategy according to the sound data set.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the multi-device intelligent interaction method as described in any one of claims 1 to 8 are implemented.