AI intelligent loudspeaker box and interaction system

Abstract

The invention belongs to the technical field of intelligent sound boxes, and particularly relates to an AI intelligent sound box and an interaction system, the AI intelligent sound box comprises a shell, and a control button and a data interface which are arranged at the side edge of the shell, the front surface of the shell is provided with sound outlet holes, and the back surface of the shell is provided with heat dissipation holes; the shell is internally and correspondingly provided with a microphone array, a loudspeaker unit, a processor, a memory and a communication module, the device has a more natural voice cloning effect, and by adopting an advanced deep learning technology, the device can accurately capture and reproduce fine features, including intonations, emotions and rhythms, of human voice, so that the human voice can be accurately cloned. And more natural and real voice interaction experience is provided.

Description

Technical Field

[0001] The present invention belongs to the technical field of smart speakers, and in particular relates to an AI smart interactive speaker and system. Background Art

[0002] With the rapid development of artificial intelligence technology, AI smart speakers have become an important part of the smart home field. These devices interact with users through voice recognition and natural language processing technology, providing multiple functions such as music playback, information query, and smart home control.

[0003] Although there are some speakers on the market that can imitate the voices of specific people, these speakers can usually only achieve simple voice output and lack in-depth learning and imitation of voice characteristics, resulting in insufficient naturalness and personalization of the voice. Most AI speakers use preset voice templates and fixed tones when interacting with users. They lack flexibility and personalization and cannot make corresponding adjustments based on the user's emotions and context. Although some speakers try to connect to large AI models to improve their intelligence, there are often problems such as poor model adaptability and slow response speed, which affects the overall performance of the speaker and user experience. When smart speakers collect and process user voice data, they may cause privacy leakage and data security issues, and users are concerned about the security and privacy protection of the speakers. Summary of the invention

[0004] In view of the above-mentioned deficiencies in the prior art, the present invention provides an AI intelligent interactive speaker and system to solve the above-mentioned existing problems.

[0005] In order to solve the above technical problems, the present invention adopts the following technical solutions:

[0006] An AI smart speaker comprises a shell and a control button arranged on the side of the shell, a speaker cover is installed above the shell, a speaker unit is installed at the connection between the inner bottom of the speaker cover and the shell, and a microphone array, a processor, a memory and a communication module are correspondingly installed in the shell.

[0007] Furthermore, the microphone array is used to capture the user's voice input.

[0008] Furthermore, the speaker unit is used to output the sound of the speaker clone.

[0009] Furthermore, the processor is used to run sound cloning and interaction algorithms.

[0010] Furthermore, the memory is used to store model parameters and user data

[0011] Furthermore, the communication module is used for exchanging data with external devices.

[0012] An interactive system of an AI smart speaker includes the following modules:

[0013] A speech recognition module, used to convert the user's voice commands into processable text information;

[0014] A voice cloning module that generates speech output similar to a specific human voice;

[0015] Emotion recognition module, used to analyze the emotional state in the user's voice;

[0016] The context analysis module is used to understand the context of user instructions.

[0017] Compared with the prior art, the present invention has the following beneficial effects:

[0018] 1. The present invention has a more natural voice cloning effect. By adopting advanced deep learning technology, the present invention can accurately capture and reproduce the subtle features of human voice, including intonation, emotion and rhythm, and provide a more natural and realistic voice interaction experience;

[0019] 2. The present invention has a highly personalized interactive experience. The built-in emotion recognition and context analysis module of the speaker can intelligently adjust the output voice, make personalized responses according to the user's emotions and context, and enhance the user's interactive experience;

[0020] 3. The present invention accesses and runs an efficient AI large model. The model compression and acceleration algorithm significantly improves the operating efficiency of the AI ​​large model, reduces resource consumption, and ensures the rapid response and smooth operation of the speaker;

[0021] 4. The present invention strengthens privacy protection and data security. By implementing end-to-end encryption technology and user-controllable privacy settings, the present invention enhances the security of user data and improves user trust in the product;

[0022] 5. The present invention optimizes the hardware design. The hardware components of the speaker are carefully designed, including a high-sensitivity microphone array and a high-fidelity speaker unit, ensuring high quality of voice input and output;

[0023] 6. The present invention has scalability and compatibility, and the software architecture has good scalability, can adapt to the development and update of future technologies, and is compatible with a variety of smart home devices and platforms;

[0024] 7. The present invention is user-friendly, and the speaker provides an intuitive and easy-to-use operation interface, allowing users to easily set and control various functions of the speaker, thereby improving the usability of the product;

[0025] 8. The present invention adopts energy-saving hardware design and software optimization, which reduces energy consumption and prolongs the service life of the product;

[0026] 9. The present invention supports customized voice cloning services, provides users with personalized voice selection, and opens up new business models and market opportunities. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 This is a schematic diagram of the three-dimensional structure of an AI intelligent interactive speaker embodiment of the present invention;

[0028] Figure 2 This is a network configuration flow chart of an AI intelligent interactive speaker embodiment of the present invention;

[0029] Figure 3 This is a WiFi and Bluetooth connection flow chart of an AI smart interactive speaker embodiment of the present invention;

[0030] Figure 4 This is a user interaction flow chart of an AI intelligent interactive speaker embodiment of the present invention;

[0031] The reference numerals in the drawings of the specification include:

[0032] Shell 1, control button 2, speaker cover 3. DETAILED DESCRIPTION

[0033] In order to enable those skilled in the art to better understand the present invention, the technical solution of the present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0034] Among them, the drawings are only used for illustrative explanations, and they only represent schematic diagrams rather than actual pictures, and should not be understood as limitations on this patent; in order to better illustrate the embodiments of the present invention, some parts of the drawings may be omitted, enlarged or reduced, and do not represent the size of the actual product; for those skilled in the art, it is understandable that some well-known structures and their descriptions in the drawings may be omitted.

[0035] Example:

[0036] Embodiment 1

[0037] Basic configuration and operation

[0038] Hardware configuration: The AI ​​smart speaker of this embodiment includes the following main components:

[0039] Highly sensitive microphone array for capturing user voice commands.

[0040] High-fidelity speaker unit for outputting the sound of speaker clones.

[0041] Powerful processors for running deep learning models and processing voice data.

[0042] Large capacity memory for storing user data and model parameters.

[0043] Stable communication module for data exchange with other devices in the smart home system.

[0044] Software configuration: The speaker software includes the following modules:

[0045] The speech recognition module is used to convert the user's voice commands into processable text information.

[0046] A voice cloning module that generates speech output similar to a specific human voice.

[0047] Emotion recognition module, used to analyze the emotional state in user speech.

[0048] The context analysis module is used to understand the context of user instructions.

[0049] How it works: The user issues a voice command to the speaker, the microphone array captures the sound signal, and the speech recognition module converts it into text. The voice cloning module generates the corresponding voice output based on the user's command and the analysis results of the emotion recognition module. The context analysis module ensures that the speaker can correctly understand the context of the command and make an appropriate response.

[0050] User interaction: The speaker interacts with the user through the voice output by the sound cloning module. According to the results of emotion recognition and context analysis, the tone, rhythm and emotional expression of the voice are adjusted to achieve a personalized interactive experience.

[0051] Privacy protection: The speaker uses end-to-end encryption technology when processing user voice data to ensure data security. Users can manage their privacy preferences and data access permissions through the speaker's settings interface.

[0052] Embodiment 2

[0053] Advanced Personalization

[0054] User-defined sound cloning: Users can upload their own sound samples through the speaker's settings interface. The speaker's sound cloning module will learn these samples and generate user-defined sound clones.

[0055] Intelligent learning and adaptation: During the interaction with the user, the speaker continuously learns the user's voice habits and preferences, and automatically adjusts the parameters of the sound cloning module to provide more personalized voice output.

[0056] Multi-scenario application: The speaker can adjust its interaction mode and sound output according to different usage scenarios (such as home, office, etc.) to adapt to different environments and user needs.

[0057] Smart device linkage: The speaker can be linked with other devices in the smart home system (such as lights, temperature controllers, etc.) to automatically adjust the settings of home devices based on the user's voice commands or environmental changes.

[0058] Embodiment 3

[0059] Enhanced security and privacy

[0060] Multi-layer encryption technology: The speaker uses multi-layer encryption technology when processing and transmitting user data, including data encryption, communication encryption and storage encryption to ensure data security.

[0061] User data control: Users can view and manage their own data through the speaker’s settings interface, including data access, storage, and deletion.

[0062] Regular security updates: The speaker's software receives regular security updates to address new security threats and vulnerabilities.

[0063] User education and notifications: The speaker will regularly send security notifications and privacy protection tips to users to educate them on how to use the speaker safely and protect their privacy.

[0064] The above embodiments all adopt the following technologies:

[0065] Voice cloning technology: This invention uses a deep learning-based neural network model that can learn and imitate the voiceprint characteristics of a specific person's voice, including pitch, timbre, speaking speed, and emotional expression. Through training, the model can generate highly realistic voice clones for interaction with users;

[0066] Personalized interaction algorithm: The speaker has built-in emotion recognition and context analysis modules, which can intelligently adjust the tone, rhythm and emotional expression of the output voice according to the user's voice input and environmental information, achieving more natural and personalized interaction;

[0067] Optimized access to large AI models: In order to improve the operating efficiency of large AI models, the present invention designs a model compression and acceleration algorithm that can reduce the model's computing resource requirements while maintaining model performance and achieve rapid response; Privacy protection mechanism: The speaker uses end-to-end encryption technology to ensure the security of all voice data during transmission and storage. At the same time, it provides user-controllable data deletion and privacy setting functions to enhance user confidence in privacy protection.

[0068] Hardware composition of the present invention: The AI ​​smart speaker of the present invention includes a microphone array, a speaker unit, a processor, a memory and a communication module. The microphone array is used to capture the user's voice input, the processor is responsible for running the sound cloning and interaction algorithm, the memory is used to store model parameters and user data, and the communication module is responsible for data exchange with external devices.

[0069] Working principle: Users interact with the speaker through voice commands. After the microphone array captures the voice signal, the neural network model in the processor analyzes and processes the signal, generates the corresponding sound clone and interactive response, and outputs it through the speaker. At the same time, the processor will continuously optimize the interaction algorithm according to the user's usage habits and environmental information to improve the personalization of the interaction.

[0070] Model method of the present invention

[0071] Model training: The neural network model is trained using a large number of human voice samples, including voices of different genders, ages, and accents, to improve the generalization ability of the model.

[0072] Algorithm optimization: Through continuous algorithm iteration and optimization, the model's running speed and accuracy are improved while reducing resource consumption.

[0073] Security testing: Regularly test and update the speaker’s privacy protection mechanism to ensure it can resist the latest security threats.

[0074] Software program of the present invention

[0075] Program description: The software part of the speaker includes speech recognition module, voice cloning module, emotion recognition module and context analysis module. These modules realize the core functions of the speaker through specific algorithms and data processing processes.

[0076] Technical features: The technical features of the program include efficient signal processing algorithms, advanced deep learning models, intelligent interaction logic, and strong privacy protection measures.

[0077] Through the above technical solution, the AI ​​smart speaker of the present invention can not only provide high-quality sound cloning and personalized interactive experience, but also ensure the security and privacy of user data, meeting the needs of the modern smart home market.

[0078] The above are only embodiments of the present invention. The common knowledge such as the known specific structures and characteristics in the scheme is not described in detail here. The ordinary technicians in the relevant field are aware of all the common technical knowledge in the technical field of the invention before the application date or priority date, can obtain all the existing technologies in the field, and have the ability to apply the conventional experimental means before that date. The ordinary technicians in the relevant field can improve and implement the scheme in combination with their own abilities under the enlightenment given by this application. Some typical known structures or known methods should not become obstacles for the ordinary technicians in the relevant field to implement this application. It should be pointed out that for the technicians in this field, without departing from the structure of the present invention, several deformations and improvements can be made, which should also be regarded as the protection scope of the present invention, and these will not affect the effect of the implementation of the present invention and the practicality of the patent.

[0079] The same or similar numbers in the drawings of the embodiments of the present invention correspond to the same or similar parts; in the description of the present invention, it should be understood that if the terms "upper", "lower", "left", "right", "inner", "outer", etc. appear, the orientation or position relationship indicated is based on the orientation or position relationship shown in the drawings, which is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, the terms describing the position relationship in the drawings are only used for illustrative purposes and cannot be understood as a limitation on this patent. For ordinary technicians in this field, the specific meanings of the above terms can be understood according to specific circumstances.

[0080] In the description of the present invention, unless otherwise clearly specified and limited, if the term "connection" or the like appears to indicate the connection relationship between components, the term should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two components or the interaction relationship between two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

Claims

1. An AI smart speaker, characterized in that: It includes a shell and a control button arranged on the side of the shell, a sound box cover is installed above the shell, a speaker unit is installed at the connection between the inner bottom of the sound box cover and the shell, and a microphone array, a processor, a memory and a communication module are installed correspondingly in the shell.

2. The AI ​​smart speaker according to claim 1, characterized in that: The microphone array is used to capture the user's voice input.

3. An AI smart speaker as claimed in claim 2, characterized in that: The speaker unit is used to output the sound of the speaker clone.

4. The AI ​​smart speaker according to claim 3, characterized in that: The processor is used to run the sound cloning and interaction algorithms.

5. The AI ​​smart speaker according to claim 4, characterized in that: The memory is used to store model parameters and user data.

6. An AI smart speaker as claimed in claim 5, characterized in that: The communication module is used for exchanging data with external devices.

7. The interactive system of an AI smart speaker according to claim 6, characterized in that: Includes the following modules: A speech recognition module, used to convert the user's voice commands into processable text information; A voice cloning module that generates speech output similar to a specific human voice; Emotion recognition module, used to analyze the emotional state in the user's voice; The context analysis module is used to understand the context of user instructions.

Images