Interaction method, device and system, sound classification model training method and automobile
By detecting the user's blowing interaction instructions in the in-car simulation scenario, using the sound classification model and the face recognition model to switch or control different scenarios, the problem that users cannot interact through blowing in special scenarios is solved, and a more flexible and intuitive human-vehicle interaction experience is achieved.
Patent Information
- Application Number
- CN202311382940.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-24
- Publication Date
- 2025-04-25
AI Technical Summary
The prior art cannot meet the user's need to interact with the in-vehicle simulation scenario in special scenarios. For example, in the simulation scenario where the candle is blown out, the user cannot interact with the interactive interface through blowing.
By responding to user operations, the first scene data is called and sent to the execution terminal. When the user's blowing interaction instruction is detected, the second scene data is called, and the sound classification model and the face recognition model are used to judge the blowing interaction instruction, so as to realize switching or control of different scenes.
It realizes a more flexible and intuitive human-vehicle interaction experience, can accurately judge users' blowing interactive instructions, and improves driving safety and user experience.
Smart Images

Figure CN119882986A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of automobile intelligent interaction, and specifically relates to an interaction method, device, system, sound classification model training method and automobile. Background Art
[0002] With the rapid development and popularization of smart cars, users' demands for vehicle interactive functions are becoming more and more diversified. Currently, traditional interactive methods generally include touch, voice, gestures, etc., which cannot meet users' needs for realism in some special scenarios. For example, in the simulation scene of blowing out candles, users cannot interact with the virtual scene in the interactive interface by blowing. Summary of the invention
[0003] In view of the above-mentioned shortcomings of the prior art, an object of the present invention is to provide an interaction method, device, system, sound classification model training method and car that can interact with a simulated scene in a car by blowing air.
[0004] To achieve the above object and other related objects, the present invention provides an interaction method, comprising the following steps:
[0005] In response to a user operation, calling first scene data, wherein the first scene data at least includes a first visual interaction interface;
[0006] Sending the first scene data to an execution terminal, wherein the execution terminal at least includes a display screen;
[0007] Determine whether a blowing interaction instruction of the user is detected;
[0008] When the blowing interaction instruction is detected, calling second scene data, wherein the second scene data at least includes a second visual interaction interface;
[0009] The second scene data is sent to the execution terminal.
[0010] In an optional embodiment of the present invention, the first scene data further includes at least one of first audio data and first lighting control data; and the execution terminal further includes at least one of a speaker and a lamp.
[0011] In an optional embodiment of the present invention, the second scene data further includes at least one of second audio data and second lighting control data; and the execution terminal further includes at least one of a speaker and a lamp.
[0012] In an optional embodiment of the present invention, the step of determining whether a blowing interaction instruction of the user is detected includes:
[0013] Get the audio data collected by the microphone;
[0014] Inputting the audio data into a sound classification model to determine whether there is a blowing sound in the audio data;
[0015] If there is a blowing sound, it is determined that a blowing interaction instruction of the user is detected.
[0016] In an optional embodiment of the present invention, the step of determining whether a blowing interaction instruction of the user is detected includes:
[0017] Obtain audio data collected by the microphone and user facial image data collected by the camera;
[0018] Inputting the audio data into a sound classification model to determine whether there is a blowing sound in the audio data;
[0019] Inputting the user's facial image data into a face recognition model to determine whether the user's face is facing a target direction;
[0020] When there is a blowing sound and the user's face is facing the target direction, it is determined that the user's blowing interaction instruction is detected.
[0021] In an optional embodiment of the present invention, the sound classification model is obtained by the following method:
[0022] Acquire an audio sample and a classification label corresponding to the audio sample, wherein the audio sample at least includes blowing sound data mixed with environmental noise;
[0023] Inputting the audio sample into a sound classification model to be trained to obtain a classification result;
[0024] Calculate the loss value according to the classification result and the classification label;
[0025] The parameters of the model are updated according to the loss value until the loss value is less than a preset threshold, thereby obtaining the sound classification model.
[0026] To achieve the above purpose and other related purposes, the present invention also provides a sound classification model training method, comprising the following steps:
[0027] Acquire an audio sample and a classification label corresponding to the audio sample, wherein the audio sample at least includes blowing sound data mixed with environmental noise;
[0028] Inputting the audio sample into a sound classification model to be trained to obtain a classification result;
[0029] Calculate the loss value according to the classification result and the classification label;
[0030] The parameters of the model are updated according to the loss value until the loss value is less than a preset threshold, thereby obtaining a sound classification model.
[0031] To achieve the above-mentioned object and other related objects, the present invention further provides an interactive device, comprising:
[0032] A first scene calling module, used to respond to a user operation and call first scene data, wherein the first scene data at least includes a first visual interaction interface;
[0033] A first scene execution module, used to send the first scene data to an execution terminal, wherein the execution terminal at least includes a display screen;
[0034] An interaction determination module, used to determine whether a blowing interaction instruction of the user is detected;
[0035] A second scene calling module, configured to call second scene data when the blowing interaction instruction is detected, wherein the second scene data at least includes a second visual interaction interface;
[0036] The second scenario execution module is used to send the second scenario data to the execution terminal.
[0037] To achieve the above objectives and other related objectives, the present invention further provides an interactive system, comprising:
[0038] The interactive device; and
[0039] A microphone, used to collect audio data and send it to the interactive device;
[0040] A camera, used to collect facial image data and send it to the interactive device;
[0041] A display screen, used to receive and display a visual interactive interface sent by the interactive device;
[0042] A speaker, used to receive and play scene audio data emitted by the interactive device;
[0043] The lamp is used to receive the scene light control data sent by the interactive device and light up according to the scene light control data.
[0044] To achieve the above-mentioned purpose and other related purposes, the present invention also provides a car, including the above-mentioned scene interaction system.
[0045] The technical effect of the present invention is that: the present invention utilizes air blowing interaction instructions to achieve a more flexible and intuitive human-vehicle interaction experience; it adopts a sound classification model and a face recognition model to accurately judge the user's air blowing interaction instructions and switch or control different scenes; this technology is of great significance for improving driving safety and user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Figure 1 is a schematic diagram of an interactive system provided by an embodiment of the present invention;
[0047] Figure 2 is a flow chart of an interactive method provided by an embodiment of the present invention;
[0048] Figure 3 is a flow chart of a blowing identification method provided by an embodiment of the present invention;
[0049] Figure 4 is a flow chart of a blowing interaction method provided by another embodiment of the present invention;
[0050] Figure 5 is a flow chart of a sound classification face model training method provided by an embodiment of the present invention;
[0051] Figure 6 is a functional module block diagram of an interactive device provided by an embodiment of the present invention;
[0052] Figure 7 It is a structural block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0053] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.
[0054] It should be noted that the illustrations provided in the following embodiments are only used to illustrate the basic concept of the present invention in a schematic manner, and thus the illustrations only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.
[0055] The interactive method provided by the present invention can be used, for example, for the interaction between an in-vehicle terminal and passengers. It should be understood that the passengers in the present invention include but are not limited to the driver's seat, the front passenger's seat and the rear passenger. It should be noted that the interactive method of the present invention is not limited to the application in in-vehicle terminals, and can also be used in the cockpit of virtual scene simulation devices such as game consoles and driving simulators.
[0056] With the popularization and development of smart cars, the human-vehicle interaction mode has become increasingly important. In order to provide a more convenient and intuitive interactive experience, the present invention proposes an interactive method applied to a vehicle-mounted terminal. The method realizes interaction by responding to user operations and calling data from different scenes. At the same time, it uses blowing interactive instructions for more flexible control, which can realize simulated interaction of virtual scenes such as blowing candles, thereby enhancing the user interaction experience.
[0057] The interactive method provided by the embodiment of the present invention comprises the following steps:
[0058] S10: In response to a user operation, calling first scene data, wherein the first scene data at least includes a first visual interactive interface for displaying the interactive interface on a display screen.
[0059] In an optional embodiment of the present invention, the first scene data may include at least one of first audio data and first lighting control data in addition to the first visual interaction interface. The execution terminal may also include at least one of a speaker and a lamp.
[0060] S20: Sending the first scene data to an execution terminal, where the execution terminal at least includes a display screen, so that a user can see an interactive interface of the first scene on the display screen.
[0061] S30: Determine whether a blowing interaction instruction of the user is detected, so that the interaction can be more flexible and realistic.
[0062] In an optional embodiment of the present invention, the following two methods may be used to determine whether a blowing interaction instruction of the user is detected:
[0063] Sound classification model method: S311 obtains audio data collected by the microphone in the car; S312 inputs the audio data into the sound classification model to determine whether there is a blowing sound; S313 if there is a blowing sound, it can be determined that the user's blowing interaction command is detected.
[0064] Method for combining sound classification model with face recognition model: In addition to obtaining audio data collected by the microphone in the car, S321 also obtains user facial image data collected by the camera in the car; S322 inputs the audio data into the sound classification model to determine whether there is a blowing sound; S323 inputs the user facial image data into the face recognition model to determine whether the user's face is facing the target direction; S324 Only when there is a blowing sound and the user's face is facing the target direction can it be determined that the user's blowing interaction command is detected.
[0065] S40: when the blowing interaction instruction is detected, calling the second scene data, the second scene data at least including a second visual interaction interface for displaying a second interaction interface;
[0066] S50: Sending the second scene data to the execution terminal, so that the user can see the interactive interface of the second scene on the display screen.
[0067] Similarly, the second scene data may include at least one of second audio data and second lighting control data in addition to the second visual interaction interface. The execution terminal may also include at least one of a speaker and a lamp.
[0068] In a specific embodiment, the lamps include but are not limited to atmosphere lights, reading lights, exterior lights, headlights, etc. When the user makes a blowing action, the speaker can play corresponding music or sound effects, and the lamps can flash or change color, giving the user a pleasant interactive experience.
[0069] In order to realize the judgment of the above-mentioned blowing interaction instruction, the present invention also provides a sound classification model training method, which includes the following steps:
[0070] S100: Acquire an audio sample and a corresponding classification label, wherein the audio sample at least includes blowing sound data mixed with environmental noise.
[0071] S200: Input the audio sample into the sound classification model to be trained to obtain a classification result.
[0072] S300: Calculate the loss value according to the classification result and the classification label.
[0073] S400: Update the parameters of the model according to the loss value until the loss value is less than a preset threshold, thereby obtaining a final sound classification model.
[0074] It should be understood that since the audio samples used in the present invention include blowing sound data with environmental noise, the trained sound classification model can also respond to and recognize blowing sounds with environmental noise, thereby improving the recognition sensitivity and further enhancing the user's interactive experience.
[0075] In a specific embodiment, the above-mentioned sound classification model can be one of the following models:
[0076] Convolutional Neural Network (CNN) based on deep learning: CNN is a model widely used in audio classification tasks. It can extract features by performing convolution and pooling operations on audio data and classify them through fully connected layers. CNN can be trained using a training dataset with blowing sound samples to achieve blowing sound recognition.
[0077] Hidden Markov Model (HMM): HMM is a classic sequence modeling method, which is widely used in speech recognition. In the recognition of blown sound, HMM can model the blown sound signal and learn the transition probability and emission probability between blown sound and non-blown sound, so as to realize the recognition of blown sound.
[0078] Gaussian Mixture Model (GMM)-based sound classification algorithm: GMM is a commonly used sound classification algorithm that classifies different types of sounds by modeling the sound signal as a mixture model composed of multiple Gaussian distributions. GMM can be trained using data with blowing sound samples, and recognition is performed by calculating the match between the blowing sound signal and the model.
[0079] Recurrent Neural Network (RNN): RNN is a neural network that can process sequence data. It can be used to model and classify audio signals in the recognition of blowing sound. By using RNN with long short-term memory (LSTM) units, the timing information in the blowing sound signal can be captured to achieve efficient recognition.
[0080] The above face recognition model can be one of the following models:
[0081] Facial Landmark Detection: This model is specifically used to detect and identify facial features on a person's face, such as eyes, nose, mouth, etc. Commonly used models include traditional Active Shape Models (ASM), Active Appearance Models (AAM), and deep learning-based methods such as Face Keypoint Detectors.
[0082] Principal Component Analysis (PCA): PCA is a common face recognition method that represents face images as low-dimensional feature vectors through dimensionality reduction and feature extraction. These feature vectors can then be trained and recognized using classifiers (such as the nearest neighbor classifier).
[0083] Linear Discriminant Analysis (LDA): LDA is a classic face recognition method that projects faces onto feature vectors in a low-dimensional space, making the distance between faces of the same type as small as possible and the distance between faces of different types as large as possible. Face recognition is performed by training the model and calculating distance metrics such as Euclidean distance or cosine similarity.
[0084] Deep Convolutional Neural Network (DCNN): DCNN is a very successful algorithm model for solving computer vision problems, including face recognition. DCNN uses multiple layers of convolution and pooling operations to extract high-level features from face images. Common models include face recognition models based on architectures such as VGGNet, ResNet, and Inception.
[0085] Multi-Task Convolutional Neural Network (MTCNN): MTCNN is a joint model for face detection and facial key point location. It combines the tasks of face detection and facial feature identification, and can simultaneously implement multiple steps of face recognition.
[0086] Figure 6 It is a functional module diagram of a preferred embodiment of the interactive device 10 of the present invention, and the interactive device includes a first scene calling module 11, a first scene execution module 12, an interaction judgment module 13, a second scene calling module 14 and a second scene execution module 15; the first scene calling module 11 is used to respond to user operations and call first scene data, and the first scene data at least includes a first visual interaction interface; the first scene execution module 12 is used to send the first scene data to the execution terminal, and the execution terminal at least includes a display screen; the interaction judgment module 13 is used to determine whether the user's blowing interaction instruction is detected; the second scene calling module 14 is used to call the second scene data when the blowing interaction instruction is detected, and the second scene data at least includes a second visual interaction interface; the second scene execution module 15 is used to send the second scene data to the execution terminal.
[0087] like Figure 6 , 7 As shown, the module referred to in the present invention refers to a series of computer program segments that can be executed by the processor 100 and can complete fixed functions, which are stored in the memory 200.
[0088] In some embodiments, the processor 100 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and combinations of various control chips. The processor is the control core (Control Unit) of the electronic device, and uses various interfaces and lines to connect various components of the entire electronic device, and executes various functions of the electronic device and processes data by running or executing programs or modules stored in the memory, and calling data stored in the memory.
[0089] The processor 100 executes the operating system of the electronic device and various installed applications. The processor 100 executes the applications to implement the steps in the above-mentioned various interaction method embodiments, for example Figure 2 Steps shown.
[0090] Exemplarily, the computer program may be divided into one or more modules, which are stored in the memory 200 and executed by the processor to implement the present invention. The one or more modules may be a series of computer program instruction segments capable of implementing specific functions, which are used to describe the execution process of the computer program in the electronic device.
[0091] The above integrated unit implemented in the form of software function modules can be stored in a computer-readable storage medium. The above software function modules are stored in a storage medium and include several instructions for enabling a computer device to perform part of the functions of the interaction method described in various embodiments of the present invention.
[0092] It should be noted that the interactive device of this embodiment is a device corresponding to the above-mentioned interactive method, and the functional modules in the interactive device may correspond to the corresponding steps in the interactive method. The interactive device of this embodiment can be implemented in conjunction with the interactive method. Accordingly, the relevant technical details mentioned in the interactive device of this embodiment can also be applied in the above-mentioned interactive method.
[0093] It should be noted that the above-mentioned functional modules can be fully or partially integrated into one physical entity during actual implementation, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. In addition, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element described here can be an integrated circuit with signal processing capabilities. In the implementation process, some or all of the steps of the above method or the above functional modules can be completed by hardware integrated logic circuits in the processor element or instructions in software form.
[0094] To achieve the above-mentioned purpose and other related purposes, the present invention also provides an interactive system, including the interactive device 10, as well as a microphone 20, a camera 30, a display screen 50, a speaker 40 and a lamp 60; the microphone 20 is used to collect audio data and send it to the interactive device; the camera 30 is used to collect facial image data and send it to the interactive device; the display screen 50 is used to receive and display a visual interactive interface issued by the interactive device; the speaker 40 is used to receive and play scene audio data issued by the interactive device; the lamp 60 is used to receive scene lighting control data issued by the interactive device, and light up according to the scene lighting control data.
[0095] To achieve the above-mentioned purpose and other related purposes, the present invention also provides a car, including the scene interaction system. The car can innovate the interaction mode of the vehicle terminal and provide a more intelligent and flexible human-vehicle interaction experience.
[0096] In summary, the present invention provides an interactive method applied to a vehicle-mounted terminal, which realizes a more flexible and intuitive human-vehicle interactive experience by responding to user operations and using air-blowing interactive commands. By using a sound classification model and a face recognition model, it is possible to accurately judge the user's air-blowing interactive commands and switch or control different scenes. This technology is of great significance for improving driving safety and user experience.
[0097] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed by the present invention shall still be covered by the claims of the present invention.
[0098] In the description herein, many specific details, such as examples of components and / or methods, are provided to provide a complete understanding of embodiments of the present invention. However, those skilled in the art will recognize that embodiments of the present invention may be practiced without one or more of the specific details or with other devices, systems, components, methods, components, materials, parts, etc. In other cases, well-known structures, materials, or operations are not specifically shown or described in detail to avoid obscuring aspects of embodiments of the present invention.
[0099] References throughout this specification to "one embodiment," "an embodiment," or "a specific embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention, and not necessarily in all embodiments. Thus, various appearances of the phrases "in one embodiment," "in an embodiment," or "in a specific embodiment" in different places throughout this specification do not necessarily refer to the same embodiment. In addition, the particular features, structures, or characteristics of any specific embodiment of the invention may be combined with one or more other embodiments in any suitable manner. It should be understood that other variations and modifications of the embodiments of the invention described and illustrated herein may be possible in light of the teachings herein and are to be considered part of the spirit and scope of the invention.
[0100] It should also be understood that one or more of the elements shown in the figures may also be implemented in a more separate or more integrated manner, or even removed because they are inoperable in certain circumstances or provided because they may be useful depending on the application.
[0101] In addition, unless otherwise explicitly stated, any marking arrows in the drawings should be regarded as exemplary only and not limiting. In addition, unless otherwise specified, the term "or" used herein is generally intended to mean "and / or". In the case where the term is unclear because it is anticipated that the ability to separate or combine is provided, the combination of components or steps will also be regarded as specified.
[0102] As used in the description herein and throughout the claims that follow, "a", "an", and "the" include plural references unless otherwise indicated. Likewise, as used in the description herein and throughout the claims that follow, the meaning of "in" includes "in" and "on" unless otherwise indicated.
[0103] The above description of the illustrated embodiments of the present invention (including that described in the Abstract) is not intended to be exhaustive or to limit the present invention to the precise form disclosed herein. Although specific embodiments of the present invention and examples of the present invention are described herein for illustrative purposes only, various equivalent modifications are possible within the spirit and scope of the present invention as will be recognized and appreciated by those skilled in the art. As noted, these modifications may be made to the present invention in accordance with the above description of the embodiments described in the present invention, and these modifications will be within the spirit and scope of the present invention.
[0104] Systems and methods have been generally described herein as details that aid in understanding the present invention. In addition, various specific details have been given to provide an overall understanding of embodiments of the present invention. However, those skilled in the relevant art will recognize that embodiments of the present invention may be practiced without one or more of the specific details, or may be practiced using other devices, systems, accessories, methods, components, materials, parts, etc. In other cases, well-known structures, materials, and / or operations are not specifically shown or described in detail to avoid confusion with various aspects of embodiments of the present invention.
[0105] Thus, although the invention has been described herein with reference to specific embodiments thereof, freedom of modification, various changes and substitutions are also within the foregoing disclosure, and it should be understood that in some cases, some features of the invention will be employed without the corresponding use of other features without departing from the scope and spirit of the proposed invention. Thus, many modifications may be made to adapt a particular environment or material to the essential scope and spirit of the invention. The invention is not intended to be limited to the specific terms used in the claims below and / or the specific embodiments disclosed as the best mode contemplated for carrying out the invention, but the invention will include any and all embodiments and equivalents falling within the scope of the appended claims. Thus, the scope of the invention will be determined solely by the appended claims.
Claims
1. An interactive method, characterized in that: The steps include: In response to a user operation, calling first scene data, wherein the first scene data at least includes a first visual interaction interface; Sending the first scene data to an execution terminal, wherein the execution terminal at least includes a display screen; Determine whether a blowing interaction instruction of the user is detected; When the blowing interaction instruction is detected, calling second scene data, wherein the second scene data at least includes a second visual interaction interface; The second scene data is sent to the execution terminal.
2. The interactive method according to claim 1, characterized in that: The first scene data also includes at least one of first audio data and first lighting control data; the execution terminal also includes at least one of a speaker and a lamp.
3. The interactive method according to claim 1, characterized in that: The second scene data also includes at least one of second audio data and second lighting control data; the execution terminal also includes at least one of a speaker and a lamp.
4. The interactive method according to claim 1, characterized in that: The step of determining whether a blowing interaction instruction of the user is detected comprises: Get the audio data collected by the microphone; Inputting the audio data into a sound classification model to determine whether there is a blowing sound in the audio data; If there is a blowing sound, it is determined that a blowing interaction instruction of the user is detected.
5. The interactive method according to claim 1, characterized in that: The step of determining whether a blowing interaction instruction of the user is detected comprises: Obtain audio data collected by the microphone and user facial image data collected by the camera; Inputting the audio data into a sound classification model to determine whether there is a blowing sound in the audio data; Inputting the user's facial image data into a face recognition model to determine whether the user's face is facing a target direction; When there is a blowing sound and the user's face is facing the target direction, it is determined that the user's blowing interaction instruction is detected.
6. The interactive method according to claim 4 or 5, characterized in that: The sound classification model is obtained by the following method: Acquire an audio sample and a classification label corresponding to the audio sample, wherein the audio sample at least includes blowing sound data mixed with environmental noise; Inputting the audio sample into a sound classification model to be trained to obtain a classification result; Calculate the loss value according to the classification result and the classification label; The parameters of the model are updated according to the loss value until the loss value is less than a preset threshold, thereby obtaining the sound classification model.
7. A sound classification model training method, characterized in that: The steps include: Acquire an audio sample and a classification label corresponding to the audio sample, wherein the audio sample at least includes blowing sound data mixed with environmental noise; Inputting the audio sample into a sound classification model to be trained to obtain a classification result; Calculate the loss value according to the classification result and the classification label; The parameters of the model are updated according to the loss value until the loss value is less than a preset threshold, thereby obtaining a sound classification model.
8. An interactive device, characterized in that: include: A first scene calling module, used to respond to a user operation and call first scene data, wherein the first scene data at least includes a first visual interaction interface; A first scene execution module, used to send the first scene data to an execution terminal, wherein the execution terminal at least includes a display screen; An interaction determination module, used to determine whether a blowing interaction instruction of the user is detected; A second scene calling module, configured to call second scene data when the blowing interaction instruction is detected, wherein the second scene data at least includes a second visual interaction interface; The second scenario execution module is used to send the second scenario data to the execution terminal.
9. An interactive system, characterized in that: include: The interactive device according to claim 8; as well as A microphone, used to collect audio data and send it to the interactive device; A camera, used to collect facial image data and send it to the interactive device; A display screen, used to receive and display a visual interactive interface sent by the interactive device; A speaker, used to receive and play scene audio data emitted by the interactive device; The lamp is used to receive the scene light control data sent by the interactive device and light up according to the scene light control data.
10. An automobile, characterized in that: Including the scene interaction system described in claim 9.
Citation Information
Patent Citations
System and method for controllable interactive interface based on air blowing
CN109634404A
Air blowing detection method and equipment
CN112149483A
Bird sound recognition method and device, model training method and device and electronic equipment
CN116206612A