Interaction method, apparatus and system, sound classification model training method, and vehicle
By introducing blowing interactive instructions and sound classification models in smart cars, combined with face recognition models, the problem that traditional interaction methods cannot meet the real needs is solved, and a more flexible and intuitive human-vehicle interaction experience is achieved, which improves driving safety and user experience.
Patent Information
- Application Number
- PCT/CN2024/127061
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-10-24
- Filing Date
- 2024-10-24
- Publication Date
- 2025-05-01
AI Technical Summary
Traditional smart car interaction methods cannot meet users' needs for reality and cannot provide a flexible and intuitive human-vehicle interaction experience.
By responding to user operations, calling data from different scenarios, and using blowing interactive instructions to achieve more flexible control, combining sound classification model and face recognition model, accurately judge the user's blowing interactive instructions.
It realizes a more flexible and intuitive human-vehicle interaction experience, improving driving safety and user experience.
Smart Images

Figure CN2024127061_01052025_PF_FP_ABST
Abstract
Description
Interaction method, device, system, sound classification model training method and automobile CROSS-REFERENCE TO RELATED APPLICATIONS
[0000] This application claims priority to the Chinese patent application filed with the China Patent Office on October 24, 2023, with application number 202311382940.7 and invention name “Interactive method, device, system, sound classification model training method and automobile”, the entire contents of which are incorporated by reference in this application. Technical Field The present application belongs to the field of automobile intelligent interaction technology, and specifically relates to an interaction method, device, system, sound classification model training method and automobile. Background Art With the rapid development and popularization of smart cars, users' demands for vehicle interactive functions are becoming more and more diversified, but traditional interactive methods generally include touch, voice, gestures, etc., which cannot meet users' needs for realism. Summary of the invention The following is a summary of the subject matter described in detail in this application. This summary is not intended to limit the scope of the claims. The purpose of the present application is to provide an interaction method, device, system, sound classification model training method and car that can interact with a simulated scene in a car by blowing air. To achieve the above purpose and other related purposes, the present application provides an interactive method, comprising the following steps: In response to a user operation, calling first scene data, wherein the first scene data at least includes a first visual interaction interface; Sending the first scene data to an execution terminal, wherein the execution terminal at least includes a display screen; Determine whether a blowing interaction command is detected; When the blowing interaction instruction is detected, calling second scene data, wherein the second scene data at least includes a second visual interaction interface; The second scene data is sent to the execution terminal. In an optional embodiment of the present application, the first scene data also includes at least one of first audio data and first lighting control data; the execution terminal also includes at least one of a speaker and a lamp. In an optional embodiment of the present application, the second scene data also includes at least one of second audio data and second lighting control data; and the execution terminal also includes at least one of a speaker and a lamp. In an optional embodiment of the present application, the step of determining whether a blowing interaction instruction is detected includes: Get the audio data collected by the microphone; Inputting the audio data into a sound classification model to determine whether there is a blowing sound in the audio data; If there is a blowing sound, it is determined that a blowing interaction instruction is detected. In an optional embodiment of the present application, the step of determining whether a blowing interaction instruction is detected includes: Get the audio data collected by the microphone and the facial image data collected by the camera; Inputting the audio data into a sound classification model to determine whether there is a blowing sound in the audio data; Inputting the facial image data into a face recognition model to determine whether the face corresponding to the facial image data is facing a target direction; When there is a blowing sound and the face corresponding to the facial image data faces the target direction, it is determined that the blowing interaction instruction is detected. In an optional embodiment of the present application, the sound classification model is obtained by the following method: Acquire an audio sample and a classification label corresponding to the audio sample, wherein the audio sample at least includes blowing sound data mixed with environmental noise; Inputting the audio sample into a sound classification model to be trained to obtain a classification result; Calculate the loss value according to the classification result and the classification label; The parameters of the sound classification model to be trained are updated according to the loss value until the loss value is less than a preset threshold, thereby obtaining the sound classification model. To achieve the above objectives and other related objectives, the present application also provides a sound classification model training method, comprising the following steps: Acquire an audio sample and a classification label corresponding to the audio sample, wherein the audio sample at least includes blowing sound data mixed with environmental noise; Inputting the audio sample into a sound classification model to be trained to obtain a classification result; Calculate the loss value according to the classification result and the classification label; The parameters of the sound classification model to be trained are updated according to the loss value until the loss value is less than a preset threshold, thereby obtaining a sound classification model. To achieve the above objectives and other related objectives, the present application also provides an interactive device, including: A first scene calling module, used to call first scene data in response to a user operation, wherein the first scene data at least includes a first visual interaction interface; A first scene execution module, used to send the first scene data to an execution terminal, wherein the execution terminal at least includes a display screen; An interaction judgment module is used to judge whether a blowing interaction instruction is detected; A second scene calling module, configured to call second scene data when the blowing interaction instruction is detected, wherein the second scene data at least includes a second visual interaction interface; The second scenario execution module is used to send the second scenario data to the execution terminal. To achieve the above objectives and other related objectives, the present application also provides an interactive system, including: The interactive device; and A microphone, used to collect audio data and send it to the interactive device; A camera, used to collect facial image data and send it to the interactive device; A display screen, used to receive and display a visual interactive interface sent by the interactive device; A speaker, used to receive and play scene audio data emitted by the interactive device; The lamp is used to receive the scene light control data sent by the interactive device and light up according to the scene light control data. To achieve the above objectives and other related objectives, the present application also provides a car, including the scene interaction system. The technical effect of the present application is that: the present application utilizes air blowing interaction commands to achieve a more flexible and intuitive human-vehicle interaction experience; the use of sound classification models and face recognition models can accurately judge the user's air blowing interaction commands and switch or control different scenes; this technology is of great significance for improving driving safety and user experience. Other aspects will be apparent upon reading and understanding the drawings and detailed description. BRIEF DESCRIPTION OF THE DRAWINGS FIG1 is a schematic diagram of an interactive system provided by an embodiment of the present application. FIG. 2 is a flow chart of an interaction method provided in an embodiment of the present application. FIG3 is a flow chart of a blowing recognition method provided in an embodiment of the present application. FIG. 4 is a flow chart of a blowing recognition method provided by another embodiment of the present application. FIG5 is a flow chart of a sound classification model training method provided in an embodiment of the present application. FIG. 6 is a functional module block diagram of an interactive device provided in an embodiment of the present application. FIG. 7 is a structural block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION The following describes the embodiments of the present application through specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict. It should be noted that the illustrations provided in the following embodiments are only used to illustrate the basic concept of the present application in a schematic manner, and therefore the illustrations only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated. The interaction method provided in this application can be used, for example, for interaction between an in-vehicle terminal and passengers. It should be understood that the passengers in this application include but are not limited to the driver's seat, the front passenger's seat, and the rear passengers. It should be noted that the interaction method of this application is not limited to application in in-vehicle terminals, and can also be used in the cockpit of virtual scene simulation devices such as game consoles and driving simulators. With the popularization and development of smart cars, the interaction between people and cars has become increasingly important. In order to provide a more convenient and intuitive interactive experience, this application proposes an interactive method for a vehicle terminal. This method responds to user operations and calls data from different scenes to achieve interaction. At the same time, it uses air blowing interactive instructions for more flexible control. Realize realistic interactions in virtual scenes such as blowing candles, and enhance user interaction experience. The interaction method provided in the embodiment of the present application includes the following steps S10-S50. S10: In response to a user operation, calling first scene data, wherein the first scene data at least includes a first visual interaction interface for displaying the interaction interface on a display screen. In an optional embodiment of the present application, the first scene data may include at least one of first audio data and first lighting control data in addition to the first visual interaction interface. The execution terminal may also include at least one of a speaker and a lamp. S20: Sending the first scene data to an execution terminal, wherein the execution terminal at least includes a display screen, so that the user can see the interactive interface of the first scene on the display screen. S30: Determine whether a blowing interaction instruction is detected, so that the interaction can be more flexible and realistic. In the embodiment of the present application, the blowing interaction instruction may come from the user who initiates the operation in step S10, or may come from other users in the car. In an optional embodiment of the present application, the following two methods may be used to determine whether a blowing interaction instruction is detected, namely, a sound classification model method and a method combining a sound classification model with a face recognition model. As shown in FIG3 , the sound classification model method may include: S311, acquiring audio data collected by a microphone in the vehicle; S312, inputting the audio data into the sound classification model to determine whether there is a blowing sound; S313, if there is a blowing sound, it can be determined that a blowing interaction instruction is detected. As shown in Figure 4, the method of combining the sound classification model and the face recognition model may include: S321, in addition to obtaining the audio data collected by the microphone in the car, also obtaining the user's facial image data collected by the camera in the car; S322, inputting the audio data into the sound classification model to determine whether there is a blowing sound; S323, inputting the user's facial image data into the face recognition model to determine whether the user's face is facing the target direction; S324, when there is a blowing sound and the user's face is facing the target direction, determining that a blowing interaction instruction is detected. S40: When the blowing interaction instruction is detected, calling the second scene data, the second scene data at least includes a second visual interaction interface for displaying a second interaction interface. S50: Sending the second scene data to the execution terminal, so that the user can see the interactive interface of the second scene on the display screen. Similarly, the second scene data may include at least one of second audio data and second lighting control data in addition to the second visual interaction interface. The execution terminal may also include at least one of a speaker and a lamp. In a specific embodiment, the lamps include but are not limited to atmosphere lights, reading lights, exterior lights, headlights, etc. When the user makes a blowing action, the speaker can play corresponding music or sound effects, and the lamps can flash or change color, giving the user a pleasant interactive experience. In some embodiments, in the scenario of the car owner's birthday, a birthday cake may be displayed on the first visual interaction interface included in the first scene data, the first audio data may include a happy birthday song and blessings, etc., and the first lighting control data may include turning on the atmosphere light, such as turning on the warm light. Specifically, for example, when the car owner opens the car door for the first time on his birthday, a picture of a birthday cake with lit candles is automatically displayed on the car display screen, and the happy birthday song is automatically played, and the atmosphere light is automatically turned on. After playing the happy birthday song, "Now please blow out the candles, birthday boy" can be automatically played and the atmosphere light is turned off. When a blowing action is detected, a birthday cake with candles blown out may be displayed on the second visual interaction interface included in the second scene data, the second audio data may include "Please check the greeting card", and the second lighting data may include turning on the atmosphere light. Based on the above embodiments, the second visual interaction interface displays the result after the content displayed in the first visual interaction interface is blown. In some embodiments, when a user is playing a game using an electronic device, water mist appears in the game interface. When a blowing interaction command is detected, the electronic device can display the image behind the screen that is blocked by the water mist. In some embodiments, when a user is playing a game using an electronic device, a bonfire appears in the game interface. When a blowing interaction command is detected, the electronic device can display a picture of the bonfire burning more vigorously. In order to realize the judgment of the above-mentioned blowing interaction instructions, the present application also provides a sound classification model training method, which includes the following steps S100 to S400. S100: Acquire an audio sample and a corresponding classification label, wherein the audio sample at least includes blowing sound data mixed with environmental noise. S200: Input the audio sample into the sound classification model to be trained to obtain a classification result. S300: Calculate the loss value according to the classification result and the classification label. S400: Update the parameters of the sound classification model according to the loss value until the loss value is less than a preset threshold, thereby obtaining a final sound classification model. Since the audio samples used contain blowing sound data with environmental noise, the trained sound classification model can also recognize blowing sounds with environmental noise accordingly, which improves the recognition sensitivity and further enhances the user's interactive experience. In a specific embodiment, the above-mentioned sound classification model can be one of the following models. Convolutional Neural Network (CNN) based on deep learning: A model widely used in audio classification tasks, which extracts features by performing convolution and pooling operations on audio data and classifies them through fully connected layers. CNN can be trained using a training dataset with blowing sound samples to achieve blowing sound recognition. Hidden Markov Model (HMM): A classic sequence modeling method widely used in speech recognition. In the recognition of blown sounds, HMM can model the blown sound signal and learn the transition probability and emission probability between blown sounds and non-blown sounds, thereby realizing the recognition of blown sounds. Gaussian Mixture Model (GMM): A commonly used sound classification algorithm that classifies different types of sounds by modeling the sound signal as a mixture model composed of multiple Gaussian distributions. GMM can be trained using data with blowing sound samples, and recognition is performed by calculating the match between the blowing sound signal and the model. Recurrent Neural Network (RNN): A neural network that can process sequence data and can be used to model and classify audio signals. By using RNN with long short-term memory (LSTM) units, the timing information in the blowing sound signal can be captured to achieve efficient recognition. The above-mentioned face recognition model can be one of the following models. Facial Landmark Detection: It is specially used to detect and identify facial features on the face, such as eyes, nose, mouth, etc. Commonly used models include traditional Active Shape Models (ASM), Active Appearance Models (AAM), and deep learning-based methods such as Face Keypoint Detectors. Principal Component Analysis (PCA): A common face recognition method that represents face images as low-dimensional feature vectors through dimensionality reduction and feature extraction. These feature vectors can then be trained and recognized using classifiers (such as the nearest neighbor classifier). Linear Discriminant Analysis (LDA): A classic face recognition method that projects faces onto feature vectors in a low-dimensional space, making the distance between faces of the same type as small as possible and the distance between faces of different types as large as possible. Face recognition is performed by training the model and calculating distance metrics such as Euclidean distance or cosine similarity. Deep Convolutional Neural Network (DCNN): A very successful algorithm model for solving computer vision problems, including face recognition. DCNN uses multiple layers of convolution and pooling operations to extract high-level features from face images. Common models include those based on VGGNet, ResNet, and Inception. Face recognition models with such architectures. Multi-Task Convolutional Neural Network (MTCNN): A joint model for face detection and facial key point localization. It combines the tasks of face detection and facial feature identification, and can simultaneously implement multiple steps of face recognition. Fig. 6 is a functional module diagram of an embodiment of an interactive device 10 of the present application, wherein the interactive device comprises a first scene calling module 11, a first scene execution module 12, an interaction judgment module 13, a second scene calling module 14, and a second scene execution module 15. The first scene calling module 11 is used to call the first scene data in response to a user operation, wherein the first scene data at least comprises a first visual interaction interface; the first scene execution module 12 is used to send the first scene data to an execution terminal, wherein the execution terminal at least comprises a display screen; the interaction judgment module 13 is used to determine whether a blowing interaction instruction is detected; the second scene calling module 14 is used to call the second scene data when the blowing interaction instruction is detected, wherein the second scene data at least comprises a second visual interaction interface; the second scene execution module 15 is used to send the second scene data to the execution terminal. As shown in FIG. 6 and FIG. 7 , the module in the interactive device 10 referred to in the present application may refer to a series of computer program segments that can be executed by the processor 100 and can complete fixed functions, which are stored in the memory 200 . In some embodiments, the processor 100 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and combinations of various control chips. The processor is the control core (Control Unit) of the electronic device, and uses various interfaces and lines to connect various components of the entire electronic device, and executes various functions of the electronic device and processes data by running or executing programs or modules stored in the memory, and calling data stored in the memory. The processor 100 executes the operating system of the electronic device and various installed applications. The processor 100 executes the applications to implement the steps in the above-mentioned various interaction method embodiments, such as the steps shown in FIG. 2 . Exemplarily, the computer program may be divided into one or more modules, which are stored in the memory 200 and executed by the processor to complete the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program in the electronic device. The above integrated unit implemented in the form of software function modules can be stored in a computer-readable storage medium. The above software function modules are stored in a storage medium and include several instructions for enabling a computer device to perform part of the functions of the interaction method described in each embodiment of the present application. It should be noted that the interactive device of this embodiment is a device corresponding to the above-mentioned interactive method, and the functional modules in the interactive device may correspond to the corresponding steps in the interactive method. The interactive device of this embodiment can be implemented in conjunction with the interactive method. Accordingly, the relevant technical details mentioned in the interactive device of this embodiment can also be applied in the above-mentioned interactive method. It should be noted that the above-mentioned functional modules can be fully or partially integrated into one physical entity during actual implementation, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. In addition, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element described here can be an integrated circuit with signal processing capabilities. In the implementation process, some or all of the steps of the above method, or the above functional modules can be completed by hardware integrated logic circuits in the processor element or instructions in software form. In order to achieve the above-mentioned purpose and other related purposes, the present application also provides an interactive system, including the interactive device 10, a microphone 20, and a display screen 50. Among them, the display screen 50 is illustrated as a vehicle-mounted display screen, but those skilled in the art should understand that other forms of display screens of other execution terminals are also applicable to the present disclosure. In addition, the interactive system may also include a camera 30, a speaker 40, and a lamp 60. Among them, the microphone 20 is used to collect audio data and send it to the interactive device; the camera 30 is used to collect facial image data and send it to the interactive device; the display screen 50 is used to receive and display the visual interactive interface issued by the interactive device 10; the speaker 40 is used to receive and play the scene audio data issued by the interactive device 10; the lamp 60 is used to receive the scene lighting control data issued by the interactive device 10, and light up according to the scene lighting control data. To achieve the above-mentioned purpose and other related purposes, the present application also provides a car, including the scene interaction system. The car can innovate the interaction mode of the vehicle terminal and provide a more intelligent and flexible human-vehicle interaction experience. In summary, the present application provides an interactive method applied to an in-vehicle terminal, which realizes a more flexible and intuitive human-vehicle interactive experience by responding to user operations and using air-blowing interactive commands. By using a sound classification model and a face recognition model, it is possible to accurately judge the user's air-blowing interactive commands and switch or control different scenes. This technology is of great significance for improving driving safety and user experience. The above embodiments are merely illustrative of the principles and effects of the present application and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application. In the description herein, many specific details are provided, such as examples of parts and / or methods, to provide a complete understanding of the embodiments of the present application. However, those skilled in the art will recognize that the embodiments of the present application can be practiced without one or more specific details or by other devices, systems, components, methods, parts, materials, parts, etc. In other cases, known structures, materials or operations are not specifically shown or described in detail to avoid blurring the aspects of the embodiments of the present application. References throughout the specification to "one embodiment," "an embodiment," or "a specific embodiment" mean that a particular feature, structure, or characteristic described in conjunction with the embodiment is included in at least one embodiment of the present application, and not necessarily in all embodiments. Thus, various appearances of the phrases "in one embodiment," "in an embodiment," or "in a specific embodiment" in different places throughout the specification do not necessarily refer to the same embodiment. In addition, the particular features, structures, or characteristics of any specific embodiment of the present application may be combined with one or more other embodiments in any suitable manner. It should be understood that other variations and modifications of the embodiments of the application described and illustrated herein may be based on the teachings herein and will be considered part of the spirit and scope of the present application. It should also be understood that one or more of the elements shown in the figures may also be implemented in a more separate or more integrated manner, or even removed because they are inoperable in certain circumstances or provided because they may be useful depending on the application. In addition, unless otherwise explicitly indicated, any marking arrows in the drawings should be regarded as exemplary only and not limiting. In addition, unless otherwise indicated, the term "or" used herein is generally intended to mean "and / or". In the case where the term is not clear because it is anticipated that the ability to separate or combine is provided, the combination of components or steps will also be regarded as indicated. As used in the description herein and throughout the claims that follow, "a", "an", and "the" include plural references unless otherwise indicated. Likewise, as used in the description herein and throughout the claims that follow, the meaning of "in" includes "in" and "on" unless otherwise indicated. The above description of the embodiments shown in the present application (including the contents described in the Abstract) is not intended to be exhaustive or to limit the present application to the precise form disclosed herein. Although specific embodiments of the present application and examples of the present application are described herein for illustrative purposes only, as those skilled in the art will recognize and understand, various equivalent modifications are possible within the spirit and scope of the present application. As noted, the above embodiments of the present application can be used in accordance with the present invention. These modifications are made to the present application based on the above description, and are intended to be within the spirit and scope of the present application. This paper has generally described systems and methods as details that are helpful for understanding the application. In addition, various specific details have been given to provide an overall understanding of the embodiments of the application. However, those skilled in the relevant art will recognize that the embodiments of the application can be put into practice without one or more specific details, or put into practice using other devices, systems, accessories, methods, assemblies, materials, parts, etc. In other cases, known structures, materials and / or operations are not particularly shown or described in detail to avoid confusion in various aspects of the embodiments of the application. Thus, although the present application has been described herein with reference to specific embodiments thereof, freedom of modification, various changes and substitutions are also within the above disclosure, and it should be understood that in some cases, some features of the present application will be adopted without corresponding use of other features without departing from the scope and spirit of the proposed application. Therefore, many modifications may be made to adapt specific environments or materials to the substantial scope and spirit of the present application. The present application is not intended to be limited to the specific terms used in the claims below and / or the specific embodiments disclosed as the best mode for carrying out the present application, but the present application will include any and all embodiments and equivalents falling within the scope of the appended claims. Thus, the scope of the present application will be determined solely by the appended claims.
Claims
1. An interactive method, comprising: In response to a user operation, calling first scene data, wherein the first scene data at least includes a first visual interaction interface; Sending the first scene data to an execution terminal, wherein the execution terminal at least includes a display screen; Determine whether a blowing interaction command is detected; When the blowing interaction instruction is detected, calling second scene data, wherein the second scene data at least includes a second visual interaction interface; The second scene data is sent to the execution terminal.
2. The interactive method according to claim 1, wherein: The first scene data also includes at least one of first audio data and first lighting control data; the execution terminal also includes at least one of a speaker and a lamp.
3. The interactive method according to claim 1, wherein: The second scene data also includes at least one of second audio data and second lighting control data; the execution terminal also includes at least one of a speaker and a lamp.
4. The interactive method according to claim 1, wherein: The step of determining whether a blowing interaction instruction is detected comprises: Get the audio data collected by the microphone; Inputting the audio data into a sound classification model to determine whether there is a blowing sound in the audio data; If there is a blowing sound, it is determined that the blowing interaction instruction is detected.
5. The interactive method according to claim 1, wherein: The step of determining whether a blowing interaction instruction is detected comprises: Get the audio data collected by the microphone and the facial image data collected by the camera; Inputting the audio data into a sound classification model to determine whether there is a blowing sound in the audio data; Inputting the facial image data into a face recognition model to determine whether the face corresponding to the facial image data is facing a target direction; When there is a blowing sound and the face corresponding to the facial image data faces the target direction, it is determined that the blowing interaction instruction is detected.
6. The interactive method according to claim 4 or 5, wherein: The sound classification model is obtained by the following method: Acquire an audio sample and a classification label corresponding to the audio sample, wherein the audio sample at least includes blowing sound data mixed with environmental noise; Inputting the audio sample into a sound classification model to be trained to obtain a classification result; Calculate the loss value according to the classification result and the classification label; The parameters of the sound classification model to be trained are updated according to the loss value until the loss value is less than a preset threshold, thereby obtaining the sound classification model.
7. The interactive method according to claim 1, wherein: The second visual interaction interface displays the result of blowing the content displayed in the first visual interaction interface.
8. A sound classification model training method, comprising: Acquire an audio sample and a classification label corresponding to the audio sample, wherein the audio sample at least includes blowing sound data mixed with environmental noise; Inputting the audio sample into a sound classification model to be trained to obtain a classification result; Calculate the loss value according to the classification result and the classification label; The parameters of the sound classification model to be trained are updated according to the loss value until the loss value is less than a preset threshold, thereby obtaining a sound classification model.
9. An interactive device, comprising: A first scene calling module, used to call first scene data in response to a user operation, wherein the first scene data at least includes a first visual interaction interface; A first scene execution module, used to send the first scene data to an execution terminal, wherein the execution terminal at least includes a display screen; An interaction judgment module is used to judge whether a blowing interaction instruction is detected; A second scene calling module, configured to call second scene data when the blowing interaction instruction is detected, wherein the second scene data at least includes a second visual interaction interface; The second scenario execution module is used to send the second scenario data to the execution terminal.
10. An interactive system comprising: The interactive device according to claim 9; as well as A microphone, used to collect audio data and send it to the interactive device; A camera, used to collect facial image data and send it to the interactive device; A display screen, used to receive and display a visual interactive interface sent by the interactive device; A speaker, used to receive and play scene audio data emitted by the interactive device; The lamp is used to receive the scene light control data sent by the interactive device and light up according to the scene light control data.
11. A car comprising the interactive system according to claim 10.
Citation Information
Patent Citations
Method, device and terminal for controlling game based on blowing
CN109589602A
System and method for controllable interactive interface based on air blowing
CN109634404A
Voice endpoint detection method for emotion recognition, electronic equipment and storage medium
CN111179975A
Air blowing detection method and equipment
CN112149483A
User interaction method and device, storage medium and electronic equipment
CN113920226A