Non-inductive interaction method based on cabin intelligent sound effect scene

Abstract

The invention relates to the technical field of intelligent sound effect interaction, in particular to a non-inductive interaction method based on a cabin intelligent sound effect scene, and the method comprises the steps: obtaining a pressure occupying signal through a seat sensor, and obtaining the position information of a passenger through the pressure occupying signal; obtaining a user portrait and an overall image of the passenger through a camera according to the passenger position information, and obtaining personal characteristics of the passenger through the overall image of the passenger; the sitting posture of the passenger on the seat is obtained through the overall image and the pressure occupying signal of the passenger on the seat, and whether the passenger is a common passenger or not is judged through the user portrait of the passenger; interacting with the intelligent sound effect scene through preferences of frequently-taken passengers, sitting postures of the passengers, user portraits, personal characteristics and the intelligent sound effect scene; and adjusting the sound equipment, the massage seat and the air conditioner through the sound system and the linkage system according to the interactive issuing instruction. According to the invention, the sound effect experience of passengers in the riding process is improved.

Description

Technical Field

[0001] The present invention relates to the field of intelligent sound effect interaction technology, and in particular to a senseless interaction method based on a cockpit intelligent sound effect scene. Background Art

[0002] With the development of smart cockpits, passengers' requirements for in-cabin audio and sound experience are not limited to the pursuit of traditional music playback and sound effects. More demands are placed on experience and seamless intelligent interaction. The rapid development of AI big models and the large-scale implementation of their applications have also brought opportunities for smart sound experience.

[0003] In conventional technology, the sound scene is adjusted manually through a remote control or physical buttons, which cannot achieve the effect of seamless interaction, resulting in a poor passenger experience. Summary of the invention

[0004] The present invention provides a senseless interaction method based on a cockpit intelligent sound effect scene, which is used to solve the problem of senseless intelligent interaction in the cabin.

[0005] The purpose of the present invention can be achieved through the following technical solutions: The first aspect of the present invention is to provide a non-sensing interaction method based on a cockpit intelligent sound effect scene, comprising: Obtaining a pressure occupancy signal through a seat sensor, and obtaining passenger position information through the pressure occupancy signal; According to the passenger's location information, the user portrait and overall image of the passenger are obtained through the camera, and the passenger's personal characteristics are obtained through the overall image of the passenger; The sitting posture of the passenger is obtained through the overall image and pressure occupancy signal of the passenger on the seat, and the frequent passenger is judged through the user portrait of the passenger. The sitting posture, user portrait, personal characteristics of the passenger and the intelligent sound effect scene are interacted according to the preferences of frequent passengers. According to the interactive instructions, the audio equipment, massage seats and air conditioning are adjusted through the audio system and linkage system.

[0006] Further, the step of obtaining a pressure occupancy signal through a seat sensor and obtaining passenger position information through the pressure occupancy signal includes: Obtain the passenger position information on each seat through machine learning and pattern recognition methods based on the pressure occupancy signal of each seat; The machine learning and pattern recognition methods are as follows: Use labeled data to train a classification model to identify the position of a person on a seat.

[0007] Furthermore, the method of obtaining a user portrait and an overall image of the passenger through a camera according to the passenger position information includes: The direction of the camera in the cabin is adjusted based on the passenger's position information, so that the passenger's overall image and user portrait can be captured.

[0008] Furthermore, obtaining the personal characteristics of the passenger through the overall image of the passenger includes: Manually mark the behavioral and emotional characteristics of all passengers in history to obtain the characteristic marking results of each passenger; The overall image is used as the input of the neural network model, and the behavioral characteristics and emotional characteristics are used as the output. The neural network model is trained through the feature labeling results of all passengers in the history and the overall image to obtain a trained neural network model; The neural network model is a convolutional neural network model CNN, and the loss function used by the CNN model during training is a cross entropy loss function. According to the overall image of the passenger, the passenger's personal characteristics are classified and judged through the trained CNN neural network model to obtain the behavioral characteristics and emotional characteristics of the passenger's personal characteristics; among them, all types of personal characteristics include age characteristics, gender characteristics, behavioral characteristics and emotional characteristics; among them, age characteristics and gender characteristics are directly obtained from the passenger information.

[0009] Furthermore, the method of obtaining the sitting posture of the passenger on the seat through the overall image of the passenger on the seat and the pressure occupancy signal, and judging whether the passenger is a frequent passenger through the user portrait of the passenger, includes: According to the pressure occupancy signal of the passenger on the seat, the sitting posture of the passenger on the seat is obtained by the center of gravity positioning method; Mark historical passengers and store their user profiles in a user database; The passenger's user profile is compared with the user profile in the user database through face recognition technology to determine whether the passenger is a frequent passenger.

[0010] Furthermore, the preferences of frequent passengers, the sitting posture, user portrait, personal characteristics of passengers and the intelligent sound effect scene are interacted with each other; according to the interactive instructions, the audio equipment, massage seats and air conditioners are adjusted through the audio system and linkage system, including: The first interactive mode is to send commands to the audio system to interact based on the preferences of frequent passengers and their personal characteristics; In the second interaction mode, commands are sent to the linkage system for interaction based on the passenger's sitting posture, pressure occupancy signal, user portrait and the temperature in the cabin.

[0011] Furthermore, the first interaction mode, based on the preferences of frequent passengers and personal characteristics of passengers, sends instructions to the sound system for interaction, including: According to the preferences and personal characteristics of passengers, the multimodal model is used to issue sound scene adjustment instructions, and the sound system is adjusted through the sound scene adjustment instructions; Among them, the sound system provides directional sound field adjustment and personalized emotional sound space; Directional sound field adjustment includes volume and sound field type; The personalized emotional sound space includes sound modes and music tracks.

[0012] Furthermore, the second interaction mode sends instructions to the linkage system for interaction according to the passenger's sitting posture, pressure occupancy signal, user portrait and cabin temperature, including: There are three interaction modes in the second interaction mode: the third interaction mode, the fourth interaction mode and the fifth interaction mode; The third interactive mode is to adjust the ambient light in the linkage system through the multimodal model according to the adjustment of the sound system; According to the interaction result in the first interaction mode, an instruction for adjusting the atmosphere light is issued to the linkage system so as to adjust the atmosphere light through the atmosphere light controller; Among them, the volume, sound field type, sound effect mode and music mode in the audio system and the atmosphere light are trained by machine learning models to obtain the relationship between the adjustment of the audio system and the atmosphere light; through the relationship and the interaction results in the audio system, the linkage system is instructed to control the atmosphere light; The fourth interactive mode adjusts the massage seat according to the sitting posture and pressure occupancy signal of the passenger on the seat; The process of adjusting the massage chair is as follows: the massage chair is adaptively adjusted through a PID control algorithm according to the pressure occupancy signal of the passenger on the seat and the frequency data of the passenger's sitting posture change; The fifth interactive mode adjusts the cabin air conditioning based on the passenger’s user profile, cabin temperature and humidity; The air conditioning in the cabin is adjusted through a multimodal model based on the passenger's user profile, temperature and humidity in the cabin.

[0013] The second aspect of the present invention is to provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the seamless interaction method based on the intelligent sound effect scene of the cockpit when executing the computer program.

[0014] A third aspect of the present invention is to provide a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the method for seamless interaction based on the intelligent sound effect scene in the cockpit is implemented.

[0015] Compared with the prior art, the present invention has the following beneficial effects: The pressure occupancy signal is obtained through the seat sensor, and the passenger position information is obtained through the pressure occupancy signal; the user portrait and overall image of the passenger are obtained through the camera according to the passenger position information, and the personal characteristics of the passenger are obtained through the overall image of the passenger on the seat; the sitting posture of the passenger on the seat is obtained through the overall image of the passenger on the seat and the pressure occupancy signal, and whether the passenger is a frequent passenger is judged by the passenger's user portrait; the efficiency of obtaining adjustment data before adjusting the sound effect scene is improved; the sitting posture, user portrait, personal characteristics of the passenger interact with the intelligent sound effect scene according to the preferences of frequent passengers; the audio equipment, massage seats, and air conditioners are adjusted through the audio system and linkage system according to the interactive instructions; the problem of passengers adjusting by themselves through remote controls and physical buttons is solved, and a method of seamless interaction for passengers is proposed, which improves the audio and sound experience of passengers during the ride. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 A flow chart of a non-sensing interaction method based on a cockpit intelligent sound effect scene is provided for the present invention; Figure 2 A schematic diagram of a flow chart of a non-sensing interaction method based on a cockpit intelligent sound effect scene provided by an embodiment of the present invention; Figure 3 This is a flowchart of the seamless intelligent interaction of the intelligent sound effect scene; Figure 4 This is the flow chart of the vehicle system. DETAILED DESCRIPTION

[0018] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0019] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0020] In view of the problems existing in the background technology, the research and design of a seamless interaction method based on the intelligent sound effect scene of the cockpit has important practical significance.

[0021] like Figure 1 As shown, the first aspect of the present invention is to provide a senseless interaction method based on a cockpit intelligent sound effect scene, comprising: S1, obtains passenger position information through seat sensors, and the vehicle system inputs the passenger position information into the AI ​​vision algorithm module; S2, the AI ​​visual algorithm module collects the user portrait and overall image of the passenger through the camera according to the passenger's location information, and determines the passenger's personal characteristics through the neural network model based on the passenger's overall image; the passenger's personal characteristics and user portrait interact with the intelligent sound effect scene; S3, according to the interactive instructions, adjust the audio equipment, massage seats and air conditioning through the audio system and linkage system.

[0022] The seat sensor in the present invention is a pressure sensor, which collects pressure data of the seat and determines whether there is a passenger on the seat based on the pressure data.

[0023] The present invention determines whether the passenger is a frequent passenger through the user portrait of the passenger, and then determines the passenger's personal characteristics through the overall image of the passenger, determines the sound effect scene adapted to the passenger through whether the passenger is a frequent passenger and the personal characteristics, and issues adjustment instructions to the sound system through the sound effect scene adapted to the passenger, and adjusts the sound effect device through the instructions. The present invention is reasonably designed and is convenient for completing the cockpit intelligent sound effect scene experience.

[0024] like Figure 2 The non-sensing interaction method based on the cockpit intelligent sound effect scene shown includes the following steps: Step 1: Obtain a pressure occupancy signal through a seat sensor, and obtain passenger position information through the pressure occupancy signal; Pressure sensors are evenly installed on the seats, and pressure occupancy signals on the seats are obtained through the pressure sensors.

[0025] Among them, the pressure occupancy signal refers to a specific signal generated based on the pressure data distribution results, which is used to indicate whether there is a passenger sitting on the seat, what the sitting posture is, and the concentrated area of ​​pressure.

[0026] Obtain the passenger position information on each seat through machine learning and pattern recognition methods based on the pressure occupancy signal of each seat; The labeled data is used to train a classification model to identify the position of a human body on a seat; the classification model may use a support vector machine (SVM), a random forest, a neural network, and a regression model, and the specific classification model used is not specifically limited.

[0027] Among them, machine learning and pattern recognition methods are well-known technologies and will not be described in detail here.

[0028] Step 2: Obtain the user portrait and overall image of the passenger through the camera according to the passenger's location information, and obtain the passenger's personal characteristics through the overall image of the passenger; A camera is installed in the cabin, and a user portrait and an overall image of the passenger are obtained through the camera according to the passenger position information; wherein the user portrait is an image of the passenger's face. The position of the camera is not specifically limited, and it is sufficient to ensure that it does not affect the collected image.

[0029] Manually mark the behavioral and emotional characteristics of all passengers in history to obtain the characteristic marking results of each passenger; Manually mark the behavioral and emotional characteristics of all passengers in history to obtain the characteristic marking results of each passenger; The overall image is used as the input of the neural network model, and the behavioral characteristics and emotional characteristics are used as the output. The neural network model is trained through the feature labeling results of all passengers in the history and the overall image to obtain a trained neural network model; wherein, during the training process, the data of historical passengers are divided into a training set, a validation set and a test set, and the ratio of the training set, the validation set and the test set is 8:1:1; The neural network model is a convolutional neural network model CNN, and the loss function used by the CNN model during training is a cross entropy loss function. According to the overall image of the passenger, the passenger's personal characteristics are classified and judged through the trained CNN neural network model to obtain the behavioral characteristics and emotional characteristics of the passenger's personal characteristics; among them, all types of personal characteristics include age characteristics, gender characteristics, behavioral characteristics and emotional characteristics; among them, age characteristics and gender characteristics are directly obtained from the passenger information.

[0030] Among them, behavioral characteristics include chatting, closing eyes to rest, reading, etc.; emotional characteristics include sadness, happiness, etc.

[0031] It should be noted that since the age characteristics and gender characteristics of personal characteristics can be directly represented, only behavioral characteristics and emotional characteristics are classified when classified through the CNN model; in the subsequent interaction process, the age characteristics, gender characteristics, behavioral characteristics and emotional characteristics of personal characteristics are all used.

[0032] It should be further explained that in subsequent use, male in the gender characteristic is quantified as 1 and female is quantified as 0.

[0033] Step 3: Obtain the sitting posture of the passenger on the seat through the overall image and pressure occupancy signal of the passenger on the seat, and determine whether the passenger is a frequent passenger through the passenger's user portrait; interact with the passenger's sitting posture, user portrait, personal characteristics and intelligent sound effect scene based on the preferences of frequent passengers; According to the pressure occupancy signal of the passenger on the seat, the sitting posture of the passenger on the seat is obtained through the center of gravity positioning method; wherein, the center of gravity positioning method is a well-known technology and will not be described in detail here.

[0034] Mark historical passengers and store their user profiles in a user database; The passenger's user profile is compared with the user profile in the user database through face recognition technology to determine whether the passenger is a frequent passenger.

[0035] If the passenger is a frequent passenger, the passenger interacts with the intelligent cabin sound scene based on the passenger's preferences and personal characteristics. The passenger's preferences are determined based on the sound effect modes and music modes that the passenger previously liked, and then the sound effect modes and music modes that the passenger previously used are recommended in order of frequency from large to small and duration from long to short. If it is a non-stop passenger, the passenger will only interact with the intelligent sound scene in the cockpit through the personal characteristics of the non-stop passenger;.

[0036] The interactive process of intelligent sound effect scenes is divided into the following categories: The first interactive mode is to send commands to the audio system to interact based on the preferences of frequent passengers and their personal characteristics; In the second interaction mode, commands are sent to the linkage system for interaction based on the passenger's sitting posture, pressure occupancy signal, user portrait and the temperature in the cabin.

[0037] Among them, the linkage system starts to adjust the seats, air conditioning, and ambient lights according to instructions.

[0038] Among them, the multimodal model is a well-known technology and will not be described in detail.

[0039] Step 4: Adjust the audio equipment, massage seats, and air conditioning through the audio system and linkage system according to the interactive instructions.

[0040] The first interactive mode is to send commands to the audio system to interact based on the preferences of frequent passengers and their personal characteristics; According to the passengers' preferences and personal characteristics, the multimodal model is used to issue sound scene adjustment instructions, and the audio system is adjusted through the sound scene adjustment instructions.

[0041] Among them, the sound system provides directional sound field adjustment and personalized emotional sound space; Directional sound field adjustment includes volume and sound field type: the sound field types include surround sound and stereo sound, etc. The personalized emotional sound space has sound modes and music tracks: the sound modes include music mode, movie mode, game mode and night mode; when passengers use the music mode, the audio equipment will automatically play music tracks suitable for the passengers.

[0042] It should be noted that the sound field adjustment drives the speakers around the passengers and the headrest speakers through independent channels to provide a precise partitioned directional sound field. Among them, "independent channel" refers to the audio signal path that can control each speaker or audio output separately.

[0043] Among them, music classification algorithms (such as machine learning) are used to automatically analyze the style of the music currently being played and adjust the sound processing accordingly.

[0044] In the second interaction mode, commands are sent to the linkage system for interaction based on the passenger's sitting posture, pressure occupancy signal, user portrait and the temperature in the cabin.

[0045] Among them, there are three interaction modes in the second interaction mode: the third interaction mode, the fourth interaction mode and the fifth interaction mode.

[0046] The third interactive mode is to adjust the ambient light in the linkage system through a multimodal model according to the adjustment of the audio system.

[0047] According to the interaction result in the first interaction mode, an instruction for adjusting the atmosphere light is sent to the linkage system so as to adjust the atmosphere light through the atmosphere light controller.

[0048] Among them, the volume, sound field type, sound effect mode, music mode and atmosphere light in the audio system are linked by training a machine learning model to obtain the correlation between the adjustment status of the audio system and the atmosphere light; through the correlation and the interaction results in the audio system, instructions are issued to the linkage system to control the atmosphere light.

[0049] The fourth interactive mode adjusts the massage seat according to the sitting posture and pressure occupancy signal of the passenger on the seat.

[0050] It should be noted that since passengers will change their sitting posture when they feel uncomfortable in the seats, the massage seats can be adjusted according to the changes in the passengers' sitting posture; among them, the seats in the cabin have a massage function.

[0051] Among them, the process of adjusting the massage chair is: adaptively adjusting the massage chair through the PID control algorithm according to the pressure occupancy signal of the passenger on the seat and the frequency data of the passenger's sitting posture change; among them, the PID control algorithm and the adaptive adjustment process are both well-known technologies and will not be described in detail here.

[0052] The fifth interactive mode adjusts the cabin air conditioning based on the passenger’s user portrait, cabin temperature, and humidity.

[0053] It should be noted that when the human body temperature is too high, the face will turn red, so the air-conditioning temperature can be controlled through the passenger's user portrait.

[0054] The air conditioning in the cabin is adjusted through a multimodal model based on the passenger's user profile, temperature and humidity in the cabin.

[0055] Among them, all the above algorithms can be built into the audio equipment, or they can be processed in the intelligent sound effect module and AI vision algorithm module and then passed to all systems through standard interfaces.

[0056] Among them, the audio system and linkage system equipment have built-in machine learning algorithm models.

[0057] Among them, the non-sensing intelligent interaction flow chart of the cockpit intelligent sound scene physical examination is as follows: Figure 3 shown.

[0058] Figure 4 The present invention provides a vehicle system, comprising the following modules: an AI visual algorithm module 1, an AI large model capability application module 2 and an intelligent sound effect module 3; AI visual algorithm module 1, used for user feature extraction, large model interaction, and intelligent sound effect scene generation; AI big model capability application module 2, used to obtain big model capabilities, with a built-in multimodal model; The intelligent sound effect module 3 is used to obtain intelligent sound effect scenes and implement sound system adjustment instructions.

[0059] Among them, the AI ​​visual algorithm module 1 includes cameras and electronic devices, which collect the user portrait and overall image of the passenger through the camera; obtain the passenger's personal characteristics based on the passenger's overall image, and judge whether the passenger is a frequent passenger through the passenger's user portrait; AI large model capability application module 2 receives the passenger's user portrait and overall image, and determines the passenger's age characteristics, gender characteristics, behavioral characteristics and emotional characteristics through large model capabilities; and completes the interaction of intelligent sound effect scenes through the passenger's personal characteristics and the pressure occupancy signals of the users and the seats; intelligent sound effect module 3 obtains the adjustment instructions of the audio system and linkage system through the AI ​​visual algorithm module 1, and the audio system provides directional sound field adjustment and personalized emotional sound effect space; the audio system provides vehicle-wide sound field adjustment; and can also drive the speakers around the passengers and the headrest speakers through independent channels to provide precise partitioned directional sound fields.

[0060] It should be noted that the AI ​​vision algorithm module memorizes the generated intelligent sound effect scenes and records the feedback from the user experience; it intelligently classifies the historically generated scenes and analyzes, optimizes and corrects the user feedback during the experience process.

[0061] The present invention provides a sound system, including: music tracks, volume, sound effect mode, and sound field adjustment.

[0062] Among them, the present invention provides a linkage system, including: adjustment of seats, air conditioning, and atmosphere lights.

[0063] The present invention also relates to a vehicle, which is equipped with the above-mentioned vehicle system, audio system, linkage system, and in-cabin passenger camera.

[0064] The second aspect of the present invention is to provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a senseless interaction method based on a cockpit intelligent sound effect scene is implemented.

[0065] The non-sensing interaction method based on the cockpit intelligent sound effect scene includes the following steps: S1, obtains passenger position information through seat sensors, and the vehicle system inputs the passenger position information into the AI ​​vision algorithm module; S2, the AI ​​visual algorithm module collects the user portrait and overall image of the passenger through the camera according to the passenger's location information, and determines the passenger's personal characteristics through the neural network model based on the passenger's overall image; the passenger's personal characteristics and user portrait interact with the intelligent sound effect scene; S3, according to the interactive instructions, adjust the audio equipment, massage seats and air conditioning through the audio system and linkage system.

[0066] A third aspect of the present invention is to provide a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, a seamless interaction method based on a cockpit intelligent sound effect scene is implemented.

[0067] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0068] The present invention is described with reference to flowcharts and / or block diagrams of methods, systems, and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the process in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0069] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0070] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0071] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents. Any modification or equivalent replacement that does not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.

Claims

1. A non-sensing interaction method based on cockpit intelligent sound effect scenes, characterized by: include: Obtaining a pressure occupancy signal through a seat sensor, and obtaining passenger position information through the pressure occupancy signal; The user portrait and overall image of the passenger are obtained through the camera based on the passenger's location information, and the passenger's personal characteristics are obtained through the overall image of the passenger; The passenger's sitting posture is obtained through the overall image and pressure occupancy signal of the seat, and the passenger's frequent passenger status is determined through the passenger's user portrait. Based on the preferences of frequent passengers, the passenger's sitting posture, user portrait, personal characteristics and intelligent sound effect scenes interact with each other. According to the interactive instructions, the audio equipment, massage seat and air conditioning are adjusted through the audio system and linkage system.

2. The method for seamless interaction based on cockpit intelligent sound effect scene according to claim 1 is characterized in that: The method of obtaining a pressure occupancy signal through a seat sensor and obtaining passenger position information through the pressure occupancy signal includes: Obtain seat passenger position information based on the pressure occupancy signal of each seat through machine learning and pattern recognition methods; The machine learning and pattern recognition methods are as follows: Use labeled data to train a classification model to identify the position of a person on a seat.

3. The method for seamless interaction based on cockpit intelligent sound effect scene according to claim 1 is characterized in that: The method of obtaining the passenger's user portrait and overall image through a camera based on the passenger's location information includes: The direction of the camera in the cabin is adjusted based on the passenger's position information, so that the overall image of the passenger and the user portrait can be captured.

4. The method for seamless interaction based on cockpit intelligent sound effect scene according to claim 1 is characterized in that: The obtaining of the passenger's personal characteristics through the passenger's overall image includes: Manually mark the behavioral and emotional characteristics of all passengers in history to obtain the characteristic marking results of each passenger; The overall image is used as the input of the neural network model, and the behavioral characteristics and emotional characteristics are used as the output. The neural network model is trained using the feature labeling results of all passengers in the history and the overall image to obtain the trained neural network model; The neural network model is a convolutional neural network model CNN, and the loss function used by the CNN model during training is a cross entropy loss function. The passenger's personal characteristics are classified and judged based on the passenger's overall image through the trained CNN neural network model to obtain the passenger's behavioral characteristics and emotional characteristics; among them, all types of personal characteristics include age characteristics, gender characteristics, behavioral characteristics and emotional characteristics; among them, age characteristics and gender characteristics are directly obtained from the passenger information.

5. The method for seamless interaction based on cockpit intelligent sound effect scene according to claim 1 is characterized in that: The method of obtaining the sitting posture of the passenger on the seat by using the overall image and pressure occupancy signal of the passenger on the seat and determining whether the passenger is a frequent passenger by using the user portrait of the passenger includes: According to the pressure occupancy signal of the passenger on the seat, the sitting posture of the passenger on the seat is obtained by the center of gravity positioning method; Mark historical passengers and store their user profiles in the user database; The passenger's user profile is compared with the user profile in the user database through face recognition technology to determine whether the passenger is a frequent passenger.

6. The method for seamless interaction based on cockpit intelligent sound effect scene according to claim 1 is characterized in that: The interaction between the preferences of frequent passengers, the passenger's sitting posture, user portrait, personal characteristics and intelligent sound effect scenes; According to the interactive instructions, the audio system and linkage system are used to adjust the audio equipment, massage seats, and air conditioning, including: The first interactive mode is to send commands to the audio system based on the preferences and personal characteristics of frequent passengers. The second interaction mode sends commands to the linkage system based on the passenger's sitting posture, pressure occupancy signal, user profile, and cabin temperature. Among them, the audio system includes audio equipment; the linkage system includes massage seats and air conditioning.

7. The method for seamless interaction based on cockpit intelligent sound effect scene according to claim 6 is characterized in that: The first interaction mode is to send commands to the audio system based on the preferences of frequent passengers and their personal characteristics, and includes: Based on the passenger's preferences and personal characteristics, a multimodal model is used to issue sound scene adjustment instructions, and the sound system is adjusted based on the sound scene adjustment instructions; Among them, the sound system provides directional sound field adjustment and personalized emotional sound space; Directional sound field adjustment includes volume and sound field type; The personalized emotional sound space includes sound modes and music tracks.

8. The method for seamless interaction based on cockpit intelligent sound effect scene according to claim 6 is characterized in that: The second interaction mode sends commands to the linkage system for interaction based on the passenger's sitting posture, pressure occupancy signal, user profile, and cabin temperature, including: There are three interaction modes in the second interaction mode: the third interaction mode, the fourth interaction mode and the fifth interaction mode; In the third interactive mode, the ambient light in the linkage system is adjusted through the multimodal model according to the adjustment of the sound system; According to the interaction result in the first interaction mode, an instruction for adjusting the atmosphere light is issued to the linkage system so as to adjust the atmosphere light through the atmosphere light controller; The volume, sound field type, sound effect mode, music mode, and ambient light in the audio system are trained on a machine learning model to obtain the correlation between the adjustment status of the audio system and the ambient light. Through this correlation and the interaction results in the audio system, the linkage system is given instructions to control the ambient light. The fourth interactive mode adjusts the massage seat according to the passenger's sitting posture and pressure occupancy signals; The massage chair adjustment process is as follows: the massage chair is adaptively adjusted using a PID control algorithm based on the pressure occupancy signal of the passenger on the seat and the frequency of the passenger's sitting posture changes; The fifth interactive mode adjusts the cabin air conditioning based on the passenger's user profile, cabin temperature, and humidity; The cabin air conditioning is adjusted based on the passenger's user profile, cabin temperature and humidity through a multimodal model.

9. An electronic device, characterized in that: It includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the senseless interaction method based on the intelligent sound effect scene of the cockpit as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the senseless interaction method based on the cockpit intelligent sound effect scene as described in any one of claims 1 to 8.

Images