Internal and external sound integration system of new energy automobile

Abstract

The invention discloses a new energy automobile interior and exterior sound integration system, and relates to the technical field of new energy automobiles, the system comprises an exterior sound production module, an automobile machine or power amplifier module, an interior sound box and an interior camera; various sound production functions are integrated in the sound production module outside the vehicle, a large number of wire harnesses and connectors are omitted, cost is reduced, a bill of materials is simplified, the whole vehicle is lightened, and when it is detected that an obstacle exists outside the vehicle, the control unit of the vehicle machine or the power amplifier module receives a sensor signal and sends the signal to the sound production module. When the vehicle is in use, the sound production module outside the vehicle is immediately triggered to give out an alarm, a driver and surrounding pedestrians are prompted to pay attention to obstacles in time, collision accidents are effectively avoided, the driving safety is improved, the driver emotion is recognized by collecting facial expressions through the camera in the vehicle, matched sound effects are selected for playing, the driver emotion is adjusted, the emotion value is provided, and the driving pressure is relieved. And the driving safety and comfort are comprehensively improved.

Description

Technical Field

[0001] The present invention relates to the technical field of new energy vehicles, and in particular to an interior and exterior sound integration system for new energy vehicles. Background Art

[0002] With the enhancement of environmental awareness and the adjustment of energy structure, new energy vehicles have been widely promoted and rapidly developed around the world with their significant advantages such as zero or low emissions, high efficiency and energy saving. Their market share has been rising year by year and the number of vehicles in use has continued to increase. However, when new energy vehicles are driving, especially at low speeds, the noise from the motor is relatively small, so it is difficult for pedestrians to detect the approach of the vehicle in time through sound like traditional fuel vehicles. This poses a potential threat to the traffic safety of pedestrians. In order to effectively solve this problem, new energy vehicles must be equipped with pedestrian reminder systems and horns. The pedestrian reminder system can emit a specific sound when the vehicle is driving at a low speed to remind pedestrians to pay attention to the vehicle. The horn provides a warning to the driver in an emergency, greatly reducing the risk of collision between vehicles and pedestrians.

[0003] Traditional in-vehicle and out-vehicle sound devices adopt a decentralized design. Pedestrian warning systems, horns, etc. are independent of each other and are equipped with a large number of wiring harnesses and connectors. This not only greatly increases the manufacturing cost of the vehicle and makes the wiring structure complex and cumbersome, but also increases the weight of the vehicle, which is not conducive to achieving the goal of lightweighting the vehicle. The existing in-vehicle and out-vehicle sound systems have relatively single functions and lack the function of caring for the driver's emotions. It is difficult to meet the growing and diverse needs of users. Therefore, it is of great significance to develop an integrated in-vehicle and out-vehicle sound system for new energy vehicles. Summary of the invention

[0004] The purpose of the present invention is to make up for the shortcomings of the prior art and provide an integrated sound system for inside and outside the vehicle of new energy vehicles. It can integrate multiple sound functions into one module, save a large number of wiring harnesses and connectors, reduce costs, simplify the bill of materials and lightweight the entire vehicle, improve energy utilization, and facilitate vehicle layout. It combines sensors to promptly issue external obstacle alarms to avoid collisions, collect facial expressions through the camera inside the vehicle to identify the driver's emotions and current mental state, select soothing sound effects to play, adjust the driver's emotions, provide emotional value and assist in adjusting the mental state during driving.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions: an integrated sound system for new energy vehicles, the system comprising: an external sound module, a vehicle machine or power amplifier module, an in-vehicle audio system and an in-vehicle camera;

[0006] The vehicle exterior sound module integrates a horn, AVAS, and a right turn warning device for commercial vehicles, integrating the vehicle exterior sound requirements into one, and can emit corresponding sound signals according to different scene requirements;

[0007] The in-vehicle computer or power amplifier module includes a control unit, a signal modulation unit, and a sound storage unit. The control unit is used to receive vehicle sensor signals, user operation instructions, and driver facial expression data collected by an in-vehicle camera. It performs emotion analysis on the driver facial expression data using a facial feature vector extraction algorithm combined with an emotion classification decision algorithm. When it determines that the driver is in a specific emotional state, it selects the corresponding sound effect from the sound storage unit. The signal modulation unit modulates the signals sent by the control unit to make them suitable for the external sound-emitting module and the in-vehicle audio system. The sound storage unit pre-stores various sound effect files.

[0008] The in-vehicle camera is installed in front of the driver's seat and is connected to the in-vehicle computer or power amplifier module through a high-speed data transmission line. It is used to collect driver facial expression data and transmit it in real time to the control unit of the in-vehicle computer or power amplifier module. The in-vehicle audio system is connected to the in-vehicle computer or power amplifier module, receives the signals sent by the control unit, and plays the sound.

[0009] Further, the sound-emitting frequency of the external sound-emitting module is dynamically adjusted according to the ambient noise and the vehicle driving speed, using an ambient-speed linked frequency adjustment algorithm. Let the ambient noise value be and the vehicle driving speed be , the initial sound-emitting frequency be , and the frequency adjustment coefficients be and . Then the real-time sound-emitting frequency , where and are specific values determined through a large number of tests according to different vehicle models and usage scenarios.

[0010] Furthermore, the control unit of the in-vehicle computer or power amplifier module analyzes the driver facial expression data using a multi-feature fusion expression recognition algorithm. First, it grayscales and denoises the collected facial images, and extracts the displacement amount of eye feature points , the angle of upward or downward turning of the mouth corners , and the degree of eyebrow wrinkling . It sets the weights of the eye, mouth, and eyebrow features to be , , and respectively. Through the formula , it calculates the comprehensive value of expression features . According to the expression-emotion mapping relationship obtained through training with a large number of samples, based on The value judges the emotional state of the driver, and then selects a suitable audio effect from the sound storage unit and controls the in-vehicle audio to play through the control unit. The vehicle head unit or power amplifier module also has a personal preference learning and recognition function. By recording the driver's selection operations on the audio effects in different scenarios, a personal preference model is established. When in a similar scenario again, the control unit calls the preset audio effect mode from the sound storage unit according to the personal preference model, and after being processed by the signal modulation unit, controls the in-vehicle audio to play the corresponding audio effect.

[0011] Furthermore, the sound storage unit adopts a three-dimensional index storage structure based on scenario-emotion-personal preference. The audio effect files are classified according to the vehicle driving scenario, emotion regulation type, and personal preference. Each audio effect file is given a scenario label, an emotion label, and a personal preference label to construct a three-dimensional index table. The control unit locates and calls the preset audio effect mode in the index table through the corresponding labels according to the vehicle state, the driver's emotion, and the recognized personal preference, and after being processed by the signal modulation unit, controls the external sound module and the in-vehicle audio to emit the corresponding sound.

[0012] Furthermore, the signal transmission between the vehicle head unit or power amplifier module and the external sound module adopts an adaptive redundant error correction transmission protocol. Before signal transmission, the channel quality is evaluated, and the signal redundancy is dynamically adjusted according to the channel quality situation. The redundant data is generated by the Hamming code algorithm, and error correction processing is performed using the redundant data at the receiving end.

[0013] Furthermore, the control unit processes the vehicle sensor signals using a multi-sensor data association prediction algorithm. By integrating the data of the vehicle speed sensor, acceleration sensor, and steering sensor, analyzing the change trend of the sensor data, calculating the vehicle state prediction parameter by setting the weight of the sensor change trend, predicting the future driving state of the vehicle based on this parameter, and judging whether to trigger the external sound module to emit the corresponding sound signal.

[0014] Furthermore, the shooting parameters of the in-vehicle camera are adaptively adjusted according to the vehicle driving state and the in-vehicle light condition. An environment-state linked shooting parameter adjustment algorithm is adopted. According to the change of the in-vehicle light intensity and the vehicle acceleration, the exposure time of the camera is adjusted, and according to the change of the distance between the driver and the camera caused by the vehicle driving state, the focal length of the camera is adjusted.

[0015] Furthermore, the system also includes a system status monitoring and intelligent repair module, which monitors the operating parameters of the external vehicle sound module, the in-vehicle computer or power amplifier module, and the in-vehicle camera in real time, including the operating current and voltage of the external vehicle sound module, the chip temperature of the in-vehicle computer or power amplifier module, and the image frame rate of the in-vehicle camera. When the operating parameters of a certain module are monitored to exceed the normal range, the fault type is analyzed and judged to determine that there is a fault. The system status monitoring and intelligent repair module automatically switches to the standby component, and at the same time starts the built-in repair program to try to repair the faulty component, and sends a fault message to the vehicle central control system.

[0016] Furthermore, the system has an external vehicle obstacle alarm function. The control unit of the in-vehicle computer or power amplifier module receives the data collected by the vehicle obstacle sensor. The obstacle sensor data includes the distance between the obstacle and the vehicle , relative speed . The control unit uses an obstacle alarm classification algorithm to calculate the risk coefficient based on the distance and relative speed . The formula is , where , are the weight coefficients of the distance and relative speed respectively. According to the risk coefficient , different risk levels are divided. When in different intervals, the control unit selects the alarm sound effects of the corresponding level from the sound storage unit, and after being processed by the signal modulation unit, controls the external vehicle sound module to emit the corresponding alarm sound.

[0017] Compared with the prior art, the integrated in-vehicle and external vehicle sound system of this new energy vehicle has the following beneficial effects:

[0018] In the present invention, by integrating various sound functions into the external vehicle sound module, a large number of wire harnesses and connectors are saved, achieving cost reduction, simplifying the bill of materials and vehicle weight reduction, reducing the vehicle weight, improving energy utilization efficiency, and facilitating vehicle layout. Combining with the vehicle sensor system, when an obstacle is detected outside the vehicle, after the control unit of the in-vehicle computer or power amplifier module receives the sensor signal, it immediately triggers the external vehicle sound module to emit an alarm sound, timely reminding the driver and surrounding pedestrians to pay attention to the obstacle, effectively avoiding the occurrence of collision accidents, improving driving safety, collecting facial expressions through the in-vehicle camera to recognize the driver's emotion, selecting soothing sound effects to play through the in-vehicle audio, adjusting the driver's emotion, providing emotional value, and relieving driving pressure, comprehensively improving driving safety and comfort.

[0019] Other advantages, objectives and features of the present invention will be described to some extent in the subsequent specification, and to some extent, will be obvious to those skilled in the art based on the study of the following text, or can be taught from the practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0021] Figure 1 It is a schematic structural diagram of the in-vehicle and out-of-vehicle sound integration system for new energy vehicles;

[0022] Figure 2 It is a structural block diagram of the vehicle-mounted computer or power amplifier module in the in-vehicle and out-of-vehicle sound integration system for new energy vehicles. Detailed implementation manners

[0023] To further elaborate on the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the following will, in conjunction with the accompanying drawings and preferred embodiments, detail the specific implementation manners, structures, features, and their effects of the present invention as follows. Embodiment 1

[0024] During a morning rush hour, a new energy vehicle is equipped with the out-of-vehicle sound integration system of the present invention. On the roads around the school, at a congested crossroads, the vehicle starts and stops frequently, and the dynamics of pedestrians and other vehicles are complex and changeable. In such an environment, the system not only needs to meet the basic requirement of ensuring pedestrian safety but also provide a comfortable driving experience for the driver who has been under driving pressure for a long time.

[0025] When the driver presses the start button and the vehicle power is turned on, the in-vehicle and out-of-vehicle sound integration system of the new energy vehicle immediately starts the initialization process. The control unit of the vehicle-mounted computer or power amplifier module first conducts a comprehensive self-check on each internal circuit, chip, and storage unit. It sends detection signals to each key node and receives feedback to confirm that each part can operate normally. At the same time, it conducts an integrity check on the sound effect files in the sound storage unit to ensure that all preset sound effects can be read and used normally.

[0026] The in-vehicle camera installed at a suitable position in front of the driver's seat starts to preheat, and the lens automatically adjusts the focal length and angle to adapt to the in-vehicle light environment and the driver's position. During the preheating process, the camera will perform automatic calibration to ensure that the captured driver's facial image is clear and complete, providing a basis for subsequent accurate expression recognition.

[0027] The out-of-vehicle sound module also enters the standby preparation state, conducts a short-term power test on its own sound components, and checks whether the sound output is normal. At this time, the entire system is in a standby state, waiting to receive various signals from vehicle sensors and driver operations.

[0028] The vehicle slowly drives out of the community and enters the street near the school. At this time, the vehicle speed is relatively low, set as speed , due to the relatively noisy surrounding environment, the environmental noise value is , the control unit of the in-vehicle computer or power amplifier module starts to work. It adjusts the initial sound frequency stored in advance according to the environment-speed linkage frequency adjustment algorithm and the frequency adjustment coefficient , , and calculates the real-time sound frequency through the formula .

[0029] After the calculation is completed, the control unit sends this frequency signal to the external sound module. After receiving the signal, the external sound module drives the internal sound components to emit the AVAS sound according to the calculated frequency. This sound is clear and unique, which can effectively attract the attention of pedestrians and remind them that there is a vehicle approaching. At the same time, in order to ensure the sound propagation effect, the external sound module will also automatically adjust the sound emission angle and volume according to the driving direction of the vehicle and the acoustic characteristics of the surrounding environment, so that the sound can cover the key areas around the vehicle.

[0030] The vehicle continues to drive. When approaching an intersection, a illegally parked bicycle suddenly appears in front. The obstacle sensors installed at the front and side of the vehicle quickly capture the information of the obstacle, including the distance between the obstacle and the vehicle and the relative speed . These data are transmitted to the control unit of the in-vehicle computer or power amplifier module in real time through a high-speed data transmission line.

[0031] After receiving the data, the control unit processes it using the obstacle alarm classification algorithm. It calculates the danger coefficient and the relative speed weight coefficient through the formula , and selects the alarm sound effect of the corresponding level from the sound storage unit according to the size of the danger coefficient . If the danger coefficient

[0032] is at a relatively high level, the control unit will select a rapid and loud alarm sound effect. After being processed by the signal modulation unit, this sound effect signal is adjusted into an electrical signal form suitable for the external sound module to receive. After receiving the modulated signal, the external sound module quickly emits a strong alarm sound, which not only reminds the driver to take braking or avoidance measures immediately, but also makes the surrounding pedestrians aware of the dangerous situation and improves the overall traffic safety.

[0033] As the vehicle moves slowly on a congested road, the driver is in a highly concentrated mental state for a long time and gradually begins to show signs of fatigue. The in-vehicle camera continuously collects the driver's facial expression data and transmits the newly collected image data to the control unit of the in-vehicle computer or power amplifier module at regular intervals.

[0034] After receiving the image data, the control unit analyzes it using a multi-feature fusion expression recognition algorithm. First, the collected facial images are grayscaled to convert the color images into grayscale images for subsequent feature extraction. Then, an advanced noise reduction algorithm is used to remove the noise interference in the images to make the images clearer. Next, the displacement of eye feature points , the angle of upward or downward turning of the corners of the mouth , the degree of eyebrow wrinkling and other key features are extracted.

[0035] Combined with the pre-set weights of eye, mouth, and eyebrow features , , , the comprehensive value of expression features is calculated through the formula . Based on the expression-emotion mapping relationship obtained from a large number of samples, the emotional state of the driver is judged according to the calculated value. If it is judged that the driver is in a fatigued state, the control unit will select a soothing natural sound effect from the sound storage unit, such as the gentle chirping of birds or the gurgling of water. After being optimized by the signal modulation unit, the sound effect signal is transmitted to the in-vehicle audio system, and the in-vehicle audio system plays this sound effect at a moderate volume to create a relaxing atmosphere inside the vehicle and relieve the driver's fatigue and tension to a certain extent.

[0036] When the system runs for the first time, the driver can select and set the in-vehicle sound effects according to personal preferences, such as choosing a favorite music type, sound style, etc. These selection information will be recorded by the in-vehicle computer or power amplifier module. During subsequent driving, the in-vehicle computer or power amplifier module will continuously learn and analyze the driver's sound effect selection behavior and continuously optimize the personal preference model. When it is detected that the driver is in a fatigued state this time, in addition to selecting a soothing natural sound effect, the control unit will also, based on the established personal preference model, if the driver has often selected a certain specific style of relaxing music before, preferentially call the corresponding preset sound effect mode from the sound storage unit. For example, if the driver prefers classical music to relax, the control unit will find the stored classical music preset mode, process it through the signal modulation unit, and play it through the in-vehicle audio system to further conform to the driver's personal preferences and improve the mood regulation effect.

[0037]

[0038] ​During the entire process of vehicle driving, the signal transmission between the in-vehicle computer or power amplifier module and the external vehicle sound module is crucial. The system adopts an adaptive redundant error correction transmission protocol to ensure stable signal transmission. Before each signal transmission, the system will comprehensively evaluate the channel quality.

[0039] If the evaluation result shows that the channel quality is poor, the system will increase the signal redundancy. The redundant data is generated through a specific coding algorithm. The external vehicle sound module uses this redundant data for error correction processing to ensure that the received signal is accurate. At the same time, the system status monitoring and intelligent repair module always maintains real-time monitoring of the external vehicle sound module, the in-vehicle computer or power amplifier module, and the in-vehicle camera.

[0040] In summary, through this embodiment, it can be clearly seen that the in-vehicle and external vehicle sound integration system of new energy vehicles plays an important role in actual complex traffic scenarios. In terms of ensuring pedestrian safety, whether it is a regular reminder during low-speed driving or an emergency alarm when encountering an obstacle, it can accurately and timely emit sound signals, effectively avoiding possible traffic accidents. The driver emotion care function effectively alleviates the fatigue and stress of the driver during long-term driving, making the driving process more comfortable and relaxed. Embodiment 2

[0041] In a large logistics park, various vehicles such as trucks and forklifts shuttle back and forth. A new energy distribution vehicle equipped with the external vehicle sound integration system of the present invention is performing cargo transportation tasks in the park. In this environment, the system not only needs to ensure the safe driving of the vehicle in complex road conditions and avoid collisions with pedestrians and other vehicles, but also needs to adapt to the noisy operating environment in the logistics park, while providing a comfortable driving experience for the driver and reducing the fatigue caused by long-term high-intensity work.

[0042] When the new energy distribution vehicle slowly drives into the logistics park, when the driver starts the vehicle, the external vehicle sound integration system starts to work. The control unit of the in-vehicle computer or power amplifier module quickly self-checks the system, checks the operating status of each functional module, the connection of the data transmission line, and the integrity of various sound effect files in the sound storage unit. The in-vehicle camera automatically adjusts the angle to ensure that the driver's facial expression can be clearly captured, and adaptively adjusts the light to adapt to the lighting conditions in different areas of the logistics park. The external vehicle sound module performs a short power calibration to ensure the stability and accuracy of the sound output, and prepares for the upcoming operation.

[0043] The distribution vehicle is driving in the park at a speed of Due to the relatively large environmental noise generated by the surrounding loading and unloading equipment, the operation of other vehicles, etc., the environmental noise value is , and the control unit of the in-vehicle computer or power amplifier module adjusts the algorithm according to the environment-speed linkage frequency, combined with the initial sounding frequency And the frequency adjustment factor , , through the formula Calculate the real-time sound frequency .

[0044] The external sound module emits continuous and clear driving warning sounds based on this frequency. When passing through a crowded cargo loading and unloading area, the system will increase the volume to ensure that the sound can penetrate the noisy environment and attract the attention of pedestrians. For example, when encountering a group of workers who are moving goods, even if the on-site environmental noise is loud, pedestrians can clearly hear the vehicle's warning sound and avoid it in time, ensuring the safety of people and the smooth passage of vehicles.

[0045] When the delivery vehicle turned into a narrow passage, a temporarily parked forklift suddenly appeared in front of the vehicle. The vehicle's obstacle sensor quickly detected the distance between the obstacle and the vehicle. and relative speed And transmit these data to the control unit of the vehicle computer or power amplifier module in real time.

[0046] The control unit uses an obstacle warning classification algorithm to classify obstacles according to the pre-set distance weight coefficient. and the relative velocity weight coefficient , through the formula Calculate the risk factor When the risk factor exceeds a preset safety threshold, the control unit selects a sharp alarm sound effect of the corresponding level from the sound storage unit.

[0047] After processing the alarm sound signal, the signal modulation unit transmits it to the external sound module. The external sound module immediately emits a loud and rapid alarm to remind the driver to emergency brake or avoid. At the same time, it also lets the surrounding people and vehicles know the dangerous situation, effectively avoiding the occurrence of collision accidents.

[0048] After working continuously for several hours in the logistics park, the driver gradually becomes tired and irritable. The camera in the car continuously collects the driver's facial expression data and transmits it to the control unit of the vehicle computer or power amplifier module in real time.

[0049] The control unit uses a multi-feature fusion expression recognition algorithm to grayscale and reduce noise on the collected facial images, and then extract the displacement of the eye feature points. , the angle of the mouth corners rising or falling , eyebrow wrinkling degree And other features, combined with the preset weights of eyes, mouth, and eyebrows , , , through the formula Calculate the comprehensive value of expression features , based on the expression-emotion mapping relationship trained from a large number of samples, the emotional state of the driver is judged according to the value.

[0050] When it is judged that the driver is in a fatigued or irritable state, the control unit selects a relaxing and pleasant music segment from the sound storage unit, such as the prelude of a lively pop song. After the signal modulation unit optimizes the sound effect signal, the in-vehicle audio plays at an appropriate volume, and the relaxing atmosphere brought by the music is felt inside the vehicle, which alleviates the negative emotions of the driver to a certain extent and improves the safety and comfort of driving.

[0051] When the vehicle in the logistics park uses this system for the first time, the driver can select the sound effects he likes in different emotional states in the system settings interface. For example, he likes pure music with a slow rhythm when fatigued and white noise with natural sounds when irritable. The system stores these selection information to build a personal preference model. During subsequent driving, the system will analyze the driver's operation habits and sound effect selection preferences in real time to improve the personal preference model. After detecting that the driver is in a fatigued or irritable state this time, the control unit will not only select a relaxing and pleasant music segment but also refer to the personal preferences. If the system finds that the driver has selected a specific album of pure music many times when fatigued, it will directly call the preset sound effect mode corresponding to this album this time, making the played sound effects more in line with the driver's personal preferences and better alleviating negative emotions.

[0052] During the process of the vehicle driving in the logistics park, the signal transmission between the in-vehicle computer or power amplifier module and the out-of-vehicle sound-emitting module adopts an adaptive redundant error correction transmission protocol. Due to various electronic device interferences in the logistics park and a complex signal transmission environment, the system will evaluate the channel quality.

[0053] If the evaluation result shows that the channel quality is poor, the system will increase the redundancy of the signal, and the out-of-vehicle sound-emitting module uses this redundant data for error correction processing to ensure accurate reception of the control signal. At the same time, the system status monitoring and intelligent repair module monitors the working parameters of the out-of-vehicle sound-emitting module, the in-vehicle computer or power amplifier module, and the in-vehicle camera in real time.

[0054] In summary, the in-vehicle and out-of-vehicle sound integration system of new energy vehicles accurately emits sound reminders and alarms according to the vehicle driving state and the surrounding environment, effectively avoiding collision accidents between the vehicle and pedestrians or other vehicles, improving the traffic safety in the logistics park. The emotional care function alleviates the fatigue and irritability caused by long-term high-intensity work, enhances the comfort and concentration of driving, and helps to reduce operation errors caused by the poor state of the driver.

[0055] The above are only the preferred embodiments of the present invention and do not impose any form of limitation on the present invention. Although the present invention has been disclosed above with the preferred embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some changes or modifications to equivalent embodiments by using the disclosed technical content within the scope of the technical solution of the present invention. However, as long as it does not depart from the content of the technical solution of the present invention, any brief modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention still fall within the scope of the technical solution of the present invention.

Claims

1. New energy vehicle interior and exterior sound integration system, characterized in that, The system includes: an external vehicle sound generation module, a vehicle head unit or power amplifier module, an in-vehicle audio system, and an in-vehicle camera; The external vehicle sound generation module integrates a horn, an AVAS, and a right-turn warning device for commercial vehicles, integrating the external vehicle sound generation requirements, and capable of emitting corresponding sound signals according to different scenario requirements; The vehicle head unit or power amplifier module includes a control unit, a signal modulation unit, and a sound storage unit. The control unit is used to receive vehicle sensor signals, user operation instructions, and driver facial expression data collected by the in-vehicle camera, perform emotion analysis on the driver facial expression data using a facial feature vector extraction algorithm combined with an emotion classification decision algorithm, and select a corresponding sound effect from the sound storage unit when it is determined that the driver is in a specific emotional state. The signal modulation unit modulates the signal sent by the control unit to make it adapt to the external vehicle sound generation module and the in-vehicle audio system. The sound storage unit pre-stores a variety of sound effect files; The in-vehicle camera is installed in front of the driver's seat and is connected to the vehicle head unit or power amplifier module through a high-speed data transmission line, and is used to collect driver facial expression data and transmit it to the control unit of the vehicle head unit or power amplifier module in real time. The in-vehicle audio system is connected to the vehicle head unit or power amplifier module and receives the signal sent by the control unit and plays the sound.

2. The in-vehicle and out-of-vehicle sound integration system for new energy vehicles according to claim 1, wherein The sounding frequency of the external vehicle sound module is dynamically adjusted according to the ambient noise and the vehicle driving speed, and an environment-speed linkage frequency adjustment algorithm is adopted; let the ambient noise value be , the vehicle driving speed be , the initial sounding frequency be , the frequency adjustment coefficients be , , then the real-time sounding frequency .

3. The in-vehicle and out-of-vehicle sound integration system for new energy vehicles according to claim 1, characterized in that The control unit of the in-vehicle computer or power amplifier module analyzes the driver's facial expression data using a multi-feature fusion expression recognition algorithm. First, the collected facial images are grayscaled and noise-reduced, and the displacement of eye feature points is extracted. 、The angle of upward or downward turning of the mouth corners 、The degree of eyebrow wrinkling features. The weights of the eye, mouth, and eyebrow features are set to 、 、 respectively. Through the formula calculate the comprehensive value of expression features . According to the expression-emotion mapping relationship obtained from a large number of samples, based on the value, judge the driver's emotion and mental state, and then select a suitable audio effect from the sound storage unit and control the in-vehicle audio to play through the control unit. The in-vehicle computer or power amplifier module also has a personal preference learning and recognition function. By recording the driver's selection operations of audio effects in different scenarios, a personal preference model is established. When in a similar scenario again, the control unit calls the preset audio effect mode from the sound storage unit according to the personal preference model, and after being processed by the signal modulation unit, controls the in-vehicle audio to play the corresponding audio effect.

4. The in-vehicle and out-of-vehicle sound integration system for a new energy vehicle according to claim 1, characterized in that, The sound storage unit adopts a three-dimensional index storage structure based on scenario-emotion-personal preference. The sound effect files are classified according to vehicle driving scenarios, emotion regulation types, and personal preferences, and each sound effect file is assigned a scenario label, an emotion label, and a personal preference label to construct a three-dimensional index table. The control unit locates and calls a preset sound effect mode in the index table through the corresponding labels according to the vehicle state, driver emotion, and recognized personal preference, and after being processed by the signal modulation unit, controls the external vehicle sound generation module and the in-vehicle audio system to emit corresponding sounds.

5. The integrated in-vehicle and off-vehicle sound system for new energy vehicles according to claim 1, wherein The signal transmission between the vehicle head unit or power amplifier module and the external vehicle sound generation module adopts an adaptive redundant error correction transmission protocol. Before signal transmission, the channel quality is evaluated, and the signal redundancy is dynamically adjusted according to the channel quality situation. The redundant data is generated by the Hamming code algorithm, and error correction processing is performed using the redundant data at the receiving end.

6. The integrated in-vehicle and out-of-vehicle sound system for new energy vehicles according to claim 1, characterized in that The control unit processes the vehicle sensor signals using a multi-sensor data association prediction algorithm, synthesizes the data of the vehicle speed sensor, acceleration sensor, and steering sensor, analyzes the change trend of the sensor data, calculates the vehicle state prediction parameter by setting the weight of the sensor change trend, predicts the future driving state of the vehicle based on this parameter, and determines whether to trigger the external vehicle sound generation module to emit a corresponding sound signal.

7. The integrated in-vehicle and out-of-vehicle sound system for new energy vehicles according to claim 1, characterized in that, The shooting parameters of the in-vehicle camera are adaptively adjusted according to the vehicle driving state and the in-vehicle lighting conditions. An environment-state linked shooting parameter adjustment algorithm is adopted to adjust the exposure time of the camera according to the change of the in-vehicle lighting intensity and the vehicle acceleration, and adjust the focal length of the camera according to the change of the distance between the driver and the camera caused by the vehicle driving state.

8. The in-vehicle and out-of-vehicle sound integration system for new energy vehicles according to claim 1, characterized in that, The system also includes a system status monitoring and intelligent repair module, which monitors the operating parameters of the external vehicle sound module, the in-vehicle computer or power amplifier module, and the in-vehicle camera in real time, including the operating current and voltage of the external vehicle sound module, the chip temperature of the in-vehicle computer or power amplifier module, and the image frame rate of the in-vehicle camera. When the operating parameters of a certain module are detected to exceed the normal range, it analyzes and judges the type of fault, determines that there is a fault, the system status monitoring and intelligent repair module automatically switches to the standby component, simultaneously starts the built-in repair program to attempt to repair the faulty component, and sends a fault message to the vehicle central control system.

9. The integrated system for the in-vehicle and out-of-vehicle sounds of a new energy vehicle according to claim 1, wherein The system has an out-of-vehicle obstacle alarm function. The control unit of the in-vehicle computer or power amplifier module receives the data collected by the vehicle obstacle sensors. The obstacle sensor data includes the distance between the obstacle and the vehicle. , relative speed . The control unit uses an obstacle alarm classification algorithm to calculate the risk coefficient based on the distance and relative speed. . The formula is , where , are the weight coefficients of the distance and relative speed respectively. According to the size of the risk coefficient , different risk levels are divided. . When it is in different intervals, the control unit selects the alarm sound effect of the corresponding level from the sound storage unit. After being processed by the signal modulation unit, it controls the out-of-vehicle sound generation module to emit the corresponding alarm sound.

Images