A remote control system and method for audio-visual equipment

Abstract

The present invention discloses a remote control system and method for audio-visual equipment, and belongs to the technical field of audio-visual equipment control. The present invention includes an initial volume setting module, a user position confirmation module, an equipment environment monitoring module, and a real-time volume adjustment module, which monitor the ambient sound level at the location of the equipment when the audio-visual equipment is turned on, monitor the minimum spacing distance between the seat of the vehicle of the audio-visual equipment and the equipment, set the appropriate volume for the audio-visual environment, monitor the identity, number of users, and user position of the user in the vehicle, analyze the user information impact index, analyze the sound at the location of the audio-visual equipment in real time, generate anti-sound at the location of the audio-visual equipment to achieve noise reduction, and calculate the ambient noise impact index of the sound at the location of the audio-visual equipment to adjust and control the volume of the audio-visual equipment in real time. The present invention intelligently sets the initial volume, establishes a remote database to analyze the user's expected volume, reduces the number of times the driver adjusts the audio-visual equipment, and meets the volume requirements of different users.

Description

Technical Field

[0001] The present invention relates to the technical field of audio-visual equipment control, and in particular to a remote control system and method applied to audio-visual equipment. Background Art

[0002] The in-car audio and video equipment market has developed rapidly in recent years as consumers' pursuit of high-quality life has increased. With the advancement of technology, these devices have not only significantly improved in sound and picture quality, but also incorporated more intelligent functions.

[0003] When using in-car audio and video equipment, drivers often need to concentrate on observing the road conditions, which makes it inconvenient to adjust the volume of the in-car audio and video equipment. Since the internal environment of the vehicle is different when using in-car audio and video equipment, the volume of the equipment required in noisy and quiet environments is also different. The fixed volume suitable for the in-car audio and video environment is not conducive to the user experience; on the one hand, the number and position of users in the car are prone to change frequently, such as the number of users getting on and off in a passenger taxi, and the fixed volume is not conducive to meeting the dynamic needs of users; on the other hand, the environmental noise is constantly changing during the driving process of the vehicle, and it is difficult for the existing in-car audio and video system to carry out targeted noise reduction of vehicle noise. Summary of the invention

[0004] The object of the present invention is to provide a remote control system and method for audio-visual equipment to solve the problems raised in the above-mentioned background technology.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions: a remote control system applied to audio-visual equipment, the system comprising an initial volume setting module, a user position confirmation module, a device environment monitoring module and a real-time volume adjustment module;

[0006] The initial volume setting module is used to monitor the ambient sound level at the location of the audio-visual device when the audio-visual device is turned on, monitor the minimum distance between the seat of the vehicle where the audio-visual device is located and the device, and set the appropriate volume for the audio-visual environment in consideration of the ambient sound level and the minimum distance;

[0007] The user location confirmation module is used to monitor the user identity, number of users and user location in the vehicle, and analyze the user information impact index considering the user's expected volume, number of users and the distance between the user and the audio-visual device;

[0008] The device environment monitoring module is used to analyze the sound at the location of the audio-visual device in real time, generate anti-sound at the location of the audio-visual device to achieve noise reduction, and calculate the environmental noise impact index of the sound at the location of the audio-visual device. When the device environment monitoring module detects that the sound waveform at the location of the audio-visual device is abnormal, the audio being played is stopped and an alarm audio is played to the user;

[0009] The real-time volume adjustment module is used to adjust and control the volume of the audio and video equipment in real time.

[0010] Further, the initial volume setting module includes a sound receiving unit, a distance confirmation unit and a volume analysis unit;

[0011] The sound receiving unit works when the audio-visual device is not started, and collects the sound level at the location of the audio-visual device every a seconds. When the audio-visual device is started, the sound level b collected by the sound receiving unit last time is called as the ambient sound level and transmitted to the volume analysis unit;

[0012] The distance confirmation unit automatically learns the features of the face image, and the deep learning model can accurately analyze the face feature area to achieve efficient face detection, thereby monitoring whether there is a user on any vehicle seat. When the system detects that there is a user on any vehicle seat, the distance between the audio-visual device and the d seats with users is recorded as {c1, c2, ..., c d}, where the minimum distance is c min As the minimum separation distance, it is transmitted to the volume analysis unit;

[0013] The volume analysis unit receives the ambient sound level b and the minimum separation distance c min Finally, calculate the environmental adaptation volume e:

[0014] ;

[0015] Among them, f is the maximum volume of the audio-visual device, and f0 is the appropriate volume of the audio-visual environment when the ambient sound level set by the system is 0 and the audio-visual device is in contact with the car seat. If the volume of the in-car audio-visual device is too loud, the driver may be frightened, and if it is too low, the driver needs to adjust the volume of the in-car audio-visual device, which increases the workload. Considering the user distance and the ambient sound in the car to set the initial volume effectively improves the user experience.

[0016] Further, the user position confirmation module includes a historical volume database, a user expected volume analysis unit, a user position confirmation unit and an influence index analysis unit;

[0017] The database realizes face detection, tracking, analysis and recognition through image or video input based on computer vision and pattern recognition theory. Its core lies in extracting feature vectors that distinguish different individuals from face images, recording them in the database, and comparing them with known faces to identify the identity of the face. The historical volume database calls the information database of the nth user. When the nth user accepts the audio-visual equipment service for the first time, the historical volume database establishes the information database of the nth user, records the duration, average volume and other users who are on the bus at the same time during the nth user's use of the audio-visual equipment. The usage duration refers to the usage duration of the audio-visual equipment this time, and the volume data refers to the average volume of the audio-visual equipment when the user is in the car this time. When the nth user uses the audio-visual equipment, other users who are on the bus at the same time are also regarded as users of the audio-visual equipment this time. Here, only the nth user is analyzed. Since the identity of passengers of the same equipment is complex and the same passenger may use the in-vehicle audio-visual equipment of different vehicles, the historical volume database is established in the cloud and transmitted and called by the in-vehicle audio-visual equipment, which reduces the storage pressure of the in-vehicle audio-visual equipment and expands the scope of application of the database.

[0018] The user expected volume analysis unit performs face recognition on the user, recognizes that there are N users on the vehicle and marks their identities as {B1, B2, ..., B N}, call the historical volume data of the nth user in the historical volume database, and analyze the expected volume C of the nth user n ;

[0019] The user position confirmation unit monitors the real-time distance D between the nth user and the audio-visual device in real time. n ; Monitor the real-time distance S between the seat of the nth user and the audio-visual equipment n ;

[0020] The influence index analysis unit receives the information collected by the user expected volume analysis unit and the user position confirmation unit, and analyzes the user information influence index E in real time. N .

[0021] Furthermore, the user expected volume analysis unit analyzes the expected volume C of the nth user. n The method is as follows: the user expected volume analysis unit collects the historical volume data of the nth user in the historical volume database {F n_1 ,F n_2 ,…,F n_X}, where X is the number of times the nth user has used the audio-visual device in history. To filter P items, refer to the volume data {G n_1 ,G n_2 ,…,G n_P}, where the volume data G can be referenced for the pth time n_p The corresponding usage time is Tn_p , calculate the expected volume C of the nth user n :

[0022] .

[0023] Considering the user's historical volume usage data to analyze the user's expected volume, a comprehensive analysis of the user's needs for current audio-visual equipment services is conducted, thus improving the user experience from the overall user perspective.

[0024] Furthermore, the user expected volume analysis unit calculates the average value of the historical volume data of the nth user as F n , call any history volume data F n_x , where x=1,2,…,X, calculate the history using volume data F n_x The average volume data is F n The coefficient of deviation H n_x :

[0025] ;

[0026] When H n_x ≤H, the xth historical volume data is regarded as the reference volume data. n_x > H, the xth historical volume data is included in the volume data to be processed, where H is the tolerance of the deviation coefficient set by the system, and the Yth volume data to be processed is recorded as {J n_1 ,J n_2 ,…,J n_Y}, for the yth volume data to be processed J n_y For analysis, the information of other users who are on the bus at the same time as the nth user uses the audio-visual device is called. The other user information includes the average historical volume data of any other user who is on the bus at the same time. The average historical volume data of R other users is recorded as {M1,M2,…,M R}, calculate the volume data to be processed J n_y The average value M of the rth historical volume data r The similarity is α n_y_r =1-|J n_y -M r | / M r , when {r=1,2,…,R} all satisfy α n_y_r ≤α, the yth historical volume data is regarded as the reference volume data. When {r=1,2,…,R} cannot all satisfy α n_y_r≤α, the yth piece of historical volume data is considered as non-reference volume data, where α is the similarity threshold set by the system, and a total of P pieces of reference volume data are available. When the user's historical volume data contains data that deviates greatly from the commonly used volume, the user's co-passengers' habits of using audio-visual equipment are analyzed to exclude non-reference data caused by the historical co-passengers' habits, thereby improving the accuracy and stability of analyzing the user's expected volume.

[0027] Furthermore, the influence index analysis unit receives the information collected by the user expected volume analysis unit and the user position confirmation unit, and analyzes the user information influence index E in real time. N :

[0028] ;

[0029] Among them, k C is the influence weight of the user's expected volume on the user information impact index, k D It is the influence weight of the real-time distance between the user and the audio-visual device on the user information influence index.

[0030] Furthermore, the equipment environment monitoring module includes an environmental noise analysis module, an environmental noise reduction module and a noise anomaly alarm module;

[0031] The environmental noise analysis module analyzes the sound at the location of the audio-visual equipment, extracts the sound waveform of the audio-visual equipment, the sound waveform of common sound sources in the car and other sound waveforms by using a multi-sound source separation method, and analyzes the environmental noise impact index; the common sound source noise in the car includes: vehicle engine noise, wind noise and road noise, and classifies and analyzes different noise types, and sets different noise reduction rates considering the importance of different types of noise to driving, so as to take into account the safety of driving the vehicle; at the same time, other sound waveforms often include the voices of users in the car and the sound of the phone, etc. Considering that these noises are not suitable for elimination by vehicle-mounted equipment, all other waveforms are extracted, and only the common sound source sounds in the car are noise-reduced.

[0032] The environmental noise reduction module analyzes and processes the sound waveforms of common sound sources in the vehicle, and generates anti-sound to reduce noise according to the noise reduction percentage set by the system;

[0033] The noise abnormality alarm module analyzes the sound waveforms of common sound sources in the car. When the peak value of the sound waveform of any common sound source in the car is higher than a set value, the audio being played is stopped and an alarm audio is played to the user.

[0034] Furthermore, the environmental noise analysis module synthesizes the sound waveforms of common sound sources in the car and other sound waveforms, the synthesized waveform is a noise waveform, and extracts the peak loudness {P1, P2, ..., P i} and valley loudness {Q1,Q2,…,Q I}, calculate the environmental noise impact index U N :

[0035] ;

[0036] Where P is the peak loudness {P1,P2,…,P i};

[0037] The environmental noise reduction module analyzes the sound waveforms of common sound sources in the car, which include engine noise, tire friction noise and wind noise, and scales the engine noise waveform by 1-β, where β is the noise reduction percentage set by the system. Similarly, the tire friction noise waveform and the wind noise waveform are scaled, and the scaled noise waveform and the wind noise waveform are synthesized into a scaled noise waveform. The inverse waveform of the scaled noise waveform is obtained through analog circuit processing, and an anti-sound is generated at the position of the audio-visual device according to the inverse waveform of the scaled noise waveform;

[0038] The noise abnormality alarm module monitors the peak values ​​of the sound waveforms of common sound sources in the car in real time. When the sound of any common sound source exceeds the threshold set by the system, the system stops the audio being played and plays an alarm audio to the user. Considering that users may find it difficult to pay attention to the safety hazards highlighted by the noise, the audio and video equipment takes into account the user's safety while analyzing the noise.

[0039] Furthermore, the real-time volume adjustment module adjusts the volume e according to the environment, the user information impact index E N and environmental noise impact index U N Real-time smooth adjustment of the volume of audio and video equipment, the volume after adjustment is W N :

[0040] ;

[0041] Where K E is the influence weight of the user information influence index on the adjusted volume, where K U is the weight of the environmental noise impact index on the adjusted volume.

[0042] A remote control method for audio-visual equipment, the method comprising:

[0043] S10: monitor the ambient sound level of the location of the device when the audio-visual device is turned on, monitor the minimum distance between the vehicle seat of the device and the device, and set the appropriate volume for the audio-visual environment in consideration of the ambient sound level and the minimum distance;

[0044] S20: monitoring the identity, number of users and location of users in the vehicle, and analyzing the user information impact index considering the number of users and the distance between the users and the audio-visual equipment;

[0045] S30: Analyze the sound at the location of the audio-visual device in real time, generate anti-sound at the location of the audio-visual device to achieve noise reduction, and calculate the environmental noise impact index of the sound at the location of the audio-visual device. When the device environment monitoring module detects that the sound waveform at the location of the audio-visual device is abnormal, stop the audio being played and play an alarm audio to the user;

[0046] S40: The volume of the audio-visual device is adjusted and controlled in real time according to the environment suitable volume, the user information impact index and the environment noise impact index.

[0047] Compared with the prior art, the beneficial effects achieved by the present invention are:

[0048] 1. The present invention monitors the ambient sound level at the location of the audio-visual device when the device is turned on, monitors the minimum spacing distance between the seat of the vehicle where the audio-visual device is located and the device, and sets the appropriate volume for the audio-visual environment in consideration of the ambient sound level and the minimum spacing distance, thereby reducing the workload of users in adjusting the volume of the audio-visual device and improving the user experience.

[0049] 2. The present invention monitors the user identity, number of users and user location in the vehicle, establishes a database associating user identity with historical volume usage, screens abnormal historical volume usage in consideration of fellow passengers, analyzes the user's expected volume, analyzes the user information impact index in consideration of the user's expected volume, number of users and the distance between the user and the audio-visual equipment, dynamically analyzes user information, and intelligently controls volume changes, which not only reduces the number of times the driver has to adjust the audio-visual equipment, but also meets the volume requirements of different users in different riding situations.

[0050] 3. The present invention analyzes the sound at the location of the audio-visual equipment in real time, generates anti-sound at the location of the audio-visual equipment to achieve noise reduction, and at the same time calculates the environmental noise impact index of the sound at the location of the audio-visual equipment. When the equipment environment monitoring module detects that the sound waveform at the location of the audio-visual equipment is abnormal, it stops the audio being played and plays an alarm audio to the user. When analyzing the ambient noise in the car, the noise type is classified and processed, which not only takes into account the playback quality of the audio-visual equipment through noise reduction, but also takes into account the driving safety through noise analysis and alarm, thereby improving the management effect of the vehicle-mounted audio-visual equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0052] Figure 1 It is a schematic diagram of the working principle structure of a remote control system and method applied to audio-visual equipment of the present invention;

[0053] Figure 2 It is a schematic diagram of the workflow of a remote control system and method applied to audio-visual equipment of the present invention. DETAILED DESCRIPTION

[0054] See also Figure 1 and Figure 2 ,The present invention provides a technical solution: a remote control system applied to audio-visual equipment, the system includes an initial volume setting module, a user position confirmation module, a device environment monitoring module and a real-time volume adjustment module;

[0055] The initial volume setting module is used to monitor the ambient sound level at the location of the audio-visual device when the audio-visual device is turned on, monitor the minimum distance between the seat of the vehicle where the audio-visual device is located and the device, and set the appropriate volume for the audio-visual environment in consideration of the ambient sound level and the minimum distance;

[0056] The user location confirmation module is used to monitor the user identity, number of users and user location in the vehicle, and analyze the user information impact index considering the user's expected volume, number of users and the distance between the user and the audio-visual device;

[0057] The device environment monitoring module is used to analyze the sound at the location of the audio-visual device in real time, generate anti-sound at the location of the audio-visual device to achieve noise reduction, and calculate the environmental noise impact index of the sound at the location of the audio-visual device. When the device environment monitoring module detects that the sound waveform at the location of the audio-visual device is abnormal, the audio being played is stopped and an alarm audio is played to the user;

[0058] The real-time volume adjustment module is used to adjust and control the volume of the audio and video equipment in real time.

[0059] The initial volume setting module includes a sound receiving unit, a distance confirmation unit and a volume analysis unit;

[0060] The sound receiving unit works when the audio-visual device is not started, and collects the sound level at the location of the audio-visual device every a seconds. When the audio-visual device is started, the sound level b collected by the sound receiving unit last time is called as the ambient sound level and transmitted to the volume analysis unit;

[0061] The distance confirmation unit detects whether there is a user on any vehicle seat through a deep learning method. When the system detects that there is a user on any vehicle seat, it records the distance between the audio-visual device and the d seats with users, which are recorded as {c1, c2, ..., c d}, where the minimum distance is c min As the minimum separation distance, it is transmitted to the volume analysis unit;

[0062] The volume analysis unit receives the ambient sound level b and the minimum separation distance c min Finally, calculate the environmental adaptation volume e:

[0063] ;

[0064] Among them, f is the maximum volume of the audio-visual device, and f0 is the appropriate volume of the audio-visual environment when the ambient sound level set by the system is 0 and the audio-visual device is in contact with the car seat. If the volume of the in-car audio-visual device is too loud, the driver may be frightened, and if it is too low, the driver needs to adjust the volume of the in-car audio-visual device, which increases the workload. Considering the user distance and the ambient sound in the car to set the initial volume effectively improves the user experience.

[0065] The user position confirmation module includes a user expected volume analysis unit, a historical volume database, a user position confirmation unit and an influence index analysis unit;

[0066] The database realizes face detection, tracking, analysis and recognition through image or video input based on computer vision and pattern recognition theory. Its core lies in extracting feature vectors that distinguish different individuals from face images, recording them in the database, and comparing them with known faces to identify the identity of the face. The historical volume database calls the information database of the nth user. When the nth user accepts the audio-visual equipment service for the first time, the historical volume database establishes the information database of the nth user, records the duration, average volume and other users who are riding at the same time during the nth user's use of the audio-visual equipment. The usage duration refers to the usage duration of the audio-visual equipment this time, and the volume data refers to the average volume of the audio-visual equipment when the user is in the car this time. Due to the complex identity of passengers of the same equipment and the possibility that the same passenger uses the in-vehicle audio-visual equipment of different vehicles, the historical volume database is established in the cloud and transmitted and called by the in-vehicle audio-visual equipment, which reduces the storage pressure of the in-vehicle audio-visual equipment and expands the scope of application of the database.

[0067] The user expected volume analysis unit performs face recognition on the user, recognizes that there are N users on the vehicle and marks their identities as {B1, B2, ..., B N}, call the historical volume data of the nth user in the historical volume database, and analyze the expected volume C of the nth user n ;

[0068] The user position confirmation unit monitors the real-time distance D between the nth user and the audio-visual device in real time. n ; Monitor the real-time distance S between the seat of the nth user and the audio-visual equipment n When users are interested in the content played by the audio-visual device, they pay more attention to the audio-visual device, and the real-time distance D nThe real-time distance D between the user and the audio-visual device is taken into account. n The real-time distance S between the user's seat and the audio-visual equipment n The distinction is conducive to more accurate analysis of the user information impact index;

[0069] The influence index analysis unit receives the information collected by the user expected volume analysis unit and the user position confirmation unit, and analyzes the user information influence index E in real time. N .

[0070] The user expected volume analysis unit analyzes the expected volume C of the nth user. n The method is as follows: the user expected volume analysis unit collects the historical volume data of the nth user in the historical volume database {F n_1 ,F n_2 ,…,F n_X}, where X is the number of times the nth user has used the audio-visual device in history. To filter P items, refer to the volume data {G n_1 ,G n_2 ,…,G n_P}, where the volume data G can be referenced for the pth time n_p The corresponding usage time is T n_p , calculate the expected volume C of the nth user n :

[0071] .

[0072] Considering the user's historical volume usage data to analyze the user's expected volume, a comprehensive analysis of the user's needs for current audio-visual equipment services is conducted, thus improving the user experience from the overall user perspective.

[0073] The user expected volume analysis unit calculates the average value of the historical volume data of the nth user as F n , call any history volume data F n_x , where x=1,2,…,X, calculate the history using volume data F n_x The average volume data is F n The coefficient of deviation H n_x :

[0074] ;

[0075] When H n_x ≤H, the xth historical volume data is regarded as the reference volume data. n_x > H, the xth historical volume data is included in the volume data to be processed, where H is the tolerance of the deviation coefficient set by the system, and the Yth volume data to be processed is recorded as {J n_1 ,Jn_2 ,…,J n_Y}, for the yth volume data to be processed J n_y For analysis, the information of other users who are on the bus at the same time as the nth user uses the audio-visual device is called. The other user information includes the average historical volume data of any other user who is on the bus at the same time. The average historical volume data of R other users is recorded as {M1,M2,…,M R}, calculate the volume data to be processed J n_y The average value M of the rth historical volume data r The similarity is α n_y_r =1-|J n_y -M r | / M r , when {r=1,2,…,R} all satisfy α n_y_r ≤α, the yth historical volume data is regarded as the reference volume data. When {r=1,2,…,R} cannot all satisfy α n_y_r ≤α, the yth piece of historical volume data is considered as non-reference volume data, where α is the similarity threshold set by the system, and a total of P pieces of reference volume data are available. When the user's historical volume data contains data that deviates greatly from the commonly used volume, the user's co-passengers' habits of using audio-visual equipment are analyzed to exclude non-reference data caused by the historical co-passengers' habits, thereby improving the accuracy and stability of analyzing the user's expected volume.

[0076] The influence index analysis unit receives the information collected by the user expected volume analysis unit and the user position confirmation unit, and analyzes the user information influence index E in real time. N :

[0077] ;

[0078] Among them, k C is the influence weight of the user's expected volume on the user information impact index, k D It is the influence weight of the real-time distance between the user and the audio-visual device on the user information influence index.

[0079] The equipment environment monitoring module includes an environmental noise analysis module, an environmental noise reduction module and a noise anomaly alarm module;

[0080] The environmental noise analysis module analyzes the sound at the location of the audio-visual equipment, extracts the audio-visual equipment sound waveform, the common sound source sound waveform in the car and other sound waveforms by using a multi-sound source separation method, and analyzes the environmental noise impact index; the common sound source noise in the car includes: vehicle engine noise, wind noise and road noise, and classifies and analyzes different noise types, and sets different noise reduction rates considering the importance of different types of noise to driving, so as to take into account the safety of driving the vehicle; other sound waveforms are sound waveforms other than the audio-visual equipment sound and the common sound source sound in the car in the sound at the location of the audio-visual equipment, which often include the voices of users in the car and the phone sounds, etc. Considering that these noises are not suitable for elimination by vehicle-mounted equipment, all other waveforms are extracted, and only the common sound source sounds in the car are noise-reduced.

[0081] The environmental noise reduction module analyzes and processes the sound waveforms of common sound sources in the vehicle, and generates anti-sound to reduce noise according to the noise reduction percentage set by the system;

[0082] The noise abnormality alarm module analyzes the sound waveforms of common sound sources in the car. When the peak value of the sound waveform of any common sound source in the car is higher than a set value, the audio being played is stopped and an alarm audio is played to the user.

[0083] The environmental noise analysis module synthesizes the sound waveforms of common sound sources in the car and other sound waveforms, and the synthesized waveform is a noise waveform. The peak loudness {P1, P2, ..., P i} and valley loudness {Q1,Q2,…,Q I}, calculate the environmental noise impact index U N :

[0084] ;

[0085] Among them, P max is the peak loudness {P1,P2,…,P i};

[0086] The environmental noise reduction module analyzes the sound waveforms of common sound sources in the car, including engine noise, tire friction noise and wind noise, scales the engine noise waveform by 1-β, where β is the noise reduction percentage set by the system, scales the tire friction noise waveform and the wind noise waveform in the same way, synthesizes the scaled noise waveform into a scaled noise waveform, thereby obtaining an inverse waveform of the scaled noise waveform, and generates an anti-sound at the position of the audio-visual device according to the inverse waveform of the scaled noise waveform;

[0087] The noise abnormality alarm module monitors the peak values ​​of the sound waveforms of common sound sources in the car in real time. When the sound of any common sound source exceeds the threshold set by the system, the system stops the audio being played and plays an alarm audio to the user. Considering that users may find it difficult to pay attention to the safety hazards highlighted by the noise, the audio and video equipment analyzes the safety hazards while analyzing the noise, taking into account the safety of the user.

[0088] The real-time volume adjustment module adapts the volume e to the environment and the user information impact index E N and environmental noise impact index U N Real-time smooth adjustment of the volume of audio and video equipment, the volume after adjustment is W N :

[0089] ;

[0090] Where K E is the influence weight of the user information influence index on the adjusted volume, where K U is the weight of the environmental noise impact index on the adjusted volume.

[0091] A remote control method for audio-visual equipment, the method comprising:

[0092] S10: monitor the ambient sound level of the location of the device when the audio-visual device is turned on, monitor the minimum distance between the vehicle seat of the device and the device, and set the appropriate volume for the audio-visual environment in consideration of the ambient sound level and the minimum distance;

[0093] S20: monitoring the identity, number of users and location of users in the vehicle, and analyzing the user information impact index considering the number of users and the distance between the users and the audio-visual equipment;

[0094] S30: Analyze the sound at the location of the audio-visual device in real time, generate anti-sound at the location of the audio-visual device to achieve noise reduction, and calculate the environmental noise impact index of the sound at the location of the audio-visual device. When the device environment monitoring module detects that the sound waveform at the location of the audio-visual device is abnormal, stop the audio being played and play an alarm audio to the user;

[0095] S40: The volume of the audio-visual device is adjusted and controlled in real time according to the environment suitable volume, the user information impact index and the environment noise impact index.

[0096] Embodiment 1: The distance confirmation unit uses a deep learning method to monitor whether there is a user on any vehicle seat. When the system detects that there is a user on any vehicle seat, the distance between the audio-visual device and the three seats with users is recorded as {0.5m, 2m, 3m}, where the minimum distance is c min =1.5 as the minimum separation distance, which is transmitted to the volume analysis unit;

[0097] The volume analysis unit receives the ambient sound level b = 30dB and the minimum separation distance c min =0.5m, f=100 is the maximum volume of the audio-visual device, f0 is the appropriate volume of the audio-visual environment when the ambient sound level set by the system is 0 and the audio-visual device is in contact with the seat, which is set to 20, c=1m is the average distance between the device and all seats calculated by the system, k1=0.2 is the influence weight of the ambient sound level set by the system on the appropriate volume of the environment, k2=0.2 is the influence weight of the minimum interval distance set by the system on the appropriate volume of the environment, and the appropriate volume of the environment is calculated as follows:

[0098] .

[0099] Embodiment 2: Real-time volume adjustment module adapts the volume according to the environment e=33, user information impact index E N =2 and environmental noise impact index U N =2.5 Real-time smooth adjustment of the volume of audio and video equipment, K E =1 is the influence weight of the user information influence index on the adjusted volume, where K U =2 is the weight of the environmental noise impact index on the adjusted volume. The adjusted volume is W N :

[0100] .

[0101] Embodiment 3: Real-time volume adjustment module adapts the volume according to the environment e=33, user information impact index E N =-6 and environmental noise impact index U N =2.5 Real-time smooth adjustment of the volume of audio and video equipment, K E =1 is the influence weight of the user information influence index on the adjusted volume, where K U =2 is the weight of the environmental noise impact index on the adjusted volume. The adjusted volume is W N :

[0102]

[0103] Here, since the user's expected volume is less than the environmental suitable volume, the user information impact index is negative.

[0104] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0105] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A remote control system for audio and video equipment, characterized in that: The system includes: an initial volume setting module, a user location confirmation module, a device environment monitoring module and a real-time volume adjustment module; The initial volume setting module is used to monitor the ambient sound level at the location of the audio-visual device when the audio-visual device is turned on, monitor the minimum distance between the seat of the vehicle where the audio-visual device is located and the device, and set the appropriate volume for the audio-visual environment in consideration of the ambient sound level and the minimum distance; The user location confirmation module is used to monitor the user identity, number of users and user location in the vehicle, and analyze the user information impact index considering the user's expected volume, number of users and the distance between the user and the audio-visual device; The device environment monitoring module is used to analyze the sound at the location of the audio-visual device in real time, generate anti-sound at the location of the audio-visual device to achieve noise reduction, and calculate the environmental noise impact index of the sound at the location of the audio-visual device. When the device environment monitoring module detects that the sound waveform at the location of the audio-visual device is abnormal, the audio being played is stopped and an alarm audio is played to the user; The real-time volume adjustment module is used to adjust and control the volume of the audio and video equipment in real time; The user position confirmation module includes a historical volume database, a user expected volume analysis unit, a user position confirmation unit and an influence index analysis unit; The historical volume database stores the information base of the nth user. When the nth user receives the audio-visual device service for the first time, the historical volume database establishes the information base of the nth user, and records the usage time, volume data and other users who are riding at the same time during any use of the audio-visual device by the nth user. The usage time refers to the time when any user uses the audio-visual device, and the volume data refers to the average volume of any user using the audio-visual device. The user expected volume analysis unit performs face recognition on the user, recognizes that there are N users on the vehicle and marks their identities as {B1, B2, ..., B N }, call the historical volume data of the nth user in the historical volume database, and analyze the expected volume C of the nth user n ; The user position confirmation unit monitors the real-time distance D between the nth user and the audio-visual device in real time. n ; Monitor the real-time distance S between the seat of the nth user and the audio-visual equipment n ; The influence index analysis unit receives the information collected by the user expected volume analysis unit and the user position confirmation unit, and analyzes the user information influence index E in real time. N ; The user expected volume analysis unit analyzes the expected volume C of the nth user. n The method is as follows: the user expected volume analysis unit collects the historical volume data of the nth user in the historical volume database {F n_1 ,F n_2 ,…,F n_X }, where X is the number of times the nth user has used the audio-visual device in history. To filter P items, refer to the volume data {G n_1 ,G n_2 ,…,G n_P }, where the volume data G can be referenced for the pth time n_p The usage time of the corresponding audio-visual equipment is T n_p , calculate the expected volume C of the nth user n : ； The user expected volume analysis unit calculates the average value of the historical volume data of the nth user as F n , call any history volume data F n_x , where x=1,2,…,X, calculate the history using volume data F n_x The average volume data is F n The coefficient of deviation H n_x : ； When H n_x ≤H, the xth historical volume data is regarded as the reference volume data. n_x > H, the xth historical volume data is included in the volume data to be processed, where H is the tolerance of the deviation coefficient set by the system, and the Yth volume data to be processed is recorded as {J n_1 ,J n_2 ,…,J n_Y }, for the yth volume data to be processed J n_y For analysis, the information of other users who are on the bus at the same time as the nth user uses the audio-visual device is called. The other user information includes the average historical volume data of any other user who is on the bus at the same time. The average historical volume data of R other users is recorded as {M1,M2,…,M R }, calculate the volume data to be processed J n_y The average value M of the rth historical volume data r The similarity is α n_y_r =1-|J n_y -M r | / M r , when {r=1,2,…,R} all satisfy α n_y_r ≤α, the yth historical volume data is regarded as the reference volume data. When {r=1,2,…,R} cannot all satisfy α n_y_r When ≤α, the yth piece of historical volume data is regarded as non-reference volume data, where α is the similarity threshold set by the system, and there are a total of P pieces of reference volume data; The influence index analysis unit receives the information collected by the user expected volume analysis unit and the user position confirmation unit, and analyzes the user information influence index E in real time. N : ； Among them, k C is the influence weight of the user's expected volume on the user information impact index, k D The weight of the real-time distance between the user and the audio-visual device on the user information impact index; The equipment environment monitoring module includes an environmental noise analysis module, an environmental noise reduction module and a noise anomaly alarm module; The environmental noise analysis module analyzes the sound at the location of the audio-visual equipment, extracts the sound waveform of the audio-visual equipment, the sound waveform of common sound sources in the car and other sound waveforms by using a multi-sound source separation method, and analyzes the environmental noise impact index; The environmental noise reduction module analyzes and processes the sound waveforms of common sound sources in the car, and generates anti-sound according to the noise reduction percentage set by the system to achieve the noise reduction effect; The noise abnormality alarm module analyzes the sound waveforms of common sound sources in the car. When the peak value of the sound waveform of any common sound source in the car is higher than the set value, the audio being played is stopped and an alarm audio is played to the user; The environmental noise analysis module synthesizes the sound waveforms of common sound sources in the car and other sound waveforms, and the synthesized waveform is a noise waveform. The peak loudness {P1, P2, ..., P i } and valley loudness {Q1,Q2,…,Q I }, calculate the environmental noise impact index U N : ； Among them, P max is the peak loudness {P1,P2,…,P i }; The environmental noise reduction module analyzes the sound waveforms of common sound sources in the car, including engine noise, tire friction noise and wind noise, scales the engine noise waveform by 1-β, where β is the noise reduction percentage set by the system, scales the tire friction noise waveform and the wind noise waveform in the same way, synthesizes the scaled noise waveform into a scaled noise waveform, and generates an anti-sound for the scaled noise waveform at the location of the audio-visual equipment; The noise abnormality alarm module monitors the peak values ​​of the sound waveforms of common sound sources in the car in real time. When the sound of any common sound source exceeds the threshold set by the system, the system stops the audio being played and plays an alarm audio to the user.

2. A remote control system for audio-visual equipment according to claim 1, characterized in that: The initial volume setting module includes a sound receiving unit, a distance confirmation unit and a volume analysis unit; The sound receiving unit works when the audio-visual device is not started, and collects the sound level at the location of the audio-visual device every a seconds. When the audio-visual device is started, the sound level b collected by the sound receiving unit most recently is called as the ambient sound level and transmitted to the volume analysis unit; The distance confirmation unit detects whether there is a user on any vehicle seat by a deep learning method. When the system detects that there is a user on any vehicle seat, the distance between the audio-visual device and the d vehicle seats with users is recorded as {c1, c2, ..., c d }, we get {c1,c2,…,c d The minimum value in} is c min , c min Refers to the minimum separation distance; The volume analysis unit receives the ambient sound level b and the minimum separation distance c min Finally, calculate the environmental adaptation volume e: ； Among them, f is the maximum volume of the audio and video equipment, f0 is the appropriate sound volume of the audio and video environment when the ambient sound level set by the system is 0 and the audio and video equipment is in contact with the seat, c is the average distance between the device and all seats calculated by the system, k1 is the influence weight of the ambient sound level set by the system on the environmental appropriate sound volume, and k2 is the influence weight of the minimum interval distance set by the system on the environmental appropriate sound volume.

3. A remote control system for audio-visual equipment according to claim 2, characterized in that: The real-time volume adjustment module adapts the volume e to the environment and the user information impact index E N and environmental noise impact index U N Real-time smooth adjustment of the volume of audio and video equipment, the volume after adjustment is W N : ； Where K E is the influence weight of the user information influence index on the adjusted volume, where K U is the weight of the environmental noise impact index on the adjusted volume.

4. A remote control method for audio-visual equipment applied to a remote control system for audio-visual equipment according to any one of claims 1 to 3, characterized in that: The method comprises: S10: monitor the ambient sound level of the location of the device when the audio-visual device is turned on, monitor the minimum distance between the vehicle seat of the device and the device, and set the appropriate volume for the audio-visual environment in consideration of the ambient sound level and the minimum distance; S20: monitoring the identity, number of users and location of users in the vehicle, and analyzing the user information impact index considering the number of users and the distance between the users and the audio-visual equipment; S30: Analyze the sound at the location of the audio-visual device in real time, generate anti-sound at the location of the audio-visual device to achieve noise reduction, and calculate the environmental noise impact index of the sound at the location of the audio-visual device. When the device environment monitoring module detects that the sound waveform at the location of the audio-visual device is abnormal, stop the audio being played and play an alarm audio to the user; S40: The volume of the audio-visual device is adjusted and controlled in real time according to the environment suitable volume, the user information impact index and the environment noise impact index.

Images