Working parameter determination method and device of audio equipment, equipment and storage medium

Abstract

The invention relates to a working parameter determination method and device of audio equipment, equipment, a readable storage medium and a program product. The method comprises the steps of obtaining user state information of each seat in a target vehicle, wherein the user state information is used for indicating whether a user exists on each seat or not; when it is determined that a user sits on the seat based on the user state information, the behavior state and auditory simulation information of the user are obtained, and road condition information of the target vehicle is obtained; the auditory simulation information is used for representing environment sound which can be perceived by a user sitting on the seat at present; the auditory simulation information is determined according to audio data collected by a sensor arranged at the head of the seat; and determining a target audio playing device from a plurality of audio playing devices of the target vehicle based on the user state information, and determining working parameters of the target audio playing device based on the behavior state, the auditory simulation information and the road condition information. By adopting the method, the flexibility of adjusting the working parameters of the target audio playing equipment can be improved.

Description

Technical Field

[0001] This application relates to the field of vehicle intelligent cockpit technology, and in particular to a method, apparatus, computer device, computer-readable storage medium, and computer program product for determining the operating parameters of an audio device. Background Technology

[0002] With the continuous upgrading of intelligent cockpit technology, users' requirements for driving comfort and interactive convenience are constantly increasing. As a core experience component, the personalized and precise adjustment needs of the in-vehicle audio system are becoming increasingly prominent.

[0003] In related technologies, the operating parameters of audio systems mostly rely on users to actively adjust them via buttons, touch controls, or voice commands. However, this method of relying on users to actively adjust the operating parameters of audio systems suffers from a lack of flexibility. Summary of the Invention

[0004] Therefore, it is necessary to provide a method, apparatus, computer device, computer-readable storage medium, and computer program product with high flexibility for determining the operating parameters of an audio device, in response to the above-mentioned technical problems.

[0005] In a first aspect, this application provides a method for determining the operating parameters of an audio device, including:

[0006] Obtain user status information for each seat in the target vehicle. The user status information is used to indicate whether there is a user in each seat.

[0007] When a user is identified as being seated based on user status information, the system acquires the user's behavioral state and auditory simulation information, as well as the road condition information of the target vehicle. The auditory simulation information is used to characterize the ambient sounds that the user currently perceives while seated. The auditory simulation information is determined based on audio data collected by sensors installed in the head of the seat.

[0008] The target audio playback device is determined from multiple audio playback devices in the target vehicle based on user status information, and the operating parameters of the target audio playback device are determined based on behavioral status, auditory simulation information, and road condition information.

[0009] In one embodiment, determining the operating parameters of the target audio playback device based on behavioral state, auditory simulation information, and road condition information includes: acquiring the driving state parameters of the target vehicle, and determining the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device based on the driving state parameters, behavioral state, auditory simulation information, and road condition information; and determining the operating parameters of the target audio playback device based on the volume parameters, sound effect parameters, and mixing parameters.

[0010] In one embodiment, determining the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device based on driving state parameters, behavioral state, auditory simulation information, and road condition information includes: determining initial volume parameters based on auditory simulation information and driving state parameters, and correcting the initial volume parameters based on road condition information and behavioral state to obtain the volume parameters; determining initial sound effect parameters based on auditory simulation information and driving state parameters, and correcting the initial sound effect parameters based on behavioral state to obtain the sound effect parameters; acquiring at least two different types of audio signals to be played by the target audio playback device, and acquiring initial weights corresponding to at least two different types of audio signals, wherein at least two different types of audio signals need to be played simultaneously; adjusting the initial weights based on behavioral state and road condition information to obtain target weights corresponding to at least two different types of audio signals, and determining the mixing parameters based on the target weights.

[0011] In one embodiment, determining a target audio playback device from multiple audio playback devices in a target vehicle based on user status information includes: determining the location of a target seat in the target vehicle where a user exists based on the user status information; and determining the target audio playback device from multiple audio playback devices in the target vehicle based on the target seat location.

[0012] In one embodiment, obtaining user status information for each seat in the target vehicle includes: obtaining first data collected by pressure sensors installed on each seat, and obtaining second data collected by a first image acquisition device installed in the target vehicle; determining whether a user is present on each seat based on the first data and the second data, and determining user status information for each seat based on the determination result.

[0013] In one embodiment, acquiring the user's auditory simulation information includes: acquiring third data collected by sensors installed on the headrests of each seat in the target vehicle; determining at least one of ambient noise, user interaction sounds within the target vehicle, and audio sounds output by each audio playback device based on the third data; and determining at least one of the ambient noise, interaction sounds, and audio sounds as auditory simulation information.

[0014] In one embodiment, obtaining road condition information of the target vehicle includes: obtaining fourth data collected by a second image acquisition device located outside the target vehicle; determining at least one of scene information, traffic light status information, and obstacle information of the target vehicle based on the fourth data; and determining at least one of the scene information, traffic light status information, and obstacle information as road condition information.

[0015] Secondly, this application also provides an audio device operating parameter determination apparatus, comprising:

[0016] The first acquisition module is used to acquire user status information for each seat in the target vehicle. The user status information is used to indicate whether there is a user in each seat.

[0017] The second acquisition module is used to acquire the user's behavioral state and auditory simulation information when a user is sitting in the seat based on the user's status information, and to acquire the road condition information of the target vehicle; the auditory simulation information is used to characterize the ambient sound that the user sitting in the seat can currently perceive; the auditory simulation information is determined based on the audio data collected by the sensor set in the head of the seat;

[0018] The determination module is used to determine the target audio playback device from multiple audio playback devices in the target vehicle based on user status information, and to determine the operating parameters of the target audio playback device based on behavioral status, auditory simulation information and road condition information.

[0019] Thirdly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of the method described in any of the embodiments of the first aspect above.

[0020] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described in any of the embodiments of the first aspect above.

[0021] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the method described in any of the embodiments of the first aspect above.

[0022] The aforementioned method, apparatus, computer device, computer-readable storage medium, and computer program product for determining the operating parameters of an audio device first acquire user status information for each seat in the target vehicle. This user status information indicates whether a user is present in each seat. Then, upon determining that a user is present in a seat based on the user status information, the method acquires the user's behavioral state and auditory simulation information, as well as the road condition information of the target vehicle. The auditory simulation information characterizes the ambient sounds currently perceived by the user sitting in the seat. This auditory simulation information is determined based on audio data collected by sensors installed at the head of the seat. Finally, based on the user status information, the method identifies the target audio playback device from multiple audio playback devices in the target vehicle and determines the operating parameters of the target audio playback device based on the behavioral state, auditory simulation information, and road condition information. The method for determining the operating parameters of the audio device provided in this application determines the target audio playback device in the target vehicle by using the user status information of each seat in the target vehicle, and determines the operating parameters of the target audio playback device by using the user's behavioral status, the user's auditory simulation information, and the road condition information of the target vehicle. This not only realizes the automatic adjustment of the operating parameters of the audio system, improving the user's flexibility in controlling the vehicle audio system, but also realizes the precise adjustment of the operating parameters of the audio system, which is conducive to improving the user's user experience. Attached Figure Description

[0023] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 This is a flowchart illustrating a method for determining the operating parameters of an audio device in one embodiment;

[0025] Figure 2 This is a flowchart illustrating a method for obtaining user status information in one embodiment;

[0026] Figure 3 This is a flowchart illustrating a method for obtaining simulated auditory information of a user in one embodiment;

[0027] Figure 4 This is a flowchart illustrating a method for obtaining road condition information of a target vehicle in one embodiment.

[0028] Figure 5 This is a flowchart illustrating a method for determining a target audio playback device in one embodiment;

[0029] Figure 6This is a flowchart illustrating a method for determining the operating parameters of a target audio playback device in one embodiment;

[0030] Figure 7 This is a flowchart illustrating the process of determining volume parameters, sound effect parameters, and mixing parameters in one embodiment;

[0031] Figure 8 This is a flowchart illustrating a method for determining the operating parameters of an audio device in another embodiment;

[0032] Figure 9 This is a schematic diagram of the target vehicle in one embodiment;

[0033] Figure 10 A structural block diagram of an audio device operating parameter determination apparatus in one embodiment;

[0034] Figure 11 This is an internal structural diagram of a computer device in one embodiment;

[0035] Figure 12 This is a diagram of the internal structure of a computer device in another embodiment. Detailed Implementation

[0036] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0037] It should be noted that the terms "first," "second," etc., used in this application can be used to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from the second element. The terms "comprising" and "having," and any variations thereof, used in this application, are intended to cover non-exclusive inclusion. The term "multiple" used in this application refers to two or more. The term "and / or" used in this application refers to one of the embodiments, or any combination of multiple embodiments.

[0038] With the continuous upgrading of intelligent cockpit technology, users' requirements for driving comfort and interactive convenience are constantly increasing. As a core experience component, the personalized and precise adjustment needs of the in-vehicle audio system are becoming increasingly prominent.

[0039] In related technologies, the operating parameters of audio systems mostly rely on users to actively adjust them via buttons, touch controls, or voice commands. However, this method of relying on users to actively adjust the operating parameters of audio systems suffers from a lack of flexibility.

[0040] In view of this, this application provides a method for determining the operating parameters of an audio device. First, user status information for each seat in the target vehicle is acquired, indicating whether a user is present in each seat. Then, when it is determined that a user is present in a seat based on the user status information, the user's behavioral state and auditory simulation information are acquired, along with the road condition information of the target vehicle. The auditory simulation information characterizes the ambient sounds currently perceived by the user sitting in the seat; this information is determined based on audio data collected by sensors installed in the head of the seat. Finally, based on the user status information, a target audio playback device is determined from multiple audio playback devices in the target vehicle, and the operating parameters of the target audio playback device are determined based on the behavioral state, auditory simulation information, and road condition information. The method for determining the operating parameters of an audio device provided in this application determines the target audio playback device in the target vehicle through the user status information of each seat, and determines the operating parameters of the target audio playback device through the user's behavioral state, auditory simulation information, and road condition information. This not only achieves automatic adjustment of the audio system's operating parameters, improving the user's flexibility in controlling the vehicle's audio system, but also enables precise adjustment of the audio system's operating parameters, thus enhancing the user experience.

[0041] The method for determining the operating parameters of an audio device provided in this application can be executed by a computer device, which can be a terminal, such as the electronic control unit of the target vehicle or an in-vehicle intelligent computing platform. The computer device can also be a server, which can communicate with the target vehicle via a network, obtain user status information, auditory simulation information, and road condition information through the network, and send the determined operating parameters of the target audio playback device to the target vehicle through the network.

[0042] In one exemplary embodiment, such as Figure 1 As shown, a method for determining the operating parameters of an audio device is provided, the method comprising the following steps:

[0043] Step 101: Obtain the user status information of each seat in the target vehicle.

[0044] Optionally, user status information can be used to indicate whether a user is present in each seat.

[0045] In some exemplary embodiments, the computer device can obtain user status information for each seat in the target vehicle.

[0046] Specifically, to determine whether a user is in each seat, the computer equipment can use data collected by pressure sensors installed on each seat. For example, when the pressure value collected by the pressure sensor is greater than a preset pressure threshold, it can be determined that a user is in the corresponding seat. The computer equipment can also use images collected by image acquisition equipment installed in the vehicle to determine whether a user is in the corresponding seat. For example, the computer equipment can perform human contour recognition on the seat area in the image. If a human contour is recognized, it can be determined that a user is in the corresponding seat.

[0047] Step 102: Based on the user status information, determine that a user is sitting in the seat, obtain the user's behavioral status and auditory simulation information, and obtain the road condition information of the target vehicle.

[0048] Optionally, the user's behavioral state can be used to indicate the user's posture, head orientation, audiovisual behavior, and body movements. Auditory simulation information can be used to characterize the ambient sounds currently perceived by the user sitting in the seat.

[0049] For example, the auditory simulation information can be determined based on audio data collected by sensors installed in the head of the seat. For instance, the audio data collected by the sensors can be directly used as the auditory simulation information, or the audio data obtained after processing the audio data collected by the sensors can be used as the auditory simulation information. The processing of audio data includes, but is not limited to, data format unification or standardization, time-domain and frequency-domain conversion, etc. The auditory simulation information is mainly used to simulate the ambient sounds perceived by the user. This embodiment does not limit the processing method used to determine the auditory simulation information. The sensor can be a headrest microphone array, installed on the left and right sides of the headrest, with the pickup end facing the user's ear, at a distance of 50mm to 200mm from the horizontal position of the ear, to pick up ambient sounds near the ear. The microphone can be a dual-microphone array or a quad-microphone array, using an omnidirectional pickup pattern, supporting a frequency response range of 20Hz to 20kHz, and a sensitivity ≥65dB, ensuring accurate acquisition of sound signals in different frequency bands. In an alternative approach, the sensor can also be placed on the seat back or door of the target vehicle.

[0050] Optionally, the road condition information of the target vehicle can be used to characterize the target vehicle's scene information, traffic light status information, obstacle information, road type information, etc. Scene information refers to the geographical environment or functional area type where the target vehicle is currently located, such as a school zone, residential area, highway service area, construction section, etc.; traffic light status information refers to the real-time display status of traffic lights ahead of the vehicle's path, such as red light, green light, flashing yellow light, arrow indicating passage status, etc.; obstacle information refers to the status of various objects in front of or around the vehicle that may affect driving safety, such as vehicles ahead, pedestrians on the roadside, non-motorized vehicles, scattered stones / goods on the road, road construction barriers, protrusions in green belts, etc.; road type information refers to the attributes and grade type of the road the target vehicle is currently traveling on, such as urban arterial road, highway, rural road, tunnel, bridge, ramp, temporary construction road, etc.

[0051] In some exemplary embodiments, after acquiring user status information of each seat in the target vehicle, the computer device can determine whether a user is sitting in the seat based on the user status information. If so, it can acquire the user's behavioral status and auditory simulation information.

[0052] Specifically, for determining a user's behavioral state, the computer device can use images captured by image acquisition equipment installed inside the vehicle. For example, the computer device can perform human posture recognition on the images to determine the user's behavioral state. The computer device can also use data collected by seat posture sensors. For example, the computer device can determine the seat back tilt angle based on the data collected by the seat posture sensors to determine the user's behavioral state. For auditory simulation information, the computer device can acquire audio data collected by sensors at the head of the seat to obtain the user's auditory simulation information.

[0053] Furthermore, the computer equipment can also acquire road condition information of the target vehicle. Specifically, the computer equipment can acquire images of the external environment through image acquisition devices installed outside the target vehicle, and obtain the target vehicle's road condition information by performing image semantic segmentation, target detection, and other image processing on the images; the computer equipment can also acquire electronic map data from the target vehicle's in-vehicle navigation system, and obtain the target vehicle's road condition information based on the electronic map data.

[0054] Step 103: Based on user status information, determine the target audio playback device from multiple audio playback devices in the target vehicle, and determine the operating parameters of the target audio playback device based on behavioral status, auditory simulation information, and road condition information.

[0055] Optionally, operating parameters may include equalizer band parameters, channel switching parameters, audio delay compensation parameters, active noise cancellation intensity parameters, volume parameters, sound effect parameters, mixing parameters, etc.

[0056] In some exemplary embodiments, after acquiring user status information, auditory simulation information, and road condition information, the computer device can first determine the target audio playback device from multiple audio playback devices of the target vehicle based on the user status information.

[0057] Specifically, multiple audio playback devices in the target vehicle can be associated with corresponding seats within the vehicle. For example, for the driver, the speaker on the front left door and the headrest speaker can be associated with the driver. The computer can determine whether a user is present in each seat based on user status information and identify the audio playback device corresponding to the seat with the present user as the target audio playback device.

[0058] In some exemplary embodiments, the computer device can also determine the target audio playback device corresponding to the user from multiple audio playback devices in the target vehicle based on the behavioral status in the user status information. For example, if a user's behavioral status indicates that the user is answering a phone call, then the audio playback device that is close to the user can be determined as the target audio playback device.

[0059] Furthermore, after determining the target audio playback device from multiple audio playback devices in the target vehicle based on user status information, the computer device can determine the operating parameters of the target audio playback device based on user status information, auditory simulation information, and road condition information.

[0060] Specifically, the computer device can use a user status-operating parameter mapping list to determine the first operating parameter based on user status information, an auditory simulation-operating parameter mapping list to determine the second operating parameter based on auditory simulation information, and a road condition-operating parameter mapping list to determine the third operating parameter based on road condition information. The first, second, and third operating parameters are then weighted and summed to determine the operating parameters of the target audio playback device. The user status-operating parameter mapping list can indicate the mapping relationship between different user status information and different operating parameters, the auditory simulation-operating parameter mapping list can indicate the mapping relationship between different auditory simulation information and different operating parameters, and the road condition-operating parameter mapping list can indicate the mapping relationship between different road condition information and different operating parameters.

[0061] The aforementioned method for determining the operating parameters of an audio device first acquires user status information for each seat in the target vehicle. This user status information indicates whether a user is seated in each seat. Then, when it is determined that a user is seated based on the user status information, the user's behavioral state and auditory simulation information are acquired, along with the road condition information of the target vehicle. The auditory simulation information characterizes the ambient sounds currently perceived by the user seated in the seat. This auditory simulation information is determined based on audio data collected by sensors installed in the head of the seat. Finally, based on the user status information, the target audio playback device is determined from multiple audio playback devices in the target vehicle, and the operating parameters of the target audio playback device are determined based on the behavioral state, auditory simulation information, and road condition information. The method for determining the operating parameters of an audio device provided in this application determines the target audio playback device in the target vehicle through the user status information for each seat, and determines the operating parameters of the target audio playback device through the user's behavioral state, auditory simulation information, and road condition information. This not only achieves automatic adjustment of the audio system's operating parameters, improving the user's flexibility in controlling the vehicle's audio system, but also enables precise adjustment of the audio system's operating parameters, thus enhancing the user experience.

[0062] Furthermore, the method for determining the operating parameters of the audio device provided in this application can reduce the need for users to manually adjust the frequency of the audio device, reduce the risk of distraction caused by operating the audio device while driving, and significantly improve driving safety.

[0063] In one exemplary embodiment, such as Figure 2 As shown, obtaining user status information for each seat in the target vehicle includes the following steps:

[0064] Step 201: Acquire the first data collected by the pressure sensors installed on each seat, and acquire the second data collected by the first image acquisition device installed in the target vehicle.

[0065] Optionally, the first image acquisition device can be a camera installed in the rearview mirror or on the left or right B-pillars of the target vehicle. The first image acquisition device can have a resolution of ≥5 megapixels, a viewing angle of ≥100 degrees, and a frame rate of ≥30fps.

[0066] In some exemplary embodiments, the computer device can acquire first data collected by pressure sensors installed on each seat. Specifically, the computer device can communicate with the pressure sensors installed on each seat and acquire the first data collected by the pressure sensors on each seat based on the communication connection.

[0067] Furthermore, the computer device can also acquire second data collected by the first image acquisition device installed inside the target vehicle. Specifically, the computer device can communicate with the first image acquisition device and acquire the second data collected by the first image acquisition device based on this communication connection.

[0068] Step 202: Determine whether there is a user on each seat based on the first data and the second data, and determine the user status information of each seat according to the determination result.

[0069] In some exemplary embodiments, after acquiring first data collected by pressure sensors installed on each seat and second data collected by a first image acquisition device installed in the target vehicle, the computer device can determine whether a user is present on each seat based on the first data and / or the second data.

[0070] Specifically, the computer device can determine a first judgment result based on the first data. For example, when the real-time pressure value collected by the pressure sensor is greater than a preset human body pressure threshold and the pressure duration exceeds a preset stable duration, the first judgment result can be determined as the presence of a user in the seat. When the pressure value is less than the threshold or the duration is insufficient, the first judgment result can be determined as the absence of a user. The computer device can also determine a second judgment result based on the second data. For example, the computer device can perform image preprocessing, human contour detection, and feature point extraction on the second data to identify whether there are human features such as heads and shoulders in the seat area. If human features are detected, the second judgment result is determined as the presence of a user; if no human features are detected, the second judgment result is determined as the absence of a user. Then, the presence of a user in each seat is determined according to the first and second judgment results. For example, when the first and second judgment results are consistent, the result is directly used as the final judgment result. When the two results are inconsistent, the first and second data within a preset duration can be retrieved for fusion analysis, and the majority judgment result of multiple consecutive frames of data is used as the final judgment result.

[0071] Furthermore, after determining whether a user is present in each seat based on the first and second data, the computer equipment can determine the user status information of each seat according to the determination result.

[0072] Specifically, if it is determined based on the first data and the second data that there is a user in seat A of the target vehicle, then the user status information of seat A can be determined as having a user.

[0073] In an optional embodiment of this application, when the computer device determines that a user is sitting in the seat based on user status information, it can obtain the user's behavioral status.

[0074] Optionally, a user's behavioral state may include at least one of sitting posture, head orientation, and audiovisual behavior. For example, sitting posture may be an upright sitting posture, a relaxed sitting posture with the head leaning back, a forward-leaning operating posture, or a side-lying leaning posture; head orientation may be facing the front of the vehicle, facing the left side window, facing the right side window, or facing the rear passenger; audiovisual behavior may be talking, using electronic devices, or looking down.

[0075] In some exemplary embodiments, the computer device may determine the user's behavioral state based on second data.

[0076] Specifically, regarding sitting posture, the computer device can extract key points of the human skeleton from the second data, calculate the angles between the shoulders, waist, and seat back, and the percentage of contact area between the buttocks and the seat cushion to determine the user's sitting posture. For example, when the angle is greater than a preset threshold and the percentage of contact area is higher than a baseline value, it is determined to be a relaxed, reclining posture; when the angle is less than a preset threshold and the upper body contour leans forward beyond the edge of the seat, it is determined to be a forward-leaning posture. The computer device can also use image semantic segmentation technology to separate the user's body area from the seat area in the second data, analyze the projection position of the body's center of gravity on the seat, and determine the user's sitting posture by combining the direction and amount of the projection position's offset. The computer device can also obtain seat posture through the seat adjustment system, such as seat cushion height, seat cushion tilt angle, and backrest tilt angle, thereby determining the user's sitting posture.

[0077] Regarding head orientation, the computer device can detect the user's facial feature points in the second data, extract the coordinate information of key facial features such as eyes, nose, and chin, calculate the angle between the facial orientation vector and the vehicle's driving direction, and determine the head orientation based on the angle range. For example, when the angle is between 0 and 15 degrees, it is determined that the head is facing the front of the vehicle; when the angle is between 16 and 75 degrees and the face is facing the left side of the vehicle, it is determined that the head is facing the left window; when the angle is between 16 and 75 degrees and the face is facing the right side of the vehicle, it is determined that the head is facing the right window; and when the angle is greater than 75 degrees, it is determined that the head is turned towards the rear passengers.

[0078] Regarding audiovisual behavior, computer devices can perform target detection on the second data to identify whether the user is holding an electronic device or whether there are lip-opening conversational movements, in order to determine the user's audiovisual behavior. The computer devices can also perform action timing analysis on the second data to extract features such as the user's head rotation frequency and gaze placement area within a preset time period, in order to determine the user's audiovisual behavior. For example, when the head rotation frequency is higher than a threshold and the gaze frequently rests on the central control display screen, it is determined to be a behavior of focused viewing of audiovisual content. When the gaze does not have a fixed placement area and is accompanied by body interaction, it is determined to be a leisure behavior without active audiovisual engagement.

[0079] In one exemplary embodiment, such as Figure 3 As shown, obtaining the user's auditory simulation information includes the following steps:

[0080] Step 301: Obtain third data collected by sensors installed on the head of each seat in the target vehicle.

[0081] Optionally, the sensor can be a headrest microphone array, installed on the left and right sides of the seat headrest, with the pickup end facing the user's ear, at a distance of 50mm to 200mm from the horizontal position of the ear, to pick up the sound environment near the ear. The microphone can be a dual-microphone array or a quad-microphone array, with omnidirectional pickup mode, supporting a frequency response range of 20Hz to 20kHz, and a sensitivity of ≥65dB, ensuring accurate acquisition of sound signals in different frequency bands. In an optional configuration, the sensor can also be placed on the seat back or door of the target vehicle.

[0082] In some exemplary embodiments, the computer device may acquire third data collected by sensors located on the head of each seat in the target vehicle.

[0083] Specifically, the computer equipment can communicate with the sensors in each seat head and acquire third data collected by the sensors in each seat head through this communication connection.

[0084] Step 302: Based on the third data, determine at least one of the following: ambient noise, user interaction sounds inside the target vehicle, and audio sounds output by each audio playback device.

[0085] In some exemplary embodiments, after acquiring third data collected by sensors installed on the headrests of each seat in the target vehicle, the computer device can determine at least one of the following based on the third data: ambient noise, user interaction sounds within the target vehicle, and audio sounds output by each audio playback device.

[0086] Specifically, the computer equipment can first preprocess the third data, for example, by using an adaptive filtering algorithm to eliminate circuit noise and signal transmission interference; then, it can determine the audio features from the third data that match the ambient noise, the interactive sounds of the user inside the target vehicle, and the audio sounds output by each audio playback device, as the ambient noise, the interactive sounds of the user inside the target vehicle, and the audio sounds output by each audio playback device.

[0087] Step 303: Identify at least one of ambient noise, interactive sound, and audio sound as auditory simulation information.

[0088] In some exemplary embodiments, after determining at least one of ambient noise, interactive sounds of a user inside a target vehicle, and audio sounds output by various audio playback devices based on third data, the computer device may determine at least one of ambient noise, interactive sounds, and audio sounds as auditory simulation information.

[0089] In one exemplary embodiment, such as Figure 4 As shown, obtaining road condition information for the target vehicle includes the following steps:

[0090] Step 401: Obtain the fourth data collected by the second image acquisition device set outside the target vehicle.

[0091] Optionally, the second image acquisition device may be a camera installed above the windshield and on the left and right rearview mirrors of the target vehicle.

[0092] In some exemplary embodiments, the computer device may acquire fourth data from a second image acquisition device located outside the target vehicle.

[0093] Specifically, the computer device can communicate with the second image acquisition device and obtain the fourth data acquired by the second image acquisition device through the communication connection.

[0094] Step 402: Determine at least one of the following based on the fourth data: scene information of the target vehicle, traffic light status information, and obstacle information.

[0095] For example, scene information refers to the geographical environment or functional area type where the target vehicle is currently located, such as school area, residential area, highway service area, construction section, etc.

[0096] Traffic light status information refers to the real-time display status of traffic lights ahead of a vehicle's travel path, such as red light, green light, flashing yellow light, and arrows indicating the passage status.

[0097] Obstacle information refers to the state of various objects in front of or around a vehicle that may affect driving safety, such as vehicles in front, pedestrians on the roadside, non-motorized vehicles, scattered stones / goods on the road, road construction barriers, and protrusions in green belts.

[0098] In some exemplary embodiments, after acquiring fourth data from a second image acquisition device located outside the target vehicle, the computer device can determine at least one of the following based on the fourth data: scene information of the target vehicle, traffic light status information, and obstacle information.

[0099] Specifically, the computer equipment can first perform image preprocessing on the fourth data, such as defogging, noise reduction, and white balance calibration, to enhance the effective features of the image. Then, for scene information, the computer equipment can use image semantic segmentation algorithms to extract regional features such as road signs, building facades, and road facilities, and match them with preset scene feature templates such as school areas, residential areas, and construction sections to determine the current scene information based on the matching degree. For traffic light status information, the computer equipment can use color threshold segmentation algorithms to extract red, yellow, and green regions, and combine shape detection to identify the circular or arrow outline of the traffic light to determine the traffic light status information. For obstacle information, the computer equipment can use target detection algorithms to identify targets such as vehicles, pedestrians, and non-motorized vehicles in the image, and mark the location coordinates and outline range of the targets to determine obstacle information.

[0100] Step 403: Determine at least one of the following as road condition information: scene information, traffic light status information, and obstacle information.

[0101] In some exemplary embodiments, after determining at least one of the scene information, traffic light status information, and obstacle information of the target vehicle based on the fourth data, the computer device may determine at least one of the scene information, traffic light status information, and obstacle information as road condition information.

[0102] In one exemplary embodiment, such as Figure 5 As shown, determining the target audio playback device from multiple audio playback devices in the target vehicle based on user status information includes the following steps:

[0103] Step 501: Determine the location of the target seat in the target vehicle where the user exists based on the user status information.

[0104] In some exemplary embodiments, after obtaining user status information, the computer device can determine the location of a target seat in the target vehicle where a user exists based on the user status information.

[0105] Specifically, since user status information can be used to indicate whether there is a user in each seat, the seats with users can be determined based on the user status information, and the seats with users can be identified as target seats. The location of the target seats can be obtained, such as the front left seat, the front right seat, the rear left seat, and the rear right seat.

[0106] Step 502: Determine the target audio playback device from multiple audio playback devices in the target vehicle based on the target seat position.

[0107] In some exemplary embodiments, after determining the location of a target seat in a target vehicle where a user exists based on user status information, the computer device can determine the target audio playback device from multiple audio playback devices in the target vehicle based on the target seat location.

[0108] Specifically, the computer equipment can utilize a seat-audio playback device mapping list to determine the target audio playback device from multiple audio playback devices in the target vehicle based on the target seat's location. The seat-audio playback device mapping list can be used to indicate the correspondence between different seats and different audio playback devices.

[0109] In one exemplary embodiment, such as Figure 6 As shown, the operating parameters of the target audio playback device are determined based on behavioral state, auditory simulation information, and road condition information, including:

[0110] Step 601: Obtain the driving status parameters of the target vehicle, and determine the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device based on the driving status parameters, behavior status, auditory simulation information, and road condition information.

[0111] Optionally, driving status parameters can include vehicle speed, engine speed, gear status, braking status, steering angle, accelerator pedal opening, window opening / closing status, suspension vibration, and tire noise.

[0112] Volume parameters refer to parameters used to control the loudness of the sound output from the target audio playback device. Sound effect parameters refer to parameters used to adjust the frequency characteristics and sound field effects of the audio signal. Mixing parameters refer to parameters used to coordinate the superposition and output of multiple audio source signals. For example, mixing parameters may include the weight of each audio source, mixing priority order, signal superposition algorithm selection, noise reduction processing intensity, etc.

[0113] In some exemplary embodiments, the computer device can acquire driving status parameters of the target vehicle. Specifically, the computer device can acquire the driving status parameters of the target vehicle through sensors installed on the target vehicle, such sensors including vehicle speed sensors, gear position sensors, window status sensors, active noise cancellation acceleration sensors, etc.

[0114] Furthermore, after acquiring the driving status parameters of the target vehicle, the computer equipment can determine the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device based on the driving status parameters, the user's behavior status, auditory simulation information, and road condition information.

[0115] Specifically, the computer equipment can input driving status parameters, user behavior status, auditory simulation information, and road condition information into pre-trained volume parameter determination models, sound effect parameter determination models, and mixing parameter determination models, respectively, to obtain the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device output by the volume parameter determination models, sound effect parameter determination models, and mixing parameter determination models.

[0116] Each of the defined models can be a lightweight Transformer regression model. The input layer of this model can uniformly encode driving state parameters, user state information, auditory simulation information and road condition information. The encoding layer adopts a multi-layer Transformer encoder and captures the correlation between different input features through a multi-head self-attention mechanism. The output layer outputs volume parameters, sound effect parameters and mixing parameters through a regression head.

[0117] Computer equipment can also use algorithms such as adaptive filtering, equalizer adjustment, and 3D sound processing to determine the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device based on driving status parameters, user status information, auditory simulation information, and road condition information.

[0118] Step 602: Determine the operating parameters of the target audio playback device based on the volume parameters, sound effect parameters, and mixing parameters.

[0119] In some exemplary embodiments, after determining the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device based on driving status parameters, user status information, auditory simulation information, and road condition information, the computer device can determine the operating parameters of the target audio playback device based on the volume parameters, sound effect parameters, and mixing parameters.

[0120] Specifically, computer equipment can determine the volume parameters, sound effect parameters, and mixing parameters as the operating parameters of the target audio playback device.

[0121] In one exemplary embodiment, such as Figure 7 As shown, the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device are determined based on driving state parameters, behavioral state, auditory simulation information, and road condition information, including the following steps:

[0122] Step 701: Determine the initial volume parameters based on auditory simulation information and driving state parameters, and correct the initial volume parameters based on road condition information and behavioral state to obtain the volume parameters.

[0123] In some exemplary embodiments, the computer device may determine the initial volume parameters based on auditory simulation information and driving state parameters.

[0124] Specifically, the computer equipment can first perform spectrum analysis and energy feature extraction on the auditory simulation information, and determine the first ambient noise intensity by comparing it with a preset noise spectrum template; then, it can obtain parameters such as vehicle speed, engine speed, window opening / closing status, and suspension vibration frequency through driving state parameters, and determine the second ambient noise intensity based on a preset driving parameter-noise intensity mapping relationship list; then, it can determine the total noise intensity based on the first and second ambient noise intensities, for example, by calculating the sum of the first and second ambient noise intensities as the total noise intensity, and using the noise intensity-volume parameter mapping relationship list to determine the initial volume parameter based on the total noise intensity. The noise intensity-volume parameter mapping relationship list is used to indicate the mapping relationship between different noise intensities and different volume parameters; alternatively, it can use preset volume parameter determination rules to determine the initial volume parameter based on the total noise intensity. For example, the preset volume parameter determination rule could be that for every 10dB increase in noise intensity, the volume should increase by 3-5dB.

[0125] Furthermore, after determining the initial volume parameters based on auditory simulation information and driving state parameters, the computer equipment can correct the initial volume parameters based on road condition information and behavioral state to obtain the final volume parameters.

[0126] Specifically, if the traffic information indicates a scenario such as a school or hospital, the computer equipment can first lower the upper limit of the initial volume parameter by 10-15dB, and then reduce the actual volume increase by 50% according to the original volume gain rule; if the traffic information indicates a scenario such as a highway or urban main road, the gain of the initial volume parameter can be retained, and the volume fluctuation range can be adjusted only according to the real-time traffic density; if the behavior status indicates that the user in the vehicle is looking down at their mobile phone, the computer equipment can increase the volume parameter by 2-3dB; if the user status information indicates that there is conversation or multi-person interaction in the vehicle, the computer equipment can reduce the volume parameter by 5-8dB.

[0127] Step 702: Determine the initial sound effect parameters based on auditory simulation information and driving state parameters, and correct the initial sound effect parameters based on the behavior state to obtain the sound effect parameters.

[0128] In some exemplary embodiments, the computer device may determine initial sound effect parameters based on auditory simulation information and driving state parameters.

[0129] Specifically, the computer equipment can first perform full-band spectrum analysis on the auditory simulation information to obtain the noise energy proportion and distribution characteristics of each sub-band from 20Hz to 20kHz. Based on the vehicle speed, suspension vibration frequency, and road contact feedback data in the driving state parameters, a matching model is used to determine the current dominant noise type. This matching model is pre-loaded with a feature database of typical noises such as tire noise, wind noise, and engine noise, including the high-frequency peak characteristics of tire noise from 1000 to 3000Hz, the frequency band energy characteristics of wind noise from 2000 to 5000Hz, and the low-frequency periodic pulsation characteristics of engine noise. Simultaneously, it associates the corresponding noise type with the triggering driving parameter range. For example, tire noise corresponds to a suspension vibration frequency of 20~50Hz and a vehicle speed of 40~80km / h; wind noise corresponds to a vehicle speed ≥80km / h and a window that is open or half-open; and engine noise corresponds to a speed ≥2500r / min and a low gear. The computer equipment performs similarity matching between the real-time collected noise spectrum characteristics and the feature database, while verifying whether the current driving parameters fall within the corresponding noise trigger range. When the spectrum similarity is ≥85% and the driving parameter matching degree is ≥90%, the triggering range is determined. When the noise is dominant, it can be determined that the noise is the dominant noise type. For tire noise-dominated scenarios, when the suspension vibration frequency is in the tire noise sensitive range and the energy proportion of the 1000~3000Hz frequency band exceeds the preset threshold, the gain of this frequency band can be increased by 3~6dB, while attenuating low-frequency redundant noise below 500Hz to reduce the interference of noise on audio clarity. For wind noise-dominated scenarios, when the vehicle speed is ≥80km / h and the energy proportion of the 2000~5000Hz frequency band increases, the gain of this frequency band can be increased by 2~5dB, while adjusting the gain correction coefficient according to the opening and closing status of the windows. In addition, the computer equipment can also combine the gear status and engine speed in the driving status parameters to determine the stability of the vehicle power supply, set the basic output threshold of the sound effect parameters, avoid audio distortion under high load conditions, and generate initial sound effect parameters.

[0130] Furthermore, after determining the initial sound effect parameters based on auditory simulation information and driving state parameters, the computer device can modify the initial sound effect parameters based on the behavioral state to obtain the final initial sound effect parameters.

[0131] Specifically, if the behavior status indicates that the passenger is in a reclining position, the mid-to-high frequency gain of the initial sound effect parameters in the range of 1000~5000Hz can be enhanced to improve the directional perception of the audio. If the behavior status indicates that the passenger is in a forward-leaning operating posture, the phase difference parameter of the initial sound effect parameters can be adjusted to expand the sound field coverage and achieve wide-angle propagation of the audio signal. If the behavior status indicates that the passenger is a single person in the vehicle with their head facing the driver's side speaker, the mono directional output parameter of the initial sound effect parameters can be optimized. If the behavior status indicates that the passenger is a multiple person in the vehicle and there is head-turning conversation, the initial sound effect parameters can be adjusted to achieve a directional sound field and avoid mutual interference.

[0132] Step 703: Obtain at least two different types of audio signals to be played by the target audio playback device, and obtain the initial weights corresponding to the at least two different types of audio signals; adjust the initial weights based on the behavior state and road condition information to obtain the target weights corresponding to the at least two different types of audio signals, and determine the mixing parameters based on the target weights.

[0133] At least two different types of audio signals must be played simultaneously. Optionally, different types of audio signals may include navigation voice, call sound, warning sound, and music.

[0134] In some exemplary embodiments, the computer device may first obtain at least two different types of audio signals that the target audio playback device is currently playing, and obtain the initial weights corresponding to the at least two different types of audio signals.

[0135] Specifically, the initial weight of the navigation voice can be greater than the initial weight of the call voice, the initial weight of the call voice can be greater than the initial weight of the warning tone, and the initial weight of the warning tone can be greater than the initial weight of the music. For example, the initial weight of the navigation voice can be 0.6-0.8, the initial weight of the call voice can be 0.4-0.6, the initial weight of the warning tone can be 0.3-0.5, and the initial weight of the music can be 0.2-0.4.

[0136] Furthermore, after acquiring the initial weights of various types of audio signals, the computer device can adjust the initial weights based on behavioral state and road condition information to obtain target weights corresponding to at least two different types of audio signals.

[0137] Specifically, if the traffic information indicates a complex road condition such as a construction zone, tunnel entrance, or sharp bend, the computer equipment can increase the initial weight of the navigation voice by 0.1-0.2, while decreasing the initial weight of the music by 0.1-0.15 to ensure clear transmission of navigation instructions. If the traffic information indicates a quiet environment such as a school zone or hospital zone, the computer equipment will decrease the initial weight of the warning sound by 0.05-0.1 to avoid excessive noise interference, while maintaining the navigation voice weight unchanged to ensure driving safety. If the traffic information indicates that the traffic light has turned red or there is an obstacle ahead, the computer equipment will temporarily increase the initial weight of the warning sound to 0.7-0.8, while simultaneously decreasing the weights of the navigation voice, call audio, and music by 0.1-0.2 each, until the traffic light turns green or the obstacle is cleared.

[0138] If the behavior status indicates that a passenger is answering a phone call in the vehicle, the computer system can increase the initial weight of the call audio by 0.1-0.15, decrease the initial weight of the music by 0.1-0.2, and reduce the weight of the navigation voice and warning sounds by 0.05-0.1 to avoid interference from other audio signals with call clarity. If the behavior status indicates that the occupants are conversing, the computer system can reduce the initial weight of the music by 0.1-0.15 while maintaining the basic weight of the navigation voice and warning sounds. If the behavior status indicates that some passengers are resting with their eyes closed, the computer system will reduce the weight of the music in the corresponding seat area by 0.2-0.3 while retaining the minimum weight threshold for the navigation voice and warning sounds. If the behavior status indicates that passengers are focused on watching the audio-visual content on the central control screen, the computer system will increase the initial weight of the music by 0.1-0.15 and reduce the weight of the navigation voice by 0.05-0.1, and will only restore the weight when key navigation commands are triggered.

[0139] Furthermore, after adjusting the initial weights based on user status information and traffic information to obtain target weights corresponding to at least two different types of audio signals, the computer equipment can determine the mixing parameters based on the target weights.

[0140] Specifically, the computer equipment can assign gain coefficients to each audio signal according to the target weight, with higher weights resulting in greater gains. It can also set signal superposition priorities, prioritizing the output of high-weight signals and attenuating and superimposing low-weight signals. Furthermore, it can calibrate the phase difference of multiple signals to eliminate distortion and generate mixing parameters.

[0141] The method described above, which determines the volume, sound effect, and mixing parameters of the target audio playback device based on driving status parameters, behavioral status, auditory simulation information, and road condition information, enables personalized audio adjustment for users in different seats. By identifying the status and behavioral status of each seat user, it differentiates and matches volume, sound effect, and mixing parameters to ensure that each user receives an auditory experience that meets their individual needs. Simultaneously, it automatically optimizes the direction and intensity of sound effects based on the user's position and behavioral status, and dynamically adjusts the sound field positioning and frequency band gain based on posture, head orientation, and other behavioral states, effectively counteracting environmental noise interference and creating a layered and immersive auditory environment for the user. This system enhances the listening experience during long car rides, reducing fatigue and supporting personalized audio settings for multiple users. Through zoned volume control, directional sound field adjustment, and dynamic audio weighting, it caters to the auditory preferences of different users in various states such as conversation, rest, and audio-visual activities. It balances individual needs with the overall in-vehicle audio environment, and achieves deep correlation between audio parameters and vehicle driving conditions and external road conditions. It can automatically adjust audio strategies according to different scenarios such as highways, construction zones, and school zones, maintaining optimal audio performance without manual intervention from the user. This also reduces the risk of distraction caused by operating audio devices while driving, improving driving safety.

[0142] In one exemplary embodiment, such as Figure 8 As shown, another method for determining the operating parameters of an audio device is provided, including the following steps:

[0143] Step 801: Acquire first data collected by pressure sensors installed on each seat, and acquire second data collected by a first image acquisition device installed in the target vehicle; determine whether there is a user on each seat based on the first and second data, and when a user is sitting on a seat based on user status information, acquire the user's behavioral status; the user's behavioral status includes at least one of sitting posture, head orientation, and audiovisual behavior.

[0144] Step 802: Acquire third data collected by sensors installed on the headrests of each seat in the target vehicle; determine at least one of the following based on the third data: ambient noise, user interaction sounds in the target vehicle, and audio sounds output by each audio playback device; determine at least one of the following as auditory simulation information, which is used to characterize the ambient sounds currently perceived by the user sitting in the seat; the auditory simulation information is determined based on the audio data collected by the sensors installed on the headrests of the seats.

[0145] Step 803: Acquire the fourth data collected by the second image acquisition device set outside the target vehicle; determine at least one of the scene information, traffic light status information and obstacle information of the target vehicle based on the fourth data; determine at least one of the scene information, traffic light status information and obstacle information as road condition information;

[0146] Step 804: Determine the location of the target seat in the target vehicle where the user exists based on the user status information; determine the target audio playback device from multiple audio playback devices in the target vehicle based on the target seat location;

[0147] Step 805: Determine the initial volume parameters based on auditory simulation information and driving state parameters, and correct the initial volume parameters based on road condition information and behavioral state to obtain the volume parameters; determine the initial sound effect parameters based on auditory simulation information and driving state parameters, and correct the initial sound effect parameters based on behavioral state to obtain the sound effect parameters; acquire at least two different types of audio signals to be played by the target audio playback device, and acquire the initial weights corresponding to at least two different types of audio signals, which must be played simultaneously; adjust the initial weights based on behavioral state and road condition information to obtain the target weights corresponding to at least two different types of audio signals, and determine the mixing parameters based on the target weights; determine the operating parameters of the target audio playback device based on the volume parameters, sound effect parameters, and mixing parameters.

[0148] In one exemplary embodiment, such as Figure 9 As shown, Figure 9 The locations of the aforementioned sensors on the target vehicle are shown.

[0149] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages in other steps. It is understood that the steps in different embodiments can be freely combined as needed, and all non-contradictory solutions formed by such combinations are within the scope of protection of this application.

[0150] Based on the same inventive concept, this application also provides an audio device operating parameter determination apparatus for implementing the above-described audio device operating parameter determination method. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, the specific limitations in one or more audio device operating parameter determination apparatus embodiments provided below can be found in the limitations of the audio device operating parameter determination method described above, and will not be repeated here.

[0151] In one exemplary embodiment, such as Figure 10 As shown, an audio device operating parameter determination apparatus 1000 is provided, comprising: a first acquisition module 1001, a second acquisition module 1002, and a determination module 1003, wherein:

[0152] The first acquisition module 1001 is used to acquire user status information of each seat in the target vehicle. The user status information is used to indicate whether there is a user in each seat.

[0153] The second acquisition module 1002 is used to acquire the user's behavioral state and auditory simulation information when it is determined that a user is sitting in the seat based on the user's state information, and to acquire the road condition information of the target vehicle; the auditory simulation information is used to characterize the ambient sound that the user sitting in the seat can currently perceive; the auditory simulation information is determined based on the audio data collected by the sensor set in the head of the seat.

[0154] The determination module 1003 is used to determine the target audio playback device from multiple audio playback devices in the target vehicle based on user status information, and to determine the operating parameters of the target audio playback device based on user status information, auditory simulation information and road condition information.

[0155] In one embodiment, the determining module 1003 is specifically used to acquire the driving state parameters of the target vehicle, and determine the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device based on the driving state parameters, behavior state, auditory simulation information, and road condition information; and determine the operating parameters of the target audio playback device based on the volume parameters, sound effect parameters, and mixing parameters.

[0156] In one embodiment, the determining module 1003 is specifically configured to: determine initial volume parameters based on auditory simulation information and driving state parameters; and correct the initial volume parameters based on road condition information and behavioral state to obtain volume parameters; determine initial sound effect parameters based on auditory simulation information and driving state parameters; and correct the initial sound effect parameters based on behavioral state to obtain sound effect parameters; acquire at least two different types of audio signals to be played by the target audio playback device, and acquire the initial weights corresponding to the at least two different types of audio signals, wherein the at least two different types of audio signals need to be played simultaneously; adjust the initial weights based on behavioral state and road condition information to obtain target weights corresponding to the at least two different types of audio signals, and determine mixing parameters based on the target weights.

[0157] In one embodiment, the determining module 1003 is specifically used to determine the location of a target seat in the target vehicle where a user exists based on user status information; and to determine a target audio playback device from multiple audio playback devices in the target vehicle based on the target seat location.

[0158] In one embodiment, the first acquisition module 1001 is specifically used to acquire first data collected by pressure sensors installed on each seat and second data collected by a first image acquisition device installed in the target vehicle; determine whether there is a user on each seat based on the first data and the second data, and determine the user status information of each seat according to the determination result.

[0159] In one embodiment, the second acquisition module 1002 is specifically used to acquire third data collected by sensors installed on the head of each seat in the target vehicle; determine at least one of the following based on the third data: ambient noise, user interaction sounds in the target vehicle, and audio sounds output by each audio playback device; and determine at least one of the following as auditory simulation information: ambient noise, interaction sounds, and audio sounds.

[0160] In one embodiment, the second acquisition module 1002 is specifically used to acquire fourth data collected by a second image acquisition device located outside the target vehicle; determine at least one of the target vehicle's scene information, traffic light status information, and obstacle information based on the fourth data; and determine at least one of the scene information, traffic light status information, and obstacle information as road condition information.

[0161] The various modules in the aforementioned audio device operating parameter determination device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of a computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0162] In one exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 11 As shown, this computer device includes a processor, memory, input / output interfaces (I / O), and a communication interface. The processor, memory, and I / O interfaces are connected via a system bus, and the communication interface is also connected to the system bus via the I / O interfaces. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides the environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The database stores data. The I / O interfaces are used for exchanging information between the processor and external devices. The communication interface is used for communicating with external terminals via a network connection. When executed by the processor, the computer program implements a method for determining the operating parameters of an audio device.

[0163] In one exemplary embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 12As shown, the computer device includes a processor, memory, input / output interface, communication interface, display unit, and input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interface. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The input / output interface is used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, Near Field Communication (NFC), or other technologies. When executed by the processor, the computer program implements a method for determining the operating parameters of an audio device.

[0164] Those skilled in the art will understand that Figure 11 and Figure 12 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0165] In one exemplary embodiment, a computer device is provided, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, it implements the steps of the audio device operating parameter determination method described in any of the above embodiments. In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, it implements the steps of the audio device operating parameter determination method described in any of the above embodiments. In one embodiment, a computer program product is provided, including a computer program, which, when executed by a processor, implements the steps of the audio device operating parameter determination method described in any of the above embodiments.

[0166] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.

[0167] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one of relational databases and non-relational databases. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0168] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0169] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for determining the operating parameters of an audio device, characterized in that, The method includes: Obtain user status information for each seat in the target vehicle, wherein the user status information is used to indicate whether a user is present in each of the seats; When it is determined that a user is sitting in the seat based on the user status information, the user's behavioral status and auditory simulation information are obtained, and the road condition information of the target vehicle is also obtained; the auditory simulation information is used to characterize the ambient sound that the user sitting in the seat can currently perceive; the auditory simulation information is determined based on the audio data collected by the sensor installed in the head of the seat; Based on the user status information, the target audio playback device is determined from multiple audio playback devices in the target vehicle, and the operating parameters of the target audio playback device are determined based on the behavioral status, the auditory simulation information, and the road condition information.

2. The method according to claim 1, characterized in that, Determining the operating parameters of the target audio playback device based on the behavioral state, the auditory simulation information, and the road condition information includes: The driving status parameters of the target vehicle are obtained, and the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device are determined based on the driving status parameters, the behavior status, the auditory simulation information, and the road condition information. The operating parameters of the target audio playback device are determined based on the volume parameters, the sound effect parameters, and the mixing parameters.

3. The method according to claim 2, characterized in that, The process of determining the volume parameters, sound effect parameters, and mixing parameters of the target audio playback device based on the driving state parameters, the behavioral state, the auditory simulation information, and the road condition information includes: An initial volume parameter is determined based on the auditory simulation information and the driving state parameters, and the initial volume parameter is corrected based on the road condition information and the behavioral state to obtain the final volume parameter. Initial sound effect parameters are determined based on the auditory simulation information and the driving state parameters, and the initial sound effect parameters are corrected based on the behavioral state to obtain the sound effect parameters. The system acquires at least two different types of audio signals to be played by the target audio playback device, and acquires the initial weights corresponding to the at least two different types of audio signals. The at least two different types of audio signals need to be played simultaneously. The initial weights are adjusted based on the behavioral state and the road condition information to obtain target weights corresponding to the at least two different types of audio signals, and the mixing parameters are determined based on the target weights.

4. The method according to claim 1, characterized in that, The step of determining the target audio playback device from multiple audio playback devices in the target vehicle based on the user status information includes: Based on the user status information, determine the location of the target seat in the target vehicle where a user exists; The target audio playback device is determined from among multiple audio playback devices in the target vehicle based on the target seat position.

5. The method according to claim 1, characterized in that, The process of obtaining user status information for each seat in the target vehicle includes: Acquire first data collected by pressure sensors installed on each of the seats, and acquire second data collected by a first image acquisition device installed inside the target vehicle; Based on the first data and the second data, it is determined whether there is a user on each of the seats, and the user status information of each seat is determined according to the determination result.

6. The method according to claim 1, characterized in that, The process of obtaining the user's auditory simulation information includes: Acquire third data collected by sensors installed on the head of each seat in the target vehicle; Based on the third data, at least one of the following is determined: ambient noise, user interaction sounds inside the target vehicle, and audio sounds output by each of the audio playback devices; The auditory simulation information is determined by identifying at least one of the ambient noise, the interactive sound, and the audio sound.

7. The method according to claim 1, characterized in that, The acquisition of the road condition information of the target vehicle includes: Acquire fourth data from a second image acquisition device located outside the target vehicle; Based on the fourth data, at least one of the following is determined: scene information of the target vehicle, traffic light status information, and obstacle information; The road condition information is determined by identifying at least one of the scene information, the traffic light status information, and the obstacle information.

8. A device for determining the operating parameters of an audio device, characterized in that, The device includes: The first acquisition module is used to acquire user status information of each seat in the target vehicle, wherein the user status information is used to indicate whether there is a user on each of the seats. The second acquisition module is used to acquire the user's behavioral state and auditory simulation information when it is determined that a user is sitting in the seat based on the user status information, and to acquire the road condition information of the target vehicle; the auditory simulation information is used to characterize the ambient sound that the user sitting in the seat can currently perceive; the auditory simulation information is determined based on the audio data collected by the sensor set in the head of the seat; The determination module is used to determine the target audio playback device from multiple audio playback devices of the target vehicle based on the user status information, and to determine the operating parameters of the target audio playback device based on the user status information, the auditory simulation information, and the road condition information.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

Images