In-vehicle audio tuning method and device, electronic equipment and storage medium

By identifying passenger information and determining the highest priority target person, the system automatically adjusts audio playback parameters, solving the problem of in-vehicle audio systems being unable to adapt and improving the user experience.

CN118942474APending Publication Date: 2024-11-12ZHEJIANG ZEEKR INTELLIGENT TECH CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410960901.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-17
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Existing car audio systems cannot automatically adapt to the different sound needs of the occupants, making manual adjustments cumbersome and inconvenient.

Method used

By determining the information of each passenger in the vehicle, the highest priority target person is identified, and the audio playback parameters, including timbre type and sound style, are adjusted according to their tuning method.

Benefits of technology

It achieves automated audio tuning, enhancing the user experience for passengers and meeting their personalized sound needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118942474A_ABST
    Figure CN118942474A_ABST
Patent Text Reader

Abstract

The invention provides an in-vehicle audio tuning method and device, electronic equipment and a storage medium. The method comprises the following steps: determining passenger information of each person in a target vehicle; determining a target person with the highest priority in all persons according to the passenger information of each person; and adjusting an audio playing parameter according to the target tuning mode corresponding to the target person. According to the method, the target person with the highest priority is determined, and the target audio is tuned according to the target tuning mode on the basis, so that the purpose of changing the audio playing parameters according to the tuning requirements of the target person can be achieved, and the purpose of automatically tuning the audio can be achieved; and the use experience of people in the vehicle can be effectively improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence technology, and more particularly to an in-vehicle audio tuning method and device, an electronic device, and a storage medium. Background Art

[0002] As more and more cars enter ordinary families, the use of cars becomes more and more frequent, and cars are becoming more intelligent and user-friendly. As an essential entertainment device for cars, the sound effects of car audio directly affect the driving experience. With the current car audio system, when different users have different sound effect requirements (for example, rock, pop, etc.), they can only be set manually separately. With the increasing number of functional scene modes in the cockpit, manual adjustments will become more and more troublesome, making it more inconvenient for users to make adjustments. Moreover, there is no perfect implementation method in the relevant technology to automatically and adaptively adjust the sound effect requirements according to the people in the car. Summary of the invention

[0003] In order to overcome the problems existing in the related art, this specification provides an in-vehicle audio tuning method and device, an electronic device and a storage medium.

[0004] According to a first aspect of an embodiment of this specification, a method for tuning an in-vehicle audio system is provided, the method comprising:

[0005] Determining passenger information for each person in the target vehicle;

[0006] According to the passenger information of each person, determine the target person with the highest priority among all the persons;

[0007] The audio playback parameters are adjusted according to the target tuning method corresponding to the target person.

[0008] According to a second aspect of an embodiment of this specification, there is provided an in-vehicle audio tuning device, comprising:

[0009] A passenger information determination module, used to determine the passenger information of each person in the target vehicle;

[0010] A priority determination module, used to determine the target person with the highest priority among all the persons according to the passenger information of each person;

[0011] The tuning module is used to adjust the audio playback parameters according to the target tuning method corresponding to the target person.

[0012] According to a third aspect of one or more embodiments of this specification, an electronic device is provided, including:

[0013] processor;

[0014] a memory for storing processor-executable instructions;

[0015] The processor implements the method described in the first aspect above by running the executable instructions.

[0016] According to a fourth aspect of one or more embodiments of the present specification, a computer-readable storage medium is provided, on which computer instructions are stored, and when the instructions are executed by a processor, the steps of the method described in the first aspect are implemented.

[0017] According to a fifth aspect of one or more embodiments of the present specification, a computer program product is proposed, comprising a computer program / instruction, which, when executed by a processor, implements the steps of the method described in the first aspect above.

[0018] The technical solutions provided by the embodiments of this specification may have the following beneficial effects:

[0019] In the embodiments of the present specification, by determining the target person with the highest priority, and tuning the target audio according to the target tuning method on this basis, the purpose of changing the audio playback parameters according to the tuning requirements of the target person can be achieved, thereby automatically achieving the purpose of audio tuning and effectively improving the user experience of the people in the car.

[0020] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present specification. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the specification and, together with the description, serve to explain the principles of the specification.

[0022] Figure 1 The flowchart of a method for tuning in-vehicle audio according to an exemplary embodiment of the present specification is shown.

[0023] Figure 2 is a flow chart of an in-vehicle audio tuning method according to another exemplary embodiment of the present specification.

[0024] Figure 3 is a flow chart of an in-vehicle audio tuning method according to another exemplary embodiment of the present specification.

[0025] Figure 4 is a flow chart of an in-vehicle audio tuning method according to another exemplary embodiment of the present specification.

[0026] Figure 5 It is a hardware structure diagram of the computer device where the in-car audio tuning device of the embodiment of this specification is located.

[0027] Figure 6 It is a block diagram of an in-vehicle audio tuning device according to an exemplary embodiment of the present specification. DETAILED DESCRIPTION

[0028] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this specification. Instead, they are merely examples of devices and methods consistent with some aspects of this specification as detailed in the appended claims.

[0029] Next, the embodiments of this specification are described in detail.

[0030] like Figure 1 As shown, Figure 1 This is a flow chart of a method for tuning in-vehicle audio according to an exemplary embodiment of the present specification, comprising the following steps:

[0031] Step S102, determining the passenger information of each person in the target vehicle.

[0032] The method of this embodiment can be applied to the scenario of tuning the audio to be played in the vehicle when the audio is played in the vehicle. For example, the scenario of tuning the audio to be played in a fuel vehicle, the scenario of tuning the audio to be played in a new energy vehicle, the scenario of tuning the audio to be played in a train, and so on. In addition, the method of this embodiment can also be applied to the scenarios of tuning the audio to be played in other types of vehicles, which are not listed here one by one. In the embodiment described below, taking the scenario of tuning the audio to be played in a new energy vehicle as an example, the method of tuning the audio in the car is described in detail.

[0033] In this embodiment, the passenger information may be information indicating the identity and / or the position of each person in the target vehicle. The sub-information in the passenger information may include, but is not limited to, one or more of the following: seat, name, age, gender, family relationship, occupation, physical health, etc. The correspondence between the pre-entered facial information and the passenger information can be used to accurately determine the passenger information of the person whose facial information has been entered by performing facial recognition on the person in the target vehicle. For an unknown person whose facial information has not been entered in advance, the facial information of the unknown person can be obtained through a facial entry device in the vehicle or a facial information entry device that can communicate with the vehicle. In addition, the age range, gender, and physical health of the unknown person can be determined through facial recognition. The unknown person can be allowed to edit his accurate passenger information through an interactive interface, thereby obtaining the complete passenger information of the unknown person, and establishing a correspondence between the passenger information and the facial information of the unknown person. Optionally, the facial information entry device may include, but is not limited to, a device for facial information entry in the target vehicle, or a smart phone, smart wearable device, tablet computer, computer, etc. that is connected to the target vehicle for communication.

[0034] As an optional embodiment, step S102 can be implemented by the following steps: determining the seat occupancy information in the target vehicle, and determining the passenger information of each person according to the seat occupancy information, wherein the seat occupancy information is used to indicate the occupancy status of each seat in the target vehicle, and the passenger information corresponding to each person includes the seat occupied by each person.

[0035] In this embodiment, an occupancy sensor can be set on each seat in the target vehicle. Through the occupancy sensor, identification information of whether a person is sitting on the corresponding seat can be identified. That is, the identification information can determine whether the corresponding seat is occupied by a person. The seat occupancy information is information determined based on the identification information, and can be used to characterize whether each seat in the target vehicle is occupied by a person.

[0036] Step S104: determining the target person with the highest priority among all the persons according to the passenger information of each person.

[0037] After determining the passenger information of each person, the priority of each person can be sorted according to the passenger information to determine the target person with the highest priority.

[0038] In this embodiment, the higher the priority level of a person, the higher the priority level of the person. The higher the priority level of the person, the higher the priority level of the person.

[0039] Optionally, the preset priority corresponding to each passenger information in the scenario of adjusting the audio playback parameters can be predetermined. For example, when there are persons P1, P2, P3, and P4 in the target vehicle, and the preset priorities corresponding to the above persons P1, P2, P3, and P4 are as follows: 1, 3, 2, and 4; and when the value of the preset priority is larger, indicating a higher priority, then person P4 is determined to be the target person with the highest priority. In addition, by determining the weight corresponding to each sub-information in the passenger information and the scoring method corresponding to each sub-information, the weighted score corresponding to each passenger information can be calculated by weighted calculation, and the persons corresponding to each passenger information can be sorted according to the weighted score. When the higher the score, the higher the priority, the person with the highest score can be determined as the target person. For example, there are persons P1 and P2 in the target vehicle. The sub-information of each person includes name, age, gender, and health status, and the weights corresponding to the above self-information are 0, 0.2, 0.2, and 0.6 respectively. The scores corresponding to the ages of 15-25 and 70-120 are 10 and 30 respectively, the scores corresponding to the genders of male and female are 10 and 15 respectively, and the scores corresponding to the good and poor health status are 10 and 30 respectively. If the passenger information of person P1 is (Zhang San, 20, male, good) and the passenger information of person P2 is (Li Si, 80, female, poor), the weighted score corresponding to person P1 is 10 and the weighted score corresponding to P2 is 27. Therefore, the priority of person P2 is higher than that of person P1, and person P2 is the target person.

[0040] As an optional embodiment, step S104 can be implemented by the following steps: according to the seat occupancy information and the priority corresponding to each seat, the target person with the highest priority among all the persons is determined. In this embodiment, after the seat occupancy information indicating the occupied status of each seat is determined, the target person with the highest priority among all the persons in the current target vehicle can be determined according to the priority corresponding to each seat, that is, the priority of each person among all the persons can be consistent with the priority of the seat occupied by each person among all the seats. And, in this embodiment, the higher the priority corresponding to the person, the more priority is given to tuning the target audio to be played according to the needs of the person. Optionally, the preset priority corresponding to each seat information in the scene of tuning the audio can be pre-determined. For example 1, when there are currently seats P1, P2, P3, and P4 in the target vehicle, and the preset priorities corresponding to the above seats P1, P2, P3, and P4 are as follows: 1, 3, 2, 4; and when the value of the preset priority is larger, indicating a higher priority, it is determined that seat P4 is the target seat with the highest priority.

[0041] As an optional embodiment, the target person with the highest priority among all the persons according to the seat occupancy information and the priority corresponding to each seat can be determined in the following manner: determine the priority corresponding to each seat in the target vehicle according to the vehicle model of the target vehicle; determine the occupied designated seat among all the seats according to the seat occupancy information; determine the target seat with the highest priority among all the designated seats according to the priority corresponding to each seat, and determine the person occupying the target seat as the target person with the highest priority. In this embodiment, for vehicles of different vehicle models, the priorities corresponding to each seat in each vehicle are different. For example, for a nanny car, the seat with the highest priority can be the seat located in the back row of the vehicle. For a five-seat medium-sized car, the seat with the highest priority can be the seat located in the back row of the vehicle, or the seat located in the co-pilot, etc. Further, the priority of each seat can be determined in each vehicle through configuration. That is to say, the currently occupied seat can be determined among all the seats according to the obtained seat occupancy information, and the occupied seat can be recorded as the designated seat. After all designated seats are determined, the priority corresponding to each designated seat can be determined based on the priority corresponding to each seat mentioned above, and then the target seat with the highest priority can be determined according to the priority corresponding to each designated seat, and finally the person occupying the target seat can be determined as the target person with the highest priority. For example, based on Example 1, if it is determined that the current seats P2, P3, and P4 are occupied by persons R2, R3, and R4, respectively, since seat P4 is the seat with the highest priority among the above seats P2, P3, and P4, person R4 is determined as the target person; if it is determined that the current seats P1, P2, and P3 are occupied by persons R1, R2, and R3, respectively, since there is no person sitting on seat P4, and seat P3 is the seat with the highest priority among all seats with people sitting (i.e., seats P1, P2, and P3), person R3 is determined as the target person.

[0042] Step S106, adjusting the audio playback parameters according to the target tuning method corresponding to the target person.

[0043] In this embodiment, the tuning method includes at least one of the following: playback parameters, timbre type and sound style of the speakers in the target vehicle. That is to say, at least one of the following tunings can be achieved through the determined target tuning method: tuning the timbre type and sound style of the audio, and adjusting the playback parameters of the speakers in the target vehicle.

[0044] Among them, tuning the timbre type and sound style of the audio can be achieved by the following method: pre-determine the correspondence between each seat and the speaker tuning sub-mode (i.e., including timbre type and sound style); therefore, after determining the target person, the target timbre type and target sound style corresponding to the target person can be determined based on the seat occupied by the target person.

[0045] In addition, the audio tuning sub-mode can be implemented by the following method: one or more of the following detailed information can be determined: the current state of the target person, the audio content of the target audio, and the current scene of the target vehicle. The state may include but is not limited to: happy, sad, calm, tired and other states. The audio content may include but is not limited to: the melody, words, etc. of the corresponding audio. The current scene can be used to indicate the environment outside the car, such as: forest, city streets, streets at night, etc. In this embodiment, the audio tuning sub-mode may include but is not limited to: the timbre type and / or sound style to which the target audio needs to be adjusted. The target tuning mode may include but is not limited to: the timbre type and / or sound style to which the target audio needs to be adjusted. The target audio may include but is not limited to: songs sung by human voices, articles read by human voices, music played by musical instruments, etc. When the target audio is a song sung by human voices or an article read by human voices, the target tuning mode may include one or both of the timbre type and the sound style; when the target audio is music played by musical instruments, the target tuning mode only includes the sound style. The timbre type may be: sweet, rough, delicate, etc., which affect the perception and emotional expression of the sound. The sound style can be: exaggerated, retro, happy, sad, etc., which reflects the overall feeling of the audio.

[0046] After the target tuning method is determined, the target audio can be tuned according to the target tuning method, so as to obtain the tuned audio.

[0047] As an optional implementation, the personnel type information of each person in the target vehicle can also be identified, and the personnel type information can include but is not limited to: the elderly, adults, pregnant women, teenagers, children, etc. The sub-information in the posture information can be obtained by including but not limited to the following types of information: age, gender, physical health status, etc. The image acquisition device in the vehicle can be used, such as: image sensor, depth sensor, infrared sensor, etc. The appearance image information of each person is collected, and then the appearance image information can be input into the pre-trained personnel type recognition model to identify the personnel type of each person in the vehicle. When there are elderly people, pregnant women, and children in the target vehicle, it is determined that there are currently vulnerable group types (i.e., elderly people, pregnant women, children) in the target vehicle. Therefore, the person corresponding to the vulnerable group can be determined as the target person with the highest priority, and the target tuning method corresponding to the target person for soft tuning is determined.

[0048] Furthermore, in the case where there are both people corresponding to the seats with the highest priority and people of vulnerable groups, one of the types of people can be determined as the target person with the highest priority by pre-configuring relevant strategies. For example, the priority of the person corresponding to the seat with the highest priority can be higher than the priority of the person corresponding to the vulnerable group, and then in the case where the above two types of people exist, the person corresponding to the seat with the highest priority can be determined as the target person; in addition, the priority of the person of the vulnerable group type can also be higher than the priority of the person corresponding to the seat with the highest priority, and then in the case where the above two types of people exist, the person of the vulnerable group type can be determined as the target person.

[0049] As an optional implementation, the Figure 2 The steps S202 to S206 shown implement the step S106:

[0050] Step S202, determining the target ear direction and target spatial position information of the target person.

[0051] As an optional implementation, the target ear direction of the target person can be determined by the following method: face detection is performed on the target person, the eye position, nose position and mouth position of the target person are determined, and the target ear direction of the target person is determined according to the eye position, nose position and mouth position. Specifically, the orientation of the face can be determined after detecting the eye position, nose position and mouth position of the target person, and then the target ear direction can be determined by the direction of the face and the line connecting the two eyes, that is, the target ear direction is perpendicular to the face orientation, and behind the direction of the line connecting the two eyes (with the face orientation as the front), and this method is applicable to the case where the ear is blocked and not blocked. In addition, ear detection can be performed directly on the target person, the ear image of the target person is determined, and the target ear direction of the target person is determined according to the ear image. Specifically, when the ear of the target person is not blocked, ear recognition can be performed directly on the target person, the ear image of the target person is determined, and then the target ear direction can be identified based on the ear image. In addition, when the complete eye position, nose position and mouth position cannot be obtained, since the ear position is generally located below the eyes and above the mouth, the direction of the human ear can also be determined directly based on the position of the center of the two eyes and / or the position of the nose.

[0052] The target spatial position information can be determined based on the position of the seat where the target person is located in the vehicle, or can be determined by positioning the target person in the vehicle through image positioning.

[0053] Step S204, inputting the target ear direction and target spatial position information of the target person into a pre-trained target tuning model to obtain at least one candidate tuning method corresponding to the target person.

[0054] In this embodiment, after determining the target ear direction and target spatial position information of the target person, the target ear direction and target spatial position information corresponding to each seat can be input into a pre-trained target tuning model to determine at least one candidate tuning method corresponding to the target person.

[0055] Optionally, the candidate tuning methods in this embodiment can be used to determine the corresponding audio playback parameters, which may include but are not limited to the following types of information: playback parameters corresponding to each speaker, such as playback delay, volume, timbre type and sound style corresponding to the target audio to be played, etc. Taking the adjustment of the playback parameters of the speaker as an example, the area corresponding to each seat (i.e., the seat and the area above it) can be preset to a preset position, and the playback parameters corresponding to each preset position can be pre-configured. When playing according to the playback parameters corresponding to each preset position, each preset position can obtain the best auditory experience that the in-car speaker can provide. Taking the playback parameters corresponding to any preset position as an example, under this playback parameter, the time and volume of the audio played by each speaker reaching the human ear at the preset position are equal. In addition, the preset position may include the following information: human ear direction and spatial position information.

[0056] After determining the target human ear direction and the target spatial position information, the preset position corresponding to the target seat (i.e., the preset human ear direction, the preset spatial position information) and the preset playback parameters can be determined first; then the first deviation between the target human ear direction and the preset human ear direction, and the second deviation between the target spatial position information and the preset spatial position information can be determined; after determining the first deviation and the second deviation, the preset playback parameters can be adjusted according to the first deviation and the second deviation through the target tuning model, so as to obtain the target playback parameters. In the case where the target tuning model is a model applicable to different vehicle models, the data input to the target tuning model can also include the target speaker position information of the target vehicle, so as to provide at least one candidate tuning method applicable to the speaker configuration of the target vehicle; in the case where the target tuning model is only applicable to the corresponding vehicle model of the target vehicle, the target tuning model can directly output at least one candidate tuning method applicable to the speaker configuration of the target vehicle without inputting the target speaker position information.

[0057] As an optional implementation, multiple sets of training data may be acquired in advance, wherein each set of training data includes: speaker position information in the vehicle, spatial position information and ear direction of the occupants in the vehicle, and a tuning method corresponding to the occupants in the vehicle; the preset model is trained with multiple sets of training data to obtain a target tuning model for obtaining a tuning method according to the speaker position in the vehicle, the spatial position information and ear direction of the occupants in the vehicle. Specifically, the target tuning model may be obtained by training with the following steps: multiple sets of training data are collected, each set of training data includes corresponding speaker position information in the vehicle, spatial position information of the occupants in the vehicle, ear direction and tuning method. The collected multiple sets of training data are grouped and divided into first training data for training and second training data for verification. After the preset model is trained with the first training data, if the trained model is verified by the second training data, the trained model is determined as the target tuning model. Otherwise, if the trained model fails to be verified, the trained model is continued to be trained until it passes the verification. Furthermore, based on the above method, a target tuning model corresponding to each vehicle model can be trained. Since the seat distribution and speaker configuration (i.e., speaker position and number of speakers) of each vehicle model remain consistent, after the vehicle model is determined, the target tuning model corresponding to the vehicle model can be used to determine at least one candidate tuning method without inputting the speaker position information inside the vehicle.

[0058] Step S206: adjusting the audio playback parameters according to a target tuning method among at least one candidate tuning method.

[0059] In this embodiment, after at least one candidate tuning method is determined, the at least one candidate tuning method may be further screened to determine a target tuning method that is ultimately used to adjust the audio playback parameters.

[0060] As an optional implementation, the following method can be used to adjust the audio playback parameters according to the target tuning method in at least one candidate tuning method, including: adjusting the playback parameters of the speaker in the target vehicle according to the target tuning method in at least one candidate tuning method, wherein the audio playback parameters include the playback parameters of the speaker. That is, after determining at least one candidate tuning method, further screening can be performed from the at least one candidate tuning method to obtain the target tuning method used in the end. When at least one candidate tuning method only includes one, the target tuning method is directly obtained by the target tuning model based on the aforementioned information output. When multiple candidate tuning methods are included, the target tuning method is screened from all candidate tuning methods based on other types of information. Optionally, the user can select the target tuning method from multiple candidate tuning methods based on his or her own preferences or based on information such as personal identity. That is, each person with different personal identities prefers different tuning methods, and then further screening can be performed from all candidate tuning methods based on personal identity to obtain the target tuning method.

[0061] As an optional implementation, the playback parameters of the speakers in the target vehicle can be adjusted according to the target tuning method in at least one candidate tuning method by the following steps: identifying the target state of the target person and the audio content information of the target audio to be played; determining the target tuning style according to the target state and the audio content information, wherein the tuning style includes the volume of the audio; determining the target tuning method corresponding to the target tuning style in at least one candidate tuning method, wherein each candidate tuning method has a corresponding tuning style; and adjusting the target audio according to the target tuning method.

[0062] That is to say, in this embodiment, the target state of the target person and the audio content information of the target audio are also used as conditions for determining the target tuning method, wherein the target state can be used to indicate whether the target person is in a state of fatigue and sleepiness. Optionally, the target state of the target person can be identified by performing the following steps on the target person in sequence: 1. Face detection: The face can be directly detected by using a deep learning model such as a convolutional neural network. 2. Feature extraction: Once the face is detected, the next step is to extract facial features related to the state, which usually includes the eye area, eyebrows, nose, mouth and muscle movements around it. Feature extraction can be based on manually designed features, such as Facial Action Coding System (FACS), which decomposes facial expressions into basic action units, or it can be automatically learned features, such as advanced features extracted by a deep learning model. 3. State classification: The extracted features will be input into a classifier for identifying specific state categories. Optional classifiers include support vector machines (SVM), neural networks, decision trees, etc. In addition, deep learning models such as convolutional neural networks (CNN), recurrent neural networks (RNN) or their combinations (such as LSTM, GRU), or even more complex architectures such as ResNet, Inception, etc. can be used as classifiers to determine the target state of the target person. In addition, the target audio can be input into a pre-trained machine learning model to analyze the audio features of the target audio, such as timbre, dynamics, and predict music emotion tags, thereby obtaining the audio content information of the target audio.

[0063] After determining the target state and audio content information, the target tuning style of the audio that is suitable for the target person to listen to in the current situation can be determined based on the target state. For example, when the target state indicates that the target person is tired and sleepy, it indicates that the target person is currently less sensitive to sounds outside the car (for example, horns or alarms). At this time, the target tuning style may be a style that reduces the audio noise by lowering the current volume, so as to avoid excessive noise due to reasons such as the high volume inside the car, which makes it impossible for the target person to hear the sounds outside the car; when the target state indicates that the target person is in a good mental state, it indicates that the target person is currently more sensitive to sounds outside the car. At this time, the target tuning style may be a style that enhances the audio listening experience by increasing the current volume, so that the target person can have a better audio listening experience on the basis of being able to hear the sounds outside the car clearly.

[0064] In this embodiment, the target tuning model can output multiple candidate tuning methods through the steps of the aforementioned embodiments, and each candidate tuning method can have a corresponding tuning style. Therefore, a specified tuning style consistent with the target tuning style can be matched among all tuning styles, and the candidate tuning method corresponding to the specified tuning style can be determined as the target tuning method.

[0065] As an optional implementation, before playing the target audio according to the target tuning mode in step S206, the following steps may be performed: Figure 3 The steps S302 to S306 shown implement the following scheme:

[0066] Step S302, obtaining the positioning information of the target vehicle.

[0067] Optionally, a positioning system installed on the target vehicle can be activated to determine the current location of the target vehicle through the positioning system.

[0068] Step S304, determining the current scene information of the target vehicle according to the positioning information, wherein the current scene information is used to indicate the type of the environment in which the target vehicle is currently located.

[0069] Optionally, after obtaining the positioning information, the current geographical environment of the target vehicle can be determined by using electronic map information. For example, the positioning information can be used to determine that the current environment includes but is not limited to cities, forests, parks, beaches, country roads, etc.

[0070] Furthermore, the current weather conditions (e.g., sunny, rainy, snowy, etc.) can be determined in real time by subscribing to weather information, and the current time can also be determined to determine whether it is daytime or nighttime, etc. Therefore, the current scene information includes not only the above-mentioned geographical environment, but also the current weather conditions and time.

[0071] Step S306, determining a sound effect scheme corresponding to the current scene information.

[0072] Optionally, a sound effect scheme that matches the current scene information can be determined by querying a pre-established sound effect database. The sound effect scheme may include, but is not limited to: driving prompt sounds, environmental simulation sound effects (such as rain sounds, wind sounds), safety warning sounds, etc. For example, when the current scene information indicates that the target vehicle is currently located on a country road, the corresponding sound effect scheme may be the sound of insects and birds chirping and / or the sound of flowing water under a small bridge, etc.; when the current scene information indicates that the target vehicle is currently located on a windy and rainy day, the corresponding sound effect scheme may be the sound of wind, rain, thunder and lightning, etc.

[0073] like Figure 4As shown, the aforementioned steps can be implemented by adjusting the audio playback parameters according to the target tuning method corresponding to the target person through the following steps:

[0074] Step S402: Tuning the target audio according to the sound effect scheme and the target tuning method to obtain tuned audio.

[0075] After obtaining the tuned audio, the following step S404 may be further performed:

[0076] Step S404: play the tuned audio.

[0077] After the sound effect scheme is determined, the sound effect scheme can be superimposed on the target tuning method to obtain tuned audio. For example, when the target tuning method includes a sub-method for tuning the target audio, the target audio can be tuned through the sub-method to obtain a first audio, and on this basis, the audio corresponding to the sound effect scheme can be added to the first audio to obtain the tuned audio. After obtaining the tuned audio, the audio can be played through the speaker system in the target vehicle.

[0078] The method of this embodiment determines a sound effect scheme, and tunes the target audio according to the sound effect scheme and the target tuning method to obtain the tuned audio, so that the tuned audio can represent the current environment of the target vehicle, making the occupants of the vehicle more immersed and effectively improving the driving experience.

[0079] The method of this embodiment, by determining the target person with the highest priority, and tuning the target audio according to the target tuning method on this basis, can achieve the purpose of changing the timbre or sound style of the target audio, as well as audio playback parameters such as speaker playback parameters according to the tuning requirements of the target person, thereby automatically achieving the purpose of audio tuning and effectively improving the user experience of people in the car.

[0080] Figure 5 is a schematic structural diagram of a device provided by an exemplary embodiment. Figure 5 At the hardware level, the device includes a processor 502, an internal bus 504, a network interface 506, a memory 508, and a non-volatile memory 510, and may also include hardware required for other functions. One or more embodiments of this specification may be implemented based on software, such as the processor 502 reading the corresponding computer program from the non-volatile memory 510 into the memory 508 and then running it. Of course, in addition to the software implementation, one or more embodiments of this specification do not exclude other implementations, such as logic devices or a combination of software and hardware, etc., that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0081] Please refer to Figure 6 , the in-car audio tuning device can be used for Figure 6 The device shown in the figure is used to implement the technical solution of this specification. The in-car audio tuning device may include:

[0082] A passenger information determination module 61, used to determine the passenger information of each person in the target vehicle;

[0083] A priority determination module 62, used to determine the target person with the highest priority among all persons according to the passenger information of each person;

[0084] The adjustment module 63 is used to adjust the audio playback parameters according to the target tuning method corresponding to the target person.

[0085] As an optional implementation, the passenger information determination module 61 is configured to: determine the seat occupancy information in the target vehicle, and determine the passenger information of each person according to the seat occupancy information, wherein the seat occupancy information is used to indicate the occupancy status of each seat in the target vehicle, and the passenger information corresponding to each person includes the seat occupied by each person;

[0086] The priority determination module 62 is configured to:

[0087] Determine the priority corresponding to each seat in the target vehicle according to the vehicle model of the target vehicle;

[0088] Determining an occupied designated seat among all seats according to the seat occupancy information;

[0089] According to the priority corresponding to each seat, a target seat with the highest priority is determined among all designated seats, and a person occupying the target seat is determined as the target person with the highest priority.

[0090] As an optional implementation, the adjustment module 63 includes:

[0091] A determination unit, used to determine the target ear direction and target spatial position information of the target person;

[0092] A model processing unit, configured to input the target ear direction and the target spatial position information of the target person into a pre-trained target tuning model to obtain at least one candidate tuning method corresponding to the target person;

[0093] A parameter adjustment unit is used to adjust the audio playback parameter according to the target tuning method in the at least one candidate tuning method.

[0094] As an optional implementation, it further includes a model training module configured to:

[0095] Acquire multiple sets of training data, where each set of training data includes: speaker position information in the vehicle, spatial position information and ear direction of people in the vehicle, and a tuning method corresponding to the people in the vehicle;

[0096] The preset model is trained by using multiple sets of training data to obtain a target tuning model for obtaining a tuning method according to the position of the speakers in the vehicle, the spatial position information of the occupants in the vehicle, and the direction of the human ear;

[0097] The parameter adjustment unit is configured as:

[0098] The playback parameters of the speaker in the target vehicle are adjusted according to the target tuning method among the at least one candidate tuning method, wherein the audio playback parameters include the playback parameters of the speaker.

[0099] As an optional implementation manner, the determining unit is configured to:

[0100] Perform face detection on the target person to determine the eye position, nose position and mouth position of the target person, and determine the target ear direction of the target person based on the eye position, nose position and mouth position; or,

[0101] Perform ear detection on the target person, determine the ear image of the target person, and determine the target ear direction of the target person based on the ear image.

[0102] As an optional implementation manner, the parameter adjustment unit is configured as follows:

[0103] Identifying the target status of the target person and audio content information of the target audio to be played;

[0104] Determine a target tuning style according to the target state and the audio content information, wherein the tuning style includes the volume of the audio;

[0105] Determining the target tuning method corresponding to the target tuning style from the at least one candidate tuning method, wherein each candidate tuning method has a corresponding tuning style;

[0106] The target audio is adjusted according to the target tuning method.

[0107] As an optional implementation, the system further includes a sound effect scheme determination module configured to:

[0108] Determining the positioning information of the target vehicle;

[0109] Determining current scene information of the target vehicle according to the positioning information, wherein the current scene information is used to indicate the type of environment in which the target vehicle is currently located;

[0110] Determine the sound effect scheme corresponding to the current scene information;

[0111] The adjustment module 63 is configured to:

[0112] Tuning the target audio according to the sound effect scheme and the target tuning method to obtain the tuned audio;

[0113] It also includes a playing module, which is configured to play the tuned audio.

[0114] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.

[0115] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this specification. A person of ordinary skill in the art can understand and implement it without paying creative labor.

[0116] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a tablet computer, a wearable device or a combination of any of these devices.

[0117] In a typical configuration, a computer includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0118] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0119] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, disk storage, quantum memory, graphene-based storage media or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0120] As an optional implementation, a computer program product is also provided, including a computer program / instruction, which implements the steps of the method described in any of the aforementioned embodiments when executed by a processor.

[0121] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0122] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0123] The terms used in one or more embodiments of this specification are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of this specification. The singular forms of "a", "said" and "the" used in one or more embodiments of this specification and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0124] It should be understood that although the terms first, second, third, etc. may be used to describe various information in one or more embodiments of this specification, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of this specification, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0125] The above description is merely a preferred embodiment of one or more embodiments of the present specification and is not intended to limit one or more embodiments of the present specification. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of the present specification shall be included in the scope of protection of one or more embodiments of the present specification.

Claims

1. A method for tuning in-vehicle audio, characterized in that: include: Determining passenger information for each person in the target vehicle; According to the passenger information of each person, determine the target person with the highest priority among all the persons; The audio playback parameters are adjusted according to the target tuning method corresponding to the target person.

2. The method according to claim 1, characterized in that The step of determining the passenger information of each person in the target vehicle includes: Determine seat occupancy information in the target vehicle, and determine the passenger information of each person according to the seat occupancy information, wherein the seat occupancy information is used to indicate the occupancy status of each seat in the target vehicle, and the passenger information corresponding to each person includes the seat occupied by each person; The method of determining the target person with the highest priority among all the persons according to the passenger information of each person includes: Determine the priority corresponding to each seat in the target vehicle according to the vehicle model of the target vehicle; Determining an occupied designated seat among all seats according to the seat occupancy information; According to the priority corresponding to each seat, a target seat with the highest priority is determined among all designated seats, and a person occupying the target seat is determined as the target person with the highest priority.

3. The method according to claim 1, characterized in that The adjusting the audio playback parameters according to the target tuning mode corresponding to the target person includes: Determining the target ear direction and target spatial position information of the target person; Inputting the target ear direction and the target spatial position information of the target person into a pre-trained target tuning model to obtain at least one candidate tuning method corresponding to the target person; The audio playback parameter is adjusted according to the target tuning method among the at least one candidate tuning method.

4. The method according to claim 3, characterized in that The method further comprises: Acquire multiple sets of training data, wherein each set of training data includes: speaker position information in the vehicle, spatial position information and ear direction of a person in the vehicle, and a tuning method corresponding to the person in the vehicle; The preset model is trained by using the plurality of sets of training data to obtain a target tuning model for obtaining a tuning method according to the speaker positions in the vehicle, the spatial position information of the occupants in the vehicle, and the direction of the human ear; The adjusting the audio playback parameter according to the target tuning mode among the at least one candidate tuning mode includes: The playback parameters of the speaker in the target vehicle are adjusted according to the target tuning method among the at least one candidate tuning method, wherein the audio playback parameters include the playback parameters of the speaker.

5. The method according to claim 3, characterized in that: The step of determining the target ear direction of the target person includes: Performing face detection on the target person to determine the eye position, nose position and mouth position of the target person, and determining the target ear direction of the target person according to the eye position, nose position and mouth position; or Perform ear detection on the target person to determine the ear image of the target person, and determine the target ear direction of the target person according to the ear image.

6. The method according to claim 3, characterized in that The adjusting the playback parameters of the speaker in the target vehicle according to the target tuning method among the at least one candidate tuning method includes: Identifying the target status of the target person and audio content information of the target audio to be played; Determine a target tuning style according to the target state and the audio content information, wherein the tuning style includes the volume of the audio; Determining the target tuning method corresponding to the target tuning style from the at least one candidate tuning method, wherein each candidate tuning method has a corresponding tuning style; The target audio is adjusted according to the target tuning method.

7. The method according to claim 1, characterized in that The method further comprises: Determining the positioning information of the target vehicle; Determining current scene information of the target vehicle according to the positioning information, wherein the current scene information is used to indicate the type of environment in which the target vehicle is currently located; Determining a sound effect scheme corresponding to the current scene information; The adjusting the audio playback parameters according to the target tuning mode corresponding to the target person includes: Tuning the target audio according to the sound effect scheme and the target tuning method to obtain tuned audio; The method further includes: playing the tuned audio.

8. An in-car audio tuning device, characterized in that: include: A passenger information determination module, used to determine the passenger information of each person in the target vehicle; A priority determination module, used to determine the target person with the highest priority among all the persons according to the passenger information of each person; The tuning module is used to adjust the audio playback parameters according to the target tuning method corresponding to the target person.

9. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor implements the method according to any one of claims 1 to 7 by running the executable instructions.

10. A computer-readable storage medium, characterized in that: Computer instructions are stored thereon, and when the instructions are executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.