Method and apparatus for generating in-vehicle audio playback information, and device and medium
By detecting audio signals and image information inside the cabin, identifying target users, and generating audio preference information for masking, the problem of poor user experience and low security caused by soundproof glass is solved, resulting in better conversation and user experience.
Patent Information
- Application Number
- PCT/CN2025/143778
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-06
- Filing Date
- 2025-12-19
- Publication Date
- 2026-11-12
AI Technical Summary
Existing technologies that use soundproof glass to isolate sound inside the vehicle result in a poor user experience and low safety within the cabin.
By detecting audio signals and real-time scene image information inside the cabin, it is determined whether the encryption scene conditions are met, the user at the target location is identified, audio signal preference information is generated, and audio signal masking is performed based on the preference information to control the speaker playback.
It improves the conversational experience and user experience within the vehicle cabin, while reducing the safety risks associated with soundproof glass.
Smart Images

Figure CN2025143778_12112026_PF_FP_ABST
Abstract
Description
Methods, apparatus, equipment and media for generating in-vehicle audio playback information Regarding public cross-references
[0001] This disclosure claims priority to Chinese Patent Application No. CN202510579119.7, filed on May 6, 2025, entitled “Method, Apparatus, Device and Medium for Generating Vehicle Audio Playback Information”, the entire contents of which are incorporated herein by reference. Technical Field
[0002] The embodiments disclosed herein relate to, but are not limited to, the field of computer technology, and more specifically, to a method, apparatus, device, and medium for generating in-vehicle audio playback information. Background Technology
[0003] In the public environment of a vehicle cabin, encrypting and masking encrypted conversations can enhance the user experience and provide a secure space for conversation. Currently, the common method for encrypting sound inside a vehicle is to use soundproof glass to isolate and mask the encrypted sound.
[0004] However, in practice, it has been found that when using the above methods to process sound inside the vehicle cabin, the following technical problems often arise:
[0005] Soundproofing the car cabin with soundproof glass requires a large amount of glass, which can impair conversation in the cabin when soundproofing is not needed, resulting in a poor user experience. Furthermore, the large amount of soundproof glass can reduce user safety while driving.
[0006] The information disclosed in this background section is only intended to enhance the understanding of the background of the inventive concept, and therefore may contain information that does not form prior art known to those skilled in the art. Summary of the Invention
[0007] The summary portion of this disclosure is intended to provide a brief overview of the concepts, which will be described in detail in the detailed description portion. This summary portion is not intended to identify key or essential features of the claimed technical solutions, nor is it intended to limit the scope of the claimed technical solutions.
[0008] Some embodiments of this disclosure provide a method, apparatus, device, and medium for generating in-vehicle audio playback information to address one or more of the technical problems mentioned in the background section above.
[0009] In a first aspect, some embodiments of this disclosure provide a method, apparatus, electronic device, and computer-readable medium for generating in-vehicle audio playback information. The method includes: in response to detecting audio signal information in a vehicle cabin, determining whether the current scene in the vehicle cabin meets preset encryption scene conditions based on the audio signal information and real-time scene image information; in response to determining that the current scene in the vehicle cabin meets the preset encryption scene conditions, determining whether the location information of a user that meets preset masking conditions is target location information; in response to determining that the location information of a user that meets the preset masking conditions is target location information, generating audio signal preference information corresponding to the user based on the user's historical playback record information; masking the audio signal information based on the audio signal preference information to obtain audio playback information corresponding to the user; and controlling the speakers in the vehicle cabin to play the audio playback information.
[0010] Secondly, some embodiments of this disclosure provide a sound processing device applied in a vehicle cabin. The device includes: a first determining unit configured to, in response to detecting audio signal information in the vehicle cabin, determine whether the current scene in the vehicle cabin meets preset encryption scene conditions based on the audio signal information and real-time scene image information; a second determining unit configured to, in response to determining that the current scene in the vehicle cabin meets the preset encryption scene conditions, determine whether the location information of a user who meets preset masking conditions is target location information; a generating unit configured to, in response to determining that the location information of a user who meets the preset masking conditions is target location information, generate audio signal preference information corresponding to the user based on the user's user history playback record information; a masking processing unit configured to, based on the audio signal preference information, mask the audio signal information to obtain audio playback information corresponding to the user; and a control unit configured to control the speakers in the vehicle cabin to play the audio playback information.
[0011] Thirdly, some embodiments of this disclosure provide an electronic device, including: at least one processor; and a storage device having at least one program stored thereon, wherein when the at least one program is executed by the at least one processor, the at least one processor implements the method described in any implementation of the first aspect above.
[0012] Fourthly, some embodiments of this disclosure provide a computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method described in any of the implementations of the first aspect above.
[0013] The above-described embodiments of this disclosure have the following beneficial effects: the in-vehicle audio playback information generation method of some embodiments of this disclosure improves the effect of conversations in the vehicle cabin and enhances the user experience in the vehicle cabin, while reducing situations that affect user safety. Specifically, the reason why the effect of conversations in the vehicle cabin is poor and the user experience in the vehicle cabin is poor, thus affecting user safety, is that soundproofing the vehicle cabin with soundproof glass requires a large amount of soundproof glass, which affects the effect of conversations in the vehicle cabin when soundproofing is not needed, resulting in a poor user experience in the vehicle cabin. Furthermore, a large amount of soundproof glass leads to lower user safety during driving. Based on this, the in-vehicle audio playback information generation method of some embodiments of this disclosure firstly, in response to detecting audio signal information in the vehicle cabin, determines whether the current scene in the vehicle cabin meets preset encryption scene conditions based on the audio signal information and real-time scene image information. Thus, it can be determined whether the current scene in the vehicle cabin needs to be encrypted. Then, in response to determining that the current scene in the vehicle cabin meets the preset encryption scene conditions, it is determined whether the location information of the user who meets the preset concealment conditions is the target location information. Thus, the location of the user who needs to be concealed can be further determined. Secondly, in response to determining the location information of a user who meets the aforementioned preset masking conditions as the target location information, audio signal preference information corresponding to the user is generated based on the user's historical playback record information. Thus, the user's audio preferences can be obtained. Then, based on the aforementioned audio signal preference information, the audio signal information is masked to obtain the corresponding audio playback information for the user. Thus, masked audio playback information is obtained. Finally, the speakers in the vehicle cabin are controlled to play the audio playback information. Thus, the generated audio playback information can be played, achieving encryption of the audio signal information. Because sound isolation is not achieved using soundproof glass, but rather by masking the detected audio signal information, encryption of conversations within the vehicle cabin is achieved. This reduces the impact on conversation quality in situations where soundproofing is not required. Furthermore, because the masking is based on the user's audio signal preference information, the user experience is improved, and the lower security associated with extensive soundproof glass is eliminated. Therefore, the effectiveness of conversations within the vehicle cabin and the overall user experience are enhanced. Attached Figure Description
[0014] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and elements are not necessarily drawn to scale.
[0015] Figure 1 is a flowchart of some embodiments of the in-vehicle audio playback information generation method according to the present disclosure;
[0016] Figure 2 is a structural schematic diagram of some embodiments of the in-vehicle audio playback information generation device according to the present disclosure;
[0017] Figure 3 is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. Detailed Implementation
[0018] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.
[0019] It should also be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings. Unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other.
[0020] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.
[0021] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".
[0022] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
[0023] This disclosure will now be described in detail with reference to the accompanying drawings and embodiments.
[0024] Figure 1 illustrates a flow 100 of some embodiments of the in-vehicle audio playback information generation method according to the present disclosure. The in-vehicle audio playback information generation method includes the following steps:
[0025] Step 101: In response to the detection of audio signal information in the cabin, determine whether the current scene in the cabin meets the preset encryption scene conditions based on the audio signal information and real-time scene image information.
[0026] In some embodiments, in response to detecting audio signal information within the vehicle cabin, the executing entity (e.g., a computing device) of the in-vehicle audio playback information generation method can determine whether the current scene within the vehicle cabin meets preset encryption scene conditions based on the audio signal information and real-time scene image information. The audio signal information can represent the voice signal currently detected by the microphone within the vehicle cabin. The real-time scene image information can represent the image of the current scene within the vehicle cabin captured by the camera within the vehicle cabin. The preset encryption scene conditions can be that there is a user in the current vehicle cabin who needs to be concealed.
[0027] In some optional implementations of certain embodiments, the aforementioned execution entity may determine whether the current scene inside the vehicle cabin meets the preset encryption scene conditions based on the aforementioned audio signal information and real-time scene image information through the following steps:
[0028] The first step is to determine the number of passengers in the current scene inside the vehicle cabin based on the aforementioned real-time scene image information. This passenger number information represents the number of people currently inside the vehicle cabin. In practice, the executing entity can use object detection algorithms to detect the number of people in the image represented by the aforementioned real-time scene image information.
[0029] The second step involves obtaining initial cabin voice signal information in response to the determination that the passenger number information meets a preset encryption detection condition. This preset encryption detection condition can be that the number of passengers represented by the passenger number information is greater than a preset value. The specific value of this preset value is not limited; for example, it can be 1. The initial cabin voice signal information can represent the voice signal of the first conversation between the users in the cabin. In practice, the executing entity can obtain the initial cabin voice signal information from a database.
[0030] The third step is to determine, based on the initial cabin voice signal information, whether the current scene in the cabin meets the preset encryption scene conditions.
[0031] In some optional implementations of certain embodiments, the aforementioned execution entity may determine whether the current scene within the vehicle cabin meets the aforementioned preset encryption scene conditions based on the aforementioned initial cabin voice signal information through the following steps:
[0032] The first step is to perform semantic detection processing on the initial cabin voice signal information to obtain the semantic information corresponding to the initial cabin voice signal information. This semantic information can represent the semantics represented by the initial cabin voice signal information. In practice, firstly, the executing entity can convert the initial cabin voice signal information into text sentences using a speech recognition algorithm. Then, the BERT model can be used to perform semantic detection processing on the initial cabin voice signal information to obtain the corresponding semantic information.
[0033] The second step involves determining, in response to the determination that the aforementioned semantic information satisfies the preset conversation encryption conditions, whether the current scene within the vehicle cabin satisfies the preset encryption scene conditions based on the aforementioned audio signal information. Here, the preset conversation encryption conditions can be that the aforementioned semantic information is preset semantic information. The semantics represented by the aforementioned preset semantic information are not limited here. For example, the preset semantic information could represent the semantics of a taxi driver asking a customer for the last four digits of their mobile phone number.
[0034] Optionally, before step 101, the aforementioned executing entity may further modify the detected audio signal information to obtain modified audio signal information as audio signal information.
[0035] In some optional implementations of certain embodiments, the aforementioned execution entity may modify the detected audio signal information through the following steps to obtain the modified audio signal information as the audio signal information:
[0036] The first step involves, in response to the determination that the location information of a user satisfying the aforementioned preset masking conditions does not satisfy the preset passenger arrangement conditions, modifying the detected audio signal information according to a first preset modification method to obtain the modified audio signal information. The aforementioned preset passenger arrangement conditions can be that the location of a user satisfying the aforementioned masking conditions is in the same row as the location corresponding to the aforementioned audio signal information. The aforementioned first preset modification method can characterize the method of modifying the detected audio signal information using preset transfer function information.
[0037] The second step involves, in response to the determination that the location information of users meeting the aforementioned preset masking conditions also meets the aforementioned preset passenger arrangement conditions, modifying the detected audio signal information according to the second preset modification method to obtain the modified audio signal information as the audio signal information. The aforementioned second preset modification method can characterize the method of modifying the detected audio signal information through signal characteristics.
[0038] In the process of adopting technical solutions to address the first technical problem mentioned above, the following second technical problem often arises: directly masking the detected audio signal information before playback, without processing the detected audio signal information, causes speaker feedback, resulting in a poor user experience. The conventional solution to this second technical problem is to add sound-absorbing materials to avoid speaker feedback. However, considering the drawbacks of adding sound-absorbing materials to avoid speaker feedback, and given that the inventor's organization has experience in avoiding speaker feedback, and taking into account the situation of the partner company that commissioned the development, we decided to adopt the following solution:
[0039] In some optional implementations of certain embodiments, the aforementioned execution entity may perform modification processing on the detected audio signal information according to a first preset modification method through the following steps to obtain the modified audio signal information as the audio signal information:
[0040] The first step involves generating redundant signal prediction information corresponding to the audio signal information based on the initial audio playback information and the preset transfer function information corresponding to the aforementioned cabin. The preset transfer function information represents the set transfer function corresponding to the aforementioned cabin. The initial audio playback information represents the sound signal played by the speakers within the aforementioned cabin. The redundant signal prediction information represents the redundant sound signals included in the initial audio playback information. For example, the redundant sound signals can represent the sound signals represented by the feedback loop formed between the speakers and microphones within the cabin. In practice, the executing entity can determine the redundant signal prediction information corresponding to the aforementioned audio signal information as the convolution or product between the preset transfer function information and the initial audio playback information.
[0041] The second step involves modifying the detected audio signal information based on the aforementioned redundant signal prediction information to obtain the modified audio signal information. In practice, the executing entity can determine the modified audio signal information as the difference between the aforementioned audio signal information and the aforementioned redundant signal prediction information.
[0042] As redundant signal prediction information is continuously eliminated from the audio signal information collected by the microphone, the cumulative gain trend of the audio signal information amplitude can be suppressed, thereby preventing feedback when the speaker plays audio playback information obtained from the modified audio signal information.
[0043] In some optional implementations of certain embodiments, the aforementioned execution entity may perform modification processing on the detected audio signal information according to a second preset modification method through the following steps to obtain the modified audio signal information as the audio signal information:
[0044] The first step involves feature extraction processing of the initial audio playback information and the detected audio signal information to obtain first signal feature information corresponding to the initial audio playback information and second signal feature information corresponding to the detected audio signal information. The first signal feature information characterizes the amplitude spectrum characteristics of the initial audio playback information. The second signal feature information characterizes the amplitude spectrum characteristics of the detected audio signal information. In practice, the executing entity can perform feature extraction processing on the audio playback information and the detected audio signal information using an amplitude spectrum feature extraction algorithm. For example, the amplitude spectrum feature extraction algorithm can be a combination of Short-Time Fourier Transform (STFT) and amplitude spectrum algorithm.
[0045] The second step involves performing feature concatenation processing on the aforementioned first signal feature information and the aforementioned second signal feature information to obtain concatenated feature information. This concatenated feature information characterizes the combined features of the first signal feature information and the aforementioned second signal feature information. In practice, the executing entity can perform feature concatenation processing on the aforementioned first signal feature information and the aforementioned second signal feature information using a point-by-point weighted averaging algorithm.
[0046] The third step involves feature extraction processing of the aforementioned splicing feature information to obtain splicing amplitude spectrum feature information. This splicing amplitude spectrum feature information characterizes the amplitude spectrum features of the extracted splicing feature information. In practice, the executing entity can input the splicing feature information into a fully connected layer to obtain the corresponding splicing amplitude spectrum feature information.
[0047] The fourth step involves generating amplitude spectrum feature representation information corresponding to the spliced amplitude spectrum feature information, based on the aforementioned spliced amplitude spectrum feature information. This amplitude spectrum feature representation information characterizes the output result obtained by outputting the spliced amplitude spectrum feature information to the three-layer BiGRU layer. In practice, the executing entity can input the spliced amplitude spectrum feature information into the three-layer BiGRU layer to obtain the output amplitude spectrum feature representation information. Each of the three BiGRU layers contains 128 neurons.
[0048] Fifth, based on the amplitude spectrum feature representation information described above, ratio masking information corresponding to the amplitude spectrum feature representation information is generated. This ratio masking information can characterize the IRM value corresponding to the amplitude spectrum feature representation information. In practice, the executing entity can input the amplitude spectrum feature representation information into a fully connected layer to obtain the ratio masking information corresponding to the amplitude spectrum feature representation information. The obtained IRM value is between 0 and 1.
[0049] The sixth step involves modifying the detected audio signal information based on the aforementioned ratio masking information to obtain the modified audio signal information. In practice, the executing entity can modify the detected audio signal information using an activation function and the aforementioned ratio masking information to obtain the modified audio signal information. For example, the activation function could be the sigmoid function.
[0050] The above-described technical solution, as an inventive point of this disclosure, addresses technical problem two: the factors causing speaker feedback and resulting in a poor user experience are often as follows: directly masking the detected audio signal information before playback without processing it. Solving these factors avoids speaker feedback and improves the user experience. To achieve this, this disclosure processes the detected audio signal information using the first preset modification method when the preset load arrangement conditions are not met, and processes the detected audio signal information using the second preset modification method when the preset load arrangement conditions are met, obtaining modified audio signal information to avoid speaker feedback. This improves the user experience.
[0051] Step 102: In response to determining that the current scene inside the vehicle cabin meets the preset encryption scene conditions, determine whether the location information of the user who meets the preset masking conditions is the target location information.
[0052] In some embodiments, in response to determining that the current scene within the vehicle cabin meets the preset encryption scene conditions, the executing entity can determine whether the location information of a user meeting the preset masking conditions is target location information. The target location information can represent the position of the driver within the vehicle cabin. In practice, firstly, the executing entity can acquire historical audio signal information corresponding to the audio signal information. The historical audio signal information can represent the voice signal within a preset time period preceding the audio signal information. Here, the preset time period is not limited. For example, the preset time period can be within 3 seconds. Then, the executing entity can determine whether the historical audio signal information and the audio signal information constitute a dialogue using a voiceprint recognition algorithm and a speech recognition algorithm. Afterwards, in response to determining that the historical audio signal information and the audio signal information constitute a dialogue, the executing entity can determine the sound source location corresponding to the historical audio signal information as a first location and the sound source location of the audio signal information as a second location using a sound source localization algorithm. Secondly, the executing entity can determine users sitting in positions within the vehicle cabin other than the first and second locations as users meeting the preset masking conditions. The aforementioned preset masking conditions can indicate that the user's location is neither the first location nor the second location.
[0053] Step 103: In response to determining the location information of a user that meets the preset masking conditions as the target location information, the corresponding user's audio signal preference information is generated based on the user's historical playback record information.
[0054] In some embodiments, in response to determining the location information of a user who meets preset masking conditions as the target location information, the executing entity can generate audio signal preference information corresponding to the user based on the user's historical playback record information. The historical playback record information can represent the playback records of in-vehicle audio. The audio signal preference information can represent the predicted type of audio signal the user prefers. In practice, the executing entity can obtain the historical playback records for the target time period corresponding to the user from a database storing historical playback records. Here, the target time period is not specifically limited. For example, the target time period can be the previous month.
[0055] In the process of adopting technical solutions to address the aforementioned technical problem one, the following technical problem three often arises: directly playing the set audio type without considering the user's audio preferences results in a poor user experience. The conventional solution to this technical problem three is to select and play the audio signal with the highest ranking on the audio charts. However, considering the drawbacks of selecting the highest-ranking audio signal, and given that the inventor's organization has experience in determining user-preferred audio, and taking into account the situation of the partner company involved in the commissioned development, we have decided to adopt the following solution:
[0056] In some optional implementations of certain embodiments, the execution entity may generate audio signal preference information corresponding to the user based on the user's historical playback record information through the following steps:
[0057] The first step is to perform format conversion on the aforementioned user history playback record information to obtain the format-converted user history playback record information. In practice, the aforementioned execution entity can use a predefined regular expression pattern to perform format conversion on the aforementioned user history playback record information to obtain the format-converted user history playback record information.
[0058] The second step involves performing outlier detection on the user's historical playback records after the format conversion process, obtaining outlier detection results. These outlier detection results characterize various abnormal data within the user's historical playback records. In practice, the executing entity can use an outlier detection algorithm to perform outlier detection on the user's historical playback records after the format conversion process, obtaining the outlier detection results. For example, the outlier detection algorithm could be the SVM algorithm.
[0059] The third step involves updating the user's historical playback record information based on the outlier detection results. The updated user historical playback record information is then used as the target user's historical playback record information. This target user's historical playback information can include the historical playback information of each sub-user. The sub-user historical playback information can include audio type features, audio playback duration features, audio playback count features, audio playback time features, and vehicle travel characteristics corresponding to the audio playback. Specifically, the audio type feature represents the type of audio. For example, it could be a soothing audio track. The audio playback duration feature represents the duration of audio playback. For example, it could be a playback duration of 6 hours. The audio playback count feature represents the number of times the audio was played. For example, it could be played 20 times. The audio playback time feature represents the time period during which the audio was played. For example, it could be played in the afternoon. The vehicle travel characteristics corresponding to the audio playback represent the vehicle's speed and continuous travel duration during the audio playback. For example, the vehicle driving characteristics corresponding to audio playback could be a vehicle speed of 50 kilometers per hour and a driving time of 2 hours. In practice, the aforementioned executing entity can delete the above-mentioned outlier detection result information from the above-mentioned user historical playback record information to update the above-mentioned user historical playback record information, and use the updated user historical playback record information as the target user's historical playback record information.
[0060] The fourth step involves selecting a preset number of feature information from the target user's historical playback information to obtain each selected feature information. The target user's historical playback record information may also include the historical playback record information of each sub-target. The sub-target historical playback record information may include audio type features, audio playback duration features, audio playback count features, audio playback time features, and audio playback corresponding vehicle travel features. The target user's historical playback record information may have the same data structure as the user's historical playback record information. The audio type features, audio playback duration features, audio playback count features, audio playback time features, and audio playback corresponding vehicle travel features included in the sub-target historical playback record information have the same meaning as those included in the sub-user's historical playback information. Therefore, the audio type features, audio playback duration features, audio playback count features, audio playback time features, and audio playback corresponding vehicle travel features included in the sub-target historical playback record information will not be elaborated further here. The preset number is less than the number of features included in the target sub-user's historical playback information. The aforementioned selected feature information can characterize the various features selected from the target user's historical playback information.
[0061] The fifth step is to generate a feature subspace corresponding to each of the selected feature information mentioned above. In practice, the executing entity can combine the selected feature information into a feature subspace.
[0062] Step 6: Based on the aforementioned feature subspace, generate node information corresponding to the aforementioned feature subspace. This node information can represent the optimal splitting node of the decision tree. In practice, the executing entity can use the ID3 algorithm to generate node information corresponding to the aforementioned feature subspace.
[0063] Step 7: Based on the obtained node information, generate decision tree information corresponding to the target user's historical playback information. This decision tree information represents the decision tree trained based on the node information. In practice, the executing entity can use a decision tree algorithm to train the decision tree corresponding to the node information. For example, the decision tree algorithm can be the CART algorithm. The trained decision tree can be a decision tree that takes selected features as input and audio signal preference information as output.
[0064] Step 8: Based on the decision tree information and the user's historical playback record information, generate audio signal preference information corresponding to the user. In practice, the executing entity can input the user's historical playback record information into the decision tree information to obtain the audio signal preference information corresponding to the user.
[0065] The above technical solution, as an inventive point of this disclosure, addresses technical problem three: factors contributing to a poor user experience often include directly playing a pre-defined audio type without considering the user's audio preferences. Solving these factors improves the user experience. To achieve this, this disclosure first trains a decision tree using the target user's historical playback information. Then, it inputs the user's historical playback records into the trained decision tree to obtain the output audio signal preference information. This allows for the prediction of the user's audio signal preference information, enabling playback based on that preference, thus enhancing the user experience.
[0066] Step 104: Mask the audio signal information according to the audio signal preference information to obtain the audio playback information of the corresponding user.
[0067] In some implementations, the aforementioned executing entity can mask the aforementioned audio signal information based on the aforementioned audio signal preference information to obtain the audio playback information corresponding to the aforementioned user.
[0068] In some optional implementations of certain embodiments, the execution entity may perform masking processing on the audio signal information based on the audio signal preference information to obtain the audio playback information corresponding to the user through the following steps:
[0069] The first step is to determine the preset audio signal information corresponding to the aforementioned audio signal preference information from the preset audio signal information set. The preset audio signal information in the preset audio information set represents the correspondence between the audio signal preference information and the audio signal. For example, the preset audio signal information could be "Audio signal preference information: Preferred audio signal type is soothing, Audio signal: Soothing audio signal". In practice, the executing entity can determine the audio signal included in the preset audio signal information set that has the same audio signal preference information as the aforementioned audio signal preference information as the preset audio signal information corresponding to the aforementioned audio signal preference information.
[0070] The second step is to update the aforementioned audio signal information to obtain the updated audio signal information. In practice, the executing entity can update the audio signal information by time-domain scrambling and then re-encoding it to obtain the updated audio signal information.
[0071] The third step involves fusing the aforementioned preset audio signal information and the aforementioned audio signal information to obtain the audio playback information corresponding to the aforementioned user. In practice, the executing entity can use a linear superposition method to fuse the aforementioned preset audio signal information and the aforementioned audio signal information to obtain the audio playback information corresponding to the aforementioned user.
[0072] Optionally, after step 103, in response to determining that the location information of the user satisfying the aforementioned preset masking conditions is not the aforementioned target location information, the executing entity can generate audio playback information corresponding to the aforementioned user based on the target preset audio signal information and the aforementioned audio signal information. The aforementioned target preset audio signal information can represent a preset random noise signal. In practice, firstly, the executing entity can scramble the aforementioned audio signal information using the aforementioned time-domain scrambling and re-encoding method to obtain the scrambled audio signal information as the target audio signal information. Then, the executing entity can fuse the aforementioned target audio signal information and the aforementioned target preset audio signal information using a linear superposition method to obtain the audio playback information corresponding to the aforementioned user.
[0073] Step 105: Control the speakers in the cabin to play audio information.
[0074] In some implementations, the aforementioned executing entity can control the speakers in the vehicle cabin to play the aforementioned audio playback information. In practice, the aforementioned executing entity can control the speakers corresponding to the positions of users in the vehicle cabin who meet the aforementioned preset masking conditions (e.g., the speakers inside the headrests at that position) to play the aforementioned audio playback information.
[0075] The above-described embodiments of this disclosure have the following beneficial effects: the in-vehicle audio playback information generation method of some embodiments of this disclosure improves the effect of conversations in the vehicle cabin and enhances the user experience in the vehicle cabin, while reducing situations that affect user safety. Specifically, the reason why the effect of conversations in the vehicle cabin is poor and the user experience in the vehicle cabin is poor, thus affecting user safety, is that soundproofing the vehicle cabin with soundproof glass requires a large amount of soundproof glass, which affects the effect of conversations in the vehicle cabin when soundproofing is not needed, resulting in a poor user experience in the vehicle cabin. Furthermore, a large amount of soundproof glass leads to lower user safety during driving. Based on this, the in-vehicle audio playback information generation method of some embodiments of this disclosure firstly, in response to detecting audio signal information in the vehicle cabin, determines whether the current scene in the vehicle cabin meets preset encryption scene conditions based on the audio signal information and real-time scene image information. Thus, it can be determined whether the current scene in the vehicle cabin needs to be encrypted. Then, in response to determining that the current scene in the vehicle cabin meets the preset encryption scene conditions, it is determined whether the location information of the user who meets the preset concealment conditions is the target location information. Thus, the location of the user who needs to be concealed can be further determined. Secondly, in response to determining the location information of a user who meets the aforementioned preset masking conditions as the target location information, audio signal preference information corresponding to the user is generated based on the user's historical playback record information. Thus, the user's audio preferences can be obtained. Then, based on the aforementioned audio signal preference information, the audio signal information is masked to obtain the corresponding audio playback information for the user. Thus, masked audio playback information is obtained. Finally, the speakers in the vehicle cabin are controlled to play the audio playback information. Thus, the generated audio playback information can be played, achieving encryption of the audio signal information. Because sound isolation is not achieved using soundproof glass, but rather by masking the detected audio signal information, encryption of conversations within the vehicle cabin is achieved. This reduces the impact on conversation quality in situations where soundproofing is not required. Furthermore, because the masking is based on the user's audio signal preference information, the user experience is improved, and the lower security associated with extensive soundproof glass is eliminated. Therefore, the effectiveness of conversations within the vehicle cabin and the overall user experience are enhanced.
[0076] Referring further to FIG2, as an implementation of the methods shown in the above figures, this disclosure provides some embodiments of an in-vehicle audio playback information generation device, which correspond to the method embodiments shown in FIG1, and the device can be specifically applied to various electronic devices.
[0077] As shown in Figure 2, an in-vehicle audio playback information generation device 200 according to some embodiments includes: a first determining unit 201, configured to determine whether the current scene in the vehicle cabin meets preset encryption scene conditions based on the audio signal information and real-time scene image information in response to detecting audio signal information in the vehicle cabin; a second determining unit 202, configured to determine whether the location information of a user that meets preset masking conditions is target location information in response to determining that the current scene in the vehicle cabin meets the preset encryption scene conditions; a generation unit 203, configured to generate audio signal preference information corresponding to the user based on the user's historical playback record information in response to determining that the location information of the user that meets the preset masking conditions is target location information; a masking processing unit 204, configured to mask the audio signal information according to the audio signal preference information to obtain audio playback information corresponding to the user; and a control unit 205, configured to control the speakers in the vehicle cabin to play the audio playback information.
[0078] It is understood that the units described in the sound processing device 200 applied in the vehicle cabin correspond to the various steps in the method described with reference to FIG1. Therefore, the operation, features, and beneficial effects described above with respect to the method also apply to the device 200 and the units contained therein, and will not be repeated here.
[0079] Referring now to FIG3, a schematic diagram of the structure of an electronic device (e.g., a computing device) 300 suitable for implementing some embodiments of the present disclosure is shown. The electronic device shown in FIG3 is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of the present disclosure.
[0080] As shown in Figure 3, the electronic device 300 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage device 308 into a random access memory (RAM) 303. The RAM 303 also stores various programs and data required for the operation of the electronic device 300. The processing unit 301, ROM 302, and RAM 303 are interconnected via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.
[0081] Typically, the following devices can be connected to I / O interface 305: input devices 306 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 307 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 308 including, for example, magnetic tapes, hard disks, etc.; and communication devices 309. Communication device 309 allows electronic device 300 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 3 shows electronic device 300 with various devices, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively. Each box shown in Figure 3 may represent one device, or multiple devices may be represented as needed.
[0082] In particular, according to some embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 309, or installed from storage device 308, or installed from ROM 302. When the computer program is executed by processing device 301, it performs the functions defined in the methods of some embodiments of this disclosure.
[0083] It should be noted that, in some embodiments of this disclosure, the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In some embodiments of this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In some embodiments of this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0084] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol), and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.
[0085] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device. The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to: in response to detecting audio signal information within the vehicle cabin, determine whether the current scene within the vehicle cabin meets preset encryption scene conditions based on the audio signal information and real-time scene image information; in response to determining that the current scene within the vehicle cabin meets the preset encryption scene conditions, determine whether the location information of a user meeting preset masking conditions is target location information; in response to determining that the location information of a user meeting the preset masking conditions is target location information, generate audio signal preference information corresponding to the user based on the user's historical playback record information; perform masking processing on the audio signal information based on the audio signal preference information to obtain audio playback information corresponding to the user; and control the speakers within the vehicle cabin to play the audio playback information.
[0086] Computer program code for performing operations of some embodiments of this disclosure can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, and conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0087] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0088] The units described in some embodiments of this disclosure can be implemented in software or hardware. The described units can also be housed in a processor; for example, a processor may be described as including a first determining unit, a second determining unit, a generating unit, a masking processing unit, and a control unit. The names of these units do not necessarily limit the specific unit itself; for example, the first determining unit may also be described as "a unit that, in response to detecting audio signal information within the vehicle cabin, determines whether the current scene within the vehicle cabin meets preset encryption scene conditions based on the audio signal information and real-time scene image information."
[0089] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.
[0090] The above description is merely a selection of preferred embodiments of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in the embodiments of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described inventive concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features with similar functions disclosed in the embodiments of this disclosure.
Claims
1. A method for generating in-vehicle audio playback information, comprising: In response to the detection of audio signal information in the cabin, the system determines whether the current scene in the cabin meets the preset encryption scene conditions based on the audio signal information and real-time scene image information. In response to determining that the current scene inside the vehicle cabin meets the preset encrypted scene conditions, determine whether the location information of the user who meets the preset concealment conditions is the target location information; In response to determining the location information of a user that meets the preset masking conditions as the target location information, audio signal preference information corresponding to the user is generated based on the user's historical playback record information; Based on the audio signal preference information, the audio signal information is masked to obtain the audio playback information corresponding to the user; The system controls the speakers in the vehicle cabin to play the audio information.
2. The method according to claim 1, wherein, Before determining whether the current scene inside the vehicle cabin meets the preset encrypted scene conditions based on the audio signal information and real-time scene image information, the method further includes: The detected audio signal information is modified to obtain the modified audio signal information as the audio signal information.
3. The method according to claim 1 or 2, wherein, The step of determining whether the current scene inside the vehicle cabin meets the preset encrypted scene conditions based on the audio signal information and real-time scene image information includes: Based on the real-time scene image information, determine the number of passengers in the current scene inside the vehicle cabin; In response to determining that the passenger number information meets the preset encryption detection conditions, the initial cabin voice signal information in the cabin is obtained; Based on the initial cabin voice signal information, determine whether the current scene in the cabin meets the preset encrypted scene conditions.
4. The method according to claim 3, wherein, The step of determining whether the current scene in the vehicle cabin meets the preset encrypted scene conditions based on the initial cabin voice signal information includes: Semantic detection processing is performed on the initial cabin voice signal information to obtain semantic information corresponding to the initial cabin voice signal information; In response to determining that the semantic information satisfies the preset conversation encryption conditions, the system determines whether the current scene inside the vehicle cabin satisfies the preset encryption scene conditions based on the audio signal information.
5. The method according to any one of claims 1-4, wherein, The step of masking the audio signal information based on the audio signal preference information to obtain the audio playback information corresponding to the user includes: Based on the audio signal preference information, determine the preset audio signal information corresponding to the audio signal preference information from the preset audio signal information set; The audio signal information is updated to obtain the updated audio signal information. The preset audio signal information and the audio signal information are fused together to obtain the audio playback information corresponding to the user.
6. The method according to any one of claims 1-5, wherein, The method further includes: In response to determining that the location information of a user who meets the preset masking conditions is not the target location information, audio playback information corresponding to the user is generated based on the target preset audio signal information and the audio signal information.
7. The method according to claim 2, wherein, The process of modifying the detected audio signal information to obtain modified audio signal information includes: In response to the determination that the location information of a user who meets the preset masking conditions does not meet the preset passenger arrangement conditions, the detected audio signal information is modified according to the first preset modification method to obtain the modified audio signal information as the audio signal information. In response to determining that the location information of a user that meets the preset masking conditions meets the preset vehicle arrangement conditions, the detected audio signal information is modified according to the second preset modification method to obtain the modified audio signal information as the audio signal information.
8. A vehicle-mounted audio playback information generation device, comprising: The first determining unit is configured to, in response to detecting audio signal information inside the vehicle cabin, determine whether the current scene inside the vehicle cabin meets the preset encrypted scene conditions based on the audio signal information and real-time scene image information. The second determining unit is configured to determine whether the location information of a user that meets the preset masking conditions is target location information in response to determining that the current scene in the cabin meets the preset encrypted scene conditions. The generation unit is configured to, in response to determining that the location information of a user who meets the preset masking conditions is the target location information, generate audio signal preference information corresponding to the user based on the user's historical playback record information; The masking processing unit is configured to mask the audio signal information according to the audio signal preference information to obtain audio playback information corresponding to the user; The control unit is configured to control the speakers in the cabin to process the audio playback information.
9. An electronic device, comprising: At least one processor; A storage device having at least one program stored thereon; When the at least one program is executed by the at least one processor, the at least one processor implements the method as described in any one of claims 1 to 7.
10. A computer-readable medium having a computer program stored thereon, wherein, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 7.
