Vehicle-mounted audio output method and device and computer readable storage medium
By building a communication link between the vehicle and the head-mounted display device, detecting and processing audio priority, the problem of audio output as preemptive in the prior art is solved, and the simultaneous playback of multiple audios is realized, which improves user experience and Timely reminder of audio information.
Patent Information
- Application Number
- CN202310572561.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-18
- Publication Date
- 2024-11-22
AI Technical Summary
In the complex environment of multimedia, the existing vehicle audio output method leads to preemptive audio output, affecting the user experience, and unable to play multiple audio simultaneously, resulting in the omission of important audio information.
By building a communication link between the vehicle and the head-mounted display device, detect and determine the audio priority, play the first type of audio with low audio priority, and send the second type of audio with high audio priority to the head-mounted display device. , realizes simultaneous playback of multiple audios.
It improves the user's audio experience, ensures timely prompts and synchronous playback of important audio information, improves the globality of audio playback control, and avoids the intermittent phenomenon of audio output.
Smart Images

Figure CN119002857A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of vehicle-mounted audio processing, and in particular to a vehicle-mounted audio output method, device, and computer-readable storage medium. Background Art
[0002] With the continuous advancement of automotive electronics, more and more multimedia technologies are being added to in-vehicle intelligent terminal platforms, such as MP3 and DVD playback systems for audio-visual entertainment, GPS navigation systems for driver assistance, and Bluetooth voice communication systems for wireless communications. Due to limited space and power inside vehicles, the terminal platform's hardware resources are constrained, making it impossible to allocate a relatively independent hardware unit to each application. This places higher demands on how to effectively share hardware resources. In particular, the automotive industry is currently moving towards intelligentization, and in-vehicle audio and video playback sources are becoming increasingly complex. Audio within a moving vehicle is typically output through media sources such as the radio and call audio, such as Bluetooth phone calls. These outputs are preemptive, impacting the vehicle's entertainment experience. Vehicle audio systems primarily consist of media sources such as the radio and Bluetooth phone calls, and operate in a single-focus preemptive mode. In single-focus preemptive mode, newly connected audio replaces the current audio source, and only one audio source can be playing while the vehicle is in motion. For example, replacing the song currently playing in a music app with the navigation notification sound from a navigation app is considered app function replacement.
[0003] The drawback of the above solution is that: since the newly connected audio is generally short-lived, such as navigation prompts, the new audio is only used to replace the current audio playback, which greatly reduces the user's experience of the audio playback system. Summary of the Invention
[0004] The main purpose of this application is to provide a vehicle-mounted audio output method, device and computer-readable storage medium, aiming to provide in-vehicle users with a better audio experience while enabling them to obtain important audio information in a timely manner and improve the overall audio playback control.
[0005] To achieve the above objectives, the present application provides a vehicle-mounted audio output method, which is applied to a vehicle, wherein the vehicle establishes a communication link with a head-mounted display device, and the method includes: Check whether there are at least two audio files to be played. If yes, determining the first category audio and the second category audio in each of the to-be-played audios, wherein the audio priority of the first category audio is lower than the audio priority of the second category audio; Play the first type of audio, and send the audio file corresponding to the second type of audio to the head-mounted display device through the communication link for playback.
[0006] Optionally, the step of playing the first type of audio includes: If there are multiple first-category audios in each of the to-be-played audios, analyzing each of the first-category audios to obtain an audio priority of each of the first-category audios; Play the first-category audios in order from high to low according to the audio priority.
[0007] Optionally, after the step of obtaining the audio priority of each of the first-category audios, the method further includes: detecting whether the audio priority of each of the first-category audios is lower than a preset priority; If not, executing: the step of playing each of the first-category audios in order from high to low according to the audio priority; If so, perform the first mixing processing on each of the first-category audios to obtain the first-category audio after the first mixing processing and play it. In the first-category audio after the first mixing processing, the first-category audio with the first audio priority is the first volume, and the first-category audio with the second audio priority is the second volume, wherein the first audio priority is greater than the second audio priority, and the first volume is greater than the second volume.
[0008] Optionally, the step of sending the audio file corresponding to the second type of audio to the head mounted display device for playback through the communication link includes: If each of the to-be-played audios includes a plurality of second-category audios, parsing each of the second-category audios to obtain an audio priority of each of the second-category audios; Through the communication link, the audio files corresponding to the second-category audio are sent to the head-mounted display device for playback in order of audio priority from high to low.
[0009] Optionally, after the step of obtaining the audio priority of each second-category audio, the method further includes: detecting whether the audio priority of each of the second-category audios is lower than a preset priority; If not, executing: the step of sending the audio files corresponding to the second-category audio to the head-mounted display device for playback in descending order of audio priority through the communication link; If so, a second mixing process is performed on each of the second-category audios, and the audio files corresponding to the second-category audios after the second mixing process are sent to the head-mounted display device for playback through the communication link. In the second-category audio after the second mixing process, the second-category audio with the third audio priority is the third volume, and the second-category audio with the fourth audio priority is the fourth volume, wherein the third audio priority is greater than the third audio priority, and the third volume is greater than the fourth volume.
[0010] Optionally, the first category of audio includes voice audio, media audio and system prompt audio, and the second category of audio includes security audio and communication audio, wherein the audio priorities are from high to low and are the security audio, the communication audio, the voice audio, the media audio and the system prompt audio.
[0011] The present application also provides a vehicle-mounted audio output method, which is applied to a head-mounted display device, wherein the head-mounted display device establishes a communication link with the vehicle, and the method includes: detecting, via the communication link, whether the vehicle currently has at least two audios to be played; If yes, determining the first category audio and the second category audio in each of the to-be-played audios, wherein the audio priority of the first category audio is lower than the audio priority of the second category audio; An audio file corresponding to the second type of audio is obtained from the vehicle through the communication link to play the second type of audio.
[0012] Optionally, the step of obtaining an audio file corresponding to the second type of audio from the vehicle through the communication link includes: If each of the to-be-played audios includes a plurality of second-category audios, parsing each of the second-category audios to obtain an audio priority of each of the second-category audios; Through the communication link, audio files corresponding to the second-category audios are obtained from the vehicle in order from high to low audio priorities, so as to play the second-category audios in order from high to low audio priorities.
[0013] The present application also provides an in-vehicle audio output device, which is a physical device and includes: a memory, a processor, and a program of the in-vehicle audio output method stored in the memory and executable on the processor. When the program of the in-vehicle audio output method is executed by the processor, the steps of the in-vehicle audio output method described above can be implemented.
[0014] The present application also provides a computer-readable storage medium, on which is stored a program for implementing the in-vehicle audio output method. The program for implementing the in-vehicle audio output method is executed by a processor to implement the steps of the in-vehicle audio output method as described above.
[0015] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned in-vehicle audio output method when executed by a processor.
[0016] The in-vehicle audio output method of the present application is applied to a vehicle, and the vehicle establishes a communication link with a head-mounted display device. The in-vehicle audio output method of the present application is to detect whether there are at least two audios to be played. If so, the first category of audio (such as music, radio broadcasts, and built-in audio when opening application software) and the second category of audio (such as navigation voice reminders, excessive vehicle speed voice reminders, and collision warning reminders) in each audio to be played are determined, wherein the audio priority of the first category of audio is lower than the audio priority of the second category of audio, and the first category of audio is played, and the audio file corresponding to the second category of audio is sent to the head-mounted display device through the communication link for playback, so that the user can have a better audio experience in the car while not missing the prompts of important audio information. For example, a user in a car is listening to music played through the car audio system, and then the navigation voice reminds him to turn right 50 meters ahead. At this time, the present application sends the navigation voice reminder to the head-mounted display device worn by the driver for playback. Since the speakers of the head-mounted display device are closer to the ears, the driver can hear it more clearly, which not only allows the user to have a better audio experience in the car, but also enables the user in the car to promptly know important audio information during driving, thereby orderly managing the playback of the entire vehicle's audio source, enhancing the user's audio enjoyment while driving, and thereby improving the overall control of audio playback.
[0017] Current in-car audio output methods typically replace the current audio with a new one, significantly reducing the user experience. For example, if a user is listening to music and the navigation system prompts a turn or a reminder, the music playback must be interrupted to receive the navigation voice prompt, resulting in intermittent music playback and a poor audio experience.
[0018] Compared with the current in-vehicle audio output method, this application establishes a communication link between the vehicle and the head-mounted display device, and then plays the first type of audio through the vehicle's own audio device, and simultaneously plays the second type of audio through the head-mounted display device connected to the vehicle. The audio priority of the first type of audio is lower than the audio priority of the second type of audio, thereby achieving the simultaneous playback of audio with different audio priorities (for example, music audio stream and navigation audio stream are played at the same time), which increases the amount of information obtained by users, improves the user's audio experience, and does not miss the prompts of important audio information, thereby achieving the synchronous playback of important audio (such as safety audio) during driving while playing general audio (such as entertainment audio), which neither affects the playback quality of the current audio nor misses emergency audio. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0020] In order to more clearly illustrate the technical solutions in this embodiment or the prior art, the following briefly introduces the drawings required for use in the embodiment or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0021] Figure 1 This is a flow chart of the first embodiment of the in-vehicle audio output method of the present application; Figure 2 This is a flow chart of a second embodiment of the in-vehicle audio output method of the present application; Figure 3 This is a flow chart of a third embodiment of the in-vehicle audio output method of the present application; Figure 4 This is a schematic diagram of the module structure of the vehicle audio output device according to an embodiment of the present application; Figure 5 Schematic diagram of the device structure of the hardware operating environment involved in the vehicle audio output device in this embodiment.
[0022] The purpose, features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0023] To make the above-mentioned objects, features, and advantages of the present invention more clearly understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present invention.
[0024] Example 1 At present, the automotive industry is developing towards the trend of intelligence, and the audio and video playback sources of cars are becoming more and more complex. The audio inside a moving vehicle is generally output through media audio such as radio and call audio such as Bluetooth phone, and the output method is preemptive output, which affects the entertainment of the car; the vehicle audio system is mainly composed of media audio sources such as radio and Bluetooth phone, and it is in single-focus preemptive mode when outputting sound; among them, the single-focus preemptive mode is that the newly connected audio replaces the current audio for playback, and only one audio can be played while the vehicle is driving. For example, using the navigation prompt tone of the navigation APP (Application) to replace the song currently played by the music APP is a function replacement of the APP.
[0025] The drawback of the above solution is that: since the newly connected audio is generally short-lived, such as navigation prompts, the new audio is only used to replace the current audio playback, which greatly reduces the user's experience of the audio playback system.
[0026] Based on this, please refer to Figure 1 This embodiment provides a method for in-vehicle audio output, which is applied to a vehicle. The vehicle establishes a communication link with a head-mounted display device, and the method includes: Step S10, detecting whether there are at least two audios to be played; In this embodiment, the vehicle generally needs to output multiple audios to be played simultaneously, such as radio, Bluetooth phone, radar, navigation system, and instrument panel.
[0027] Step S20: If yes, determining the first category audio and the second category audio in each of the to-be-played audios, wherein the audio priority of the first category audio is lower than the audio priority of the second category audio; Step S30: play the first type of audio, and send the audio file corresponding to the second type of audio to the head-mounted display device through the communication link for playback.
[0028] For the head-mounted display device, it has its own audio player, which can play the first type of audio through the vehicle, and send the audio file corresponding to the second type of audio to the head-mounted display device for playback, thereby realizing the integration of the head-mounted display device and the vehicle audio strategy, giving users a better audio experience.
[0029] Exemplarily, the first category of audio includes voice audio, media audio and system prompt audio, and the second category of audio includes security audio and communication audio, wherein the audio priorities are from high to low, namely, the security audio, the communication audio, the voice audio, the media audio and the system prompt audio.
[0030] Specifically, the vehicle's sound sources include FM (Frequency Modulation) radio, AM (Amplitude Modulation) radio, USB-Music (music played via USB connection), BT-Music (music played via Bluetooth connection), B-Call (remote rescue call), BT-Call (Bluetooth call), Ring-Tone, Chime (seat belt, turn signal prompt sound, etc.). The sound sources of Internet cars will increase to Online-Music, Online-Radio, Online-Video, VOIP (Internet call), Voice-Recognition, Navigation, Notification, Safety-Alert, and System (touch screen interface feedback sound).
[0031] Specifically, based on usage scenarios, audio can be categorized as security, communications, voice, media, and system notifications. Original Equipment Manufacturers (OEMs) generally define audio priorities in the following order: security > communications > voice > media > system notifications.
[0032] 1. Safety: Safety-Alert and Chime, typically brief warning announcements and prompts, such as critical fault announcements and driver assistance prompts. Safety-related sounds have the highest priority and cannot be interrupted by any other type of sound, except for post-event sounds of the same type.
[0033] 2. Communication: B-Call, BT-Call, Ring-Tone, and VOIP. Communication sounds have a lower priority than safety sounds in driving scenarios, but they may be very important information to users. These sounds require continuous user attention and feedback and cannot be interrupted at will. They should be mixed with safety announcements.
[0034] 3. Voice: Voice-Recognition, Navigation, and Notification. Voice has a lower priority than security and communication, and will be preempted by the former. Voice is often real-time and high-information, and decoding it consumes significant resources. Therefore, only one voice channel can be played simultaneously.
[0035] 4. Media: FM, AM, USB-Music, BT-Music, Online-Music, Online-Radio, and Online-Video. Although media-related sounds have a lower priority and the information they contain is not very important, if they are frequently interrupted and played intermittently, the user experience will be poor. Therefore, they are suitable for background music playback.
[0036] 5. System prompt type: System. This type of sound is short and rhythmic, conveying fixed information. It can be broadcast with all other types including its own mixing.
[0037] The embodiment of the present application uses the above-mentioned audio strategy design to allow users to have a better audio experience in the car while not missing important information prompts.
[0038] The in-vehicle audio output method of an embodiment of the present application is applied to a vehicle, and the vehicle establishes a communication link with a head-mounted display device. The in-vehicle audio output method of an embodiment of the present application is to detect whether there are at least two audios to be played. If so, the first type of audio (such as music, radio broadcasts, and built-in audio when opening application software) and the second type of audio (such as navigation voice reminders, excessive vehicle speed voice reminders, and collision warning reminders) in each audio to be played are determined, wherein the audio priority of the first type of audio is lower than the audio priority of the second type of audio, and the first type of audio is played, and the audio file corresponding to the second type of audio is sent to the head-mounted display device through the communication link for playback, so that the user can have a better audio experience in the car while not missing the prompts of important audio information. For example, a user in a car is listening to music played through the car audio system, and then the navigation voice reminds him to turn right 50 meters ahead. At this time, the embodiment of the present application sends the navigation voice reminder to the head-mounted display device worn by the driver for playback. Since the speakers of the head-mounted display device are closer to the ears, the driver can hear it more clearly, which not only allows the user to have a better audio experience in the car, but also enables the user in the car to promptly know important audio information during driving, thereby orderly managing the playback of the entire vehicle's audio source, enhancing the user's audio enjoyment while driving, and further improving the overall control of audio playback.
[0039] Current in-car audio output methods typically replace the current audio with a new one, significantly reducing the user experience. For example, if a user is listening to music and the navigation system prompts a turn or a reminder, the music playback must be interrupted to receive the navigation voice prompt, resulting in intermittent music playback and a poor audio experience.
[0040] Compared with the current in-vehicle audio output method, the embodiment of the present application establishes a communication link between the vehicle and the head-mounted display device, and then plays the first type of audio through the audio device carried by the vehicle itself, and simultaneously plays the second type of audio through the head-mounted display device connected to the vehicle in communication. The audio priority of the first type of audio is lower than the audio priority of the second type of audio, thereby achieving the simultaneous playback of audio with different audio priorities (for example, music audio stream and navigation audio stream are played at the same time), which increases the amount of information obtained by users, improves the user's audio experience, and does not miss the prompts of important audio information, thereby achieving the synchronous playback of important audio (for example, safety audio) during driving while playing general audio (for example, entertainment audio), which neither affects the playback quality of the current audio nor misses emergency audio.
[0041] In one practicable manner, see Figure 2 , the step of playing the first type of audio includes: Step S31: If there are multiple first-category audios in the audios to be played, each of the first-category audios is parsed to obtain an audio priority of each of the first-category audios; Step S32: Play the first-category audios in order from high to low priority.
[0042] This embodiment parses each first-category audio when there are multiple first-category audios to obtain the audio priority of each first-category audio, and then plays each first-category audio in sequence from high to low audio priority, thereby achieving audio priority sorting of each first-category audio, avoiding safety hazards caused by safety-related audios with higher audio priorities (such as serious fault broadcasts and driving assistance prompt sounds) not being played in time, and preventing the driver from failing to realize the dangerous working condition of the current vehicle in time, thereby effectively improving driving safety.
[0043] In addition, the in-vehicle audio output method of the embodiment of the present application can play different types of audio at the same time through a head-mounted display device that is communicatively connected to the vehicle, thereby increasing the amount of information obtained by users. By integrating all the audio streams of the vehicle and setting the playback priority according to the category, the playback of the entire vehicle's audio source is managed in an orderly manner, greatly improving the user experience.
[0044] In a possible implementation, after the step of obtaining the audio priority of each of the first-category audios, the method further includes: Step A10, detecting whether the audio priority of each of the first-category audios is lower than a preset priority; In this embodiment, the audio priority of each first-category audio is lower than the preset priority, indicating that each first-category audio is mixable. However, if at least one first-category audio has a higher priority than the preset priority, the first-category audio cannot be mixed. This prevents higher-priority safety-related audio (such as critical fault announcements and driver assistance prompts) from failing to attract the driver's attention after mixing, potentially creating a safety hazard. This prevents the driver from failing to promptly recognize the vehicle's dangerous operating conditions, thereby effectively improving driving safety.
[0045] The preset priority level can be set by those skilled in the art according to actual conditions, and is not specifically limited in this embodiment.
[0046] Step A20: If not, then execute: the step of playing each of the first-category audios in order from high to low according to the audio priority; Step A30: If yes, perform the first mixing processing on each of the first-category audios to obtain the first-category audio after the first mixing processing and play it. In the first-category audio after the first mixing processing, the first-category audio with the first audio priority is the first volume, and the first-category audio with the second audio priority is the second volume, wherein the first audio priority is greater than the second audio priority, and the first volume is greater than the second volume.
[0047] In this embodiment, when the audio priorities are all lower than the preset priorities, that is, for example, the audio content to be played is all entertainment images, not safety-related, and does not need to be played separately to highlight the information, the non-safety-related audios can be mixed and played all at once, thereby ensuring driving safety while allowing users to simultaneously obtain multiple audio information, thereby allowing users to have a better audio experience in the car while allowing users to pay attention to prompts of important audio information in a timely manner.
[0048] In this embodiment, the mixable audio combinations may include: key tones (emergency calls, communication sounds, navigation sounds, voice interaction sounds, media sounds and reminder sounds); among them, communication sounds cannot be mixed with each other; voice interaction sounds and navigation sounds cannot be mixed; media sounds cannot be mixed with navigation sounds and communication sounds.
[0049] In this embodiment, the type of the currently playing audio may include a mixable type, a pauseable type, and a waitable type. When mixing the audio for synchronous playback, the higher the audio priority, the louder the volume of the audio involved in the mixing (that is, the more important the audio, the louder the volume prompted), thereby improving the audio experience and safety.
[0050] The in-vehicle audio output method of the embodiment of the present application can mix multiple audios and, while playing audio, play other important audio for emergency handling separately, without affecting the playback quality of the current audio and without reducing the prominence of the important audio information. Through the in-vehicle audio and a head-mounted display device connected to the vehicle for communication, it is possible to achieve the situation where the in-vehicle audio plays general audio (such as entertainment audio) while the head-mounted display device plays important audio (such as safety audio) during driving, without affecting the playback quality of the current audio and without missing the emergency audio.
[0051] In order to help understand the technical concept of the embodiments of the present application, a specific embodiment 1 is listed: In this specific embodiment, because AR glasses (an example of a head-mounted display device) are worn close to the ears, the in-ear volume will be louder than the car audio and can cover the sound source of the vehicle's own player. Therefore, safety and communication sound sources are played by AR glasses according to the priority of safety > communication.
[0052] For other types of audio sources, they will be played by the vehicle's own player in the order of priority: voice > media > system prompt sound.
[0053] For example, when listening to music, the navigation prompts a turn reminder, and the music playback has to be interrupted, resulting in intermittent music playback and a poor user experience. After adopting this solution, users can clearly receive navigation information reminders while the music continues to play.
[0054] Example 1: A passenger and driver are listening to music played on the vehicle's audio system. The navigation system prompts a right turn 50 meters ahead. This audio reminder is played through the speaker of the driver's AR glasses. Because it is closer to the driver's ears, the driver can hear it more clearly without affecting the passenger's music listening experience.
[0055] Example 2: The two passengers in the back row use the rear car large screen and car audio to watch a movie, the front passenger uses the AR glasses' speakers to listen to music, and the driver uses the AR glasses to listen to navigation information. The four people do not affect each other. Example 3: Two rear passengers and a front passenger use AR glasses to watch different movies. A third passenger listens to the movie audio through their own AR glasses. The driver uses AR glasses to listen to navigation information. None of the four people interact with each other.
[0056] This embodiment can provide users with a better audio experience in the car without missing any important information prompts through special audio strategy design.
[0057] It should be noted that the many details shown in this example are only helpful for understanding the technical concept of the embodiment of this application, and do not constitute a limitation of this application. More forms of deformation or transformation based on the technical concept of the embodiment of this application should all be within the scope of protection of this application.
[0058] Example 2 Based on the first embodiment of the present application, in another embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction and will not be repeated hereafter. On this basis, the step of sending the audio file corresponding to the second type of audio to the head-mounted display device for playback via the communication link includes: Step B10: If each of the to-be-played audios includes multiple second-category audios, each of the second-category audios is parsed to obtain an audio priority of each of the second-category audios; Step B20: Send the audio files corresponding to the second-category audio to the head-mounted display device for playback in descending order of audio priority through the communication link.
[0059] This embodiment parses each second-category audio when there are multiple second-category audios to obtain the audio priority of each second-category audio, and then sends the audio files corresponding to each second-category audio to the head-mounted display device for playback in order from high to low audio priority, thereby achieving audio priority sorting of each second-category audio, avoiding that voice audio with higher audio priority is preempted, and media audio and system prompt audio with lower audio priority are played instead, thereby making the embodiment of the present application effectively improve the user's audio experience.
[0060] In addition, the in-vehicle audio output method of the embodiment of the present application can play different types of audio at the same time through the in-vehicle audio system, thereby increasing the amount of information obtained by users. By integrating all the audio streams of the vehicle and setting the playback priority according to the category, the playback of the entire vehicle's audio source is managed in an orderly manner, greatly improving the user experience.
[0061] In a possible implementation, after the step of obtaining the audio priority of each second-category audio, the method further includes: Step C10, detecting whether the audio priority of each of the second-category audios is lower than a preset priority; If not, step C20 is executed: the step of sending the audio files corresponding to the second-category audio to the head-mounted display device for playback in descending order of audio priority through the communication link; Step C30: If so, perform a second mixing process on each of the second-category audios, and send the audio files corresponding to the second-category audios after the second mixing process to the head-mounted display device for playback through the communication link. In the second-category audio after the second mixing process, the second-category audio with the third audio priority has a third volume, and the second-category audio with the fourth audio priority has a fourth volume, wherein the third audio priority is greater than the third audio priority, and the third volume is greater than the fourth volume.
[0062] This embodiment performs a second mixing process on each second-category audio when it is detected that the audio priority of each second-category audio is lower than the preset priority, and sends the audio file corresponding to the second-category audio after the second mixing process to the head-mounted display device for playback through the communication link. In the second-category audio after the second mixing process, the second-category audio with the third audio priority has a third volume, and the second-category audio with the fourth audio priority has a fourth volume, wherein the third audio priority is greater than the third audio priority, and the third volume is greater than the fourth volume. Therefore, when each second-category audio is mixed, the volume of the audio with a higher audio priority is greater, so that the audio information with a high audio priority can be highlighted as much as possible, which greatly improves the user experience and safety, and enhances the driving experience while ensuring the driver's driving safety.
[0063] Example 3 This application also provides a method for in-vehicle audio output, please refer to Figure 3 The vehicle-mounted audio output method is applied to a head-mounted display device, the head-mounted display device establishes a communication link with the vehicle, and the method further includes: Step S40: detecting, via the communication link, whether the vehicle currently has at least two audios to be played; Step S50: If yes, determining the first category audio and the second category audio in each of the to-be-played audios, wherein the audio priority of the first category audio is lower than the audio priority of the second category audio; Step S60: obtaining an audio file corresponding to the second type of audio from the vehicle through the communication link to play the second type of audio.
[0064] The in-vehicle audio output method of an embodiment of the present application is applied to a head-mounted display device, and the head-mounted display device establishes a communication link with the vehicle. The in-vehicle audio output method of the embodiment of the present application detects, through the communication link, whether there are at least two audios to be played in the vehicle; if there are at least two audios to be played, determines a first category of audio and a second category of audio in each audio to be played, wherein the audio priority of the first category of audio is lower than the audio priority of the second category of audio, and then obtains an audio file corresponding to the second category of audio from the vehicle through the communication link to play the second category of audio, thereby allowing the user to have a better audio experience in the car while not missing prompts of important audio information. For example, a user in a car is listening to music played through the car audio system, and then the navigation voice reminds him to turn right 50 meters ahead. At this time, the embodiment of the present application sends the navigation voice reminder to the head-mounted display device worn by the driver for playback. Since the speakers of the head-mounted display device are closer to the ears, the driver can hear it more clearly, which not only allows the user to have a better audio experience in the car, but also enables the user in the car to promptly know important audio information during driving, thereby orderly managing the playback of the entire vehicle's audio source, enhancing the user's audio enjoyment while driving, and further improving the overall control of audio playback.
[0065] Current in-vehicle audio output methods typically replace the current audio with new audio, significantly reducing the user experience of the audio playback system. For example, if a user is listening to music in a car and the navigation system makes a turn or prompts a reminder, the music playback must be interrupted to receive the navigation voice prompt, resulting in intermittent music playback and a poor user audio experience. Compared to current in-vehicle audio output methods, the present embodiment establishes a communication link between the vehicle and a head-mounted display device, then plays a first type of audio through the vehicle's own audio device, while simultaneously playing a second type of audio through the head-mounted display device connected to the vehicle. The audio priority of the first type of audio is lower than that of the second type of audio. This allows for simultaneous playback of audio with different audio priorities (for example, simultaneous playback of music and navigation audio streams), increasing the user's information acquisition and improving the user's audio experience without missing important audio information. Furthermore, the present embodiment allows for the simultaneous playback of important driving audio (for example, safety-related audio) while playing general audio (for example, entertainment audio), without affecting the playback quality of the current audio or missing emergency audio.
[0066] In a possible implementation, the step of obtaining an audio file corresponding to the second type of audio from the vehicle through the communication link includes: Step D10: If each of the to-be-played audios includes multiple second-category audios, each of the second-category audios is parsed to obtain an audio priority of each of the second-category audios; Step D20: Obtain the audio files corresponding to the second-category audios from the vehicle in descending order of audio priority through the communication link, so as to play the second-category audios in descending order of audio priority.
[0067] This embodiment parses each second-category audio when there are multiple second-category audios, obtains the audio priority of each second-category audio, and then obtains the audio files corresponding to each second-category audio from the vehicle in order from high to low according to the audio priority, so as to play each second-category audio in order from high to low according to the audio priority, thereby realizing audio priority sorting of each second-category audio, avoiding that voice audio with higher audio priority is preempted and media audio and system prompt audio with lower audio priority are played instead, thereby making the embodiment of the present application effectively improve the user's audio experience.
[0068] In addition, the in-vehicle audio output method of the embodiment of the present application can play different types of audio at the same time through a head-mounted display device, thereby increasing the amount of information obtained by users. By integrating all the audio streams of the vehicle and setting the playback priority according to the category, the playback of the entire vehicle's audio source is managed in an orderly manner, greatly improving the user experience.
[0069] Example 4 The embodiment of the present invention also provides a vehicle-mounted audio output device, please refer to Figure 4 The vehicle-mounted audio output device is applied to a vehicle, and the vehicle establishes a communication link with a head-mounted display device, and the device includes: A detection module 10 is configured to detect whether there are at least two audios to be played; The determining module 20 is configured to, if yes, determine the first category audio and the second category audio in each of the to-be-played audios, wherein the audio priority of the first category audio is lower than the audio priority of the second category audio; The playing module 30 is configured to play the first type of audio and send the audio file corresponding to the second type of audio to the head-mounted display device through the communication link for playback.
[0070] Optionally, the playing module 30 is further configured to: If there are multiple first-category audios in each of the to-be-played audios, analyzing each of the first-category audios to obtain an audio priority of each of the first-category audios; Play the first-category audios in order from high to low according to the audio priority.
[0071] Optionally, the playing module 30 is further configured to: detecting whether the audio priority of each of the first-category audios is lower than a preset priority; If not, executing: the step of playing each of the first-category audios in order from high to low according to the audio priority; If so, perform the first mixing processing on each of the first-category audios to obtain the first-category audio after the first mixing processing and play it. In the first-category audio after the first mixing processing, the first-category audio with the first audio priority is the first volume, and the first-category audio with the second audio priority is the second volume, wherein the first audio priority is greater than the second audio priority, and the first volume is greater than the second volume.
[0072] Optionally, the playing module 30 is further configured to: If each of the to-be-played audios includes a plurality of second-category audios, parsing each of the second-category audios to obtain an audio priority of each of the second-category audios; Through the communication link, the audio files corresponding to the second-category audio are sent to the head-mounted display device for playback in order of audio priority from high to low.
[0073] Optionally, the playing module 30 is further configured to: detecting whether the audio priority of each of the second-category audios is lower than a preset priority; If not, executing: the step of sending the audio files corresponding to the second-category audio to the head-mounted display device for playback in descending order of audio priority through the communication link; If so, a second mixing process is performed on each of the second-category audios, and the audio files corresponding to the second-category audios after the second mixing process are sent to the head-mounted display device for playback through the communication link. In the second-category audio after the second mixing process, the second-category audio with the third audio priority is the third volume, and the second-category audio with the fourth audio priority is the fourth volume, wherein the third audio priority is greater than the third audio priority, and the third volume is greater than the fourth volume.
[0074] Optionally, the first category of audio includes voice audio, media audio and system prompt audio, and the second category of audio includes security audio and communication audio, wherein the audio priorities are from high to low and are the security audio, the communication audio, the voice audio, the media audio and the system prompt audio.
[0075] The in-vehicle audio output device provided in an embodiment of the present invention, utilizing the in-vehicle audio output method of the first or second embodiment above, can provide a better audio experience for in-vehicle users while enabling them to promptly access important audio information, thereby improving the overall control of audio playback. Compared to the prior art, the in-vehicle audio output device provided in an embodiment of the present invention has the same beneficial effects as the in-vehicle audio output method provided in the above embodiment. Other technical features of the in-vehicle audio output device are the same as those disclosed in the above embodiment and are not further described here.
[0076] Example 5 An embodiment of the present invention provides an in-vehicle audio output device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the in-vehicle audio output method of the above-mentioned embodiment 1.
[0077] Reference below Figure 5 , which shows a schematic diagram of the structure of an in-vehicle audio output device suitable for implementing the embodiments of the present disclosure. In this embodiment, the in-vehicle audio output device includes, but is not limited to, head-mounted display devices such as Mixed Reality (MR) devices (e.g., MR glasses or MR helmets), Augmented Reality (AR) devices (e.g., AR glasses or AR helmets), Virtual Reality (VR) devices (e.g., VR glasses or VR helmets), Extended Reality (XR) devices, or some combination thereof. In another embodiment, the in-vehicle audio output device is a vehicle (the vehicle can establish a communication link with the head-mounted display device). Figure 5 The in-vehicle audio output device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0078] like Figure 5 As shown, the in-vehicle audio output device may include a processing device 1001 (e.g., a central processing unit, graphics processing unit, etc.), which can perform various appropriate actions and processes based on programs stored in a read-only memory (ROM) 1002 or programs loaded from a storage device into a random access memory (RAM) 1004. RAM 1004 also stores various programs and data required for the operation of the in-vehicle audio output device. Processing device 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface is also connected to bus 1005.
[0079] Typically, the following systems may be connected to I / O interface 1006: input device 1007 including, for example, a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output device 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage device 1003 including, for example, a magnetic tape, hard disk, etc.; and communication device 1009. Communication device 1009 may allow the in-vehicle audio output device to communicate with other devices wirelessly or by wire to exchange data. While the figure illustrates an in-vehicle audio output device with various systems, it should be understood that implementation or presence of all illustrated systems is not required. More or fewer systems may alternatively be implemented or present.
[0080] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.
[0081] The in-vehicle audio output device provided by the present invention utilizes the in-vehicle audio output method of the aforementioned embodiment, thereby providing a better audio experience for in-vehicle users while enabling them to promptly access important audio information and improving the overall control of audio playback. Compared to the prior art, the in-vehicle audio output device provided by the embodiment of the present invention achieves the same beneficial effects as the in-vehicle audio output method provided by the aforementioned embodiment. Other technical features of the in-vehicle audio output device are the same as those disclosed in the aforementioned embodiment and are not further elaborated here.
[0082] It should be understood that various parts of the present disclosure can be implemented with hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in an appropriate manner.
[0083] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.
[0084] Example 6 An embodiment of the present invention provides a computer-readable storage medium having computer-readable program instructions stored thereon, and the computer-readable program instructions are used to execute the vehicle-mounted audio output method in the above embodiment.
[0085] The computer-readable storage medium provided in the embodiments of the present invention may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems, or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.
[0086] The computer-readable storage medium may be included in the vehicle-mounted audio output device, or may exist independently without being assembled into the vehicle-mounted audio output device.
[0087] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the vehicle-mounted audio output device, the vehicle-mounted audio output device: detects whether there are at least two audios to be played; if so, determines the first category of audio and the second category of audio in each of the audios to be played, wherein the audio priority of the first category of audio is lower than the audio priority of the second category of audio; plays the first category of audio, and sends the audio file corresponding to the second category of audio to the head-mounted display device through the communication link for playback.
[0088] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0089] The flow charts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0090] The modules involved in the embodiments described in this disclosure may be implemented in software or hardware, wherein the name of a module does not necessarily limit the unit itself.
[0091] The computer-readable storage medium provided by the present invention stores computer-readable program instructions for executing the aforementioned in-vehicle audio output method. This enables in-vehicle users to enjoy a better audio experience while also providing timely access to important audio information, thereby improving the overall control of audio playback. Compared to the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiments of the present invention are similar to those of the in-vehicle audio output method provided by the aforementioned first or second embodiments, and are not further elaborated here.
[0092] Example 7 An embodiment of the present invention further provides a computer program product, including a computer program, which implements the steps of the above-mentioned in-vehicle audio output method when executed by a processor.
[0093] The computer program product provided in this application can provide in-vehicle users with a better audio experience while enabling them to promptly access important audio information, thereby improving the overall control of audio playback. Compared to the prior art, the beneficial effects of the computer program product provided in this embodiment of the present invention are the same as those of the in-vehicle audio output method provided in the first or second embodiments above, and are not further elaborated here.
[0094] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.
Claims
1. A vehicle audio output method, characterized in that: The vehicle audio output method is applied to a vehicle, and the vehicle establishes a communication link with a head mounted display device. The method comprises: Detect whether there are at least two audios to be played; If yes, determining the first category audio and the second category audio in each of the to-be-played audios, wherein the audio priority of the first category audio is lower than the audio priority of the second category audio; The first type of audio is played, and an audio file corresponding to the second type of audio is sent to the head mounted display device through the communication link for playback.
2. The vehicle audio output method according to claim 1, characterized in that: The step of playing the first type of audio comprises: If there are multiple first-category audios in each of the to-be-played audios, each of the first-category audios is parsed to obtain an audio priority of each of the first-category audios; The first-category audios are played in sequence from high to low according to the audio priority.
3. The vehicle audio output method according to claim 2, characterized in that: After the step of obtaining the audio priority of each of the first-category audios, the method further includes: Detecting whether the audio priority of each of the first-category audios is lower than the preset priority; If not, executing: the step of playing each of the first-category audios in order from high to low according to the audio priority; If so, perform the first mixing processing on each of the first-category audios to obtain the first-category audio after the first mixing processing and play it. In the first-category audio after the first mixing processing, the first-category audio with the first audio priority is the first volume, and the first-category audio with the second audio priority is the second volume, wherein the first audio priority is greater than the second audio priority, and the first volume is greater than the second volume.
4. The vehicle audio output method according to claim 1, characterized in that: The step of sending the audio file corresponding to the second type of audio to the head mounted display device for playing through the communication link includes: If each of the to-be-played audios includes a plurality of second-category audios, parsing each of the second-category audios to obtain an audio priority of each of the second-category audios; Through the communication link, the audio files corresponding to the second-category audio are sent to the head-mounted display device for playback in order from high to low audio priority.
5. The vehicle audio output method according to claim 4, characterized in that: After the step of obtaining the audio priority of each of the second-category audios, the method further includes: Detecting whether the audio priority of each of the second-category audios is lower than a preset priority; If not, executing: the step of sending the audio files corresponding to the second-category audio to the head mounted display device for playing in order from high to low audio priority through the communication link; If so, a second mixing process is performed on each of the second-category audios, and the audio files corresponding to the second-category audios after the second mixing process are sent to the head-mounted display device for playback through the communication link. In the second-category audio after the second mixing process, the second-category audio with the third audio priority is the third volume, and the second-category audio with the fourth audio priority is the fourth volume, wherein the third audio priority is greater than the third audio priority, and the third volume is greater than the fourth volume.
6. The vehicle audio output method according to any one of claims 1 to 5, characterized in that: The first category of audio includes voice audio, media audio and system prompt audio, and the second category of audio includes security audio and communication audio, among which, in descending order of audio priority, they are the security audio, the communication audio, the voice audio, the media audio and the system prompt audio.
7. A vehicle audio output method, characterized in that: The vehicle-mounted audio output method is applied to a head-mounted display device, the head-mounted display device establishes a communication link with the vehicle, and the method comprises: Detecting, through the communication link, whether there are at least two audios to be played in the vehicle; If yes, determining the first category audio and the second category audio in each of the to-be-played audios, wherein the audio priority of the first category audio is lower than the audio priority of the second category audio; An audio file corresponding to the second type of audio is obtained from the vehicle through the communication link to play the second type of audio.
8. The vehicle audio output method according to claim 7, characterized in that: The step of obtaining the audio file corresponding to the second type of audio from the vehicle through the communication link comprises: If each of the to-be-played audios includes a plurality of second-category audios, parsing each of the second-category audios to obtain an audio priority of each of the second-category audios; Through the communication link, audio files corresponding to the second-category audios are obtained from the vehicle in order from high to low audio priorities, so as to play the second-category audios in order from high to low audio priorities.
9. A vehicle-mounted audio output device, characterized in that: The vehicle-mounted audio output device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the in-vehicle audio output method according to any one of claims 1 to 8.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a program for implementing the in-vehicle audio output method, and the program for implementing the in-vehicle audio output method is executed by a processor to implement the steps of the in-vehicle audio output method as claimed in any one of claims 1 to 8.
