Method, system and electronic equipment for in-car audio broadcasting

Abstract

Some embodiments of the present application provide a method, system, and electronic device for broadcasting audio in a car, the method comprising: obtaining a user status, wherein the user status includes the user's position and / or user behavior in the car; obtaining audio information based on the user status and the audio information to be broadcast, wherein the audio information includes: an audio transmission path and an audio file, wherein the audio information to be broadcast carries the type of audio to be played and car early warning position information; broadcasting the audio file along the audio transmission path, wherein the audio transmission path includes at least two sound source positions, and there is a broadcast time difference between each two sound source positions of the at least two sound source positions. Some embodiments of the present application can define the sound source position of the broadcast audio to an appropriate position, thereby improving the warning effect of the audio on the user in the car.

Description

Technical Field

[0001] The present application relates to the field of smart car technology, and more specifically, to a method, system, and electronic device for in-car audio broadcasting. Background Art

[0002] With the development of intelligent automobile technology, driving safety (for example, safety during driving or parking) has become extremely important.

[0003] Currently, due to the variability and complexity of the environments in which cars operate, the number of safety messages that require pre-playing audio warnings to occupants is increasing. Typically, these warnings rely on a limited number of frequencies and intensities for differentiation. As the amount of safety information that requires warning increases, the human ear and brain's ability to discern the association between the warning scene and the sound becomes increasingly blurred. When the warning audio is triggered, occupants must consider the actual environment and determine which side of the car they are on, which significantly increases their deliberation and reaction time. Furthermore, as cars become more intelligent, occupants' concentration decreases, making the warning less effective when the audio warning is triggered.

[0004] Therefore, how to provide a technical solution for a method of broadcasting audio with high efficiency and good warning effect has become a technical problem that needs to be solved urgently. Summary of the Invention

[0005] The purpose of some embodiments of the present application is to provide a method, system and electronic device for broadcasting audio in a car. Through the technical solutions of the embodiments of the present application, the sound source position of the broadcast audio can be defined to an appropriate position, reducing the time for people in the car to make a second judgment on the spatial orientation, allowing people in the car to adjust the driving status within the shortest reaction time, thereby improving the warning effect of the audio on people in the car, and thereby improving the safety of car driving.

[0006] In a first aspect, some embodiments of the present application provide a method for broadcasting audio in a car, comprising: obtaining a user status, wherein the user status includes the user's position and / or user behavior in the car; obtaining audio information based on the user status and the audio information to be broadcast, wherein the audio information includes: an audio transmission path and an audio file, and the audio information to be broadcast carries the type of audio to be played and car early warning position information; broadcasting the audio file along the audio transmission path, wherein the audio transmission path includes at least two sound source positions, and there is a broadcasting time difference between each two of the at least two sound source positions.

[0007] Some embodiments of the present application obtain an audio transmission path and an audio file through the user status and the audio information to be played, and then broadcast the audio file along the audio transmission path. The sound source position in this embodiment is not fixed, which allows people in the car to easily identify the car's early warning position information, reduces the reaction time of people in the car to the secondary judgment of the spatial orientation, and allows people in the car to adjust the driving status in the shortest time, thereby improving the warning effect of the audio on people in the car, and thereby improving the safety of car driving.

[0008] In some embodiments, obtaining the user status includes: identifying the user, obtaining the user position and the user behavior, wherein the user position includes the user head position, and the user behavior includes: user hand behavior and / or user head behavior.

[0009] Some embodiments of the present application can accurately obtain the user's position and behavior in the car by identifying the user, providing data support for subsequently obtaining a more accurate audio transmission path.

[0010] In some embodiments, before obtaining audio information based on the user status and the audio information to be broadcast, the method also includes: monitoring the vehicle driving environment and / or vehicle status to obtain vehicle warning information, the types of which include at least: lane deviation warning, blind spot warning, and vehicle failure warning; and determining the audio information to be broadcast corresponding to the vehicle warning information.

[0011] Some embodiments of the present application can quickly obtain vehicle driving information and vehicle fault information by monitoring the vehicle driving environment and / or vehicle status, providing data support for subsequent acquisition of a more accurate audio transmission path.

[0012] In some embodiments, obtaining audio information based on the user status and the audio information to be broadcast includes: obtaining the audio file corresponding to the type of the audio to be broadcast; and obtaining the audio transmission path based on the user status and the car early warning position information.

[0013] Some embodiments of the present application can quickly search and download the corresponding audio file based on the type of audio to be broadcast, and use the user location and car warning position information to obtain a more accurate audio transmission path, thereby improving the intelligence level of the car and thus improving the user experience.

[0014] In some embodiments, obtaining the audio transmission path based on the user status and the car's pre-warning police position information includes: if the user's hand behavior or the user's head behavior is normal behavior, obtaining the audio transmission path based on the car's pre-warning police position information, or obtaining the audio transmission path based on the user's seat position and the car's pre-warning police position information.

[0015] Some embodiments of the present application obtain an audio transmission path by comprehensively considering the user's head position or the user's seat position and the car's pre-warning police position information, thereby reducing the secondary reaction time of people in the car to the spatial orientation and improving driving safety.

[0016] In some embodiments, obtaining the audio transmission path based on the user status and the car's pre-warning police position information includes: if the user's hand behavior or the user's head behavior is abnormal behavior, performing the following operations: obtaining a preset audio path corresponding to the car's pre-warning police position information; and using the user's head position to correct the preset audio path to obtain the audio transmission path.

[0017] Some embodiments of the present application analyze the user status and correct the preset audio path to obtain a more accurate audio transmission path, so that people in the car can accurately determine the direction information of the car warning based on the audio transmission path, thereby improving the user experience.

[0018] In some embodiments, before obtaining the user status, the method further includes: obtaining multiple audio transmission paths.

[0019] Some embodiments of the present application set up multiple audio transmission paths in advance to facilitate subsequent use and provide users with a rich data foundation.

[0020] In some embodiments, obtaining multiple audio transmission paths includes: using at least one microphone to collect any type of voice file played at multiple sound source locations; selecting at least two sound source positions from the multiple sound source positions, and obtaining any one audio transmission path from the multiple audio transmission paths based on the order in which each sound source position from the at least two sound source positions is selected.

[0021] Some embodiments of the present application use at least one microphone installed in the car to collect voice files played at each of multiple sound source locations, providing a basis for the spatialization of the broadcast audio. Users can then customize the most suitable audio center position and any audio transmission path for different car warning information, and then subsequently select the optimal audio transmission path for different situations, thereby improving the user experience.

[0022] In some embodiments, obtaining multiple audio transmission paths includes: using at least one microphone to collect audio files of any type played at at least two sound source locations among multiple sound source locations; and obtaining any one audio transmission path among the multiple audio transmission paths according to the playback order of each sound source location among the at least two sound source locations.

[0023] Some embodiments of the present application collect voice files played at at least two of multiple sound source locations through at least one microphone set up in the car, and use the order of playing the voice files at at least two sound source locations each time as any audio transmission path, providing a basis for the spatialization of the broadcast audio, so that the user can customize the most suitable audio center position and audio transmission path for different car warning information, and then subsequently select the optimal audio transmission path in different situations, thereby improving the user experience.

[0024] In a second aspect, some embodiments of the present application provide a device for broadcasting audio in a car, comprising: a user identification module, configured to obtain user status, wherein the user status includes: user location and / or user behavior in the car; an audio data module, configured to obtain audio information based on the user status and the audio information to be broadcast, wherein the audio information includes: an audio transmission path and an audio file, and the audio information to be broadcast carries the type of audio to be played and car early warning position information; an audio broadcast module, configured to broadcast the audio file along the audio transmission path, wherein the audio transmission path includes at least two sound source positions, and there is a broadcast time difference between each two of the at least two sound source positions.

[0025] In a third aspect, some embodiments of the present application provide a system for broadcasting audio in a car, including: a system for broadcasting audio in a car, characterized in that it includes: a monitoring module, configured to obtain car warning information based on the car driving environment or the car status; a user identification module, configured to identify the user and obtain the user status; an audio editing module, configured to obtain an audio transmission path; an audio storage module, configured to store at least one audio file; an audio processing module, configured to generate corresponding audio information to be broadcast according to the car warning information, and call the audio transmission path and the audio file according to the audio information to be broadcast and the user status; an audio playback module, configured to use at least one speaker to broadcast the audio file along the audio transmission path.

[0026] In a fourth aspect, some embodiments of the present application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, can implement the method described in any embodiment of the first aspect.

[0027] In a fifth aspect, some embodiments of the present application provide an electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor can implement a method as described in any embodiment of the first aspect when executing the program.

[0028] In a sixth aspect, some embodiments of the present application provide a computer program product, comprising a computer program, wherein the computer program, when executed by a processor, can implement the method described in any embodiment of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions of some embodiments of the present application, the following is a brief introduction to the drawings required for use in some embodiments of the present application. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without paying any creative work.

[0030] Figure 1 One of the system diagrams of in-car audio announcements provided in some embodiments of the present application;

[0031] Figure 2 A second diagram of a system for in-car audio announcements provided in some embodiments of the present application;

[0032] Figure 3 One of the flow charts of the method for in-car audio broadcasting provided in some embodiments of the present application;

[0033] Figure 4 Schematic diagram of the location of sound sources and microphone distribution in a car provided for some embodiments of the present application;

[0034] Figure 5 Flowchart 2 of the method for in-car audio broadcasting provided in some embodiments of the present application;

[0035] Figure 6 A schematic diagram of a blind spot alarm provided for some embodiments of the present application;

[0036] Figure 7 A block diagram of a device for in-car audio broadcasting provided in some embodiments of the present application;

[0037] Figure 8 A schematic diagram of an electronic device is provided for some embodiments of the present application. DETAILED DESCRIPTION

[0038] The technical solutions in some embodiments of the present application will be described below in conjunction with the drawings in some embodiments of the present application.

[0039] It should be noted that similar reference numerals and letters represent similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and should not be understood as indicating or implying relative importance.

[0040] In the related art, as multiple automotive functions gradually become intelligent, the content of human-computer interaction continues to increase. Warning sounds (i.e., audio broadcasts) are often used to alert occupants in many scenarios. As the number of related scenarios increases, existing warning sounds require more time for occupants to think and react when triggered. For example, when a car's left blind spot alarm is triggered, after a traditional warning sound is triggered, the occupant needs to further determine whether it is on the left or right side based on the warning light and text. Moreover, when autonomous driving enters the conditional autonomous driving stage, although the system will actively handle many scenarios, the need for warning sounds will obviously decrease. However, at the same time, the occupant's position in the cockpit will change significantly (for example, their hands, feet, or eyes may be free under limited conditions and move further away from the driving position). This will also reduce the occupant's focus on driving. Existing warning sound strategies have a fixed sound source center position, which reduces the warning effect when triggered. As can be seen from the above related art, existing warning sound broadcasts are ineffective and increase the occupant's reaction time, preventing the occupant from adjusting their driving strategy in a timely manner, and thus failing to effectively ensure safety.

[0041] In view of this, some embodiments of the present application provide a method, system, and electronic device for broadcasting audio in a vehicle. The method obtains an audio transmission path and an audio file through the user status and the audio information to be broadcast, and finally broadcasts the audio file along the audio transmission path, wherein the audio transmission path includes at least two sound source positions, and there is a broadcast time difference between each two sound source positions of the at least two sound source positions. Some embodiments of the present application can define the sound source position to a suitable position and broadcast the corresponding audio file along the set audio transmission path, thereby reducing the time for the occupants of the vehicle to make a second judgment on the spatial orientation, allowing the occupants of the vehicle to adjust the driving status within the shortest reaction time, and improving the warning effect of the audio on the occupants of the vehicle.

[0042] like Figure 1 As shown, some embodiments of the present application provide a system for broadcasting audio in a vehicle, the system comprising: an audio broadcast processing terminal 100 and a speaker terminal 200. The audio broadcast processing terminal 100 is used to obtain a user status, and obtain audio information based on the user status and the audio information to be broadcast, and finally broadcast the audio file through the speaker terminal 200 along the audio transmission path.

[0043] In another embodiment of the present application, there is also provided Figure 2 The system for broadcasting audio in a car shown includes: a monitoring module 210 , a user identification module 220 , an audio editing module 230 , an audio storage module 240 , an audio processing module 250 and an audio playing module 260 .

[0044] The functions of each module are described below by way of example.

[0045] In some embodiments of the present application, the monitoring module 210 is configured to obtain automobile warning information based on the automobile driving environment or automobile status.

[0046] For example, in some embodiments of the present application, the monitoring module 210 refers to monitoring usage scenarios (that is, the car driving environment or the car status) that have a demand for car warning information. For example, an intelligent driving assistance system can be installed in the monitoring module 210 to realize lane departure warning, blind spot warning and brake system failure warning (as a specific embodiment of the car status), etc. The monitoring module 210 can exchange information with the audio processing module 250. Furthermore, when the monitoring module 210 exchanges information with the audio processing module 250, it can adopt a signal communication method or a service call method. When the signal communication method is adopted, the needs of each functional module are realized in the form of signals to request audio files; the service call method refers to based on the SOA architecture (Service-Oriented Architecture), the call request for the audio file is realized by calling the service interface.

[0047] In some embodiments of the present application, the user identification module 220 is configured to identify the user and obtain the user status.

[0048] For example, in some embodiments of the present application, the user identification module 220 includes an in-vehicle biometric identification device, a DMS (Driver Monitor System), a user ID, etc. The user identification module 220 can exchange information with the audio processing module 250. For example, the user identification module 220 can transmit the user's location information in the cabin (e.g., the user's head position, face or ear orientation, etc.).

[0049] For example, in some embodiments of the present application, the user identification module 220 can also provide input to the monitoring module 210, such as the user's fatigue status, user identity information (for example, it can be bound to the user's audio preference settings), hand-holding steering wheel status, and seat occupancy status.

[0050] In some embodiments of the present application, the audio editing module 230 is configured to obtain an audio transmission path.

[0051] For example, in some embodiments of the present application, the audio editing module 230 allows developers or users to select, combine, and edit different audio types and their sound source centers (i.e., sound source locations) based on the types of warning information in the audio storage module 240 and the monitoring module 210 to obtain multiple audio transmission paths, thereby achieving different spatial effects for the warning sound (i.e., broadcast audio). The audio editing module 230 can receive a call request sent by the audio processing module 250 and then send the audio transmission path to the audio processing module 250.

[0052] In some embodiments of the present application, the audio storage module 240 is configured to store at least one audio file.

[0053] For example, in some embodiments of the present application, the audio storage module 240 may store audio files corresponding to various warning sounds, as well as multiple sound source location distribution spatial arrays maintained and updated by the host manufacturer or professional supplier. The audio storage module 240 may receive a call request sent by the audio processing module 250 and then send the corresponding audio file to the audio processing module 250.

[0054] In some embodiments of the present application, the audio processing module 250 is configured to generate corresponding audio information to be broadcast according to the automobile warning information, and to retrieve the audio transmission path and the audio file according to the audio information to be broadcast and the user status.

[0055] For example, in some embodiments of the present application, the scenario requirement information (i.e., vehicle warning information) from the monitoring module 210 and the user status from the user identification module 220 can be comprehensively processed. Then, combined with multiple audio transmission paths in the audio editing module 230 or the audio storage module 240, the corresponding spatial warning sound (i.e., audio file) can be called and output to the speakers in the audio playback module 260. Furthermore, the audio processing module 250 interacts with the audio editing module 230 primarily to obtain the audio transmission paths defined by the audio editing module 230 for developers or users. Simultaneously, the audio file corresponding to the scenario requirement information can be obtained through the audio storage module 240.

[0056] In some embodiments of the present application, the audio playback module 260 is configured to play the audio file along the audio transmission path using at least one speaker.

[0057] For example, in some embodiments of the present application, the audio playback module 260 is a device for playing spatial warning sounds, and speakers are arranged at different spatial positions in the car, wherein the audio playback module 260 includes at least one speaker. It should be understood that, unlike the traditional method of broadcasting warning sounds with a fixed sound source position, the audio broadcast in the present application has a sound source position or position coordinates. For example, when the intelligent driving assistance system detects a forward cross-traffic collision alarm, the requested sound source position of the spatial warning sound (that is, the audio file) can be moved laterally in front of the cabin; and for a rear cross-traffic collision alarm, the requested sound source position of the spatial warning sound can be moved laterally behind the cabin.

[0058] The following is combined with Figure 3 Exemplary description of some embodiments of the present application provided by Figure 1 The implementation process of the method for broadcasting audio in the car performed by the audio broadcast processing end 100.

[0059] Please see the attached Figure 3 , Figure 3 A flow chart of a method for broadcasting audio in a car provided in some embodiments of the present application, the method for broadcasting audio in a car includes:

[0060] S310: Acquire multiple audio transmission paths.

[0061] In order to ensure that the corresponding audio transmission path can be accurately obtained later, in some embodiments of the present application, multiple audio transmission paths need to be set first. The following example illustrates the implementation process of obtaining multiple audio transmission paths.

[0062] In some embodiments of the present application, S310 may include: using at least one microphone to collect any type of voice file played at multiple sound source locations; selecting at least two sound source positions from the multiple sound source positions, and obtaining any one of the multiple audio transmission paths based on the order in which each sound source position from the at least two sound source positions is selected.

[0063] For example, in some embodiments of the present application, the following is provided for the convenience of explanation: Figure 4 The diagram shows the distribution of multiple sound source locations and at least one microphone in the car. Figure 4 The small circles in 5 rows and 11 columns are the sound source positions. One small circle represents one sound source position. The 8 ovals of different sizes are the positions of microphones, which are also the distribution positions of speakers. One ellipse represents one microphone or one speaker.

[0064] For the sake of simplicity of description, in some embodiments of the present application, any one of the multiple audio paths is taken as an example to illustrate a method for obtaining any one of the audio paths.

[0065] The first step is Figure 4 Each sound source position in the broadcasts the same warning sound a (that is, voice file) in sequence.

[0066] In the second step, when the warning sound a is broadcasted at each sound source position in sequence, 8 microphones are used to collect the warning sound a played at each sound source position and store it in the microphone.

[0067] The third step is to customize the audio path corresponding to the warning message, based on the warning message corresponding to warning sound a. For example, the target user can select any of multiple sound source locations as the starting point of the sound source location, and select any sound source location corresponding to the direction of the warning message as the end point of the sound source location. By calculating the shortest path from the starting point to the end point of the sound source location, an audio path is obtained. An audio path includes at least two sound source locations.

[0068] It should be understood that by changing the warning sound b, repeating the above steps 1 to 3, at least one audio path corresponding to the warning sound b can be obtained. The number of audio paths can be specifically limited according to actual conditions and is not specifically limited in this application.

[0069] In other embodiments of the present application, obtaining multiple audio transmission paths includes: using at least one microphone to collect and play any type of voice file at at least two sound source locations among multiple sound source locations; and obtaining any one audio transmission path among the multiple audio transmission paths according to the playback order of each sound source location among the at least two sound source locations.

[0070] For example, in some other embodiments of the present application, any audio path can be obtained by the following method:

[0071] S1, selecting a first sound source position from multiple sound source positions to play a warning sound a, and using 8 microphones to collect the warning sound a played at the first sound source position.

[0072] S2, selecting a second sound source position from a plurality of sound source positions to play a warning sound a, and using 8 microphones to collect the warning sound a played at the second sound source position.

[0073] S3, the first sound source position and the second sound source position form a sound source path.

[0074] It is understandable that a sound source path does not only include the first sound source position and the second sound source position mentioned above. In other embodiments of the present application, the number of sound source positions can be selected according to actual circumstances, and the operating principle is similar to that of S1 or S2.

[0075] It should be noted that the type of the in-car broadcast audio may be the audio corresponding to the above-mentioned car warning information, or may be other audio suitable for in-car broadcast, such as playing music audio.

[0076] S320: Acquire user status, where the user status includes the user's location and / or user behavior in the vehicle.

[0077] In some embodiments of the present application, S320 may include: identifying the user, obtaining the user position and the user behavior, wherein the user position includes the user head position, and the user behavior includes: user hand behavior and / or user head behavior.

[0078] For example, in some embodiments of the present application, the audio broadcast processing terminal 100 is provided with a device (e.g., a camera, a biometric device, or an image acquisition device) for collecting information about the occupant (i.e., the user) in the vehicle. For example, the biometric device can be used to obtain information about the position of the occupant in the vehicle cabin, such as the user's seat position, the occupant's head position (i.e., the user's head position), the direction of their face or ears, etc. It can also obtain the user's hand grip on the steering wheel (i.e., the user's hand behavior) and the user's head behavior (e.g., whether they are talking to someone or whether they are tired), etc.

[0079] In some embodiments of the present application, after executing S310 and before executing S320, or after executing S320 and before executing S330, the method of broadcasting audio in the car also includes: monitoring the car driving environment and / or the car status to obtain car warning information, the types of the car warning information including at least: lane deviation warning, blind spot warning and car fault warning; determining the audio information to be broadcast corresponding to the car warning information.

[0080] For example, in some embodiments of the present application, the audio broadcast processing terminal 100 is provided with an intelligent driving assistance system that can monitor the vehicle's driving environment and vehicle status. When a situation occurs in the vicinity of the vehicle, different vehicle warning information can be generated according to different situations. In addition to lane deviation warnings and blind spot warnings, it can also include, for example, warnings for pedestrians crossing the road ahead and warnings for approaching non-motor vehicles. Vehicle fault warnings may include: abnormal braking warnings, abnormal left headlight warnings, low fuel tank warnings, and turn signal damage warnings, etc.

[0081] S330: Acquire audio information according to the user status and the audio information to be broadcast, wherein the audio information includes: an audio transmission path and an audio file, and the audio information to be broadcast carries the type of the audio to be played and the car warning position information.

[0082] In some embodiments of the present application, S330 may further include: S331, obtaining the audio file corresponding to the type of the audio to be broadcast; S332, obtaining the audio transmission path according to the user status and the car early warning position information.

[0083] In order to reduce the secondary reaction time of people in the car to their orientation, in some embodiments of the present application, S332 may also include: if the user's hand behavior or the user's head behavior is normal behavior, then the audio transmission path is obtained according to the car's early warning position information.

[0084] For example, in some embodiments of the present application, a car appears in the blind spot behind the right side of the car, and the car warning position information is a blind spot warning. It is recognized that the user's hand behavior or the user's head behavior is normal behavior, wherein normal behavior is used to characterize the user's standard car driving behavior or the state in which the person in the car is focused on supervising the driving of the car. The head, eyes and hands of the person in the car are comprehensively analyzed by the biometric device to confirm whether the user's hand behavior or the user's head behavior is normal behavior, for example, both hands control the steering wheel, both eyes look forward and the head faces forward, etc. At this time, the best audio transmission path corresponding to the blind spot alarm can be directly obtained according to the direction information of the blind spot warning. Among them, the audio transmission path belongs to one of the multiple audio transmission paths in S310.

[0085] In some embodiments of the present application, S332 may also include: if the user's hand behavior or the user's head behavior is abnormal behavior, performing the following operations: obtaining a preset audio path corresponding to the user's position and the car's early warning police position information; using the user's head position to correct the preset audio path to obtain the audio transmission path.

[0086] For example, in some embodiments of the present application, it is recognized that the user's hand behavior or the user's head behavior is abnormal behavior, wherein the abnormal behavior is used to characterize the user's non-standard driving behavior of the car or the state in which the occupants of the car are not focused on supervising the driving of the car. For example, the driver in the driving seat (as an example of the user) is talking to the co-pilot (that is, the user's head behavior), operating the steering wheel with one hand (that is, the user's hand behavior), the eyes are not facing forward, or the occupants of the car are sleeping, etc. At this time, it is necessary to use the user's head position to correct the preset audio path obtained from the car's pre-warning position information, so as to obtain a more accurate audio transmission path, improve the audio warning effect on the user, and ensure driving safety. Alternatively, the preset audio path obtained from the car's pre-warning position information can be corrected according to the user's seat position to obtain an audio transmission path. Among them, the preset audio path belongs to one of the multiple audio transmission paths in S310.

[0087] In other embodiments of the present application, if the driver operates the steering wheel very standardly and seriously and is highly focused on driving, the preset audio path can be modified to obtain the audio transmission path, or the preset audio path can be directly used as the audio transmission path.

[0088] S340: broadcast the audio file along the audio transmission path, wherein the audio transmission path includes at least two sound source positions, and there is a broadcasting time difference between each two sound source positions of the at least two sound source positions.

[0089] For example, in some embodiments of the present application, the audio transmission path includes two sound source positions, such as a first sound source position and a second sound source position. The speaker end 200 will broadcast the pre-collected audio corresponding to the audio file at the first sound source position and the second sound source position in sequence, so that the user can quickly know the direction of the warning, adjust the driving strategy in time, and ensure driving safety.

[0090] The following takes blind spot alarm as an example. Figure 5 The specific process of the method for broadcasting audio in a car provided by some embodiments of the present application is exemplified. For example, the audio processing terminal 100 of the vehicle has an advanced driver assistance system. In order to facilitate the description of some embodiments of the present application, the following are provided: Figure 6 The schematic diagram of the orientation of the driving car 610 and the blind spot car 620 shows that a car 620 enters the left blind spot of the car 610.

[0091] Please see the attached Figure 5 , attached Figure 5 Flowchart of a method for in-car audio broadcasting provided by some embodiments of the present application. It should be understood that when performing the following in-car audio broadcasting information, the audio processing terminal 100 has stored multiple audio transmission paths for selection. The following exemplifies the implementation process of in-car audio broadcasting.

[0092] S510: Acquire audio information to be broadcast.

[0093] As a specific example of the present application, the advanced driver assistance system detects that a car 620 enters the left blind spot of the car 610 in the car driving environment, and at this time triggers a blind spot alarm request information (that is, the audio information to be broadcast). The blind spot alarm request information carries the type of blind spot alarm audio and the direction information of the blind spot alarm (that is, the car warning position information).

[0094] S520: Obtain user status.

[0095] As a specific example of the present application, the biometric recognition device in the car recognizes that the driver is lightly supporting the steering wheel with one hand (that is, the user's hand behavior) and turning his head to talk to the co-driver (that is, the user's head behavior), and collects the driver's head position (that is, the user's head position). It can be seen that the driver's lightly supporting the steering wheel with one hand and turning his head to talk to the co-driver are abnormal driving behaviors (that is, abnormal behaviors), so S530 is executed.

[0096] S530: Acquire a preset audio path corresponding to the vehicle early warning position information.

[0097] As a specific example of this application, according to the position information of the blind spot alarm, the preset audio path is retrieved, that is, Figure 6 The path from A to B.

[0098] S540: Modify the preset audio path using the user's head position to obtain the audio transmission path.

[0099] As a specific example of this application, since the driver does not drive the car 610 normally, in order to ensure the accuracy of the warning effect of the warning sound, it is necessary to correct the preset audio path according to the driver's head position to obtain the following Figure 6 The path from A to C shown in the figure, AC is the audio transmission path.

[0100] S550: Acquire the audio transmission path and audio file.

[0101] As a specific example of the present application, an audio file corresponding to the blind spot warning is obtained.

[0102] S560: Play the audio file along the audio transmission path.

[0103] As a specific example of the present application, an audio file corresponding to the blind spot warning is broadcast along the AC.

[0104] Please refer to Figure 7 , Figure 7 A block diagram of the components of an in-vehicle audio broadcast device provided by some embodiments of the present application is shown. It should be understood that the in-vehicle audio broadcast device corresponds to the aforementioned method embodiment and is capable of executing each of the steps involved in the aforementioned method embodiment. The specific functions of the in-vehicle audio broadcast device can be found in the description above, and a detailed description is omitted here to avoid repetition.

[0105] Figure 7The device for broadcasting audio in the car includes at least one software functional module that can be stored in a memory in the form of software or firmware or solidified in the device for broadcasting audio in the car, and the device for broadcasting audio in the car includes: a user identification module 710, which is at least configured to obtain user status, wherein the user status includes: user location and / or user behavior in the car; an audio data module 720, which is at least configured to obtain audio information based on the user status and the audio information to be broadcast, wherein the audio information includes: an audio transmission path and an audio file, and the audio information to be broadcast carries the type of audio to be played and car early warning position information; an audio broadcast module 730, which is at least configured to broadcast the audio file along the audio transmission path, wherein the audio transmission path includes at least two sound source positions, and there is a broadcast time difference between each two sound source positions of the at least two sound source positions.

[0106] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working process of the device described above can refer to the corresponding process in the aforementioned method, and will not be described in detail here.

[0107] Some embodiments of the present application further provide a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, the operation of the method corresponding to any embodiment of the method for broadcasting audio provided in the above embodiments can be implemented.

[0108] Some embodiments of the present application further provide a computer program product, which includes a computer program, wherein when the computer program is executed by a processor, it can implement the operations corresponding to any embodiment of the method for broadcasting audio provided in the above embodiments.

[0109] like Figure 8 As shown, some embodiments of the present application provide an electronic device 800, which includes: a memory 810, a processor 820, and a computer program stored in the memory 810 and executable on the processor 820, wherein the processor 820 reads the program from the memory 810 through a bus 830 and executes the program to implement any of the embodiments of the method for in-car audio broadcasting as described above.

[0110] The processor 820 can process digital signals and can include various computing architectures, such as a complex instruction set computer architecture, a reduced instruction set computer architecture, or an architecture that implements a combination of multiple instruction sets. In some examples, the processor 820 can be a microprocessor.

[0111] The memory 810 can be used to store instructions executed by the processor 820 or data related to the execution of instructions. These instructions and / or data may include code for implementing some or all functions of one or more modules described in the embodiments of this application. The processor 820 of the embodiment of the present disclosure can be used to execute the instructions in the memory 810 to implement the method shown above. The memory 810 includes dynamic random access memory, static random access memory, flash memory, optical memory, or other memory known to those skilled in the art.

[0112] The foregoing is merely an embodiment of the present application and is not intended to limit the scope of protection of the present application. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included within the scope of protection of the present application. It should be noted that similar reference numerals and letters represent similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined or explained in subsequent figures.

[0113] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

[0114] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

Claims

1. A method for broadcasting audio in a car, characterized in that: include: Acquiring a user state, wherein the user state includes a user position and / or user behavior in the vehicle; wherein the user position includes a user head position, and the user behavior includes: user hand behavior and / or user head behavior; Acquire audio information according to the user status and the audio information to be broadcast, wherein the audio information includes: an audio transmission path and an audio file, and the audio information to be broadcast carries the type of the audio to be played and the vehicle early warning position information; Playing the audio file along the audio transmission path, wherein the audio transmission path includes at least two sound source positions, and there is a broadcasting time difference between each two sound source positions of the at least two sound source positions; The acquiring of audio information according to the user status and the audio information to be broadcast includes: Obtain the audio file corresponding to the type of the audio to be broadcast; if the user hand behavior or the user head behavior is normal, obtain the audio transmission path according to the car early warning police position information; if the user hand behavior or the user head behavior is abnormal, perform the following operations: obtain a preset audio path corresponding to the car early warning police position information; use the user head position to correct the preset audio path to obtain the audio transmission path.

2. The method according to claim 1, wherein The obtaining of user status includes: Identify the user and obtain the user's location and behavior.

3. The method according to claim 1 or 2, wherein: Before acquiring audio information according to the user status and the audio information to be broadcasted, the method further includes: Monitor the vehicle's driving environment and / or vehicle status to obtain vehicle warning information, where the types of vehicle warning information include at least lane deviation warning, blind spot warning, and vehicle failure warning; Determine the audio information to be broadcast corresponding to the automobile warning information.

4. The method according to claim 1, wherein Before obtaining the user status, the method further includes: Get multiple audio transmission paths.

5. The method according to claim 4, wherein The obtaining of multiple audio transmission paths includes: Using at least one microphone to capture any type of voice file played at multiple sound source locations; selecting at least two sound source positions from the plurality of sound source positions, and obtaining any one of the plurality of audio transmission paths according to the order in which the sound source positions from the at least two sound source positions are selected; or, At least one microphone is used to collect and play any type of voice file at at least two sound source positions among a plurality of sound source positions; and any one of the plurality of audio transmission paths is obtained according to the playback order of each sound source position among the at least two sound source positions.

6. A device for broadcasting audio in a car, characterized in that: The apparatus is configured to execute the method according to claim 1, comprising: A user identification module is configured to obtain a user status, wherein the user status includes: a user location and / or user behavior in the vehicle; an audio data module configured to obtain audio information according to the user status and the audio information to be broadcast, wherein the audio information includes: an audio transmission path and an audio file, and the audio information to be broadcast carries the type of the audio to be played and the vehicle warning position information; The audio broadcast module is configured to broadcast the audio file along the audio transmission path, wherein the audio transmission path includes at least two sound source positions, and there is a broadcast time difference between each two sound source positions of the at least two sound source positions.

7. A system for broadcasting audio in a car, characterized in that: The system is configured to execute the method according to claim 1, comprising: The monitoring module is configured to obtain vehicle warning information based on the vehicle driving environment or vehicle status; A user identification module is configured to identify the user and obtain the user status; An audio editing module is configured to obtain an audio transmission path; An audio storage module, configured to store at least one audio file; an audio processing module configured to generate corresponding audio information to be broadcast according to the automobile warning information, and retrieve the audio transmission path and the audio file according to the audio information to be broadcast and the user status; The audio playing module is configured to play the audio file along the audio transmission path using at least one speaker.

8. An electronic device, characterized in that: The invention comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor can implement the method according to any one of claims 1 to 5 when executing the program.

Images