Audio output methods, devices, vehicles, electronic devices, chips and storage media

Abstract

This disclosure provides an audio output method, apparatus, vehicle, electronic device, chip, and storage medium, comprising: acquiring a driving scenario of the vehicle and first broadcast data, wherein the driving scenario is determined based on the vehicle's state information; determining the priority of the first broadcast data based on the attributes of the driving scenario and the first broadcast data; sorting the first broadcast data and at least one second broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data to determine the position of the first broadcast data in a broadcast sequence, wherein the second broadcast data is acquired before the first broadcast data is acquired, and at least one second broadcast data includes broadcast data from a different source than the first broadcast data; and outputting the audio corresponding to the first broadcast data according to the broadcast sequence. This method can output corresponding audio based on the priority of broadcast data from different sources, avoiding interruptions between broadcast data from different sources and improving the intelligence level of audio broadcasting in smart cockpits.

Description

Technical Field

[0001] This disclosure relates to the field of intelligent driving technology, and in particular to an audio output method, device, vehicle, electronic device, chip, and storage medium. Background Technology

[0002] With the development of intelligent driving technology, vehicles will generate a variety of voice broadcast information in different scenarios. These voice broadcast information may come from different systems in the vehicle. The voice broadcast information of different systems has independent broadcast control logic, which may cause conflicts between the voice broadcast information generated by different systems. That is, the new broadcast directly interrupts the ongoing broadcast, resulting in a poor user experience. Summary of the Invention

[0003] This disclosure provides an audio output method, apparatus, vehicle, electronic device, chip, and storage medium to solve problems in the related art.

[0004] A first aspect of this disclosure provides an audio output method, comprising: acquiring a vehicle driving scenario and first broadcast data, wherein the driving scenario is determined based on vehicle status information; determining the priority of the first broadcast data based on the driving scenario and the attributes of the first broadcast data; sorting the first broadcast data and at least one second broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data to determine the position of the first broadcast data in a broadcast sequence, wherein the second broadcast data is acquired before the first broadcast data is acquired, and at least one second broadcast data includes broadcast data from a different source than the first broadcast data; and outputting the audio corresponding to the first broadcast data according to the broadcast sequence.

[0005] In some embodiments of this disclosure, the method further includes: determining the similarity between the first broadcast data and at least one second broadcast data; and adjusting the priority of the first broadcast data based on the similarity.

[0006] In some embodiments of this disclosure, adjusting the priority of the first broadcast data based on similarity includes: merging the first broadcast data and one or more broadcast data in response to a first threshold being greater than or equal to the similarity between the first broadcast data and at least one or more broadcast data in at least one second broadcast data to obtain merged broadcast data; determining the priority of the merged broadcast data based on the priority of the first broadcast data and the priority of the one or more broadcast data; and outputting the audio corresponding to the first broadcast data according to the broadcast sequence, including: outputting the audio corresponding to the merged broadcast data based on the position of the merged broadcast data in the broadcast sequence, wherein the position of the merged broadcast data in the broadcast sequence is determined based on the priority of the merged broadcast data and the priority of the broadcast data in at least one second broadcast data that was not merged with the first broadcast data.

[0007] In some embodiments of this disclosure, adjusting the priority of the first broadcast data based on similarity includes: adjusting the priority of the first broadcast data in response to the similarity between the first broadcast data and one or more broadcast data in at least one second broadcast data being less than a first threshold and greater than or equal to a second threshold, wherein the priority of the first broadcast data after adjustment is different from the priority of one or more broadcast data; and sorting the first broadcast data and at least one second broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data includes: sorting the first broadcast data and at least one second broadcast data according to the priority of the adjusted first broadcast data and the priority of at least one second broadcast data.

[0008] In some embodiments of this disclosure, outputting the audio corresponding to the first broadcast data according to the broadcast sequence includes: determining whether there is broadcast data in an output state among at least one second broadcast data; in response to the existence of broadcast data in an output state, outputting the audio corresponding to the first broadcast data based at least on the position of the first broadcast data in the broadcast sequence and the position of the broadcast data in the output state in the broadcast sequence; in response to the absence of broadcast data in an output state, outputting the audio corresponding to the first broadcast data based on the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence.

[0009] In some embodiments of this disclosure, outputting the audio corresponding to the first broadcast data, at least based on the position of the first broadcast data in the broadcast sequence and the position of the broadcast data in the output state in the broadcast sequence, includes: stopping the output of the audio corresponding to the broadcast data in the output state and outputting the audio corresponding to the first broadcast data in response to the position of the first broadcast data being before the position of the broadcast data in the output state; outputting the audio corresponding to the first broadcast data after the output of the audio corresponding to the broadcast data in the output state is completed in response to the position of the first broadcast data being the same as the position of the broadcast data in the output state; and outputting the audio corresponding to the first broadcast data based on the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence in response to the position of the first broadcast data being after the position of the broadcast data in the output state.

[0010] In some embodiments of this disclosure, outputting the audio corresponding to the first broadcast data based on the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence includes: determining at least one idle time period of the vehicle on the current navigation route; determining a target time period from the at least one idle time period based on at least one of the following: the position of the first broadcast data in the broadcast sequence, the position of at least one second broadcast data in the broadcast sequence, the audio length corresponding to the first broadcast data, and the duration of each idle time period; and playing the audio corresponding to the first broadcast data in the target time period.

[0011] In some embodiments of this disclosure, determining at least one idle time period for a vehicle on the current navigation route includes: acquiring at least one inherent broadcast point for the vehicle on the current navigation route; outputting navigation audio related to geographical features near the inherent broadcast point in response to the distance between the vehicle and the inherent broadcast point being less than or equal to a distance threshold; determining the time for the vehicle to arrive at each inherent broadcast point based on the vehicle's speed; and determining at least one idle time period based on the time for the vehicle to arrive at each inherent broadcast point.

[0012] In some embodiments of this disclosure, determining the priority of the first broadcast data based on the driving scenario and the attributes of the first broadcast data includes: determining a target priority weight table from a pre-configured plurality of candidate priority weight tables based on the driving scenario, wherein the target priority weight table includes the correspondence between the attributes of the broadcast data and the priority of the broadcast data; determining the priority of the first broadcast data based on the attributes of the first broadcast data and the target priority weight table, wherein the attributes include at least one of the data source of the first broadcast data, the content type of the first broadcast data, and the urgency level of the first broadcast data.

[0013] A second aspect of this disclosure provides an audio output device, comprising: an acquisition module for acquiring a driving scenario of a vehicle and first broadcast data, wherein the driving scenario is determined based on vehicle status information; a determination module for determining the priority of the first broadcast data based on the driving scenario and the attributes of the first broadcast data; sorting the first broadcast data and at least one second broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data to determine the position of the first broadcast data in a broadcast sequence, wherein the second broadcast data is acquired before the first broadcast data is acquired, and the at least one second broadcast data includes a broadcast data output module with a different source than the first broadcast data, for outputting audio corresponding to the first broadcast data according to the broadcast sequence.

[0014] In some embodiments of this disclosure, the determining module is further configured to: determine the similarity between the first broadcast data and at least one second broadcast data; and adjust the priority of the first broadcast data based on the similarity.

[0015] In some embodiments of this disclosure, the determining module is further configured to: merge the first broadcast data and one or more broadcast data in response to the similarity between the first broadcast data and at least one or more broadcast data being greater than or equal to a first threshold, to obtain merged broadcast data; determine the priority of the merged broadcast data according to the priority of the first broadcast data and the priority of one or more broadcast data; the output module is further configured to: output the audio corresponding to the merged broadcast data according to the position of the merged broadcast data in the broadcast sequence, wherein the position of the merged broadcast data in the broadcast sequence is determined according to the priority of the merged broadcast data and the priority of the broadcast data in at least one second broadcast data that was not merged with the first broadcast data.

[0016] In some embodiments of this disclosure, the determining module is further configured to: adjust the priority of the first broadcast data in response to the similarity between the first broadcast data and one or more broadcast data in at least one second broadcast data being less than a first threshold and greater than or equal to a second threshold, wherein the priority of the first broadcast data after adjustment is different from the priority of one or more broadcast data; and sort the first broadcast data and at least one second broadcast data according to the priority of the first broadcast data after adjustment and the priority of at least one second broadcast data.

[0017] A third aspect of this disclosure provides a vehicle that can be used to perform the methods described in the first aspect of this disclosure.

[0018] A fourth aspect of this disclosure provides an electronic device including: a processor and a memory for storing a computer program capable of running on the processor, wherein the processor performs the method described in any of the embodiments of the first aspect of this disclosure when running the computer program.

[0019] A fifth aspect of this disclosure provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to perform the methods described in the first aspect of this disclosure.

[0020] A sixth aspect of this disclosure provides a chip including at least one processor and a communication interface; the communication interface is used to receive signals input to the chip or signals output from the chip, and the processor communicates with the communication interface and implements the method described in the first aspect of this disclosure through logic circuits or executing code instructions.

[0021] In summary, the audio output method proposed in this disclosure can determine the priority of the first broadcast data based on the driving scenario and attributes of the first broadcast data. It can accurately determine the priority of broadcast data with different attributes in different scenarios. Furthermore, it can output the first broadcast data based on the priority of the first broadcast data and the priority of at least one second broadcast data. If at least one second broadcast data contains broadcast data from a different source than the first broadcast data, it can achieve unified management of broadcast data from different sources. By comprehensively considering the priority of broadcast data from different sources to broadcast the corresponding audio, it can avoid the problem of mutual interruption caused by independently managing broadcast data from different sources.

[0022] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0023] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0024] Figure 1 A flowchart illustrating an audio output method provided in this embodiment of the present disclosure. Figure 1 ;

[0025] Figure 2 A flowchart illustrating an audio output method provided in this embodiment of the present disclosure. Figure 2 ; Figure 3 A flowchart illustrating an audio output method provided in this embodiment of the present disclosure. Figure 3 ; Figure 4A This is an architecture diagram of a multi-scenario intelligent driving broadcasting and dispatching system provided in an embodiment of the present disclosure; Figure 4B A schematic diagram of scene recognition logic provided in an embodiment of this disclosure; Figure 4C A schematic diagram of priority evaluation logic provided in an embodiment of this disclosure; Figure 4D This is a schematic diagram of a broadcast timing prediction and planning logic provided in an embodiment of the present disclosure; Figure 4E A schematic diagram of broadcast scheduling decision logic provided in an embodiment of this disclosure; Figure 5 This is a schematic diagram of the structure of an audio output device provided in an embodiment of the present disclosure; Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure; Figure 7 This is a schematic diagram of the chip structure provided in an embodiment of this disclosure. Detailed Implementation

[0026] Embodiments of this disclosure are described in detail below. Examples of these embodiments are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this disclosure, and should not be construed as limiting this disclosure.

[0027] With the development of intelligent driving technology, vehicles will generate a variety of voice broadcast information in different scenarios. For example, intelligent parking systems will broadcast safety prompts and location guidance, while autonomous driving city navigation assistance systems and autonomous driving highway navigation assistance systems will broadcast safety prompts and location guidance. Map applications will provide navigation voice broadcasts, including various types such as turn prompts, electronic eye reminders, lane line guidance, and safety reminders.

[0028] The aforementioned multi-system broadcasts can cause serious broadcast conflicts in actual use. For example, during driving, the autonomous driving system and map broadcasts interrupt each other, affecting the user experience and causing logical repetition. Another example is during parking, when the HPP parking system takes over the route, it conflicts with the map broadcasts.

[0029] Text-to-Speech (TTS) broadcasting itself has complex type classifications (navigation voice broadcasting, fatigue driving broadcasting, etc.), broadcasting timing control (inherent tone timing, fixed point timing, after tone timing), and broadcasting mode settings (detailed / concise / minimalist broadcasting), which further exacerbates the complexity of broadcasting conflicts between multiple systems.

[0030] In traditional solutions, voice broadcasts for each system are controlled independently, with each system having its own independent broadcast switch and control logic. A simple "post-overwrite" mechanism is used to handle broadcast conflicts, meaning that a new broadcast directly interrupts the ongoing broadcast. Furthermore, there is a lack of correlation analysis and merging processing of broadcast content in different scenarios, no consideration of the priority differences and scenario adaptability of broadcasts from different systems, and no ability to predict broadcast idle periods or perform advance scheduling. This independent broadcast control method leads to serious user experience problems. Important information may be interrupted by irrelevant information, and repetitive information may be broadcast multiple times, affecting driving safety and user experience.

[0031] Therefore, in order to solve the above problems, this disclosure proposes an audio output method that can uniformly manage the voice broadcasts of multiple systems in a vehicle, reduce the probability of conflicting broadcast information, and improve the user experience.

[0032] The solution disclosed herein can be executed by an electronic device, and further, by a terminal, such as a vehicle.

[0033] The specific details of this method are as follows.

[0034] Figure 1 A flowchart illustrating an audio output method provided in this embodiment of the present disclosure. Figure 1 .like Figure 1 As shown, the method may include the following steps.

[0035] Step 101: Obtain the vehicle's driving scenario and the first broadcast data.

[0036] In some embodiments, the broadcast data may refer to the information actually output through audio, such as the broadcast data "Current speed limit 80, you are speeding". The broadcast data may also be broadcast information, broadcast content, etc.

[0037] In some embodiments, the first broadcast data is the currently acquired broadcast data, the first broadcast data is the broadcast data currently being processed, and the first broadcast data is the latest acquired broadcast data up to the current moment.

[0038] In some embodiments, the vehicle's information source system can generate first broadcast data. In other words, the information source system can be used to generate data that needs to be broadcast. The vehicle may include multiple information source systems, such as intelligent parking system, autonomous driving city navigation assistance system, autonomous driving highway navigation assistance system, map navigation system, vehicle status monitoring system, etc.

[0039] In some embodiments, the driving scenario is determined based on the vehicle's state information. The driving scenario is the driving scenario when the first broadcast data is acquired. The vehicle's state information can be used to reflect the vehicle's state when the first broadcast data is acquired. The vehicle's state information may include, for example, the vehicle's position, speed, gear, vehicle control signals, control commands, etc.

[0040] In other words, when determining the driving scenario of a vehicle, it is necessary to first obtain the vehicle's status information, and then determine the driving scenario based on the vehicle's status information. The vehicle's status information can be determined based on sensor data collected by the vehicle's sensors, or it can be determined based on control commands issued by the vehicle's control system, such as parking commands, parking exit commands, parking space search commands, gear shifting commands, etc.

[0041] For example, the system can first determine whether the vehicle is currently in a parking scenario based on its status information. Parking scenarios can be divided into parking entry scenarios, parking exit scenarios, and parking space search scenarios. For instance, if a parking entry start command (including parking space coordinates command, parking path planning command, etc.) is detected from the control system, it is determined to be a parking entry scenario; if a parking exit start command (including current parking space unlock command, parking exit path planning command, etc.) is detected from the control system, it is directly determined to be a parking exit scenario. Another example is if the vehicle is in the parking waiting area outside the parking space, moves towards the parking space, and matches the parking coordinates of the target parking space, it is determined to be a parking entry scenario; if the vehicle is in a parked parking space, moves towards the passage area outside the parking space, and leaves the parking space coordinate range, it is determined to be a parking exit scenario; yet another example is if a parking space search command is detected from the control system, it is determined to be a parking space search scenario.

[0042] If, based on the vehicle's status information, it is determined that the vehicle does not meet the conditions for the above parking scenario, then the driving scenario is a non-parking scenario. Non-parking scenarios can be further divided into highway navigation scenarios, urban road navigation scenarios, and ordinary navigation scenarios. For example, based on the vehicle's location and map data, the type of road the vehicle is currently on can be determined. If the type of road is determined to be a highway, the driving scenario can be determined to be a highway navigation scenario. If the type of road is not a highway, it can be determined whether the type of road is an urban road. If the type of road is an urban road, the driving scenario can be determined to be an urban road navigation scenario; otherwise, the driving scenario is determined to be an ordinary road navigation scenario.

[0043] Step 102: Determine the priority of the first broadcast data based on the driving scenario and the attributes of the first broadcast data.

[0044] In some embodiments, the attributes of the first broadcast data can be generated by the information source system corresponding to the first broadcast data. That is, the information source system can not only generate the first broadcast data, but also generate the attributes corresponding to the first broadcast data. The attributes include at least one of the data source of the first broadcast data, the content type of the first broadcast data, and the urgency of the first broadcast data. The attributes of the first broadcast data may also include other content, such as the data volume of the first broadcast data, etc. This disclosure does not limit this.

[0045] The data source of the first broadcast data can be used to indicate the information source system that generates the first broadcast data. The content type of the first broadcast data can be various types such as turning prompts, electronic eye reminders, lane line guidance, and safety reminders. The urgency level of the first broadcast data can be high or low. For example, the urgency level of safety warning information is high, while the urgency level of waypoint reminder information is low.

[0046] In some embodiments, the priority of broadcast data may differ depending on the attributes of the broadcast data. Broadcast data with higher urgency will have a higher priority than broadcast data with lower urgency. Furthermore, the priority of different broadcast data may differ in different driving scenarios. For example, in a parking scenario, the priority of parking-related broadcast data is higher than the priority of map navigation-related broadcast data.

[0047] Therefore, the priority of the first broadcast data can be determined based on the driving scenario and the attributes of the first broadcast data. Determining the priority of the first broadcast data based on the driving scenario and the attributes of the first broadcast data includes: determining a target priority weight table from multiple pre-configured candidate priority weight tables based on the driving scenario. The target priority weight table includes the correspondence between the attributes of the broadcast data and the priority of the broadcast data; and determining the priority of the first broadcast data based on the attributes of the first broadcast data and the target priority weight table.

[0048] In other words, multiple candidate priority weight tables can be pre-configured, each corresponding to a different driving scenario. Each candidate priority weight table can include the correspondence between the attributes of the broadcast data and the priority of the broadcast data in that driving scenario. Then, based on the driving scenario, the target priority weight table corresponding to that driving scenario can be determined, and the priority of the first broadcast data can be determined from the target priority weight table based on the attributes of the first broadcast data.

[0049] In the above embodiments, a target priority weight table can be used to determine the priority of the first broadcast data. At this time, the target priority weight table can include the priorities corresponding to multiple attributes. For example, the target priority weight table can include the priority corresponding to the data source being system A, the urgency level being urgent, and the content type being security warning.

[0050] Alternatively, multiple priority weight tables can be used to determine the priority of the first broadcast data. For example, firstly, a first priority score for the first broadcast data can be determined based on a basic priority weight table applicable to any driving scenario. This basic priority weight table can include the correspondence between the data source of the broadcast data and the priority score. Then, the first priority score can be adjusted according to a content type priority weight table to obtain a second priority score. This content type priority weight table can include the urgency of the broadcast data, the correspondence between the content type and the priority score of the broadcast data, and finally, a scenario priority weight table can be determined based on the driving scenario. The second priority score can then be adjusted according to the scenario priority weight table to obtain a third priority score. The priority of the first broadcast data can then be determined based on the third priority score. This scenario priority weight table can include the priority scores corresponding to the content types of different broadcast data under different driving scenarios.

[0051] In some embodiments, priority can be determined based on the priority score level. For example, a priority score of 90-100 corresponds to the highest priority, a priority score of 70-89 corresponds to a high priority, a priority score of 40-69 corresponds to a medium priority, and a priority score of 0-39 corresponds to a low priority.

[0052] In some embodiments, after determining the priority of the first broadcast data according to the above method, the priority of the first broadcast data can also be adjusted. For example, the priority of the first broadcast data can be adjusted according to the similarity between the first broadcast data and other broadcast data. After adjustment, it can avoid multiple similar broadcast data having the same priority, which would cause the audio corresponding to multiple broadcast data to interrupt each other during output, thus improving the user experience.

[0053] Step 103: Sort the first broadcast data and at least one second broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data to determine the position of the first broadcast data in the broadcast sequence.

[0054] In some embodiments, the second broadcast data is acquired before the first broadcast data is acquired. At least one second broadcast data may include broadcast data in an output state and / or broadcast data in a pending output state. In the output state, the audio corresponding to the broadcast data is currently being output. In the pending output state, the broadcast data has entered the pending broadcast queue, but the audio corresponding to the broadcast data has not yet started to be output. After the priority of the broadcast data is determined, the broadcast data may enter the pending broadcast queue.

[0055] In some embodiments, the broadcast sequence may also be referred to as a broadcast queue, a queue to be broadcast, a queue of data to be broadcast, etc. The broadcast sequence includes one or more broadcast data. One or more broadcast data in the broadcast sequence are in an output state or in a state to be output. After the priority of each newly arrived broadcast data is determined, the priority of the newly arrived broadcast data can be compared and sorted with the priority of other broadcast data in the broadcast sequence. Then, based on the comparison result or sorting result, the newly arrived broadcast data is added to the broadcast sequence.

[0056] In some embodiments, after the priority of the first broadcast data is determined, it can be sorted according to the priority of the first broadcast data and the priority of at least one second broadcast data. For example, the first broadcast data and at least one second broadcast data can be sorted in descending order of priority. The sorted result is the broadcast sequence. For example, if the first broadcast data is broadcast data A and the at least one second broadcast data is broadcast data B and broadcast data C, then when it is determined that the priority of broadcast data A is higher than that of broadcast data C but lower than that of broadcast data B, the broadcast sequence can be determined as broadcast data B, broadcast data A, and broadcast data C. At this time, the position of broadcast data A in the broadcast sequence can be described as being between broadcast data B and broadcast data C, or it can be described as being in the second position, or it can be described as being after broadcast data B and before broadcast data A.

[0057] In some embodiments, if at least one second broadcast data contains broadcast data from a different source than the first broadcast data, then the priority of broadcast data from different systems can be comprehensively considered, and the audio output corresponding to the broadcast data from different systems can be uniformly planned and managed. This avoids the problem of mutual interruption caused by the independent processing of broadcast data from different systems, and can also prevent unimportant audio from a certain system from interrupting the important audio currently being output, thereby improving the user experience.

[0058] Step 104: Output the audio corresponding to the first broadcast data according to the broadcast sequence.

[0059] In some embodiments, outputting the audio corresponding to the first broadcast data according to the broadcast sequence can mean outputting the first broadcast data according to its position in the broadcast sequence. For example, if the first broadcast data is broadcast data A and the broadcast sequence is broadcast data B, broadcast data A, and broadcast data C, then the audio corresponding to the broadcast data can be output sequentially in the order of broadcast data B, broadcast data A, and broadcast data C. In this case, after the audio corresponding to broadcast data B is output, the audio corresponding to broadcast data A will begin to be output.

[0060] In some embodiments, outputting the audio corresponding to the first broadcast data according to the broadcast sequence may be done by determining a target time period from at least one idle time period based on the position of the first broadcast data and at least one second broadcast data in the broadcast sequence, and broadcasting the first broadcast data in the target time period, etc., wherein the position of the first broadcast data and at least one second broadcast data is determined according to the priority of the first broadcast data and at least one second broadcast data, so the target time period can be determined from at least one idle time period according to the priority of the first broadcast data and the priority of at least one second broadcast data, and the first broadcast data can be broadcast in the target time period.

[0061] In summary, the above embodiments of this application can determine the priority of the first broadcast data based on its attributes and the driving scenario when the first broadcast data is acquired. This allows for the determination of an accurate priority for broadcast data with different attributes and driving scenarios. Then, by comprehensively considering the priority of the first broadcast data and the priorities of broadcast data from different sources, a broadcast sequence is determined. Based on the position of the first broadcast data in the broadcast sequence, the audio corresponding to the first broadcast data is output. This enables unified management of broadcast data from different sources, avoiding the problem of mutual interruption caused by independently managing broadcast data from different sources.

[0062] Figure 2 A flowchart illustrating an audio output method provided in this embodiment of the present disclosure. Figure 2 .like Figure 2 As shown, the method may include the following steps.

[0063] Step 201: Determine the similarity between the first broadcast data and at least one second broadcast data.

[0064] In some embodiments, after determining the priority of the first broadcast data according to the priority weight table, the priority of the first broadcast data can be adjusted. Optionally, the first broadcast data can be adjusted according to the similarity between the first broadcast data and at least one second broadcast data.

[0065] In some embodiments, determining the similarity between the first broadcast data and at least one second broadcast data may involve determining the semantic similarity between the first broadcast data and at least one second broadcast data. When determining the semantic similarity, the core content and key information points of the first broadcast data and at least one second broadcast data may be extracted first, and then the semantic similarity between the core content and key information points of the first broadcast data and at least one second broadcast data may be calculated.

[0066] Specifically, the similarity between the first broadcast data and each of the broadcast data in at least one second broadcast data can be determined.

[0067] Step 202: Adjust the priority of the first broadcast data based on similarity.

[0068] In some embodiments, the priority of the first broadcast data can be adjusted based on the similarity between the first broadcast data and at least one second broadcast data.

[0069] In some embodiments, adjusting the priority of the first broadcast data based on similarity includes: merging the first broadcast data and one or more broadcast data in response to a similarity greater than or equal to a first threshold between the first broadcast data and at least one or more broadcast data in at least one second broadcast data to obtain merged broadcast data; determining the priority of the merged broadcast data based on the priority of the first broadcast data and the priority of one or more broadcast data; and outputting the audio corresponding to the first broadcast data according to the broadcast sequence, including: outputting the audio corresponding to the merged broadcast data based on the position of the merged broadcast data in the broadcast sequence, wherein the position of the merged broadcast data in the broadcast sequence is determined based on the priority of the merged broadcast data and the priority of the broadcast data in at least one second broadcast data that was not merged with the first broadcast data.

[0070] In the above embodiments, in response to the similarity between the first broadcast data and one or more broadcast data in at least one second broadcast data being greater than or equal to a first threshold, the content of the first broadcast data and one or more broadcast data in at least one second broadcast data being very similar, if the audio corresponding to the first broadcast data and the audio of the aforementioned one or more broadcast data are output separately, the user may hear multiple repeated messages, which not only leads to energy waste but also results in a poor user experience. Furthermore, since the content of the first broadcast data and one or more broadcast data in at least one second broadcast data are very similar, the priority of the first broadcast data and one or more broadcast data in at least one second broadcast data may be the same, which may cause the audio corresponding to the first broadcast data and one or more broadcast data in at least one second broadcast data to interrupt each other during output.

[0071] Therefore, in response to the fact that the similarity between the first broadcast data and one or more broadcast data in at least one second broadcast data is greater than or equal to the first threshold, the first broadcast data and one or more broadcast data can be merged to obtain the merged broadcast data. At this time, only the audio corresponding to the merged broadcast data needs to be output, that is, repeated content only needs to be output once, which can avoid energy waste and improve user experience.

[0072] When merging broadcast data, the principle is to retain the core information of each broadcast data and remove duplicate content from multiple broadcast data. For example, if one broadcast data is "Turn left ahead, speed limit 80 ahead" and another broadcast data is "Speed ​​limit 80 ahead, you are speeding", then the merged broadcast data can be "Turn left ahead, speed limit 80 ahead, you are speeding".

[0073] In some embodiments, the merged broadcast data actually includes all the core content of one or more broadcast data from the first broadcast data and at least one second broadcast data. Therefore, the merged broadcast data may include one or more broadcast data from the first broadcast data and at least one second broadcast data. After merging, the priority of the merged broadcast data can be determined. At this time, it can be understood that the adjusted priority of the first broadcast data is the priority of the merged broadcast data. Outputting the first broadcast data is equivalent to outputting the merged broadcast data.

[0074] In other words, outputting the first broadcast data can refer to the original first broadcast data generated by the output information source system, or it can refer to the combined broadcast data including the first broadcast data; that is, the first broadcast data can be output independently or output after being combined with other broadcast data.

[0075] After obtaining the merged broadcast data, the priority of the merged broadcast data can be determined based on the priority of the first broadcast data and the priorities of one or more broadcast data. For example, the highest priority among the priorities of the first broadcast data and one or more broadcast data can be determined as the priority of the merged broadcast data. After determining the priority of the merged broadcast data, the broadcast data that was not merged with the first broadcast data can be sorted according to the priority of the merged broadcast data and the priority of the broadcast data that was not merged with the first broadcast data in at least one second broadcast data. This sorting determines the position of the first broadcast data in the broadcast sequence. For example, if the first broadcast data is broadcast data A, and the at least one second broadcast data is broadcast data B, broadcast data C, and broadcast data D, and broadcast data A and broadcast data B have a high similarity and need to be merged, the merged broadcast data E is obtained. At this time, the priority of broadcast data E can be determined, and broadcast data C, broadcast data D, and broadcast data E can be sorted according to the priorities of broadcast data C, broadcast data D, and broadcast data E to obtain the broadcast sequence. The position of broadcast data E in the broadcast sequence can then be determined, and broadcast data E can be output according to its position in the broadcast sequence.

[0076] In some embodiments, adjusting the priority of the first broadcast data based on similarity includes: adjusting the priority of the first broadcast data in response to the similarity between the first broadcast data and one or more broadcast data in at least one second broadcast data being less than a first threshold and greater than or equal to a second threshold, wherein the priority of the first broadcast data after adjustment is different from the priority of one or more broadcast data; and sorting the first broadcast data and at least one second broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data includes: sorting the first broadcast data and at least one second broadcast data according to the priority of the adjusted first broadcast data and the priority of at least one second broadcast data.

[0077] In some embodiments, in response to the similarity between the first broadcast data and one or more broadcast data in at least one second broadcast data being less than a first threshold and greater than or equal to a second threshold, directly merging the first broadcast data and one or more broadcast data in at least one second broadcast data may cause the meaning of the merged content to change, that is, the merged broadcast data may contain errors. In this case, multiple broadcast data still need to be played separately, so the first broadcast data and one or more broadcast data in at least one second broadcast data are not merged.

[0078] However, at this point, the first broadcast data and one or more broadcast data in at least one second broadcast data may have the same priority, which may cause a conflict during output. Therefore, it is necessary to adjust the priority of the first broadcast data, that is, to adjust the priority of the first broadcast data to be different from the priority of one or more broadcast data in at least one second broadcast data, in order to avoid conflicts during output.

[0079] In some embodiments, after adjusting the priority of the first broadcast data, the first broadcast data and at least one second broadcast data can be sorted according to the adjusted priority of the first broadcast data and the priority of at least one second broadcast data. For example, the first broadcast data is broadcast data A, and the at least one second broadcast data is broadcast data B and broadcast data C. The similarity between broadcast data A and broadcast data B is less than a first threshold and greater than a second threshold. According to the target priority weight table, the priority of broadcast data A is determined to be level 1, the priority of broadcast data B is level 2, and the priority of broadcast data C is level 3. Since level 1 is greater than level 3, the priority of broadcast data A can be adjusted to level 2. Then, the broadcast data A, broadcast data B, and broadcast data C can be sorted according to the adjusted priority of broadcast data A and the priorities of broadcast data B and broadcast data C to obtain the broadcast sequence as broadcast data B, broadcast data A, and broadcast data C.

[0080] In some embodiments, in response to the similarity between the first broadcast data and one or more broadcast data in at least one second broadcast data being less than a second threshold, there is no need to adjust the priority of the first broadcast data.

[0081] In summary, the above embodiments of this disclosure can merge or prioritize broadcast data with high similarity, which can avoid increased energy consumption caused by broadcasting repeated audio and avoid audio conflicts when similar broadcast data are output, thus avoiding mutual interruption and improving user experience.

[0082] Figure 3 A flowchart illustrating an audio output method provided in this embodiment of the present disclosure. Figure 3 .like Figure 3 As shown, the method includes the following steps.

[0083] Step 301: Determine whether there is any broadcast data in the output state among at least one second broadcast data.

[0084] In some embodiments, after determining the priority of the first broadcast data and the priority of at least one second broadcast data, the first broadcast data can be output according to the priority of the first broadcast data and the priority of at least one second broadcast data. In the process of outputting the first broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data, it can be determined whether there is broadcast data in the output state among the at least one second broadcast data.

[0085] The priority of the first broadcast data and the priority of at least one second broadcast data can be the priority determined by the first broadcast data and at least one second broadcast data according to the priority weight table; or it can be the priority obtained after adjusting the priority determined by the first broadcast data and at least one second broadcast data according to the priority weight table.

[0086] Step 302: In response to the existence of broadcast data in the output state, output the audio corresponding to the first broadcast data, at least according to the position of the first broadcast data in the broadcast sequence and the position of the broadcast data in the output state in the broadcast sequence.

[0087] In some embodiments, if there is broadcast data in an output state in at least one second broadcast data, the positions of the first broadcast data and the broadcast data in the output state in the broadcast sequence can be compared first, and then the audio corresponding to the first broadcast data can be output according to the comparison result.

[0088] In some embodiments, outputting the audio corresponding to the first broadcast data, at least based on the position of the first broadcast data in the broadcast sequence and the position of the broadcast data in the output state in the broadcast sequence, includes: stopping the output of the audio corresponding to the broadcast data in the output state and outputting the audio corresponding to the first broadcast data in response to the position of the first broadcast data being before the position of the broadcast data in the output state; outputting the audio corresponding to the first broadcast data after the output of the audio corresponding to the broadcast data in the output state is completed in response to the position of the first broadcast data being the same as the position of the broadcast data in the output state; and outputting the audio corresponding to the first broadcast data based on the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence in response to the position of the first broadcast data being after the position of the broadcast data in the output state.

[0089] If the position of the first broadcast data is before the position of the broadcast data in the output state, it means that the priority of the first broadcast data is higher than the priority of the broadcast data in the output state. In this case, it can be determined that the first broadcast data is more important and the audio corresponding to the first broadcast data needs to be output first. At this time, the audio corresponding to the broadcast data in the output state needs to be stopped, and the audio corresponding to the first broadcast data needs to be output, that is, the output of the audio corresponding to the broadcast data in the output state is interrupted.

[0090] If the position of the first broadcast data is the same as the position of the broadcast data in the output state, it means that the priority of the first broadcast data is equal to the priority of the broadcast data in the output state. The first broadcast data and the broadcast data in the output state are equally important. At this time, the audio corresponding to both the first broadcast data and the broadcast data in the output state needs to be output completely. Therefore, the audio corresponding to the first broadcast data can be output after the audio corresponding to the broadcast data in the output state has been output. That is, the first broadcast data can be inserted at the beginning of the queue to be broadcast.

[0091] If the position of the first broadcast data is after the position of the broadcast data in the output state, it means that the priority of the first broadcast data is lower than the priority of the broadcast data in the output state. The first broadcast data may not be very important. In this case, the first broadcast data can be output according to its position in the broadcast sequence. For example, the audio corresponding to multiple broadcast data can be output sequentially according to the positions of multiple broadcast data in the broadcast sequence.

[0092] Optionally, when the priority of the first broadcast data is equal to that of any of the at least one second broadcast data, the first broadcast data is delayed in playback. For example, if the priority of the first broadcast data is equal to that of broadcast data B, then the audio corresponding to the first broadcast data is output after the audio output of broadcast data B is completed.

[0093] Specifically, the audio corresponding to the first broadcast data is output based on the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence. This can be done during idle periods based on the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence.

[0094] In some embodiments, the idle time period is determined based on the inherent broadcast points of the vehicle on the current navigation route, and each idle time period is determined based on the time when the vehicle arrives at two adjacent inherent broadcast points. The idle time period is the time period during which the vehicle does not need to broadcast the navigation audio corresponding to the inherent broadcast point while passing through two adjacent inherent broadcast points; or, the idle time period is the time period between the end of the navigation audio broadcast corresponding to the previous inherent broadcast point and the start of the navigation audio broadcast corresponding to the next adjacent inherent broadcast point; or, in other words, the idle time period is the time period during which the navigation audio corresponding to the inherent broadcast point is not broadcast.

[0095] Among them, the inherent broadcast point is the vehicle's location on the current navigation route; or, the inherent broadcast point is the location where the vehicle needs to broadcast navigation audio related to geographical features; or, the inherent broadcast point is the location where the distance to a specific geographical location is less than or equal to a distance threshold, such as the inherent broadcast point being the location 50m before the tunnel; or, in other words, the inherent broadcast point refers to the location where the vehicle outputs navigation audio related to geographical features near the geographical location when the distance to that geographical location is less than or equal to the distance threshold.

[0096] Step 303: In response to the absence of broadcast data in the output state, output the audio corresponding to the first broadcast data according to the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence.

[0097] In some embodiments, in response to the absence of any broadcast data in an output state, the audio corresponding to the first broadcast data can be output sequentially according to the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence. In other words, the audio corresponding to the first broadcast data can be output sequentially according to the priority of the first broadcast data and the priority of at least one second broadcast data. Similarly, outputting the audio corresponding to the first broadcast data according to the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence can be done during idle periods.

[0098] In some embodiments, outputting the audio corresponding to the first broadcast data based on the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence includes: determining at least one idle time period of the vehicle on the current navigation route; determining a target time period from the at least one idle time period based on at least one of the position of the first broadcast data in the broadcast sequence, the position of at least one second broadcast data in the broadcast sequence, the audio length corresponding to the first broadcast data, and the duration of each idle time period; and playing the audio corresponding to the first broadcast data in the target time period.

[0099] In other words, the current navigation route of the vehicle can be obtained first, then it can be determined which idle time periods exist during the vehicle's movement along the navigation route that can be used to play the first broadcast data, and then a suitable target time period for playing the audio corresponding to the first broadcast data can be matched from at least one idle time period, and the audio corresponding to the first broadcast data can be played in the target time period.

[0100] For example, after determining at least one idle time period, the duration of each idle time period and the duration of the audio corresponding to the first broadcast data can be determined to determine which idle time periods can be used to play the first broadcast data. For example, it can be determined which idle time periods have a duration greater than or equal to the duration of the audio corresponding to the first broadcast data. If there are multiple idle time periods with a duration greater than or equal to the duration of the audio corresponding to the first broadcast data, the target time period corresponding to the first broadcast data can be determined according to the priority of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence.

[0101] In some embodiments, determining at least one idle time period for the vehicle on the current navigation route includes: acquiring at least one inherent broadcast point for the vehicle on the current navigation route, wherein an inherent broadcast point is a location point that outputs navigation audio related to geographical features near the geographical location point when the distance between the vehicle and the geographical location point is less than or equal to a distance threshold; determining the time when the vehicle arrives at each inherent broadcast point based on the vehicle speed; and determining at least one idle time period based on the time when the vehicle arrives at each inherent broadcast point.

[0102] Among them, geographical features refer to the characteristics of the geographical environment near the fixed broadcast point, which are used to reflect the key location information of the auxiliary police officers at the fixed broadcast point. For example, if the geographical feature is a route, the navigation audio may be "turn left at the intersection ahead." If the geographical feature is a traffic camera monitoring point, the navigation audio may be "there is a traffic camera monitoring point 30m ahead." If the geographical feature is a tunnel entrance, the navigation audio may be "entering the XX tunnel 50m ahead," and so on. The fixed broadcast point is a fixed location point determined based on the navigation route and the characteristics of the geographical environment on the navigation route.

[0103] In some embodiments, after determining the inherent broadcast points, the time when the vehicle arrives at each inherent broadcast point can be determined based on the vehicle speed, and at least one idle time period can be determined based on the time when the vehicle arrives at each inherent broadcast point. For example, the time period between two time points when the vehicle arrives at two adjacent inherent broadcast points can be determined as the first time period. Then, the time period occupied by the navigation audio to be broadcast at each inherent broadcast point can be determined. The remaining time period is the idle time period when the first time period is subtracted from the time period occupied by the navigation audio.

[0104] For example, if a vehicle arrives at the designated broadcast point A at 14:00 and arrives at the designated broadcast point B at 14:10, then the first time slot is ten minutes from 14:00 to 14:10. After that, if it is determined that the navigation audio for the designated broadcast point A needs to be played from 14:00 to 14:02, then the idle time slot is eight minutes from 14:02 to 14:10.

[0105] In some embodiments, in response to the fact that the length of at least one idle time period does not meet the playback requirements of the audio corresponding to the first broadcast data, for example, in response to the fact that the length of at least one idle time period is less than the length of the audio corresponding to the first broadcast data, the playback period of the navigation audio corresponding to at least one fixed broadcast point can be adjusted. For example, if the idle time period between fixed broadcast point A and fixed broadcast point B is only 3 seconds, while the length of the audio corresponding to the first broadcast data is 5 seconds, then the audio corresponding to the first broadcast data can be output after the navigation audio output of fixed broadcast point A ends, and the navigation audio corresponding to fixed broadcast point B can be output after the audio output of the first broadcast data ends. Alternatively, the navigation audio corresponding to fixed broadcast point B can be canceled. For example, if the priority of the first broadcast data is higher than that of the navigation audio corresponding to fixed broadcast point B, the playback period of the navigation audio corresponding to fixed broadcast point B can be adjusted, or the navigation audio corresponding to fixed broadcast point B can be canceled.

[0106] In summary, the above embodiments of this application can output the first broadcast data according to the position of the first broadcast data in the broadcast sequence. If at least one of the second broadcast data contains broadcast data from a different source than the first broadcast data, then unified management of broadcast data from different sources can be achieved. By comprehensively considering the priority of broadcast data from different sources and broadcasting the audio corresponding to the broadcast data, the problem of mutual interruption caused by independently managing broadcast data from different sources can be avoided.

[0107] The above embodiments of this disclosure can be implemented individually or in combination. The steps in different embodiments can be explained or combined with each other, and the steps in each embodiment can be explained with each other.

[0108] The technical solutions of this disclosure will be further described in detail below with reference to specific application embodiments.

[0109] The following is an embodiment of a multi-scenario intelligent driving broadcasting and dispatching system provided in this disclosure. The overall architecture of the system is as follows: Figure 4A As shown, it includes a data source layer, a core processing layer, and an output layer. Multiple modules in these three layers work together to achieve intelligent scheduling and management of broadcasts from multiple systems.

[0110] The data source layer includes various systems that generate broadcast information and vehicle status monitoring systems, such as intelligent parking systems, autonomous driving city navigation assistance systems, autonomous driving highway navigation assistance systems, map navigation systems, vehicle status monitoring systems, and so on.

[0111] The core processing layer can realize information collection, scene recognition, priority evaluation, content analysis and merging, timing planning and scheduling decision-making. The core processing layer includes a broadcast information collection module, a content analysis and merging module, a broadcast timing prediction and planning module, a scene recognition module, a priority evaluation module, and a broadcast scheduling decision-making module.

[0112] The broadcast information acquisition module can obtain broadcast information provided by different systems in the data source layer, as well as broadcast status feedback information provided by the output layer. The broadcast information acquisition module can provide the acquired broadcast information to other modules, such as the scene recognition module to help the scene recognition module identify the scene, the priority evaluation module to help the priority evaluation module evaluate the priority of the content to be broadcast, and the content analysis and merging module to help the content analysis and merging module analyze and merge the content to be broadcast.

[0113] The scene recognition module can determine the current driving scenario based on vehicle status and environmental information, providing a scenario-based basis for subsequent broadcast scheduling, such as... Figure 4B As shown, the scene recognition logic is as follows: It receives vehicle status information, and further, can receive status information such as vehicle location, environment, speed, and gear position. Then, it combines map data and vehicle status indicators to determine the current scene, such as whether it is in a parking state. Parking scenes can be divided into searching for parking spaces, parking in, and parking out stages. Non-parking scene screenshots are further divided into highway, urban road, and ordinary navigation scenes. After scene recognition, the scene recognition module can output scene recognition results for use by other modules, such as the priority evaluation module and the broadcast timing prediction and planning module.

[0114] The priority evaluation module can assess the priority of each broadcast message based on its source, content type, and current context, such as... Figure 4CAs shown, the priority evaluation logic is as follows: It receives broadcast information and extracts the attributes of the broadcast information, including the source system, content type, and urgency level; it obtains the current scenario information to apply different priority weight tables according to the current scenario; then, it calculates a basic priority score based on the priority weight table; after obtaining the basic priority score, it determines whether the information is a security emergency and increases its priority; it also determines whether the information is duplicate or similar and decreases its priority; finally, it outputs the final priority evaluation result.

[0115] The content analysis and merging module performs similarity analysis on broadcast content generated by different systems, merging duplicate or similar broadcast information. The content analysis and merging logic is as follows: receiving the queue of information to be broadcast; extracting the core content and key information points of each message; calculating and analyzing semantic similarity based on the core content and key information points; intelligently merging information with similarity exceeding a threshold; retaining core information and removing duplicate content; marking the relevance of similar information that does not reach the merging threshold; and outputting the processed broadcast information queue.

[0116] The broadcast timing prediction and planning module predicts idle broadcast periods based on route information, vehicle speed, and existing broadcast points, and plans the optimal broadcast timing, such as... Figure 4D As shown, the broadcast timing prediction and planning logic is as follows: Obtain the current navigation route information and inherent broadcast points (such as turns, electronic eyes, etc.); Obtain the current vehicle speed and driving status, and calculate the estimated arrival time of each inherent broadcast point based on the current vehicle speed and driving status; Analyze the time interval between inherent broadcast points and identify potential broadcast idle periods; Evaluate the broadcast length that each idle period can accommodate; Match a suitable broadcast period according to the length and priority of the information to be broadcast; Generate and output the broadcast timing planning scheme.

[0117] The broadcast scheduling decision module comprehensively considers priority, content relevance, and timing planning results to make the final broadcast scheduling decision, such as... Figure 4EAs shown, the broadcast scheduling decision logic is as follows: First, it can receive priority evaluation results, content analysis and processing results, and timing planning results; then, it can establish a priority queue for information to be broadcast by combining the priority evaluation results, content analysis and processing results, and timing planning results; for newly arrived broadcast information, it first determines whether there is an ongoing broadcast. If there is, it determines the priority of the new information compared to the currently ongoing broadcast; if the new information has a higher priority, it can be inserted at the front of the queue, and the current broadcast can be interrupted immediately if necessary; if the new information has a lower priority, it is inserted into the queue in priority order; if there is no current broadcast, it can arrange the broadcast according to the timing planning results and output the final broadcast scheduling instruction, such as checking whether there is a planned idle time period. If there is, the broadcast is arranged according to the planned timing; if there is no planned idle time period, the broadcast packet is arranged immediately according to the priority.

[0118] The output layer is responsible for speech synthesis output and status feedback. The output layer includes a speech synthesis and output module, as well as a broadcast status feedback module.

[0119] The speech synthesis and output module can be used to respond to the broadcast scheduling instructions of the broadcast scheduling decision module, generate the corresponding speech based on the content to be broadcast, and output it; the broadcast status feedback module provides feedback on the broadcast results to the broadcast information acquisition module based on the results of speech synthesis and output, such as broadcast end, broadcast success, broadcast failure, etc.

[0120] The interaction process of the intelligent dispatch system for multi-scenario intelligent driving broadcasting is as follows: Each information source system (parking, autonomous driving, map, etc.) sends a broadcast request and vehicle status to the broadcast information collection module. The broadcast request can include the broadcast content and its attributes. Then, the broadcast information collection module distributes the relevant information to each processing module. For example, it provides the acquired vehicle status information to the scene recognition module and sends the broadcast content and its attributes to the priority evaluation module. The scene recognition module then analyzes the current driving scenario based on the vehicle status information and provides it to the priority evaluation module. Optionally, the vehicle status information can also be directly provided by the vehicle status monitoring system. The priority evaluation module calculates the basic priority of each broadcast message based on the scene information, the attributes of the broadcast content, and the broadcast content itself, and sends the broadcast content with the basic priority information to the content... The content analysis and merging module performs similarity analysis and merging on the broadcast content, and sends the processed broadcast content to the broadcast timing prediction and planning module. This module analyzes idle time periods, predicts suitable broadcast times, generates a timing planning scheme, and provides it to the broadcast scheduling decision module. The broadcast scheduling decision module integrates all results to make the final broadcast scheduling decision and outputs broadcast instructions to the speech synthesis and output module. These instructions include the broadcast content and the broadcast timing. The speech synthesis and output module performs speech synthesis and output based on the broadcast instructions, and then feeds back the broadcast status to the broadcast information acquisition module. It can also directly feed back the broadcast status to various information source systems.

[0121] In summary, the examples disclosed above, through a priority management mechanism, can prevent important information from being interrupted by irrelevant information, thus resolving the issue of broadcast conflicts between multiple systems; through content similarity analysis and merging, duplicate broadcast content is eliminated, reducing redundant broadcasts; by adjusting broadcast strategies according to scenario characteristics, broadcast services that better meet the needs of the current scenario are provided, optimizing user experience; through timing planning, appropriate content is broadcast at appropriate times, improving information reception and transmission efficiency; and it can ensure that important safety tips are delivered to users with priority and clarity, enhancing driving safety; it achieves unified coordination of broadcasts from various independent systems, forming an organic whole and improving system synergy; and by optimizing broadcast strategies for different scenarios such as parking, highways, and urban roads, it can adapt to different driving scenarios and meet the needs of different driving scenarios.

[0122] Figure 5 This is a schematic diagram of the structure of an audio output device 500 provided in an embodiment of this disclosure. Figure 5As shown, the device includes: an acquisition module 510, used to acquire the vehicle's driving scenario and first broadcast data, wherein the driving scenario is determined based on the vehicle's state information; a determination module 520, used to determine the priority of the first broadcast data based on the driving scenario and the attributes of the first broadcast data; sorting the first broadcast data and at least one second broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data to determine the position of the first broadcast data in the broadcast sequence, wherein the second broadcast data is acquired before the first broadcast data is acquired, and at least one second broadcast data includes broadcast data from a different source than the first broadcast data; and an output module 530 outputting the audio corresponding to the first broadcast data according to the broadcast sequence.

[0123] In some embodiments, the acquisition module is further configured to determine a target priority weight table from a plurality of pre-configured candidate priority weight tables based on the driving scenario, wherein the target priority weight table includes the correspondence between the attributes of the broadcast data and the priority of the broadcast data; and determine the priority of the first broadcast data based on the attributes of the first broadcast data and the target priority weight table, wherein the attributes include at least one of the data source of the first broadcast data, the content type of the first broadcast data, and the urgency of the first broadcast data.

[0124] In some embodiments, the determining module is further configured to determine the similarity between the first broadcast data and at least one second broadcast data; and adjust the priority of the first broadcast data according to the similarity.

[0125] In some embodiments, the determining module is further configured to, in response to the similarity between the first broadcast data and one or more broadcast data in at least one second broadcast data being greater than or equal to a first threshold, merge the first broadcast data and one or more broadcast data to obtain merged broadcast data; and determine the priority of the merged broadcast data according to the priority of the first broadcast data and the priority of one or more broadcast data.

[0126] In some embodiments, the output module is further configured to output the audio corresponding to the merged broadcast data according to the position of the merged broadcast data in the broadcast sequence. The position of the merged broadcast data in the broadcast sequence is determined according to the priority of the merged broadcast data and the priority of the broadcast data that is not merged with the first broadcast data in at least one second broadcast data.

[0127] In some embodiments, the determining module is further configured to adjust the priority of the first broadcast data in response to the similarity between the first broadcast data and one or more broadcast data in at least one second broadcast data being less than a first threshold and greater than or equal to a second threshold, wherein the priority of the first broadcast data after adjustment is different from the priority of one or more broadcast data.

[0128] In some embodiments, the determining module is further configured to sort the first broadcast data and at least one second broadcast data according to the priority of the adjusted first broadcast data and the priority of at least one second broadcast data.

[0129] In some embodiments, the output module is further configured to determine whether there is any broadcast data in the output state among at least one second broadcast data; in response to the existence of broadcast data in the output state, output the audio corresponding to the first broadcast data at least according to the position of the first broadcast data in the broadcast sequence and the position of the broadcast data in the output state in the broadcast sequence; in response to the absence of broadcast data in the output state, output the audio corresponding to the first broadcast data according to the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence.

[0130] In some embodiments, the output module is further configured to: stop outputting the audio corresponding to the broadcast data in the output state and output the audio corresponding to the first broadcast data in response to the position of the first broadcast data being before the position of the broadcast data in the output state; output the audio corresponding to the first broadcast data in response to the position of the first broadcast data being the same as the position of the broadcast data in the output state after the audio corresponding to the broadcast data in the output state has finished outputting; and output the audio corresponding to the first broadcast data in response to the position of the first broadcast data being after the position of the broadcast data in the output state, based on the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence.

[0131] In some embodiments, the output module is further configured to determine at least one idle time period of the vehicle on the current navigation route; determine a target time period from at least one idle time period based on at least one of the following: the position of the first broadcast data in the broadcast sequence and the position of at least one second broadcast data in the broadcast sequence, the corresponding audio length of the first broadcast data, and the duration of each idle time period; and play the audio corresponding to the first broadcast data in the target time period.

[0132] In some embodiments, the output module is further configured to acquire at least one inherent broadcast point on the current navigation route of the vehicle, and output navigation audio related to the geographical features near the inherent broadcast point in response to the distance between the vehicle and the inherent broadcast point being less than or equal to a distance threshold; determine the time when the vehicle arrives at each inherent broadcast point based on the vehicle speed; and determine at least one idle time period based on the time when the vehicle arrives at each inherent broadcast point.

[0133] In summary, the audio output device 500 can determine the priority of the first broadcast data based on the driving scenario and attributes of the first broadcast data. This enables precise determination of the priority of broadcast data with different attributes in different scenarios. Furthermore, it can sort the first broadcast data and at least one second broadcast data based on their priorities to determine the position of the first broadcast data in the broadcast sequence, and output the first broadcast data according to its position in the broadcast sequence. If at least one second broadcast data contains broadcast data from a different source than the first broadcast data, then unified management of broadcast data from different sources can be achieved. By comprehensively considering the priorities of broadcast data from different sources and broadcasting the corresponding audio, the problem of mutual interruption caused by independently managing broadcast data from different sources can be avoided.

[0134] The methods and apparatus provided in the embodiments of this application have been described above. To implement the functions of the methods provided in the embodiments of this application, the electronic device may include a hardware structure and software modules, and may implement the above functions in the form of a hardware structure, software modules, or a hardware structure plus software modules. One of the above functions may be executed in the form of a hardware structure, software modules, or a hardware structure plus software modules.

[0135] Figure 6 This is a block diagram illustrating an electronic device 600 according to an exemplary embodiment. For example, the electronic device 600 may be a vehicle, such as a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicles. The vehicle may be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

[0136] Reference Figure 6 The electronic device 600 may include various subsystems, such as an infotainment system 610, a sensing system 620, a decision control system 630, a drive system 640, and a computing platform 650. The electronic device 600 may also include more or fewer subsystems, and each subsystem may include multiple components. Furthermore, each subsystem and each component of the electronic device 600 can be interconnected via wired or wireless means.

[0137] In some embodiments, the infotainment system 610 may include a communication system, an entertainment system, and a navigation system, etc.

[0138] The sensing system 620 may include several types of sensors for sensing information about the environment surrounding the electronic device 600. For example, the sensing system 620 may include a global positioning system (which may be GPS, BeiDou, or other positioning systems), an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and a camera device.

[0139] The decision control system 630 may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.

[0140] The drive system 640 may include components that provide powered motion to the electronic device 600. In one embodiment, the drive system 640 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of internal combustion engines, electric motors, and compressed air engines. The engine is capable of converting energy provided by the energy source into mechanical energy.

[0141] Some or all of the functions of electronic device 600 are controlled by computing platform 650. Computing platform 650 may include at least one processor 651 and memory 652, and processor 651 may execute instructions 653 stored in memory 652.

[0142] Processor 651 can be any conventional processor, such as a commercially available CPU. Processors may also include graphics processing units (GPUs), field-programmable gate arrays (FPGAs), systems-on-chips (SoCs), application-specific integrated circuits (ASICs), or combinations thereof.

[0143] The memory 652 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0144] In addition to instruction 653, memory 652 can also store data, such as road maps, route information, and data on the location, direction, and speed of electronic devices. The data stored in memory 652 can be used by computing platform 650.

[0145] In this embodiment of the disclosure, processor 651 may execute instruction 653 to complete all or part of the steps of the above method.

[0146] Embodiments of this disclosure also propose a vehicle for performing the audio output method proposed in this disclosure.

[0147] Embodiments of this disclosure also provide a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to perform the methods described in the above embodiments of this disclosure.

[0148] Figure 7 This is a schematic diagram illustrating the structure of a chip 700 for implementing the above method according to an exemplary embodiment. (Refer to...) Figure 7 The chip 700 includes a communication interface 701 and at least one processor 702. The communication interface 701 is used to receive signals input to the chip 700 or signals output from the chip 700. The processor 702 communicates with the communication interface 701 and implements the methods described in the above embodiments of this disclosure through logic circuits or executing code instructions.

[0149] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0150] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with an embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in at least one embodiment or example.

[0151] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of the invention includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as will be understood by those skilled in the art to which embodiments of the invention pertain.

[0152] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processing module, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having at least one wiring (control method), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which programs can be printed, because programs can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0153] It should be understood that various parts of the embodiments of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0154] Those skilled in the art will understand that all or part of the steps of the methods described in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0155] Furthermore, the functional units in the various embodiments of the present invention can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc.

[0156] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. An audio output method, characterized in that, The method includes: The vehicle's driving scenario and first broadcast data are obtained, wherein the driving scenario is determined based on the vehicle's status information; The priority of the first broadcast data is determined based on the driving scenario and the attributes of the first broadcast data. Based on the priority of the first broadcast data and the priority of at least one second broadcast data, the first broadcast data and the at least one second broadcast data are sorted to determine the position of the first broadcast data in the broadcast sequence. The second broadcast data is obtained before the first broadcast data is obtained. The at least one second broadcast data includes broadcast data from a different source than the first broadcast data. The audio corresponding to the first broadcast data is output according to the broadcast sequence.

2. The method according to claim 1, characterized in that, The method further includes: Determine the similarity between the first broadcast data and the at least one second broadcast data; The priority of the first broadcast data is adjusted based on the similarity.

3. The method according to claim 2, characterized in that, The step of adjusting the priority of the first broadcast data based on the similarity includes: In response to the fact that the similarity between the first broadcast data and one or more broadcast data in the at least one second broadcast data is greater than or equal to a first threshold, the first broadcast data and the one or more broadcast data are merged to obtain merged broadcast data; The priority of the merged broadcast data is determined based on the priority of the first broadcast data and the priority of the one or more broadcast data. The step of outputting the audio corresponding to the first broadcast data according to the broadcast sequence includes: Based on the position of the merged broadcast data in the broadcast sequence, the audio corresponding to the merged broadcast data is output. The position of the merged broadcast data in the broadcast sequence is determined according to the priority of the merged broadcast data and the priority of the broadcast data that is not merged with the first broadcast data among the at least one second broadcast data.

4. The method according to claim 2, characterized in that, The step of adjusting the priority of the first broadcast data based on the similarity includes: In response to the fact that the similarity between the first broadcast data and one or more broadcast data in the at least one second broadcast data is less than a first threshold and greater than or equal to a second threshold, the priority of the first broadcast data is adjusted, and the priority of the first broadcast data after adjustment is different from the priority of the one or more broadcast data. The step of sorting the first broadcast data and the at least one second broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data includes: The first broadcast data and the at least one second broadcast data are sorted according to the adjusted priority of the first broadcast data and the priority of the at least one second broadcast data.

5. The method according to any one of claims 1 to 4, characterized in that, The step of outputting the audio corresponding to the first broadcast data according to the broadcast sequence includes: Determine whether any of the at least one second broadcast data is in an output state; In response to the presence of broadcast data in the output state, the audio corresponding to the first broadcast data is output, based at least on the position of the first broadcast data in the broadcast sequence and the position of the broadcast data in the output state in the broadcast sequence. In response to the absence of broadcast data in the output state, the audio corresponding to the first broadcast data is output according to the position of the first broadcast data in the broadcast sequence and the position of the at least one second broadcast data in the broadcast sequence.

6. The method according to claim 5, characterized in that, The step of outputting the audio corresponding to the first broadcast data based at least on the position of the first broadcast data in the broadcast sequence and the position of the broadcast data in the output state in the broadcast sequence includes: In response to the fact that the position of the first broadcast data is before the position of the broadcast data in the output state, the audio corresponding to the broadcast data in the output state is stopped, and the audio corresponding to the first broadcast data is output. In response to the fact that the position of the first broadcast data is the same as the position of the broadcast data in the output state, after the audio output corresponding to the broadcast data in the output state ends, the audio corresponding to the first broadcast data is output. In response to the position of the first broadcast data following the position of the broadcast data in the output state, the audio corresponding to the first broadcast data is output according to the position of the first broadcast data in the broadcast sequence and the position of the at least one second broadcast data in the broadcast sequence.

7. The method according to claim 5, characterized in that, The step of outputting the audio corresponding to the first broadcast data based on the position of the first broadcast data in the broadcast sequence and the position of the at least one second broadcast data in the broadcast sequence includes: Determine at least one idle period for the vehicle on the current navigation route; Based on at least one of the following: the position of the first broadcast data in the broadcast sequence, the position of the at least one second broadcast data in the broadcast sequence, the corresponding audio length of the first broadcast data, and the duration of each idle period, a target time period is determined from the at least one idle period. The audio corresponding to the first broadcast data is played during the target time period.

8. The method according to claim 7, characterized in that, Determining at least one idle period for the vehicle on the current navigation route includes: Obtain at least one inherent broadcast point of the vehicle on the current navigation route, and in response to the distance between the vehicle and the inherent broadcast point being less than or equal to a distance threshold, output navigation audio related to the geographical features near the inherent broadcast point; Based on the vehicle's speed, determine the time it takes for the vehicle to arrive at each established broadcast point; The at least one idle period is determined based on the time when the vehicle arrives at each inherent broadcast point.

9. The method according to claim 1, characterized in that, Based on the driving scenario and the attributes of the first broadcast data, the priority of the first broadcast data is determined, including: Based on the driving scenario, a target priority weight table is determined from multiple pre-configured candidate priority weight tables. The target priority weight table includes the correspondence between the attributes of the broadcast data and the priority of the broadcast data. The priority of the first broadcast data is determined based on its attributes and the target priority weight table. The attributes include at least one of the following: the data source of the first broadcast data, the content type of the first broadcast data, and the urgency level of the first broadcast data.

10. An audio output device, characterized in that, The device includes: The acquisition module is used to acquire the vehicle's driving scenario and the first broadcast data, wherein the driving scenario is determined based on the vehicle's status information; The determining module is configured to determine the priority of the first broadcast data based on the driving scenario and the attributes of the first broadcast data; sort the first broadcast data and the at least one second broadcast data according to the priority of the first broadcast data and the priority of at least one second broadcast data to determine the position of the first broadcast data in the broadcast sequence, wherein the second broadcast data is acquired before the first broadcast data is acquired, and the at least one second broadcast data includes broadcast data from a different source than the first broadcast data. The output module is used to output the audio corresponding to the first broadcast data according to the broadcast sequence.

11. The apparatus according to claim 10, characterized in that, The determining module is also used for: Determine the similarity between the first broadcast data and the at least one second broadcast data; The priority of the first broadcast data is adjusted based on the similarity.

12. The apparatus according to claim 11, characterized in that, The determining module is further configured to: in response to the similarity between the first broadcast data and one or more broadcast data in the at least one second broadcast data being greater than or equal to a first threshold, merge the first broadcast data and the one or more broadcast data to obtain merged broadcast data; and determine the priority of the merged broadcast data according to the priority of the first broadcast data and the priority of the one or more broadcast data. The output module is further configured to: output the audio corresponding to the merged broadcast data according to the position of the merged broadcast data in the broadcast sequence, wherein the position of the merged broadcast data in the broadcast sequence is determined according to the priority of the merged broadcast data and the priority of the broadcast data that is not merged with the first broadcast data among the at least one second broadcast data.

13. The apparatus according to claim 11, characterized in that, The determining module is further configured to: in response to the fact that the similarity between the first broadcast data and one or more broadcast data in the at least one second broadcast data is less than a first threshold and greater than or equal to a second threshold, adjust the priority of the first broadcast data, wherein the priority of the adjusted first broadcast data is different from the priority of the one or more broadcast data; The first broadcast data and the at least one second broadcast data are sorted according to the adjusted priority of the first broadcast data and the priority of the at least one second broadcast data.

14. A vehicle, characterized in that, The vehicle performs the audio output method according to any one of claims 1-9.

15. An electronic device, characterized in that, include: The processor and the memory used to store computer programs that can run on the processor. When the processor is used to run the computer program, it performs the method according to any one of claims 1-9.

16. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-9.

17. A chip, characterized in that, It includes at least one processor and a communication interface; the communication interface is used to receive signals input to the chip or signals output from the chip, and the processor communicates with the communication interface and implements the method as described in any one of claims 1 to 9 through logic circuits or executing code instructions.

Images