An in-vehicle audio content generation method, electronic device, and computer program product
Patent Information
- Application Number
- CN202610872561.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-06-16
- Publication Date
- 2026-10-27
AI Technical Summary
[0003]然而,现有车载音频服务主要沿用移动互联网的内容推荐模式,将固定音频以列表或单条推送的方式呈现给用户,进而导致车载音频播放内容固定、播放时长固定,无法适应于实际车载通勤场景,影响用户的车载音频服务体验
[0022]本申请第六方面提供了一种存储介质,所述存储介质上存储有计算机程序,所述计算机程序被处理器运行时,实现如本申请第一方面或者本申请第一方面任一可能的实现方式所述的车载音频内容生成方法。
Smart Images

Figure CN122986188A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of in-vehicle audio technology, and in particular to an in-vehicle audio content generation method, electronic device, and computer program product. Background Technology
[0002] With the rapid development of intelligent connected vehicles and smart cockpit technologies, in-vehicle audio services have become an important means for users to obtain information, alleviate driving fatigue, and enhance their travel experience during their daily commutes.
[0003] However, existing in-vehicle audio services mainly follow the content recommendation model of the mobile Internet, presenting fixed audio to users in the form of lists or single pushes. This results in fixed audio playback content and playback duration, which cannot adapt to actual in-vehicle commuting scenarios and affects the user's in-vehicle audio service experience. Summary of the Invention
[0004] To address the aforementioned issues, this application proposes a method for generating in-vehicle audio content, an electronic device, and a computer program product to generate in-vehicle audio content that is adapted to actual in-vehicle commuting scenarios, thereby improving the user's in-vehicle audio service experience.
[0005] The first aspect of this application provides a method for generating in-vehicle audio content, including: In response to the user's in-vehicle commuting trigger operation, the total commuting time of the in-vehicle commuting is estimated based on the navigation route information of the in-vehicle commuting. A first audio content sequence is determined based on the user's audio preference information and the current in-vehicle commuting scenario information; the first audio content sequence consists of the audio content of at least one audio file. Based on the total commuting time, the audio content of the audio in the first audio content sequence is processed to generate a second audio content sequence; the playback duration of the second audio content sequence is different from the playback duration of the first audio content sequence, and the playback duration of the second audio content sequence matches the total commuting time.
[0006] In one possible implementation, determining the first audio content sequence based on the user's audio preference information and the current in-vehicle commuting scenario information includes: Based on the user's audio preference information and the current in-vehicle commuting scenario information, determine the user's audio demand perception information; Based on the total commuting time and the audio demand perception information, the first audio content sequence for the in-vehicle commuting is obtained from the audio content pool.
[0007] In one possible implementation, the audio demand-aware information includes at least one of first information, second information, and third information; The first information represents the audio ratio of at least one content type; The second information represents the topic priority among the various topics under the content type; The third piece of information represents the audio playback constraints for the in-vehicle commuting.
[0008] In one possible implementation, obtaining the first audio content sequence for in-vehicle commuting from the audio content pool based on the total commuting time and the audio demand perception information includes: The content type sequence for in-vehicle commuting and the target playback duration for each content type in the content type sequence are determined based on the total commuting time and the audio demand perception information; the content type sequence is composed of at least one content type. With the goal of the playback duration of the audio content recall result of the content type being close to the target playback duration of the content type, audio content of at least one audio corresponding to the content type is recalled from the audio content pool according to the topic priority of the content type. A first audio content sequence is generated based on the audio content corresponding to each content type in the content type sequence.
[0009] In one possible implementation, generating the first audio content sequence based on the audio content corresponding to each content type in the content type sequence includes: Based on the audio content corresponding to each of the two adjacent content types in the content type sequence, generate transition content between the two adjacent content types; A first audio content sequence is generated based on the audio content corresponding to each content type in the content type sequence and the transition content between two adjacent content types.
[0010] In one possible implementation, the step of processing the audio content of the first audio content sequence based on the total commuting time to generate the second audio content sequence includes: For each content type in the first audio content sequence, if the playback duration of the audio content of that content type does not match the target playback duration, then that content type is determined to be the target content type. The target audio content is obtained by processing the audio content corresponding to the target content type based on the target playback duration of the target content type; the playback duration of the target audio content is matched with the target playback duration of the target content type.
[0011] In one possible implementation, the audio content corresponding to the target content type is text, and the process of processing the audio content corresponding to the target content type based on the target playback duration of the target content type to obtain the target audio content includes: The target audio content is obtained by adjusting the word count level of the audio content based on the semantics of the audio content corresponding to the target content type, with the target playback duration as a constraint.
[0012] In one possible implementation, the audio content corresponding to the target content type is an original audio file, and the process of processing the audio content corresponding to the target content type based on the target playback duration of the target content type to obtain the target audio content includes: The target audio content is obtained by trimming the audio content corresponding to the target content type, with the target playback duration as a constraint.
[0013] One possible implementation also includes: During the playback of the second audio content sequence, it is determined whether a triggering event exists; the triggering event is used to trigger an update of the current second audio content sequence. If the triggering event currently exists, a target triggering event is determined from among the existing triggering events; the target triggering event is the triggering event with the highest priority. According to the audio content adjustment strategy corresponding to the target triggering event, the audio content in the current second audio content sequence is updated to obtain the updated second audio content sequence; the remaining playback time of the updated second audio content sequence is matched with the remaining commuting time of the current vehicle commuting.
[0014] In one possible implementation, the triggering event includes at least one of a first triggering event and a second triggering event, wherein: The triggering condition for the first triggering event includes receiving an interest change signal from the user; The triggering condition for the second triggering event includes the duration deviation between the remaining commuting time of the current vehicle commute and the remaining playback time of the current second audio content sequence exceeding a preset duration deviation threshold.
[0015] In one possible implementation, when the target triggering event is the first triggering event and the interest shift signal indicates that the user is not interested in the currently playing audio, the method further includes: The playback position of the current second audio content sequence is switched to the target playback position; the target playback position indicates the audio of interest to the user after the current playback position of the second audio content sequence.
[0016] One possible implementation also includes: In response to a driving safety incident, playback of the second audio content sequence is paused; Once the driving safety incident is resolved, the second audio content sequence resumes playback.
[0017] In one possible implementation, updating the audio content in the current second audio content sequence according to the audio content adjustment strategy corresponding to the target triggering event to obtain the updated second audio content sequence includes: Based on the audio content adjustment strategy corresponding to the target triggering event, the audio content of the audio content subsequence in the current second audio content sequence is processed to obtain the updated second audio content sequence; The audio content subsequence includes the next audio adjacent to the current playback position of the second audio content sequence up to the end of the current second audio content sequence.
[0018] A second aspect of this application provides an electronic device, including a memory and a processor; The memory is connected to the processor and is used to store programs; The processor is configured to implement the in-vehicle audio content generation method as described in the first aspect of this application or any possible implementation thereof by running a program in the memory.
[0019] A third aspect of this application provides a computer program product, including a computer program that, when executed by a processor, implements the in-vehicle audio content generation method as described in the first aspect of this application or any possible implementation thereof.
[0020] A fourth aspect of this application provides an in-vehicle audio content generation device, comprising: The total commute time estimation unit is used to respond to the user's in-vehicle commute trigger operation and estimate the total commute time of the in-vehicle commute based on the navigation route information of the in-vehicle commute. The first audio content sequence generation unit is used to determine a first audio content sequence based on the user's audio preference information and the current in-vehicle commuting scenario information; the first audio content sequence consists of the audio content of at least one audio file. The second audio content sequence generation unit is used to process the audio content of the audio in the first audio content sequence based on the total commuting time to generate a second audio content sequence; the playback duration of the second audio content sequence is different from the playback duration of the first audio content sequence and the playback duration of the second audio content sequence matches the total commuting time.
[0021] The fifth aspect of this application provides a chip including a processor and a data interface, wherein the processor reads and runs a program stored in a memory through the data interface to perform the in-vehicle audio content generation method as described in the first aspect of this application or any possible implementation thereof.
[0022] The sixth aspect of this application provides a storage medium storing a computer program, which, when executed by a processor, implements the in-vehicle audio content generation method as described in the first aspect of this application or any possible implementation thereof.
[0023] This application provides a method for generating in-vehicle audio content, an electronic device, and a computer program product, including: responding to a user's in-vehicle commuting trigger operation; estimating the total commuting time based on navigation route information; determining a first audio content sequence based on the user's audio preferences and the current in-vehicle commuting scenario; processing the audio content of the audio in the first audio content sequence based on the total commuting time to generate a second audio content sequence; the playback duration of the second audio content sequence differs from the playback duration of the first audio content sequence, and the playback duration of the second audio content sequence matches the total commuting time. This application can dynamically generate a second audio content sequence that accurately matches the total commuting time in actual in-vehicle commuting scenarios, effectively avoiding playback experience interruptions such as "arrival before content completion" or "no content remaining during commuting," thus improving the user's in-vehicle audio service experience. Attached Figure Description
[0024] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.
[0025] Figure 1 This is a schematic diagram of the architecture of an in-vehicle audio content generation system provided in an embodiment of this application.
[0026] Figure 2 This is a schematic diagram of the structure of an audio content pool provided in an embodiment of this application.
[0027] Figure 3 This is a flowchart of a method for generating in-vehicle audio content provided in an embodiment of this application.
[0028] Figure 4A flowchart illustrating a method for obtaining a first audio content sequence for in-vehicle commuting from an audio content pool based on total commuting time and audio demand perception information, provided in an embodiment of this application.
[0029] Figure 5 This application provides a flowchart of a method for generating a first audio content sequence based on the audio content corresponding to each content type in a content type sequence.
[0030] Figure 6 This application provides a flowchart of a method for processing the audio content of a first audio content sequence based on the total commuting time to generate a second audio content sequence.
[0031] Figure 7 A flowchart of a second audio content sequence adaptive adjustment method provided in an embodiment of this application.
[0032] Figure 8 This is a schematic diagram of the structure of an in-vehicle audio content generation device provided in an embodiment of this application.
[0033] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0034] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0035] Application Overview In the field of in-vehicle audio playback for commuting, the mainstream solution for in-vehicle audio services is to obtain the user's long-term interest tags, retrieve matching audio files from an audio library based on these tags, and generate a playlist. During playback, the audio is played one item at a time in the order of the playlist, automatically switching to the next item after each one is played, until the user reaches their destination or manually stops playback. This solution is widely adopted mainly because its implementation logic is simple, and it can use audio files of predetermined duration retrieved from the audio library to provide users with a playback sequence (playlist) that is related to their listening preferences.
[0036] However, the performance of the above-mentioned technical solutions is not ideal in actual in-vehicle commuting scenarios. A fundamental technical contradiction lies in the fact that each audio item in a playlist has a fixed playback duration, while the structure of the playlist remains static after its generation. This results in a fixed and unavoidable discrepancy between the total playback duration required for the playlist to complete its playback and the unpredictable actual commuting time in the external environment. For example, in a commute of approximately 20 minutes, if a fixed-duration playlist of 28 minutes is arranged according to listening preferences, approximately 8 minutes of audio will be forcibly interrupted when the vehicle arrives at its destination, creating a "departure before completion" situation. Conversely, if the playlist is only 12 minutes long, it will fall into a state of nearly 8 minutes of empty or random playback before the end of the commute.
[0037] Through in-depth analysis, the inventors discovered that the root cause of the aforementioned contradiction lies in the fact that the basic unit constituting the playlist (the audio files themselves) is set as an immutable data unit in related technologies. The entire arrangement process is essentially the selection and combination of discrete, fixed-duration basic units, rather than adjusting the temporal information within the basic units. This selection-only mechanism introduces constraints in the audio retrieval and playlist organization stages: audio retrieval is mainly based on listening preference matching, without incorporating total commute time as a hard constraint into the audio processing itself. This results in the playlist output during the arrangement stage being merely a collection of audio related to listening preferences, with its total playback time often deviating significantly from the total commute time. Furthermore, during the playback stage after playlist generation, the pre-assembled playlist structure lacks adaptability in the face of changes in remaining time caused by congestion or route adjustments during the commute. It can only passively wait to be interrupted upon reaching the destination or be truncated entirely if it becomes too long.
[0038] To overcome the aforementioned contradictions, this invention proposes a different technical approach. The core concept of this invention lies in introducing a mechanism that uses commuting time as a guide and performs temporal scaling on the audio content itself. This transforms the playback sequence from a fixed-duration audio selection and splicing process into a process of actively reconstructing the duration of each audio element under the constraint of commuting time. Specifically, instead of simply choosing between audio elements of predetermined duration, the audio is treated as a text or audio stream with adjustable information content. Through word-level or physical temporal-level processing (compression or expansion), the total playback duration of the final sequence can be actively adapted to the estimated total commuting time through the elastic deformation of the audio content. Simultaneously, during playback, the unplayed audio content in the sequence is continuously reconstructed and adjusted based on the remaining commuting time, rather than waiting for it to be forcibly terminated by external events. This invention solves the technical problem of mismatch between the sequence playback duration and the actual commuting time caused by the static combination of discrete fixed-duration basic units, achieving the technical effect of continuous, complete, and timely termination of in-vehicle audio service under dynamically changing commuting conditions.
[0039] Figure 1 This is a schematic diagram of the architecture of an in-vehicle audio content generation system provided in an embodiment of this application.
[0040] exist Figure 1 In the illustrated implementation environment, the in-vehicle audio content generation system is deployed on a vehicle / cloud computing platform. This platform establishes communication connections with multiple in-vehicle subsystems. Specifically, the navigation system provides the computing platform with information such as the starting point, ending point, waypoints, estimated navigation time, and real-time traffic conditions. The in-vehicle driver monitoring system continuously collects image data of the driver, including facial features and upper body posture, to monitor the driver's emotional state and fatigue level. The in-vehicle environment acquisition system collects information on occupant presence and in-vehicle noise levels to monitor the presence of passengers and noise levels. The vehicle's CAN bus provides operational status data such as vehicle speed, remaining energy, and mileage. The computing platform can also interact with external traffic information services, weather services, and calendar / system clock services.
[0041] The computing platform internally includes at least a processor, memory, and a text-to-speech synthesis engine. The memory maintains a pool of structured, indexed audio content. See also... Figure 2 This is a schematic diagram of the structure of an audio content pool provided in an embodiment of this application. Figure 2As shown, the audio content pool consists of a text storage area and a raw audio file storage area. The text storage area stores the raw texts used for speech synthesis, such as news articles, community articles, and chapter texts aggregated from external sources, as well as their pre-processed versions (texts obtained by pre-compressing / expanding the raw text at the word count level). The raw audio file storage area stores the audio files of music tracks and their corresponding emotional tone tags. A metadata index layer is built on top of the content pool. This index layer uniformly maintains the audio identifiers, content type tags, topic tags, and estimated playback durations of all audio content in the audio content pool for subsequent retrieval and recall.
[0042] The program modules running on the computing platform include a commuting time estimation unit, a demand perception unit, a content arrangement unit, an interactive feedback unit, and a playback adjustment unit.
[0043] The input interface of the commuting time estimation unit is connected to the navigation system, traffic information service, calendar / system clock service, weather service and vehicle CAN bus to continuously calculate and update the estimated total commuting time and remaining commuting time for this trip.
[0044] The input interface of the demand perception unit is connected to the user profile database (which is used to update and store users' long-term and recent audio preference information) as well as real-time signal sources such as the driver monitoring system and the in-vehicle environment acquisition system. This is used to comprehensively generate a structured demand description that includes content type ratio, topic priority, and audio playback constraints corresponding to the current in-vehicle commuting scenario.
[0045] The content orchestration unit obtains a duration baseline (estimated total commute time) from the commute time estimation unit, obtains a structured demand description from the demand awareness unit, and retrieves audio content by querying the metadata index layer of the audio content pool. During orchestration, the content orchestration unit calls a pre-trained audio content processing model deployed within the computing platform or in the cloud to rewrite the text retrieved from the text storage area. The rewritten text is then fed into a text-to-speech synthesis engine to synthesize audio segments (i.e., audio files) for playback. For audio files retrieved from the original audio file storage area, segments are directly selected or trimmed. The content orchestration unit ultimately outputs a second audio content sequence consisting of ordered audio content (the playback duration of the second audio content sequence matches the total commute time), which is then sent to the playback adjustment unit.
[0046] The playback adjustment unit is connected to the in-vehicle audio playback terminal. During the playback of the second audio content sequence, it continuously monitors events such as changes in commute time pushed by the commute time estimation unit, changes in user interest signals reflected by the interactive interface, and driving safety events pushed by ADAS (Advanced Driving Assistance System) / DMS (Driver Monitoring System). When such events occur, the playback adjustment unit adjusts the audio content subsequence after the current playback position according to a preset priority arbitration mechanism, and sends the updated second audio content sequence to the audio playback terminal for synchronous updates.
[0047] The voice commands or touch operations issued by the user through the in-vehicle interactive interface are recognized by the interactive feedback unit and distributed to the user profile database and playback adjustment unit for response.
[0048] For example, listening to an audio program continuously indicates that the user is satisfied with the audio content, which can increase the content type / topic weight of that audio in the user profile database; skipping or fast-forwarding the audio indicates that the user is not interested in the audio content, which can decrease the content type / topic weight of that audio in the user profile database; increasing the audio volume indicates increased attention to the audio, which can be recorded as positive feedback; decreasing the audio volume or muting the audio indicates that the user may not be interested in the audio, which can be recorded as negative feedback; and interrupting the audio playback indicates that the audio content is not attractive enough, which can be recorded as weak negative feedback.
[0049] For example, upon receiving voice commands (interest-changing signals) such as "learn more" or "continue speaking" from the user, the system sends interest-changing signals to the playback adjustment unit. The playback adjustment unit performs intent recognition on the interest-changing signals and can identify them as extension commands. Upon receiving voice commands (interest-changing signals) such as "change to another" or "next" from the user, the system sends interest-changing signals to the playback adjustment unit. The playback adjustment unit performs intent recognition on the interest-changing signals and can identify them as switching commands. Upon receiving voice commands (interest-changing signals) such as "too long" or "shorter" from the user, the system sends interest-changing signals to the playback adjustment unit. The playback adjustment unit performs intent recognition on the interest-changing signals and can identify them as compression commands.
[0050] The in-vehicle audio content generation system provided in this application embodiment can adapt to actual in-vehicle commuting scenarios, dynamically generate audio content sequences that accurately match commuting time, and adjust the sequence content in real time during commuting based on user interest signal changes, commuting time change events, etc., effectively avoiding the experience interruption problem of "arrival before content is finished" or "no content left during commuting", thereby significantly improving the user's in-vehicle audio service experience.
[0051] Exemplary methods Figure 3 This is a flowchart illustrating a method for generating in-vehicle audio content, provided as an embodiment of this application. The method can be... Figure 1 The processor in the system shown executes the corresponding program modules, which include the following:
[0052] Step S301: Respond to the user's in-vehicle commuting trigger operation and estimate the total commuting time based on the navigation route information of the in-vehicle commuting. In this application, the in-vehicle commuting trigger operation can refer to any operation that indicates that the user is about to start a commuting trip, such as starting the vehicle, setting a destination in the in-vehicle navigation system, or starting commuting navigation through voice commands.
[0053] As a specific implementation method, this step can be implemented as follows: when the system detects the above-mentioned triggering operation, the commuting time estimation unit obtains navigation route-related information from the navigation system, and obtains auxiliary information such as real-time traffic conditions, weekdays / holidays, special events (such as large-scale events), time information, weather environmental data and vehicle status from external traffic information services, calendar / system clock, weather services and vehicle CAN bus.
[0054] In this embodiment of the application, the navigation route information includes not only the estimated arrival time of the navigation system for this commuting trip, but also the commuting time of the same route during the same period in history (temporarily referred to as historical commuting time in this embodiment of the application), which is not limited in this embodiment of the application.
[0055] The commute time estimation unit can adopt a two-layer estimation architecture that combines basic estimation with dynamic in-trip correction. In the basic estimation stage, the basic estimated time (total commute time) is calculated by integrating the navigation-estimated arrival time, the commute time of the same route during the same period in history, and the corrections for environmental factors such as weather, holidays, and vehicle status through a weighted fusion algorithm. This calculation process can be expressed as: the total commute time equals the combined result of the navigation-estimated time, the historical commute time, and various environmental corrections.
[0056] The formula for estimating total commute time is as follows: T_total = α × T_nav + (1-α) × T_history + T_env_adjust Where T_total is the total commuting time, T_nav is the estimated arrival time, T_history is the average historical commuting time for the same route during the same period, α is the weighting coefficient, and T_env_adjust is the environmental factor adjustment.
[0057] In this embodiment, α is any value between 0 and 1, and α is automatically adjusted based on the historical accuracy of the navigation data in the current time period. The weighting coefficient of the historical average commuting time can be dynamically adjusted based on the historical accuracy of the navigation data in the current time period. For example, during the morning rush hour when navigation accuracy is low, the weighting coefficient of the estimated navigation time can be reduced, and more reliance can be placed on historical statistical data (historical average commuting time).
[0058] In this embodiment of the application, the environmental factor correction amount is superimposed as an independent term. The environmental factor correction amount includes at least one of the following: weather impact correction, holiday / special event correction, and vehicle status correction.
[0059] Weather impact correction: The delay will be increased by 3 to 8 minutes depending on the impact of rain or snow. The specific delay is based on historical commuting delay statistics for the same weather conditions, and this application does not limit the specific delay.
[0060] Holiday / Special Event Correction: During holidays / major events, an additional 5 to 15 minutes will be added. The specific delay is based on historical commuting delay statistics for the same holidays / special events, and this application does not limit the specific delay.
[0061] Vehicle status correction: If charging is required midway, the estimated charging time will be increased. The specific estimated charging time will be determined based on the actual battery level of the vehicle, and this application does not limit it.
[0062] The estimated total commute time is a key time benchmark for all subsequent scheduling and adjustment actions, providing necessary prerequisite data and constraints to ensure the effective execution of subsequent steps.
[0063] Step S302: Determine the first audio content sequence based on the user's audio preference information and the current in-vehicle commuting scenario information; the first audio content sequence consists of the audio content of at least one audio file; In this application, the first audio content sequence refers to the initial audio content list generated by the system through preliminary screening and combination before the audio content undergoes flexible generation processing.
[0064] In this embodiment of the application, determining the first audio content sequence based on the user's audio preference information and the current in-vehicle commuting scenario information includes: determining the user's audio demand perception information based on the user's audio preference information and the current in-vehicle commuting scenario information; and obtaining the first audio content sequence for in-vehicle commuting from the audio content pool based on the total commuting time and the audio demand perception information.
[0065] Audio preference information includes long-term and recent audio preference information. Long-term audio preference information includes content type preference distribution, topic interest weight, correlation preference between time period and content type, and historical completion rate of content type / topic. Recent audio preference information includes recent high-frequency topics, positive feedback (completed / favorited) content types / topics, and negative feedback (skipped / fast-forwarded) content types / topics.
[0066] For example, the themes under the content type "News" include technology news, social hot topics, and financial news; the themes under the content type "Community Articles" include AI / artificial intelligence, cutting-edge technology, and digital products; and the themes under the content type "Music" include upbeat, pop, and classical music.
[0067] The above are merely preferred contents of the audio preference information provided in the embodiments of this application. Those skilled in the art can set the specific content of the audio preference information according to their own needs, and there are no limitations here.
[0068] Information about in-vehicle commuting scenarios includes the current time period, driver's mood, fatigue level, and in-vehicle environment. For example, the in-vehicle environment includes whether there are passengers in the vehicle and the noise level inside the vehicle (e.g., mild noise, moderate noise, severe noise).
[0069] The above are merely preferred contents of the vehicle commuting scenario information provided in the embodiments of this application. The specific contents of the vehicle commuting scenario information can be set by those skilled in the art according to their own needs, and are not limited here.
[0070] As a specific implementation method, the demand perception unit obtains long-term audio preference information (long-term profile) from the user profile database, such as content type preference distribution, topic interest weight, correlation preference between time period and content type, and historical completion rate of content type / topic. It also obtains high-frequency topics, positive feedback (completed / favorited) content types / topics, and negative feedback (skipped / fast-forwarded) content types / topics from recent audio preference information (recent profile) over the past 7 days. At the same time, the demand perception unit also receives current in-vehicle commuting scenario information, which comes from the driver monitoring system, in-vehicle environment acquisition system, calendar / system clock, etc., and can include real-time signals such as the current time period (e.g., 8:15 am on Monday), driver's emotional state (e.g., normal, happy, anxious, depressed, etc.), fatigue level (e.g., awake, mild fatigue, moderate fatigue, severe fatigue, etc.), and in-vehicle environment.
[0071] Logical inference from raw data (user's audio preference information and current in-vehicle commuting scenario information) to audio demand perception information can be accomplished using a pre-trained demand perception model. This demand perception model receives structured audio preference information and current in-vehicle commuting scenario information as input, performs deep demand inference, and outputs audio demand perception information that better reflects the user's immediate needs in the current commuting scenario.
[0072] In this embodiment of the application, the audio demand perception information includes at least one of the first information, the second information, and the third information; the first information represents the audio allocation of at least one content type; the second information represents the topic priority among various topics under the content type; and the third information represents the audio playback constraints for in-vehicle commuting.
[0073] For example, the first piece of information could be a proportion or numerical sequence indicating the appropriate playback time for each content type—such as news, community articles, and music—within the total commuting time. The second piece of information represents the topic priority among different themes within a content type. For example, under the news content type, the second piece of information could indicate that tech news has a higher priority than social hot topics, and social hot topics have a higher priority than financial news. The third piece of information represents the audio playback constraints for this in-car commuting scenario. These constraints are specific limitations or suggestions generated based on the current in-car commuting scenario. For example, when a user is detected to be mildly fatigued, the third piece of information could include a constraint to play upbeat music at the end of the sequence to refresh the user; when other passengers are detected in the vehicle, it could include a constraint to avoid playing overly private or disturbing content.
[0074] By defining the abstract audio demand perception information as a structured multi-dimensional parameter set that includes content type ratio, theme priority, and audio playback constraints, precise and quantifiable instruction inputs are provided for subsequent content retrieval and arrangement actions, thereby ensuring that the arranged sequence can accurately respond to multi-dimensional personalized needs.
[0075] In this embodiment, the process of generating the first audio content sequence can be viewed as a mapping process from demand understanding to content retrieval. The content arrangement unit, based on the audio demand perception information output by the demand perception unit, queries the content metadata index layer of the audio content pool using the total commute duration to retrieve audio content, thereby initially generating a first audio content sequence. The audio content includes, but is not limited to, the text of audio in content types such as news, community articles, and audiobooks, and may also include the original audio files of audio in the content type of music.
[0076] This application embodiment not only relies on the user's static historical preferences, but also dynamically perceives the user's current emotional state and physical and temporal environment, making the generated first audio content sequence more accurate in terms of personalization, thereby solving the problem of poor matching degree between the generated audio content sequence and the real-time in-vehicle scene in related technologies.
[0077] Step S303: Based on the total commuting time, process the audio content of the audio in the first audio content sequence to generate a second audio content sequence; the playback duration of the second audio content sequence is different from the playback duration of the first audio content sequence and the playback duration of the second audio content sequence matches the total commuting time.
[0078] In this application, the first audio content sequence is simply constructed by splicing together the audio content (fixed duration) of audio retrieved from the audio content pool. Typically, its playback duration does not match the total commute time. Since the audio content of each audio retrieved from the audio content pool is only a portion of the first audio content sequence, the audio content of each audio retrieved from the audio content pool can be referred to as an audio content segment, and the audio to which this audio content segment belongs can be referred to as an audio fragment.
[0079] Audio content processing refers to manipulating the audio content itself. This processing involves actively adjusting the playback duration by changing the amount of information carried by the audio content. For example, for text-based audio content (audio content is text), semantic compression (e.g., intelligent summarization and trimming) or expansion (e.g., topic expansion and extension) can be achieved by calling an audio content processing model. For music-based audio content (audio content is the original audio file), compression can be achieved by direct trimming (fade-out cutoff) or expansion can be achieved by splicing.
[0080] Specifically, if the content arrangement unit detects a discrepancy between the playback duration of the first audio content sequence and the total commute time, it will adjust the duration of one or more audio content segments within the first audio content sequence. For example, for audio content stored in text format, the audio content processing model can be used to extract its core viewpoints, key arguments, and conclusions, generating a more concise text; or, based on understanding the semantics of the text, the audio content processing model can generate related in-depth analysis, background knowledge supplements, and other extended discussion texts. For audio content stored in the form of raw audio files, the raw audio files can be trimmed to generate audio content with a shorter playback duration, thus achieving audio content compression; or, multiple raw audio files can be spliced together to generate audio content with a longer playback duration, thus achieving audio content expansion. Through this flexible processing based on the content itself, the playback duration of the final generated second audio content sequence can be adjusted to precisely match the estimated total commute time. It is understandable that the playback duration of the second audio content sequence is the estimated playback duration of the second audio content sequence determined by combining the speech rate parameter of TTS (Text To Speech).
[0081] This process enables the playback duration of the second audio content sequence to proactively and flexibly adapt to the total commute time, thereby solving the technical problems of "arrival before content is finished" or "no content left during commute" caused by fixed audio playback content and fixed playback duration in related technologies, and achieving seamless alignment between audio content service and commute time.
[0082] To further optimize the above-mentioned embodiments that include structured audio demand perception information, and to address the problem of how to translate content allocation planning into specific content combinations and duration allocations, a preferred embodiment of this application provides a detailed arrangement process for the first audio content sequence, as detailed in [link to relevant documentation]. Figure 4 The flowchart shows a method for obtaining the first audio content sequence of in-vehicle commuting from the audio content pool based on total commuting time and audio demand perception information.
[0083] like Figure 4 As shown, the method includes: S401. Determine the content type sequence for vehicle commuting and the target playback duration for each content type in the content type sequence based on the total commuting time and audio demand perception information; the content type sequence consists of at least one content type. This step can be visualized as a time slot allocation mechanism. Specifically, firstly, the content arrangement unit determines the allocatable content duration based on the total commute time. The allocatable content duration is the time within the total commute time used to allocate to content types within the content type sequence. In other words, it is the duration available to fill the audio content retrieval results.
[0084] As one implementation of this application, the total commuting time is the allocatable content duration.
[0085] As another implementation of this application, the allocatable content duration is the remaining duration after deducting the reserved time from the total commuting time. The reserved time for transitional content (transitional phrases) required to connect the audio content of each content type in the content type sequence is deducted from the total commuting time. After deducting the reserved time, the allocatable content duration that can be used to fill the music content retrieval results is obtained.
[0086] In this embodiment of the application, the number of content types of at least one content type represented by the first information in the audio demand perception information is determined, the number of transition phrases is determined according to the number of content types, and the reserved time is determined in combination with the pre-set transition phrase duration of each transition phrase.
[0087] For example, at least one content type represented by the first information in the audio demand perception information includes news, community articles and music. Therefore, the number of content types of the first content type is 3. Thus, the number of transition words can be determined to be 2 (one transition word between news and community articles, and one transition word between community articles and music). If the pre-set duration of the transition word is 15 seconds, then the reserved time is 30 seconds.
[0088] Subsequently, the content arrangement unit invokes the content type audio allocation provided by the first information, and proportionally allocates the allocable content duration to each content type among at least one content type represented by the first information, thereby generating a specific target playback duration for each content type constituting the content type sequence. In this case, a content type can be viewed as a slot, and the target playback duration of a content type can be viewed as a time slot for the content type.
[0089] For example, if the allocatable content duration is 100 seconds, and at least one content type represented by the first information in the audio demand perception information includes news (30%), community articles (25%), and music (45%), then the target playback duration for news is 30 seconds, the target playback duration for community articles is 25 seconds, and the target playback duration for music is 45 seconds.
[0090] In this embodiment, the content type sequence defines the playback order of each type of content. This order can be dynamically determined based on audio playback constraints. For example, during a morning commute, news audio content can be configured to play before article / community audio content, while music audio content can be configured at the end when the user is fatigued. Furthermore, the playback order of each type of content in the content type sequence can also be determined by combining the user's historical listening habits, which is not limited in this embodiment.
[0091] S402. With the goal of the playback duration of the audio content recall result of the content type approaching the target playback duration of the content type, recall the audio content of at least one audio corresponding to the content type from the audio content pool according to the theme priority of the content type. After obtaining the target playback duration and theme priority for each content type, the content orchestration unit performs targeted retrieval of audio content from the audio content pool. This retrieval process has a clear duration matching target, rather than simply theme matching.
[0092] As one implementation of this application, for each content type, the content arrangement unit queries the content metadata index layer of the audio content pool, prioritizing the retrieval of audio content with the highest topic priority and whose estimated playback duration is close to the target playback duration. If a single audio content cannot fill the time slot of that content type, it will attempt to combine multiple audio contents that match the topic to piece together their total duration close to the target playback duration.
[0093] As another implementation of this application, for each content type, the top N target topics with the highest priority under that content type are determined, and the audio allocation ratio between each target topic is determined according to the topic interest weight of each target topic. Then, according to the audio allocation ratio between target topics, the target playback duration of the content type is allocated to each target topic to obtain the topic audio playback duration of each target topic. In this case, a target topic can be regarded as a slot, and the topic audio playback duration of a target topic can be regarded as a time slot of the target topic. For example, N can be 2, 3, etc. The above is only a preferred content of N provided by the embodiments of this application. Regarding the specific content of N, those skilled in the art can set it according to their own needs, and it is not limited here.
[0094] Taking a content type as an example, for each target topic within that content type, the content arrangement unit queries the content metadata index layer of the audio content pool, prioritizing the retrieval of audio content belonging to that target topic whose estimated playback duration is close to the playback duration of the target topic's theme audio. If the estimated playback duration of a single audio content cannot fill the time slot of the target topic, it will attempt to combine multiple audio contents matching the target topic to piece them together, making their total duration close to the playback duration of the target topic's theme audio. Furthermore, after recalling the audio content corresponding to each target topic within that content type, the recalled audio content corresponding to each target topic can be sorted and concatenated according to the priority of each target topic within that content type to obtain the audio content corresponding to that content type (i.e., the audio content recall result for that content type).
[0095] It should be noted that when the content type is music, in the process of recalling audio content based on the theme, it is also possible to further combine the current emotional state of the driver to recall audio content with emotional tone tags that match the emotional state, so that the recall results are more in line with the current emotional needs of the driver.
[0096] S403. Generate the first audio content sequence based on the audio content corresponding to each content type in the content type sequence.
[0097] In this embodiment, after generating audio content retrieval results for each content type, the content arrangement unit pre-arranges these retrieved audio content retrieval results according to the pre-defined order of the content type sequence to form a first audio content sequence. At this point, the first audio content sequence already possesses a content type structure that meets the user's personalized needs, topic relevance, and a duration distribution skeleton roughly aligned with its content type slots, laying the foundation for subsequent fine-tuning of duration and the generation of the final second audio content sequence.
[0098] By breaking down the total commute time into a series of content type slots with target playback durations as needed, and driving a precise recall process that matches the target playback duration, this application successfully transforms high-level content type allocation planning into specific, executable, and duration-measurable audio content recall and combination actions, constructing an initial content (first audio content sequence) skeleton that highly matches user needs in terms of content type structure, theme relevance, and duration distribution.
[0099] In the first audio content sequence generated in the above embodiments, abrupt auditory breaks occur when audio content of adjacent content types switches (e.g., a piece of music plays immediately after a news segment ends). To address this issue, a preferred embodiment of this application introduces an automatic transition content generation mechanism when generating the first audio content sequence. Specifically, Figure 5 This application provides a flowchart of a method for generating a first audio content sequence based on the audio content corresponding to each content type in a content type sequence. For example... Figure 5 As shown, the aforementioned step S403 can be specifically implemented as follows.
[0100] S501. Generate transition content between two adjacent content types based on the audio content corresponding to each of the two adjacent content types in the content type sequence. It should be noted that, in order to solve the problem of auditory discontinuity caused by switching between audio content of adjacent content types, the allocable content duration in the time slot division mechanism in step S401 above can be determined as the remaining duration after deducting the reserved time from the total commuting time. This will not be elaborated here.
[0101] Specifically, the content arrangement unit detects all content type pairs in the content type sequence (any two adjacent content types in the content type sequence constitute a content type pair). For each pair of adjacent content types, it extracts the first target information of the audio content corresponding to the previous content type and the second target information of the audio content corresponding to the next content type. This contextual information (first target information and second target information) is used as input and passed to a pre-trained transition language generation large language model. The model's task is to generate a short, natural, and conversational transitional text based on the provided contextual information; this text serves as the transitional content between the two content types in the content type pair.
[0102] In this embodiment, the first target information of the audio content corresponding to the previous content type indicates the audio name / summary of the previous content type and the last audio content in the previous content type. The second target information of the audio content corresponding to the next content type indicates the audio name / summary of the next content type and the first audio content in the next content type.
[0103] For example, taking a content type pair as an example, if the first target information is: Company A releases a new AI chip (news), and the second target information is: discussing the practical application of large-scale models (community article), then the transitional content between the two adjacent content types in the generated content type pair could be: Speaking of breakthroughs in AI chips, the practical application of large-scale models is also accelerating. Next, let's discuss this topic in more depth.
[0104] In this embodiment, the generation of transitional content aims to eliminate the abrupt transitions between different content types, achieving an effect similar to a professional radio host's segment transitions. Specifically, the transitional content between two adjacent content types in a content type pair is called transitional text, and the playback duration of the transitional text is the duration of the transitional phrase preset in step S401 above.
[0105] It should be noted that the playback duration of the transitional text is the estimated playback duration of the transitional text determined by combining the speech rate parameters of TTS (Text To Speech) technology.
[0106] S502. Generate the first audio content sequence based on the audio content corresponding to each content type in the content type sequence and the transition content between two adjacent content types.
[0107] In this embodiment, the final generated first audio content sequence is no longer a simple splicing of a series of isolated audio content of different content types, but a whole sequence with a coherent narrative flow composed of alternating audio content and transitional content. This significantly improves the listening experience in the in-vehicle scenario, fusing discrete audio content of different content types into a smooth whole.
[0108] After generating the first audio content sequence, although the playback duration of each content type is roughly close to its target playback duration, local deviations may still exist. To address this issue and achieve accurate matching with the total commute time, a preferred embodiment of this application provides a duration calibration mechanism, as detailed below. Figure 6 The flowchart illustrates a method for processing the audio content of a first audio content sequence based on the total commuting time to generate a second audio content sequence. Figure 6 As shown, the method includes: S601. For each content type in the first audio content sequence, if the playback duration of the audio content of that content type does not match the target playback duration, then determine that the content type as the target content type. In this application, for each content type in the first audio content sequence, the duration deviation between the playback duration of the audio content corresponding to that content type and the target playback duration allocated to it in step S401 is determined; if the duration deviation exceeds the preset target duration deviation, it is determined that the playback duration of the audio content corresponding to the target content type does not match the target playback duration of the target content type, and thus the content type is determined to be the target content type; if the duration deviation does not exceed the target duration deviation, it is determined that the playback duration of the audio content corresponding to the target content type matches the target playback duration of the target content type, and thus the content type is determined not to be the target content type.
[0109] For example, the target duration deviation can be 15 seconds, 30 seconds, 50 seconds, 1 minute, etc. The above are merely preferred examples of the target duration deviation provided in the embodiments of this application. Those skilled in the art can set the specific content of the target duration deviation according to their own needs, and it is not limited here.
[0110] S602. Based on the target playback duration of the target content type, the audio content corresponding to the target content type is processed to obtain the target audio content; the playback duration of the target audio content is matched with the target playback duration of the target content type.
[0111] In this embodiment, a refined content processing flow is initiated for the identified target content type. Only the audio content of the target content type in the first audio content sequence is processed to obtain the second audio content sequence, and the playback duration of the second audio content sequence matches the total commuting time. Taking a target content type in the first audio content sequence as an example, processing the audio content of that target content type in the first audio content sequence can obtain the target audio content of that target content type.
[0112] In this embodiment of the application, the process of processing the audio content in the first audio content sequence to generate the second audio content sequence does not require changing the entire first audio content sequence, but only processing the audio content of the target content type in the first audio content sequence. This targeted processing greatly reduces the computational overhead.
[0113] In this application, the audio content corresponding to the target content type is text. The target audio content is obtained by processing the audio content corresponding to the target content type based on the target playback duration of the target content type. This includes: adjusting the audio content at the word count level based on the semantics of the audio content corresponding to the target content type, with the target playback duration of the target content type as a constraint.
[0114] In this embodiment of the application, the target audio content is obtained by adjusting the audio content at the word count level based on the semantics of the audio content corresponding to the target content type, constrained by the target playback duration of the target content type. This includes: compressing / expanding the audio content at the word count level based on the semantics of the audio content corresponding to the target content type, constrained by the target playback duration of the target content type, to obtain the target audio content.
[0115] For example, compression processing can be used to trim the summary, extract the core viewpoints and key arguments of the audio content, and remove redundant examples and details; expansion processing can be used to extend the topic, using the knowledge background of the audio content to generate in-depth analysis, background supplements or related topic expansions around the core ideas of the audio content, and use the extended content to semantically expand the audio content.
[0116] Specifically, when the audio content corresponding to the target content type is text-based, such as a press release, community article, or audiobook chapter, a semantic-based word count adjustment method can be used. The process is as follows: Using the target playback duration of the target content type as a strict constraint, the target word count is calculated based on the TTS (Text-to-Speech) rate parameters. Then, the audio content processing model is invoked, receiving the audio content corresponding to the target content type and the target word count as input. Based on understanding the textual semantics of the audio content, the model performs intelligent operations: if the textual word count of the audio content exceeds the target word count, word-level compression is performed according to the audio content semantics to generate target audio content that meets the target word count; if the textual word count of the audio content does not reach the target word count, word-level expansion is performed according to the audio content semantics to generate target audio content that meets the target word count; where the textual word count of the target audio content is the target word count.
[0117] The target audio content, obtained after processing by the audio content processing model, can be synthesized into audio by a TTS engine. Furthermore, this embodiment can also execute a duration calibration closed-loop step, which includes: detecting the duration deviation between the playback duration of the TTS-synthesized audio and the target playback duration of the target content type; if the duration deviation does not exceed the preset target duration deviation, then the target audio content currently processed by the audio content processing model is determined as the final result; if the duration deviation exceeds the target duration deviation, then the number of words to be added or subtracted is calculated based on the duration deviation and fed back to the audio content processing model for processing (if the target audio content is too long, further semantic compression is performed to appropriately simplify it; if the target audio content is too short, further semantic expansion is performed to appropriately supplement details). After processing, the audio content processing model returns to execute the duration calibration closed-loop step. Furthermore, to save processing time, the number of times the duration calibration closed-loop step is repeated can be set. If the duration deviation still exceeds the target duration deviation after the third execution of the duration calibration closed-loop step, the target audio content currently processed by the audio content processing model can be forcibly determined as the final result.
[0118] In this embodiment of the application, the target audio content is obtained by adjusting the audio content at the word count level based on the semantics of the audio content corresponding to the target content type, constrained by the target playback duration of the target content type. This includes: adjusting the audio content of the target audio at the word count level based on the semantics of the audio content of the target audio in each audio corresponding to the target content type, constrained by the target playback duration of the target content type, to obtain the target audio content corresponding to the target audio content type.
[0119] After adjusting the audio content corresponding to the target audio within the audio content corresponding to the target content type, the target audio content corresponding to the target content type can be obtained. The target audio is one or more audios among the various audios corresponding to the target content type. Therefore, by processing a portion of the audio (target audio) among the various audios corresponding to the target content type, the playback duration of the adjusted target audio content corresponding to the target content type can be matched with the target playback duration of the target content type. It is not necessary to process the audio content of all audios corresponding to the target content type, thereby reducing the amount of audio content to be adjusted and making the audio content in the generated second audio content sequence more realistic and accurate.
[0120] This semantic-based word-level adjustment method can change the playback duration while preserving the integrity of the core information of the audio content and the logical coherence of the narrative to the greatest extent, thus achieving precise control over the playback duration.
[0121] In this embodiment of the application, the audio content corresponding to the target content type is the original audio file. The target audio content is obtained by processing the audio content corresponding to the target content type based on the target playback duration of the target content type. This includes: trimming the audio content corresponding to the target content type based on the target playback duration of the target content type to obtain the target audio content.
[0122] Optionally, when the audio content corresponding to the target content type is the original audio file, such as the original audio file of a song, it cannot be reconstructed through semantic understanding. In this regard, embodiments of this application employ a direct adaptation strategy of physical trimming, specifically, using the target playback duration of the target content type as a constraint, directly trimming the original audio file corresponding to the target content type.
[0123] For example, if the target content type is music, and the playback duration of the audio content corresponding to the target content type exceeds the target playback duration of the target content type, then the audio content is trimmed at the target position (i.e., a fade-out cutoff is performed) to ensure that the playback duration of the retained audio content matches the target playback duration of the target content type. If the playback duration of the audio content corresponding to the target content type does not reach the target playback duration of the target content type, then a matching track is retrieved from the audio content pool to supplement the remaining duration, thereby ensuring that the audio content corresponding to the target content type matches the target playback duration of the target content type. Furthermore, if the playback duration of the retrieved track exceeds the remaining duration, the track can be trimmed first so that the playback duration of the retained audio content in the track equals the remaining duration, and then the retained audio content in the track can be used to supplement the remaining duration, thereby ensuring that the playback duration of the audio content corresponding to the target content type matches the target playback duration of the target content type.
[0124] It should be noted that if the audio content corresponding to the target content type is text, then the playback duration of the audio content corresponding to the target content type is the estimated playback duration of the audio content corresponding to the target content type, determined by combining the speech rate parameters of the TTS; if the audio content corresponding to the target content type is the original audio file, then the playback duration of the audio content corresponding to the target content type is the playback duration of the original audio file corresponding to the target content type.
[0125] Through the differentiated and flexible processing mechanism described above for audio content stored in text form and audio content stored in the original audio file, the embodiments of this application can comprehensively and flexibly cope with the duration deviation of various content types, and ultimately ensure that the generated second audio content sequence can strictly meet the precise alignment between the playback duration and the total commuting time.
[0126] After the second audio content sequence is generated and playback begins in the above embodiments, since the in-vehicle commuting scenario is dynamically changing, this application also provides a flowchart of a method for adaptive adjustment of the second audio content sequence. Please refer to the flowchart for details. Figure 7 .like Figure 7 As shown, the method includes: S701. During the playback of the second audio content sequence, determine whether a triggering event exists. The triggering event is used to trigger the update of the current second audio content sequence. If a triggering event exists, proceed to step S702. In this embodiment of the application, the triggering event includes at least one of a first triggering event and a second triggering event, wherein: the triggering condition of the first triggering event includes receiving an interest change signal sent by the user; the triggering condition of the second triggering event includes the duration deviation between the remaining commuting time of the current vehicle commute and the remaining playback time of the current second audio content sequence exceeding a preset duration deviation threshold.
[0127] During the playback of the second audio content sequence in the vehicle, the playback adjustment unit continuously monitors multiple signal sources to determine if any triggering events are present. These triggering events are used to initiate an update operation on the current second audio content sequence. The sources of these triggering events may include: a first triggering event (commuting time change event) determined and pushed in real-time / according to a pre-set time period by the commuting time estimation unit during the dynamic correction phase; and a second triggering event (interest change signal) identified and pushed by the interaction feedback unit via voice or touch input from the user.
[0128] In this embodiment of the application, if an interest change signal sent by a user is received, it indicates that the triggering condition of the first triggering event is met, and it is determined that the first triggering event exists.
[0129] In this embodiment, the method by which the commuting time estimation unit determines and pushes the commuting time change event includes: determining whether a commuting time change event currently exists; if so, pushing the commuting time change event to the playback adjustment unit. If the duration deviation between the remaining commuting time of the current vehicle commuting and the remaining playback time of the current second audio content sequence exceeds a preset duration deviation threshold, it indicates that the triggering condition of the second triggering event is met, and it is determined that the second triggering event exists; if the duration deviation between the remaining commuting time of the current vehicle commuting and the remaining playback time of the current second audio content sequence does not exceed the preset duration deviation threshold, it indicates that the triggering condition of the second triggering event is not met, and it is determined that the second triggering event does not exist; wherein, the second triggering event is a commuting time change event.
[0130] In this embodiment of the application, the remaining commuting time for the current vehicle commute is calculated as follows: T_remain = T_nav_remain × (1 + δ_traffic + δ_speed) in: T_remain represents the remaining commute time for the current vehicle commute, T_nav_remain represents the estimated remaining time for navigation by the navigation system, δ_traffic represents the correction coefficient based on the real-time traffic flow rate change rate of the road segment ahead, and δ_speed represents the correction coefficient based on the deviation between the current actual vehicle speed and the historical average speed of the road segment.
[0131] For example, the duration deviation threshold is 3 minutes, 5 minutes, etc., and this application embodiment does not limit it. Taking a duration deviation threshold of 5 minutes as an example, if the duration deviation between the current remaining commuting time and the remaining playback time of the current second audio content sequence exceeds the preset duration deviation threshold (5 minutes), it is determined that there is a commuting time change event and it is pushed to the playback adjustment unit.
[0132] Furthermore, in this embodiment of the application, if there is no triggering event, it is determined that no update operation will be performed on the current second audio content sequence.
[0133] S702. Determine the target triggering event from the currently existing triggering events; the target triggering event is the triggering event with the highest priority. In this embodiment, if multiple triggering events exist simultaneously, the playback adjustment unit will initiate a priority arbitration mechanism. This mechanism presets priorities for different event types; for example, it sets the first triggering event as high priority and the second triggering event as low priority. The playback adjustment unit will iterate through all current triggering events and determine the event with the highest priority as the target triggering event.
[0134] The above is merely a preferred setting method for the priority of triggering events provided by the embodiments of this application. Those skilled in the art can set the priority between different triggering events according to their own needs (for example, setting the priority of the second triggering event to be higher than the priority of the first triggering event). The embodiments of this application do not limit this.
[0135] S703. Based on the audio content adjustment strategy corresponding to the target trigger event, update the audio content in the current second audio content sequence to obtain the updated second audio content sequence; the remaining playback time of the updated second audio content sequence matches the remaining commuting time of the current vehicle commute.
[0136] In this embodiment of the application, after determining the target triggering event, the playback adjustment unit will query a preset adjustment strategy mapping table and retrieve the audio content adjustment strategy corresponding to the target triggering event.
[0137] For example, if the target triggering event is the second triggering event and the second triggering event represents an extension of the remaining commuting time of the current in-vehicle commute (the remaining commuting time of the current in-vehicle commute is longer than the remaining playback time of the current second audio content sequence), the corresponding adjustment strategies include: semantically expanding the unplayed audio content in the current second audio content sequence to generate extended content to increase the playback time of the unplayed audio content in the current second audio content sequence, and adding one or more user-preferred music to the end of the current second audio content sequence.
[0138] If the target triggering event is the second triggering event and the second triggering event represents a reduction in the remaining commuting time of the current vehicle commute (the remaining commuting time of the current vehicle commute is less than the remaining playback time of the current second audio content sequence), the corresponding adjustment strategies include: semantically compressing the text content in the unplayed audio content of the current second audio content sequence to reduce the playback time of the unplayed audio content in the current second audio content sequence, and skipping (deleting) one or more low-priority audio content segments from the end of the current second audio content sequence.
[0139] If the target triggering event is the first triggering event and the interest shift signal represents an extension instruction, the corresponding adjustment strategy includes: semantically extending the currently playing audio content segment in the current second audio content sequence to generate extended content, and pruning the unplayed audio content in the current second audio content sequence (e.g., semantically compressing textual content in the unplayed audio content, or skipping low-priority audio content segments from the end of the current second audio content sequence). Preferably, the extended content is inserted at the end of the currently playing audio content segment. That is, the extended content is inserted between the currently playing audio content segment and the next adjacent audio content segment.
[0140] In this embodiment of the application, when the target triggering event is the first triggering event and the interest change signal indicates that the user is not interested in the currently playing audio, the method further includes: controlling the playback position of the current second audio content sequence to switch to the target playback position; the target playback position indicates the audio of interest to the user after the playback position of the current second audio content sequence.
[0141] For example, the target playback position indicates the next audio content segment adjacent to the audio content segment to which the current playback position of the second audio content sequence belongs; or, the target playback position indicates the first audio content segment in the next topic adjacent to the theme to which the current playback position of the second audio content sequence belongs; or, the target playback position indicates the first audio content segment in the next content type adjacent to the content type to which the current playback position of the second audio content sequence belongs.
[0142] In this embodiment of the application, if the target triggering event is a first triggering event, the currently received interest change signal indicates that the user is not interested in the currently playing audio, and no more than two interest change signals indicating that the user is not interested in the currently playing audio are received consecutively within a preset time period, the target playback position indicates the next audio content segment adjacent to the audio content segment to which the playback position of the current second audio content sequence belongs.
[0143] In this embodiment of the application, if the target triggering event is a first triggering event, the currently received interest change signal indicates that the user is not interested in the currently playing audio, and at least two interest change signals indicating that the user is not interested in the currently playing audio are received continuously within a preset time period, the target playback position indicates the first audio content segment in the next topic adjacent to the topic to which the playback position of the current second audio content sequence belongs; or, the target playback position indicates the first audio content segment in the next content type adjacent to the content type to which the playback position of the current second audio content sequence belongs.
[0144] The above is merely a preferred setting method for the target playback position provided in the embodiments of this application. Those skilled in the art can set the specific setting method for the target playback position according to their own needs, and it is not limited here.
[0145] Since the playback position of the current second audio content sequence has been switched to the target playback position, the remaining playback time in the second audio content sequence will inevitably be shortened. Therefore, after switching the playback position of the current second audio content to the target playback position, it is necessary to further adjust the audio content in the current second audio content sequence according to the audio content adjustment strategy corresponding to the target triggering event, and obtain the updated second audio content sequence.
[0146] When the target triggering event is the first triggering event and the interest change signal indicates that the user is not interested in the currently playing audio, the corresponding content adjustment strategies include: semantically expanding the unplayed audio content in the current second audio content sequence to generate extended content to increase the playback duration of the unplayed audio content in the current second audio content sequence, and adding user-preferred music to fill the end of the current second audio content sequence, or one or more of these strategies.
[0147] In this embodiment of the application, if the interest change signal represents a switching instruction, it can be considered that the interest change signal represents that the user is not interested in the currently playing audio.
[0148] By clearly defining the two core triggering events, the system incorporates two main dynamic disturbance factors—user subjective intent and changes in the objective environment—into its automatic perception and response range, providing clear and detectable activation conditions for the dynamic adjustment mechanism.
[0149] In this embodiment, the playback adjustment unit strictly follows the determined audio content adjustment strategy to update the audio content in the current second audio content sequence, thereby obtaining the updated second audio content sequence. The key to this update process is that it is dynamically completed during the playback of the second audio content sequence, and the remaining playback time of the updated second audio content sequence will re-match the remaining commuting time of the current vehicle commute.
[0150] This closed-loop adjustment mechanism, which includes trigger detection, multi-event priority arbitration, policy mapping, and content updates, empowers the system to dynamically perceive and respond in real time to changes in the real-time in-vehicle commuting scenario during audio playback, ensuring that the in-vehicle audio service remains continuously adapted to the ever-changing real-time in-vehicle commuting scenario.
[0151] Furthermore, in typical scenarios involving driving safety, this application embodiment also provides a driving safety response mechanism, which includes: pausing the playback of the second audio content sequence in response to the occurrence of a driving safety event; and resuming the playback of the second audio content sequence in response to the resolution of the driving safety event.
[0152] In this embodiment, when the playback adjustment unit receives a signal from the ADAS / DMS system indicating a driving safety event, it immediately executes the highest priority intervention strategy. This intervention strategy includes immediately pausing the playback of the currently playing second audio content sequence in response to the driving safety event. For example, when complex road conditions or an emergency are detected, the audio can be instantly muted to reduce interference with the driver's attention and ensure driving safety. Subsequently, when the playback adjustment unit receives a signal that the driving safety event has been resolved, it responds to this signal and seamlessly resumes playback of the corresponding second audio content sequence from its state before the pause.
[0153] For example, the signal indicating that a driving safety incident has been resolved can originate from various scenarios: For instance, after a vehicle safely passes through a complex intersection, the ADAS system sends a signal to the playback adjustment unit that the road conditions have returned to normal; or the driver monitoring system detects that the driver's attention has returned to focus and the fatigue level has dropped to a normal level and sends a signal indicating that the safety status has been restored; or the navigation system indicates that the accident scene ahead has been cleared and traffic flow has returned to normal; or after the vehicle completes an emergency avoidance maneuver, the CAN bus reports that the vehicle stability system has returned to normal, etc. This pause-and-resume mechanism achieves an optimal balance between driving safety and the infotainment experience.
[0154] It is important to note that after a driving safety incident is resolved and playback resumes, the vehicle's driving status may have changed during the pause (e.g., distance shortened, traffic conditions updated). The commuting time estimation unit will typically recalculate the remaining commuting time, potentially triggering a commuting time change event. This event, as a new trigger, will be processed by the playback adjustment unit according to the aforementioned priority arbitration mechanism. The unit will then dynamically update the second audio content sequence after playback resumes based on the corresponding audio content adjustment strategy, ensuring that the remaining playback time of the second audio content sequence accurately matches the new remaining commuting time. This continuous closed-loop design of pause-resume-update achieves an optimal balance between driving safety and infotainment experience, while ensuring continuous adaptability of the audio service throughout the entire commute.
[0155] In order to maintain a smooth listening experience in all dynamic adjustment operations and avoid causing auditory interruption to the user, a preferred embodiment of this application limits the audio content update operation to only the audio content to be played in the current second audio content sequence.
[0156] In this embodiment of the application, the audio content in the current second audio content sequence is updated according to the audio content adjustment strategy corresponding to the target triggering event to obtain the updated second audio content sequence. This includes: processing the audio content of the audio content subsequence in the current second audio content sequence according to the audio content adjustment strategy corresponding to the target triggering event to obtain the updated second audio content sequence; wherein, the audio content subsequence includes the next audio adjacent to the audio to which the playback position of the current second audio content sequence belongs to the end of the current second audio content sequence.
[0157] When updating the audio content in the current second audio content sequence, the operation scope of the playback adjustment unit is strictly limited to a subsequence of audio content within the current second audio content sequence. This subsequence begins at the next adjacent audio element of the audio element at the current playback position in the second audio content sequence and ends at the end of the current second audio content sequence.
[0158] It should be noted that once the playback position is switched to the target playback position in response to the first triggering event (change in user interest), the target playback position becomes the new current playback position. The starting point of any subsequent update operation involving the audio content subsequence is determined based on this new playback position.
[0159] In this embodiment, no matter what complex expansion, compression, or trimming operations are performed, the audio content segment that the user is currently listening to will never be interrupted, sped up, or skipped. This seamless hot-replacement mechanism ensures that the dynamic adjustment process of the second audio content sequence is imperceptible and smooth to the user.
[0160] This application provides a method for generating in-vehicle audio content, including: responding to a user's in-vehicle commuting trigger operation; estimating the total commuting time based on navigation route information; determining a first audio content sequence based on the user's audio preferences and the current in-vehicle commuting scenario; the first audio content sequence consisting of at least one audio file; processing the audio content of the audio files in the first audio content sequence based on the total commuting time to generate a second audio content sequence; the playback duration of the second audio content sequence differs from the playback duration of the first audio content sequence, and the playback duration of the second audio content sequence matches the total commuting time. This application can dynamically generate a second audio content sequence that precisely matches the total commuting time in actual in-vehicle commuting scenarios, effectively avoiding playback experience interruptions such as "arrival before content completion" or "no content remaining during commuting," thus improving the user's in-vehicle audio service experience.
[0161] Exemplary device Accordingly, this application also provides an in-vehicle audio content generation device.
[0162] Please see Figure 8 In one exemplary embodiment, an in-vehicle audio content generation device 800 is provided, the in-vehicle audio content generation device 800 including: The total commute time estimation unit 801 is used to respond to the user's in-vehicle commute trigger operation and estimate the total commute time based on the navigation route information of the in-vehicle commute. The first audio content sequence generation unit 802 is used to determine the first audio content sequence based on the user's audio preference information and the current in-vehicle commuting scenario information; the first audio content sequence consists of the audio content of at least one audio file. The second audio content sequence generation unit 803 is used to process the audio content of the audio in the first audio content sequence based on the total commuting time to generate a second audio content sequence; the playback duration of the second audio content sequence is different from the playback duration of the first audio content sequence and the playback duration of the second audio content sequence matches the total commuting time.
[0163] In one possible implementation, the first audio content sequence generation unit includes: The audio demand perception information determination unit is used to determine the user's audio demand perception information based on the user's audio preference information and the current in-vehicle commuting scenario information. The first audio content sequence generation subunit is used to obtain the first audio content sequence for in-vehicle commuting from the audio content pool based on the total commuting time and audio demand perception information.
[0164] In one possible implementation, the audio demand perception information includes at least one of a first information, a second information, and a third information; the first information represents the audio allocation of at least one content type; the second information represents the topic priority among various topics under the content type; and the third information represents the audio playback constraints for in-vehicle commuting.
[0165] In one possible implementation, the first audio content sequence generation subunit includes: The information determination unit is used to determine the content type sequence of in-vehicle commuting and the target playback duration of each content type in the content type sequence based on the total commuting time and audio demand perception information; the content type sequence consists of at least one content type. The information recall unit is used to recall audio content corresponding to at least one audio from the audio content pool based on the theme priority of the content type, with the goal that the playback duration of the audio content recall result of the content type is close to the target playback duration of the content type. The content generation unit is used to generate the first audio content sequence based on the audio content corresponding to each content type in the content type sequence.
[0166] In one possible implementation, the content generation unit includes: The first generation unit is used to generate transition content between two adjacent content types based on the audio content corresponding to each of the two adjacent content types in the content type sequence. The second generation unit is used to generate the first audio content sequence based on the audio content corresponding to each content type in the content type sequence and the transition content between two adjacent content types.
[0167] In one possible implementation, the second audio content sequence generation unit includes: The target content type determination unit is used to determine the content type as the target content type if the playback duration of the audio content of the content type does not match the target playback duration for each content type in the first audio content sequence. The target audio content determination unit is used to process the audio content corresponding to the target content type based on the target playback duration of the target content type to obtain the target audio content; the playback duration of the target audio content is matched with the target playback duration of the target content type.
[0168] In one possible implementation, the audio content corresponding to the target content type is text, and the target audio content determination unit is specifically used to: adjust the audio content at the word count level based on the semantics of the audio content corresponding to the target content type, with the target playback duration of the target content type as a constraint, to obtain the target audio content.
[0169] In one possible implementation, the audio content corresponding to the target content type is the original audio file, and the target audio content determination unit is specifically used to: trim the audio content corresponding to the target content type to obtain the target audio content, based on the target playback duration of the target content type.
[0170] In one possible implementation, a second audio content sequence update unit is also included, which includes: The trigger event determination unit is used to determine whether a trigger event exists during the playback of the second audio content sequence; the trigger event is used to trigger an update of the current second audio content sequence. The target triggering event determination unit is used to determine the target triggering event from the existing triggering events if there are currently existing triggering events; the target triggering event is the triggering event with the highest priority. The update unit is used to adjust the strategy according to the audio content corresponding to the target trigger event, update the audio content in the current second audio content sequence, and obtain the updated second audio content sequence; the remaining playback time of the updated second audio content sequence is matched with the remaining commuting time of the current vehicle commute.
[0171] In one possible implementation, the triggering event includes at least one of a first triggering event and a second triggering event, wherein: the triggering condition of the first triggering event includes receiving an interest change signal sent by the user; the triggering condition of the second triggering event includes the duration deviation between the remaining commuting time of the current vehicle commute and the remaining playback time of the current second audio content sequence exceeding a preset duration deviation threshold.
[0172] In one possible implementation, when the target triggering event is the first triggering event and the interest change signal indicates that the user is not interested in the currently playing audio, the device further includes: a playback position switching unit, used to control the playback position of the current second audio content sequence to switch to the target playback position; the target playback position indicates the audio of interest to the user after the playback position of the current second audio content sequence.
[0173] In one possible implementation, the device further includes: The first control unit is used to pause the playback of the second audio content sequence in response to a driving safety incident. The second control unit is used to respond to the resolution of a driving safety event and resume playback of the second audio content sequence.
[0174] In one possible implementation, the update unit is specifically used to: adjust the audio content of the audio content subsequence in the current second audio content sequence according to the audio content adjustment strategy corresponding to the target triggering event, and obtain the updated second audio content sequence. The audio content subsequence includes the next audio adjacent to the current playback position of the second audio content sequence up to the end of the current second audio content sequence.
[0175] The in-vehicle audio content generation device 800 provided in this embodiment belongs to the same application concept as the in-vehicle audio content generation method provided in the above embodiments of this application. It can execute the in-vehicle audio content generation method provided in any of the above embodiments of this application and has the corresponding functional modules and beneficial effects of executing the in-vehicle audio content generation method. Technical details not described in detail in this embodiment can be found in the corresponding method embodiments of this application, and will not be repeated here.
[0176] The functions implemented by each unit in the above device can be implemented by the same or different processors, and this application embodiment does not limit this.
[0177] It should be understood that the units in the above device can be implemented by a processor calling software. For example, the device includes a processor connected to a memory containing instructions. The processor calls the instructions stored in the memory to implement any of the above methods or to implement the functions of each unit in the device. The processor can be a general-purpose processor, such as a CPU or microprocessor, and the memory can be internal or external to the device. Alternatively, the units in the device can be implemented as hardware circuits. By designing the hardware circuits, some or all of the unit functions can be implemented. The hardware circuits can be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units are implemented by designing the logical relationships between the components within the circuit. In another implementation, the hardware circuit can be implemented using a PLD, such as an FPGA, which can include a large number of logic gates. The connection relationships between the logic gates are configured through configuration files to implement the functions of some or all of the above units. All units in the above device can be implemented entirely by a processor calling software, entirely by hardware circuits, or partially by a processor calling software with the remaining parts implemented by hardware circuits.
[0178] In this application embodiment, a processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a CPU, microprocessor, GPU, or DSP. In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships are fixed or reconfigurable. For example, the processor may be a hardware circuit implemented as an ASIC or PLD, such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the processor loading instructions to implement the functions of some or all of the above units. Furthermore, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as an NPU, TPU, or DPU.
[0179] As can be seen, each unit in the above device can be one or more processors (or processing circuits) configured to implement the above methods, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.
[0180] Furthermore, the units in the above devices can be integrated in whole or in part, or they can be implemented independently. In one implementation, these units are integrated together and implemented in the form of a System-on-Chip (SoC). The SoC may include at least one processor for implementing any of the above methods or implementing the functions of the units in the device. The at least one processor may be of different types, such as CPU and FPGA, CPU and artificial intelligence processor, CPU and GPU, etc.
[0181] Exemplary electronic devices Another embodiment of this application also proposes an electronic device. See [link to relevant documentation]. Figure 9 As shown, the electronic device may include: a memory 900 and a processor 910; wherein the memory 900 is connected to the processor 910 and is used to store programs; the processor 910 is used to implement the in-vehicle audio content generation method disclosed in any of the above embodiments by running the programs stored in the memory 900.
[0182] Specifically, the aforementioned electronic device may also include: a bus, a communication interface 920, an input device 930, and an output device 940.
[0183] The processor 910, memory 900, communication interface 920, input device 930, and output device 940 are interconnected via a bus. Among them: A bus can include a pathway for transmitting information between various components of a computer system.
[0184] The processor 910 can be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, etc., or an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of the program of the present application. It can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.
[0185] The processor 910 may include a main processor, as well as a baseband chip, modem, etc.
[0186] The memory 900 stores a program that executes the technical solution of this application, and may also store an operating system and other critical business functions. Specifically, the program may include program code, which includes computer operation instructions. More specifically, the memory 900 may include read-only memory (ROM), other types of static storage devices capable of storing static information and instructions, random access memory (RAM), other types of dynamic storage devices capable of storing information and instructions, disk storage, flash memory, etc.
[0187] Input device 930 may include a device for receiving user input data and information, such as a keyboard, mouse, camera, scanner, light pen, voice input device, touch screen, pedometer, or gravity sensor.
[0188] Output device 940 may include devices that allow information to be output to a user, such as a display screen, printer, speaker, etc.
[0189] The communication interface 920 may include a device that uses any transceiver to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Network (WLAN), etc.
[0190] The processor 910 executes the program stored in the memory 900 and calls other devices, and can be used to implement each step of any of the in-vehicle audio content generation methods provided in the above embodiments of this application.
[0191] This application also proposes a chip, which includes a processor and a data interface. The processor reads and runs a program stored in the memory through the data interface to execute any of the in-vehicle audio content generation methods provided in the above embodiments. For the specific processing procedure and its beneficial effects, please refer to the above-described embodiments of the in-vehicle audio content generation method.
[0192] Exemplary computer program products and storage media In addition to the methods and devices described above, embodiments of this application may also be computer program products, which include computer program instructions that, when executed by a processor, cause the processor to perform the steps in the in-vehicle audio content generation method according to various embodiments of this application as described in any of the above embodiments of this specification.
[0193] The computer program product can be written in any combination of one or more programming languages to perform the operations of the embodiments of this application. The programming languages include object-oriented programming languages such as Java and C++, as well as conventional procedural programming languages such as C or similar languages. The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.
[0194] Furthermore, embodiments of this application may also be storage media storing a computer program, which is executed by a processor in accordance with the steps of the in-vehicle audio content generation method according to various embodiments of this application as described in any of the foregoing embodiments of this specification.
[0195] For the foregoing method embodiments, in order to simplify the description, they are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, because according to this application, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0196] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For apparatus embodiments, since they are basically similar to method embodiments, the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.
[0197] The steps in the methods of the various embodiments of this application can be adjusted, merged, or deleted in order according to actual needs, and the technical features described in each embodiment can be replaced or combined.
[0198] The modules and sub-modules in the apparatus and terminal in the various embodiments of this application can be merged, divided, and deleted according to actual needs.
[0199] It should be understood that the disclosed terminals, devices, and methods can be implemented in other ways, given the several embodiments provided in this application. For example, the terminal embodiments described above are merely illustrative. For instance, the division of modules or sub-modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple sub-modules or modules may be combined or integrated into another module, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or modules, and may be electrical, mechanical, or other forms.
[0200] The modules or submodules described as separate components may or may not be physically separate. The components that constitute a module or submodule may or may not be physical modules or submodules; that is, they may be located in one place or distributed across multiple network modules or submodules. Some or all of the modules or submodules can be selected to achieve the purpose of this embodiment's solution, depending on actual needs.
[0201] Furthermore, the functional modules or sub-modules in the various embodiments of this application can be integrated into one processing module, or each module or sub-module can exist physically separately, or two or more modules or sub-modules can be integrated into one module. The integrated modules or sub-modules described above can be implemented in hardware or in the form of software functional modules or sub-modules.
[0202] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0203] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software unit executed by a processor, or a combination of both. The software unit can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.
[0204] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0205] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A method for generating in-vehicle audio content, characterized in that, include: In response to the user's in-vehicle commuting trigger operation, the total commuting time of the in-vehicle commuting is estimated based on the navigation route information of the in-vehicle commuting. A first audio content sequence is determined based on the user's audio preference information and the current in-vehicle commuting scenario information; the first audio content sequence consists of the audio content of at least one audio file. Based on the total commuting time, the audio content of the audio in the first audio content sequence is processed to generate a second audio content sequence; the playback duration of the second audio content sequence is different from the playback duration of the first audio content sequence, and the playback duration of the second audio content sequence matches the total commuting time.
2. The method according to claim 1, characterized in that, The step of determining the first audio content sequence based on the user's audio preference information and the current in-vehicle commuting scenario information includes: Based on the user's audio preference information and the current in-vehicle commuting scenario information, determine the user's audio demand perception information; Based on the total commuting time and the audio demand perception information, the first audio content sequence for the in-vehicle commuting is obtained from the audio content pool.
3. The method according to claim 2, characterized in that, The audio demand perception information includes at least one of the first information, the second information, and the third information; The first information represents the audio ratio of at least one content type; The second information represents the topic priority among the various topics under the content type; The third piece of information represents the audio playback constraints for the in-vehicle commuting.
4. The method according to claim 3, characterized in that, The step of obtaining the first audio content sequence for in-vehicle commuting from the audio content pool based on the total commuting time and the audio demand perception information includes: The content type sequence for in-vehicle commuting and the target playback duration for each content type in the content type sequence are determined based on the total commuting time and the audio demand perception information; the content type sequence is composed of at least one content type. With the goal of the playback duration of the audio content recall result of the content type approaching the target playback duration of the content type, audio content of at least one audio corresponding to the content type is recalled from the audio content pool according to the topic priority of the content type. A first audio content sequence is generated based on the audio content corresponding to each content type in the content type sequence.
5. The method according to claim 4, characterized in that, The step of generating a first audio content sequence based on the audio content corresponding to each content type in the content type sequence includes: Based on the audio content corresponding to each of the two adjacent content types in the content type sequence, generate transition content between the two adjacent content types; A first audio content sequence is generated based on the audio content corresponding to each content type in the content type sequence and the transition content between two adjacent content types.
6. The method according to claim 4, characterized in that, The step of processing the audio content of the first audio content sequence based on the total commuting time to generate the second audio content sequence includes: For each content type in the first audio content sequence, if the playback duration of the audio content of that content type does not match the target playback duration, then that content type is determined to be the target content type. The target audio content is obtained by processing the audio content corresponding to the target content type based on the target playback duration of the target content type; the playback duration of the target audio content is matched with the target playback duration of the target content type.
7. The method according to claim 6, characterized in that, The audio content corresponding to the target content type is text. The process of processing the audio content corresponding to the target content type based on the target playback duration to obtain the target audio content includes: The target audio content is obtained by adjusting the word count level of the audio content based on the semantics of the audio content corresponding to the target content type, with the target playback duration as a constraint.
8. The method according to claim 6, characterized in that, The audio content corresponding to the target content type is the original audio file. The process of processing the audio content corresponding to the target content type based on the target playback duration of the target content type to obtain the target audio content includes: The target audio content is obtained by trimming the audio content corresponding to the target content type, with the target playback duration as a constraint.
9. The method according to any one of claims 1-8, characterized in that, Also includes: During the playback of the second audio content sequence, determine whether a triggering event exists; The triggering event is used to trigger an update of the current second audio content sequence; If the triggering event currently exists, determine the target triggering event from among the currently existing triggering events; The target triggering event is the triggering event with the highest priority; According to the audio content adjustment strategy corresponding to the target triggering event, the audio content in the current second audio content sequence is updated to obtain the updated second audio content sequence; the remaining playback time of the updated second audio content sequence is matched with the remaining commuting time of the current vehicle commuting.
10. The method according to claim 9, characterized in that, The triggering event includes at least one of a first triggering event and a second triggering event, wherein: The triggering condition for the first triggering event includes receiving an interest change signal from the user; The triggering condition for the second triggering event includes the duration deviation between the remaining commuting time of the current vehicle commute and the remaining playback time of the current second audio content sequence exceeding a preset duration deviation threshold.
11. The method according to claim 10, characterized in that, When the target triggering event is the first triggering event and the interest shift signal indicates that the user is not interested in the currently playing audio, the method further includes: The playback position of the current second audio content sequence is switched to the target playback position; the target playback position indicates the audio of interest to the user after the current playback position of the second audio content sequence.
12. The method according to claim 9, characterized in that, Also includes: In response to a driving safety incident, playback of the second audio content sequence is paused; Once the driving safety incident is resolved, the second audio content sequence resumes playback.
13. The method according to claim 9, characterized in that, The step of updating the audio content in the current second audio content sequence according to the audio content adjustment strategy corresponding to the target triggering event to obtain the updated second audio content sequence includes: Based on the audio content adjustment strategy corresponding to the target triggering event, the audio content of the audio content subsequence in the current second audio content sequence is processed to obtain the updated second audio content sequence; The audio content subsequence includes the next audio adjacent to the current playback position of the second audio content sequence up to the end of the current second audio content sequence.
14. An electronic device, characterized in that, Including memory and processor; The memory is connected to the processor and is used to store programs; The processor is used to implement the in-vehicle audio content generation method as described in any one of claims 1 to 13 by running a program in the memory.
15. A computer program product, characterized in that, The system includes a computer program that, when executed by a processor, implements the in-vehicle audio content generation method as described in any one of claims 1 to 13.