A process scheduling method and device for Android virtual machine audio

Abstract

The application provides a process scheduling method and device for Android virtual machine audio, when an application in an Android virtual machine triggers an audio playing behavior, an audio session and control information corresponding to the audio session are created, and a session identifier is allocated; a host-side audio session object corresponding to the audio session is established in a vehicle system; audio attribute information of the audio session is collected, and the host-side audio session object corresponding to the audio session is updated in attribute through the session identifier to obtain an updated host-side audio session object; the audio attribute information is subjected to audio importance evaluation processing to obtain an audio importance score, and an isolation constraint is set; the audio importance score and the isolation constraint are compared to determine a scheduling level and schedule a process associated with the audio session; and the stable playing of the audio application in the background in the Android virtual machine is ensured under the limitation of the limited resources of the vehicle system.

Description

Technical Field

[0001] This invention relates to the fields of vehicle infotainment systems and virtualization technology, and in particular to a process scheduling method and apparatus for audio in an Android virtual machine. Background Technology

[0002] With the development of smart cockpits, Android virtual machines are increasingly being introduced into in-vehicle infotainment systems to enrich their ecosystem. This allows users to directly install and use third-party or ecosystem applications on the vehicle's infotainment system. The Android virtual machine typically runs on top of the vehicle's host operating system, and its internal applications generate various audio content such as music, voice prompts, and alert sounds.

[0003] In existing technologies, in-vehicle infotainment systems typically schedule and control related processes based solely on whether audio is being played or a simple audio focus state. This approach has the following problems in virtualization scenarios: 1. The types and importance of audio within the Android virtual machine vary greatly, but they are difficult to distinguish on the host system side; 2. Simply relying on playback status can easily lead to non-critical audio consuming foreground scheduling resources; 3. When the host system itself contains critical audio such as navigation or telephone calls, virtual machine audio may interfere with the system's real-time performance. Summary of the Invention

[0004] This invention provides a process scheduling method and apparatus for audio in an Android virtual machine, the purpose of which is to ensure stable background playback of audio applications within the Android virtual machine under the constraints of limited resources in the vehicle infotainment system.

[0005] To achieve the above objectives, this invention provides a process scheduling method for Android virtual machine audio, applied to an in-vehicle infotainment system, comprising: Step 1: When an application in the Android virtual machine triggers audio playback, an audio session and corresponding control information are created in the Android virtual machine, and a session identifier is assigned to the audio session. Step 2: After the vehicle system receives the control information, it establishes a host-side audio session object corresponding to the audio session. Step 3: During audio playback, collect audio attribute information of the audio session, and when the audio attribute information changes, update the attributes of the host-side audio session object corresponding to the audio session through the session identifier to obtain the updated host-side audio session object. Step 4: Based on the multi-dimensional audio features during audio playback, perform audio importance assessment on the audio attribute information to obtain an audio importance score, and set isolation constraints. Step 5: Compare the audio importance score and isolation constraints, and determine the scheduling level based on the comparison results to schedule and control the processes associated with the audio session.

[0006] Furthermore, the vehicle's infotainment system receives control information corresponding to the audio session through a virtual audio interface.

[0007] Furthermore, the audio attribute information includes at least one of the following: audio purpose attribute, audio focus attribute, audio concurrency attribute, audio persistence attribute, and audio perceived intensity attribute.

[0008] Furthermore, before performing audio importance assessment on audio attribute information based on multi-dimensional audio features during audio playback, the process also includes: The audio attribute information is preprocessed to obtain the preprocessed audio attribute information.

[0009] Furthermore, based on the multi-dimensional audio features during audio playback, audio attribute information is processed to evaluate audio importance, resulting in an audio importance score, including: Extracting multidimensional audio features during audio playback; Select a set of weighted parameters based on the audio's intended use; The initial importance of the audio session is calculated by weighting and combining the audio usage attribute and / or audio focus attribute and / or audio concurrency attribute and / or audio persistence attribute and / or audio perceived intensity attribute according to the set of weight parameters. The initial importance results are smoothed over time to generate an audio importance score.

[0010] Furthermore, after performing time smoothing on the initial importance results, the calculation expression for the audio importance score is as follows: ; in, express Audio importance score for each moment Represents the smoothing coefficient. express The initial importance result at each moment.

[0011] Furthermore, the isolation constraints include setting a preset importance score threshold, introducing a decay factor for the audio importance score, and scaling the weight parameters involved in the calculation as a whole.

[0012] This invention also provides a process scheduling device for Android virtual machine audio, applied to an in-vehicle infotainment system, comprising: The module is used to create an audio session and corresponding control information within the Android virtual machine when an application within the Android virtual machine triggers audio playback behavior, and to assign a session identifier to the audio session. The module is used to establish a host-side audio session object corresponding to the audio session after the vehicle system receives control information; The update module is used to collect audio attribute information of the audio session during audio playback, and when the audio attribute information changes, it updates the attributes of the host-side audio session object corresponding to the audio session through the session identifier to obtain the updated host-side audio session object. The evaluation module is used to evaluate the importance of audio attributes based on multi-dimensional audio features during audio playback, obtain an audio importance score, and set isolation constraints. The scheduling module is used to compare audio importance scores and isolation constraints, and determine the scheduling level based on the comparison results, so as to schedule and control the processes associated with the audio session.

[0013] The above-described solution of the present invention has the following beneficial effects: When an application within the Android virtual machine triggers audio playback, this invention creates an audio session and corresponding control information within the Android virtual machine, and assigns a session identifier to the audio session. After the vehicle infotainment system receives the control information, it establishes a host-side audio session object corresponding to the audio session. During audio playback, it collects audio attribute information of the audio session, and when the audio attribute information changes, it updates the attributes of the host-side audio session object corresponding to the audio session using the session identifier, resulting in an updated host-side audio session object. Based on the multi-dimensional audio features during audio playback, it performs audio importance assessment on the audio attribute information to obtain an audio importance score and sets isolation constraints. It compares the audio importance score and isolation constraints and determines the scheduling level based on the comparison result to schedule and control the processes associated with the audio session. Compared with existing technologies, this invention introduces an audio importance assessment mechanism into the vehicle infotainment system to achieve fine-grained scheduling and control of processes associated with audio sessions. This ensures stable background playback of audio applications within the Android virtual machine even under the limited resources of the vehicle infotainment system, thereby improving the overall audio experience and operational stability of the vehicle infotainment system.

[0014] Other beneficial effects of the present invention will be described in detail in the following detailed description section. Attached Figure Description

[0015] Figure 1 This is a flowchart illustrating an embodiment of the present invention; Figure 2 This is a schematic diagram of the process scheduling device in an embodiment of the present invention. Detailed Implementation

[0016] To make the technical problems, solutions, and advantages of this invention clearer, a detailed description will be provided below with reference to the accompanying drawings and specific embodiments. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0017] Furthermore, the technical features involved in the different embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0018] This invention addresses existing problems by providing a process scheduling method and apparatus for audio in an Android virtual machine.

[0019] like Figure 1 As shown, an embodiment of the present invention provides a process scheduling method for Android virtual machine audio, applied to an in-vehicle infotainment system, including: Step 1: When an application in the Android virtual machine triggers audio playback, an audio session and corresponding control information are created in the Android virtual machine, and a session identifier is assigned to the audio session. Step 2: After the vehicle system receives the control information, it establishes a host-side audio session object corresponding to the audio session. Step 3: During audio playback, collect audio attribute information of the audio session, and when the audio attribute information changes, update the attributes of the host-side audio session object corresponding to the audio session through the session identifier to obtain the updated host-side audio session object. Step 4: Based on the multi-dimensional audio features during audio playback, perform audio importance assessment on the audio attribute information to obtain an audio importance score, and set isolation constraints. Step 5: Compare the audio importance score and isolation constraints, and determine the scheduling level based on the comparison results to schedule and control the processes associated with the audio session.

[0020] In this embodiment of the invention, the session identifier is used to uniquely identify the audio session during its lifecycle and serves as an association identifier between the virtual machine-side audio session and the vehicle system host-side audio session object.

[0021] In this embodiment of the invention, the vehicle system does not directly participate in the audio processing inside the virtual machine, but instead receives control information corresponding to the audio session through the virtual audio interface.

[0022] Through step 1 in this embodiment of the invention, the vehicle system can continuously perceive the presence of virtual machine audio without breaking the virtual machine isolation boundary.

[0023] Specifically, audio attribute information is used to reflect the usage scenarios of audio sessions and their potential impact on the vehicle system, including at least one of audio usage attributes, audio focus attributes, audio concurrency attributes, audio persistence attributes, and audio perceived intensity attributes.

[0024] In this embodiment of the invention, when the virtual machine's audio framework detects a change in the state of at least one audio attribute associated with the audio session and used for vehicle system scheduling decisions, i.e. when the audio purpose attribute, audio focus attribute, audio concurrency attribute, audio persistence attribute, and audio perceived intensity attribute change, the virtual machine's audio framework sends an update notification to the vehicle system through the virtual audio interface. The vehicle system then updates the corresponding attributes of the host-side audio session object accordingly, thereby maintaining the consistency between the virtual machine-side audio session state and the host-side audio session object state.

[0025] Specifically, before performing audio importance assessment on audio attribute information based on multi-dimensional audio features during audio playback, the process also includes: The audio attribute information is preprocessed to obtain the preprocessed audio attribute information.

[0026] In this embodiment of the invention, the preprocessing includes audio session liveness determination, audio perceptibility determination, and scheduling relevance determination, thereby excluding audio sessions that do not meet the scheduling conditions.

[0027] Specifically, based on the multi-dimensional audio features during audio playback, audio attribute information is evaluated for audio importance to obtain an audio importance score, including: Extracting multidimensional audio features during audio playback; Select a set of weighted parameters based on the audio's intended use; The initial importance of the audio session is calculated by weighting and combining the audio usage attribute and / or audio focus attribute and / or audio concurrency attribute and / or audio persistence attribute and / or audio perceived intensity attribute according to the set of weight parameters. The initial importance results are smoothed over time to generate an audio importance score.

[0028] Specifically, the initial importance of an audio session is calculated by weighting and combining the audio usage attribute and / or audio focus attribute and / or audio concurrency attribute and / or audio persistence attribute and / or audio perceived intensity attribute according to the set of weight parameters. The formula is as follows: ; in, This indicates the initial importance result. Indicates the quantity of audio attribute information. Indicates the first The normalized attribute values ​​corresponding to each audio attribute range from [0,1]. Indicates the relationship with the first The weight parameters corresponding to each audio attribute are used to characterize the degree of influence of the audio attribute on the in-vehicle infotainment experience and system scheduling.

[0029] Specifically, the initial importance results are smoothed over time, and the calculation expression for the audio importance score is as follows: ; in, express Audio importance score for each moment This represents the smoothing coefficient, with a value ranging from 0.2 to 0.5. express The initial importance result at each moment.

[0030] In view of the special characteristics of virtual machine audio, this invention introduces isolation constraints in the importance calculation process. The isolation constraints include, but are not limited to, a preset importance score threshold, an attenuation factor for the audio importance score, and overall scaling of the weight parameters involved in the calculation, so as to limit the maximum influence range of virtual machine audio in the overall scheduling system, thereby avoiding adverse effects of virtual machine audio on the key functions of the vehicle system.

[0031] In this embodiment of the invention, the vehicle system performs differentiated scheduling control operations on processes associated with audio sessions for different scheduling levels. The scheduling control operations are used to adjust the resource allocation status of processes in terms of processor resources, scheduling priority, or real-time guarantee, so as to match the system resource allocation with the importance of audio.

[0032] It should be noted that in this embodiment of the invention, when the importance of audio changes or the audio session ends, the vehicle system adjusts or cancels the scheduling control operations applied to the process accordingly, thereby ensuring the dynamic balance of the system scheduling state.

[0033] When an application within the Android virtual machine triggers audio playback, this invention creates an audio session and corresponding control information within the Android virtual machine, and assigns a session identifier to the audio session. After the vehicle infotainment system receives the control information, it establishes a host-side audio session object corresponding to the audio session. During audio playback, it collects audio attribute information of the audio session, and when the audio attribute information changes, it updates the attributes of the host-side audio session object corresponding to the audio session using the session identifier, resulting in an updated host-side audio session object. Based on the multi-dimensional audio features during audio playback, it performs audio importance assessment on the audio attribute information to obtain an audio importance score and sets isolation constraints. It compares the audio importance score and isolation constraints and determines the scheduling level based on the comparison result to schedule and control the processes associated with the audio session. Compared with existing technologies, this invention introduces an audio importance assessment mechanism into the vehicle infotainment system to achieve fine-grained scheduling and control of processes associated with audio sessions. This ensures stable background playback of audio applications within the Android virtual machine even under the limited resources of the vehicle infotainment system, thereby improving the overall audio experience and operational stability of the vehicle infotainment system.

[0034] Corresponding to the Android virtual machine audio process scheduling method described in the above embodiments, such as Figure 2 As shown, this embodiment of the invention also provides an Android virtual machine audio process scheduling device 100, applied to an in-vehicle infotainment system. The process scheduling device 100 includes: Module 101 is created to create an audio session and corresponding control information within the Android virtual machine when an application within the Android virtual machine triggers audio playback behavior, and to assign a session identifier to the audio session. Module 102 is used to establish a host-side audio session object corresponding to the audio session after the vehicle system receives control information; The update module 103 is used to collect audio attribute information of the audio session during audio playback, and when the audio attribute information changes, update the attributes of the host-side audio session object corresponding to the audio session through the session identifier to obtain the updated host-side audio session object. The evaluation module 104 is used to evaluate the importance of audio attribute information based on the multi-dimensional audio features during audio playback, obtain an audio importance score, and set isolation constraints. The scheduling module 105 is used to compare the audio importance score and isolation constraints, and determine the scheduling level based on the comparison result, so as to schedule and control the processes associated with the audio session.

[0035] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0036] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0037] The above description represents the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A process scheduling method for audio in an Android virtual machine, characterized in that, Applied to in-vehicle infotainment systems, including: Step 1: When an application within the Android virtual machine triggers audio playback, an audio session and corresponding control information are created within the Android virtual machine, and a session identifier is assigned to the audio session. Step 2: After the vehicle system receives the control information, it establishes a host-side audio session object corresponding to the audio session; Step 3: During audio playback, collect the audio attribute information of the audio session, and when the audio attribute information changes, update the attributes of the host-side audio session object corresponding to the audio session through the session identifier to obtain the updated host-side audio session object; Step 4: Based on the multi-dimensional audio features during audio playback, perform audio importance assessment on the audio attribute information to obtain an audio importance score, and set isolation constraints. Step 5: Compare the audio importance score with the isolation constraint, and determine the scheduling level based on the comparison result, so as to schedule and control the processes associated with the audio session.

2. The Android virtual machine audio process scheduling method according to claim 1, characterized in that, The vehicle infotainment system receives control information corresponding to the audio session through a virtual audio interface.

3. The Android virtual machine audio process scheduling method according to claim 1, characterized in that, The audio attribute information includes at least one of the following: audio purpose attribute, audio focus attribute, audio concurrency attribute, audio persistence attribute, and audio perceived intensity attribute.

4. The Android virtual machine audio process scheduling method according to claim 3, characterized in that, Before performing audio importance assessment on the audio attribute information based on multi-dimensional audio features during audio playback, the process also includes: The audio attribute information is preprocessed to obtain preprocessed audio attribute information.

5. The Android virtual machine audio process scheduling method according to claim 4, characterized in that, Based on the multi-dimensional audio features during audio playback, audio attribute information is processed to evaluate audio importance, resulting in an audio importance score, including: Extracting multidimensional audio features during audio playback; Select a set of weighted parameters based on the audio's intended use; The initial importance result of the audio session is obtained by weighting and combining the audio usage attribute and / or the audio focus attribute and / or the audio concurrency attribute and / or the audio persistence attribute and / or the audio perceived intensity attribute according to the set of weight parameters. The initial importance results are then subjected to time smoothing to generate an audio importance score.

6. The Android virtual machine audio process scheduling method according to claim 5, characterized in that, The initial importance results are then subjected to time smoothing to generate the following calculation expression for the audio importance score: ； in, express Audio importance score for each moment Represents the smoothing coefficient. express The initial importance result at each moment.

7. The Android virtual machine audio process scheduling method according to claim 1, characterized in that, The isolation constraints include a preset importance score threshold, an introduction of a decay factor into the audio importance score, and overall scaling of the weight parameters involved in the calculation.

8. A process scheduling device for audio in an Android virtual machine, characterized in that, Applied to in-vehicle infotainment systems, including: A creation module is used to create an audio session and corresponding control information within the Android virtual machine when an application within the Android virtual machine triggers audio playback behavior, and to assign a session identifier to the audio session. The module is used to establish a host-side audio session object corresponding to the audio session after the vehicle system receives the control information; The update module is used to collect audio attribute information of the audio session during audio playback, and when the audio attribute information changes, update the attributes of the host-side audio session object corresponding to the audio session through the session identifier to obtain the updated host-side audio session object. The evaluation module is used to evaluate the audio attribute information based on the multi-dimensional audio features during audio playback, obtain an audio importance score, and set isolation constraints. The scheduling module is used to compare the audio importance score with the isolation constraint and determine the scheduling level based on the comparison result, so as to schedule and control the processes associated with the audio session.

Images