A method for dynamically switching multi-audio-zone audio hardware of a vehicle by a cross-screen touch gesture

Abstract

The application relates to an artificial intelligence technology and discloses a vehicle-mounted multi-sound-zone audio hardware dynamic switching method of a cross-screen touch gesture, which comprises the following steps: through a cross-screen global resource manager, binding an application process unique identifier or a window unique identifier with an audio track instance and a stream type to obtain an audio component; a cross-screen coordinate system is established; when the audio component is detected to be touched and long-pressed, a binding state machine is activated; a target audio session identifier is looked up according to a touch point coordinate; the state machine locks the audio stream as a to-be-routed state; starting coordinates, ending coordinates, a sliding vector and a release speed when the touch is released are extracted; boundary out-of-bounds determination and spatial directivity determination are carried out according to the ending coordinates; when the release speed is greater than a speed threshold value and the boundary out-of-bounds determination and the directivity determination are matched, a physical data access channel of the to-be-routed audio stream is redirected to an output channel corresponding to a target physical device. The application can improve the vehicle-mounted audio routing switching efficiency and safety.

Description

TECHNICAL FIELD

[0001] The present application belongs to the field of artificial intelligence, and particularly relates to a vehicle-mounted multi-audio-zone audio hardware dynamic switching method based on cross-screen touch gestures. BACKGROUND

[0002] With the development of intelligent networked vehicle technology, intelligent cockpits gradually evolve towards multi-screen and multi-audio-zone. Currently, intelligent cockpits are usually equipped with multiple display screens (such as a center control screen, a co-pilot screen, and a rear double screen) and multiple independent audio playback terminals and audio zones (such as a vehicle audio, a specific seat independent audio zone, a main driver's exclusive headrest speaker or exclusive Bluetooth earphone, etc.). In the complex scenario of multi-screen and multi-audio-zone, users often need to perform dynamic routing control of audio, that is, switch the audio stream being played on the current screen to a target physical audio zone or exclusive device for playing.

[0003] Currently, when a user needs to switch the audio played on a screen to a vehicle audio, a specific seat audio zone, or an exclusive Bluetooth earphone, a traditional graphical user interface interaction mode is usually adopted. For example, the user needs to first pull down a system menu, enter an audio or device setting page, and then perform multi-step cumbersome searching and check confirmation in multiple device lists.

[0004] However, the existing audio routing switching mode has the following obvious defects: first, the interaction experience is cumbersome and inefficient. The traditional pull-down menu and multi-step check interaction mode has a deep menu level and takes a long time, cannot realize the intuitive operation of "what you see is what you get", and is difficult to meet the user demand for fast response of the intelligent cockpit. Second, there is a significant driving safety hazard. During vehicle driving, if the driver or passenger wants to perform the searching and clicking operation of the above multi-level menu, the attention will be greatly diverted, which is likely to cause misoperation and thus pose a threat to driving safety. Finally, the audio switching process lacks smoothness. The existing routing switching usually stays at the upper software logic and fails to deeply link the front-end touch control event with the audio hardware channel of the bottom chip. In the moment of audio channel switching, sound field mutation is likely to occur, and even acoustic defects such as sound interruption and sound explosion that reduce user experience occur.

[0005] In summary, the existing technology causes low efficiency and safety of vehicle-mounted audio routing switching. SUMMARY

[0006] The present application provides a vehicle-mounted multi-audio-zone audio hardware dynamic switching method based on cross-screen touch gestures, which can improve the efficiency and safety of vehicle-mounted audio routing switching.

[0007] To achieve the above-mentioned purpose, the present application provides a vehicle-mounted multi-audio-zone audio hardware dynamic switching method based on cross-screen touch gestures, which comprises: Based on the pre-built cross-screen global resource manager, the unique identifier of the application process or the unique identifier of the window is bound to the audio track instance and stream type to obtain the audio component, and a unique audio session identifier is assigned to the audio component. Establish a cross-screen global coordinate system and activate the bound state machine when a touch event targeting the audio component meets the long press duration condition. Based on the coordinates of the current touch point, lock the unique identifier of the corresponding application process or the unique identifier of the window, reverse look up the corresponding audio session identifier to obtain the target audio session identifier, and use the state machine to lock the audio stream corresponding to the target audio session identifier into a pending routing state. Extract the gesture features when the touch is released, including the start coordinates, end coordinates, sliding vector, and release speed; In the preset physical space mapping matrix, boundary crossing is determined based on the termination coordinates, and spatial orientation is determined by calculating the angle between the sliding vector and the line vector connecting the center point of the preset physical device. When the release speed is greater than the speed threshold and the boundary out-of-bounds judgment and spatial directivity judgment are successfully matched, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device.

[0008] To address the aforementioned problems, the present invention also provides a vehicle-mounted multi-zone audio hardware dynamic switching device for cross-screen touch gestures, the device comprising: The mapping and binding initialization module is used to bind the unique identifier of the application process or the unique identifier of the window with the audio track instance and stream type according to the pre-built cross-screen global resource manager to obtain the audio component, and assign a unique audio session identifier to the audio component; The touch interaction module is used to establish a cross-screen global coordinate system and activate the binding state machine when a touch event for the audio component meets the long press duration condition. Based on the coordinates of the current touch point, it locks the unique identifier of the corresponding application process or the unique identifier of the window, looks up the corresponding audio session identifier to obtain the target audio session identifier, and uses the state machine to lock the audio stream corresponding to the target audio session identifier into a waiting-to-route state. A switching decision module is used to extract gesture features during touch release, including start coordinates, end coordinates, sliding vector, and release speed. In a preset physical space mapping matrix, boundary crossing is determined based on the end coordinates, and spatial directionality is determined by calculating the angle between the sliding vector and the vector connecting the center point of the preset physical device. When the release speed is greater than the speed threshold and the boundary crossing and spatial directionality determinations are successfully matched, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device.

[0009] To address the above problems, the present invention also provides an electronic device, the electronic device comprising: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the aforementioned cross-screen touch gesture vehicle multi-zone audio hardware dynamic switching method.

[0010] To address the aforementioned issues, the present invention also provides a computer-readable storage medium storing at least one computer program, which is executed by a processor in an electronic device to implement the aforementioned method for dynamic switching of multi-zone audio hardware in a vehicle using cross-screen touch gestures.

[0011] This invention, based on a pre-built cross-screen global resource manager, binds the unique identifier of an application process or window with an audio track instance and stream type to obtain an audio component, and assigns a unique audio session identifier to the audio component. This enables a unique global index for cross-screen multi-source audio streams and establishes a cross-screen global resource manager that conforms to the top-level logical mapping. Furthermore, statically mapping each audio session identifier to the physical audio input interface of the vehicle's underlying chip enables physical isolation between hardware and software. Additionally, establishing a cross-screen global coordinate system and activating the binding state machine when a touch event targeting an audio component meets a long-press duration condition enables zero-latency, real-time perception and capture of the user's audio migration interaction intent. Moreover, by locking the unique identifier of the corresponding application process or window based on the coordinates of the current touch point, and reverse-looking up the corresponding audio session identifier to obtain the target audio session identifier, the state machine locks the audio stream corresponding to the target audio session identifier into a pending routing state, enabling the routing of ambiguous audio streams. The screen touch behavior is converted and precisely hooked into the underlying audio physical stream to be migrated. Furthermore, gesture features at the time of touch release are extracted, including start coordinates, end coordinates, sliding vector, and release speed. This allows for multi-dimensional quantitative extraction of the spatial dynamics and physical vector features of the user's gestures, improving the accuracy of gesture intent recognition in the cabin motion environment. Moreover, in a preset physical space mapping matrix, boundary crossing is determined based on the end coordinates, and the angle between the sliding vector and the vector connecting the center point of the preset physical device is calculated for spatial directionality determination. This mathematically and precisely transforms the two-dimensional gesture trajectory on the screen plane into the target device direction in the three-dimensional cabin physical space, reducing the decision-making and operational burden. Finally, when the release speed exceeds a speed threshold and the boundary crossing and spatial directionality determinations match successfully, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface. This redirects the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device, improving the efficiency and security of in-vehicle audio routing switching. Attached Figure Description

[0012] Figure 1 This is a flowchart illustrating a method for dynamic switching of in-vehicle multi-zone audio hardware with cross-screen touch gestures, provided in an embodiment of the present invention. Figure 2 This is a functional block diagram of a vehicle-mounted multi-zone audio hardware dynamic switching device for cross-screen touch gestures, provided in an embodiment of the present invention. Figure 3 This is a schematic diagram of the structure of an electronic device that implements the cross-screen touch gesture vehicle multi-zone audio hardware dynamic switching method according to an embodiment of the present invention.

[0013] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0014] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0015] This application provides a method for dynamic switching of in-vehicle multi-zone audio hardware via cross-screen touch gestures. The executing entity of this method includes, but is not limited to, at least one of the following electronic devices that can be configured to execute the method provided in this application: a server, a terminal, etc. In other words, the method can be executed by software or hardware installed on a terminal device or a server device, where the software may be a blockchain platform. The server includes, but is not limited to, a single server, a server cluster, a cloud server, or a cloud server cluster. The server can be an independent server or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0016] Reference Figure 1 The diagram shown is a flowchart illustrating a method for dynamic switching of in-vehicle multi-zone audio hardware using cross-screen touch gestures according to an embodiment of the present invention. In this embodiment, the method includes: S1. Based on the pre-built cross-screen global resource manager, bind the unique identifier of the application process or the unique identifier of the window with the audio track instance and stream type to obtain the audio component, and assign a unique audio session identifier to the audio component.

[0017] Understandably, the cross-screen global resource manager refers to a unified management module built in the preset framework layer of a multi-screen in-vehicle system. It is used to centrally register and manage the hardware and software resources of all physical screens in the cabin, such as the central control screen, the passenger screen, and the rear dual screens, so as to establish a global mapping relationship between graphical events and underlying hardware channels.

[0018] Understandably, the unique identifier of an application process refers to a unique system-level credential, such as an APP Token, for an independent background program that runs in the preset application layer and can play audio components. These application processes include, but are not limited to, music players, radios, and video players, and each application process enjoys independent resource allocation within the system.

[0019] Understandably, a window's unique identifier refers to a unique system-level credential, such as a Window Token, for the application process's display interface. This unique identifier is crucial for the state machine's InputManagerService to identify the subject of touch events, ensuring that the system can accurately pinpoint the application interface to which the user's touch event belongs.

[0020] Understandably, an audio track instance refers to a playback object used by an application to output audio data to the system's underlying layer.

[0021] Understandably, stream type refers to the business attributes and priority strategies used to describe the sound played on the current audio track. For example, stream types include, but are not limited to, media music, navigation voice, Bluetooth calls, etc. Different stream types may correspond to different routing rules and volume control strategies at the system level.

[0022] Understandably, the audio session identifier refers to a system-level globally unique identifier, namely AudioSessionID, assigned to each audio stream by the audio service (AudioService) in the pre-defined framework layer. The audio session identifier is the core bridge connecting the upper-layer application software and the underlying hardware characteristics. Downward, it can be mapped by the audio hardware abstraction layer to the physical audio input interface of a specific chip (such as local I2S (Inter-IC Sound, audio data stream between integrated circuits) or PCIe (Peripheral Component Interconnect Express, audio data stream between peripheral components) audio streams. Upward, it can be bound to the unique identifier of the window, so that it can be looked up and locked into a waiting-to-route state when a gesture is triggered.

[0023] It is understood that the embodiments of the present invention also include statically mapping each audio session identifier to the physical audio input interface of the vehicle underlying chip, which enables subsequent audio routing switching to skip the cumbersome software layer audio resampling and link reconstruction process and directly perform fast redirection of physical channels at the hardware layer, greatly reducing the system latency of audio switching and improving the immediacy of intelligent cockpit audio interaction.

[0024] Specifically, based on the pre-built cross-screen global resource manager, the unique identifier of the application process or the unique identifier of the window is bound to the audio track instance and stream type to obtain the audio component, and a unique audio session identifier is assigned to the audio component, including: When an audio component capable of playing audio is created in the predefined application layer, obtain the unique identifier of the audio component capable of playing audio; In the preset framework layer, a corresponding audio session identifier is assigned to the unique identifier and registered to the global resource manager.

[0025] S2. Establish a cross-screen global coordinate system and activate the bound state machine when a touch event for the audio component meets the long press duration condition.

[0026] Understandably, the cross-screen global coordinate system refers to spatially stitching together the independent touch areas of all physical screens inside the smart cockpit to construct a unified virtual two-dimensional or three-dimensional coordinate system. The X-axis and Y-axis coordinates are used to represent the plane where the screen is located, and the Z-axis is also introduced to distinguish the front and rear seats of the cabin depending on the physical location requirements. The cross-screen global coordinate system can break the boundaries of single-screen interaction, so that gestures across different physical screens can be accurately extracted and calculated by the system under the same set of references.

[0027] Understandably, audio components refer to application modules or user interface elements that provide interactive audio playback for users on the smart cockpit display interface. For example, audio components include, but are not limited to, music players, car radios, and video players running on the front end.

[0028] Understandably, a state machine refers to a dynamically bound logic mechanism used to manage the entire process of gesture intent recognition and underlying hardware control. When a user triggers a long press event that meets a threshold, the state machine is activated and sequentially executes state tasks, such as: 1. Capturing the source state: locking the component identifier under the touch point and looking up the audio session identifier, setting it to a pending routing state; 2. Extracting hardware features: obtaining the hardware bus parameters of the audio stream; 3. Link activation state: establishing a "virtual pipeline" between the graphical event and the hardware channel, in a standby state that is ready to trigger the underlying hardware switching at any time by waiting for the user's gesture release signal.

[0029] Specifically, a cross-screen global coordinate system is established, and when a touch event targeting the audio component is detected that meets the long press duration condition, the bound state machine is activated, including: The physical screen touch areas within the cockpit are stitched together to form a virtual cross-screen global coordinate system that includes multi-dimensional coordinates; Continuously monitor touch events. When the long press duration reaches the long press duration threshold, trigger the input management service of the state machine to enter the capture source state.

[0030] S3. Based on the coordinates of the current touch point, lock the unique identifier of the corresponding application process or the unique identifier of the window, reverse look up the corresponding audio session identifier to obtain the target audio session identifier, and use the state machine to lock the audio stream corresponding to the target audio session identifier into a pending routing state.

[0031] Understandably, the "waiting to be routed" state refers to a low-level preparation and suspension state established by the system during gesture interaction. Specifically, in the waiting to be routed state, the system has not only successfully confirmed the specific audio stream to be operated on (i.e., the target audio session identifier), but has also extracted the current hardware bus parameters of the audio stream (such as sampling rate, number of channels, etc.), thus establishing a "virtual pipeline" connecting the front-end graphical touch event and the underlying hardware channel. Entering the waiting to be routed state means that the system has completed all the pre-processing data for audio channel switching and is in a standby phase waiting for the user's finger to finish sliding (i.e., the slide termination signal). Once the release signal is captured, the underlying physical hardware channel redirection can be activated instantly.

[0032] S4. Extract the gesture features when the touch is released, including the start coordinates, end coordinates, sliding vector and release speed.

[0033] For example, gesture features during touch release are extracted, including start coordinates, end coordinates, sliding vector, and release speed. The start coordinates, end coordinates, sliding vector, and release speed are extracted using the following formula: Starting coordinates ; Termination coordinates (release point) ; Sliding vector (direction and distance) ; Release speed ;in, The release speed is used to distinguish between accidental touches and intentional releases, representing the time from the start coordinates to the end coordinates of the gesture feature.

[0034] S5. In the preset physical space mapping matrix, perform boundary crossing judgment based on the termination coordinates, and calculate the angle between the sliding vector and the vector connecting the center point of the preset physical device to determine spatial orientation.

[0035] Understandably, the preset physical space mapping matrix refers to a set of mathematical transformation models based on the physical space geometry of the cabin that are established in advance. The preset physical space mapping matrix divides the various physical sound zones in the carriage into geometric quadrants and sets virtual threshold boundaries at the edges of the screen.

[0036] Understandably, the preset physical device center point refers to the reference spatial coordinate position in the cross-screen global coordinate system, which represents the individual physical sound-producing devices or specific sound zones in the cockpit.

[0037] Understandably, spatial directionality refers to the physical spatial intent conveyed by the user's finger swipe gesture, that is, the actual location within the cockpit where the user wants to direct the sound.

[0038] Specifically, in the preset physical space mapping matrix, boundary crossing determination is performed based on the termination coordinates, including: The sound zones of the physical cabin are divided into geometric quadrants, and screen threshold boundaries are set for each screen edge; Determine whether the termination coordinates cross the screen edge threshold boundary. If they do, and the direction of the sliding vector points to the geometric quadrant corresponding to the screen edge threshold boundary, then the physical sound zone corresponding to the geometric quadrant is determined as the target physical device through a preset physical space mapping matrix.

[0039] For example, if the termination coordinates fall outside the right screen threshold boundary of the central control screen and the sliding vector direction is to the right, then the target physical device is the passenger voice zone device; If the termination coordinates fall outside the top threshold boundary of any physical screen and the sliding vector direction is upward, then the target physical device is the vehicle's physical audio system.

[0040] Further, the spatial orientation is determined by calculating the angle between the sliding vector and the vector connecting the center point of the preset physical device, including: Obtain the cosine value of the line vector connecting the sliding vector and the center point of each physical device in the cockpit; The physical device corresponding to the direction with the largest cosine value is selected as the candidate target physical device.

[0041] For example, in the preset physical space mapping matrix, boundary crossing is determined based on the termination coordinates, and spatial orientation is determined by calculating the angle between the sliding vector and the vector connecting the center point of the preset physical device. This is achieved through the following implementation steps: Step 1: Preset a cockpit physical space mapping matrix The physical space mapping matrix dynamically transforms the sliding boundary region and sliding vector into the target physical device ID: the judgment logic is formalized into the following matrix mapping function. : ;in, The target physical device ID.

[0042] Step 2: The specific recognition algorithm performs matrix matching in two dimensions: A) Boundary crossing determination (based on termination coordinates) This divides the sound zones of the physical cabin into geometric quadrants, establishing "threshold boundaries" at the screen edges. If... If the matrix falls outside the right boundary of the central control screen and the sliding direction is to the right, then... Point it to: Passenger Seat Audio Zone ;like If the value falls outside the top boundary of any screen and the sliding direction is upward, then the matrix... Point it to: the car's physical audio system B. Spatial orientation determination (based on sliding vector) (the angle between the two sides), calculate the sliding vector. Vector lines connecting the center points of each physical sound zone / equipment within the cockpit The included angle : System matching Maximum (i.e., the direction is most compatible) and meets the release speed threshold The target is used as a candidate target physical device.

[0043] S6. When the release speed is greater than the speed threshold and the boundary over-limit judgment and spatial directivity judgment are successfully matched, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device.

[0044] It is understood that the hardware abstraction layer interface refers to the standardized communication and control interface between the preset framework layer and the underlying vehicle physical hardware. In the embodiments of the present invention, it can be used to receive the gesture intention recognition results transmitted from the upper layer and convert them into control commands that can be recognized by the underlying chip.

[0045] Understandably, a hardware register refers to an ultra-high-speed storage unit inside the underlying automotive audio chip used to store hardware configuration and control the hardware operating status. In this embodiment of the invention, by directly modifying the parameter values ​​in the register, the system can directly control the closure or switching of the audio data flow at the pure physical circuit level, without relying on upper-layer software to redistribute and package the audio data, thereby achieving the lowest latency hardware-level response.

[0046] Understandably, redirection refers to the process of changing the data output destination of the physical data access channel directly at the underlying hardware level without interrupting the current audio stream data decoding and transmission. In other words, through underlying control, the audio data stream that was originally being sent to the current screen speaker is instantly switched and connected to the output channel of the target physical device (such as the driver's headrest speaker, the rear physical sound zone, or the Bluetooth PCM channel), achieving a seamless dynamic transfer of the audio playback spatial position.

[0047] Specifically, by modifying the hardware registers of the underlying audio mixer through the hardware abstraction layer interface, the physical data access channel of the audio stream in the unrouted state is redirected to the output channel corresponding to the target physical device, including: Obtain the target device identifier corresponding to the target physical device; The audio service sends control commands containing the target device identifier and the target audio session identifier to the hardware abstraction layer, so that the hardware abstraction layer can modify the hardware registers of the underlying audio mixer through the hardware abstraction layer interface, and redirect the physical data access channel corresponding to the target audio session identifier to the output interface corresponding to the target physical device.

[0048] Furthermore, by modifying the hardware registers of the underlying audio mixer through the hardware abstraction layer interface, the physical data access channel of the audio stream in the unrouted state is redirected to the output channel corresponding to the target physical device. This also includes: While modifying the hardware registers to trigger the physical channel switching, the underlying chip's built-in audio digital signal processing hardware is called to execute the fade-in / fade-out algorithm.

[0049] Understandably, fade-in / fade-out algorithms refer to a smooth transition processing technique. Specifically, during the redirection of a physical output channel, the fade-in / fade-out algorithm controls the audio volume of the original output channel to smoothly decrease (fade out) in a very short time, while simultaneously controlling the audio volume of the target output channel to smoothly increase (fade in). Through this smooth transition mechanism of the sound field, it is possible to effectively avoid level changes caused by instantaneous "hard switching" of the underlying physical circuitry or data link, thereby completely eliminating the possible dropouts (sudden interruption of sound) and pops (POP sounds, i.e., impulse noise) that may occur during audio routing transfer, ensuring a seamless listening experience for users during cross-screen audio flow.

[0050] For example, in this embodiment of the invention, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device. The specific vehicle audio switching mapping relationship is shown in Table 1.

[0051]

[0052] Table 1. Specific In-Vehicle Audio Switching Mapping Relationship This invention, based on a pre-built cross-screen global resource manager, binds the unique identifier of an application process or window with an audio track instance and stream type to obtain an audio component, and assigns a unique audio session identifier to the audio component. This enables a unique global index for cross-screen multi-source audio streams and establishes a cross-screen global resource manager that conforms to the top-level logical mapping. Furthermore, statically mapping each audio session identifier to the physical audio input interface of the vehicle's underlying chip enables physical isolation between hardware and software. Additionally, establishing a cross-screen global coordinate system and activating the binding state machine when a touch event targeting an audio component meets a long-press duration condition enables zero-latency, real-time perception and capture of the user's audio migration interaction intent. Moreover, by locking the unique identifier of the corresponding application process or window based on the coordinates of the current touch point, and reverse-looking up the corresponding audio session identifier to obtain the target audio session identifier, the state machine locks the audio stream corresponding to the target audio session identifier into a pending routing state, enabling the routing of ambiguous audio streams. The screen touch behavior is converted and precisely hooked into the underlying audio physical stream to be migrated. Furthermore, gesture features at the time of touch release are extracted, including start coordinates, end coordinates, sliding vector, and release speed. This allows for multi-dimensional quantitative extraction of the spatial dynamics and physical vector features of the user's gestures, improving the accuracy of gesture intent recognition in the cabin motion environment. Moreover, in a preset physical space mapping matrix, boundary crossing is determined based on the end coordinates, and the angle between the sliding vector and the vector connecting the center point of the preset physical device is calculated for spatial directionality determination. This mathematically and precisely transforms the two-dimensional gesture trajectory on the screen plane into the target device direction in the three-dimensional cabin physical space, reducing the decision-making and operational burden. Finally, when the release speed exceeds a speed threshold and the boundary crossing and spatial directionality determinations match successfully, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface. This redirects the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device, improving the efficiency and security of in-vehicle audio routing switching.

[0053] like Figure 2 The diagram shown is a functional block diagram of a vehicle-mounted multi-zone audio hardware dynamic switching device for cross-screen touch gestures, provided in an embodiment of the present invention.

[0054] The in-vehicle multi-zone audio hardware dynamic switching device 100 with cross-screen touch gestures described in this invention can be installed in an electronic device. Depending on the functions implemented, the in-vehicle multi-zone audio hardware dynamic switching device 100 may include a mapping and binding initialization module 101, a touch interaction module 102, and a switching decision module 103.

[0055] The module described in this invention can also be called a unit, which refers to a series of computer program segments that can be executed by the processor of an electronic device and can perform a fixed function, and are stored in the memory of the electronic device.

[0056] In this embodiment, the functions of each module / unit are as follows: The mapping and binding initialization module 101 is used to bind the unique identifier of the application process or the unique identifier of the window with the audio track instance and stream type according to the pre-built cross-screen global resource manager to obtain the audio component, and to assign a unique audio session identifier to the audio component.

[0057] The touch interaction module 102 is used to establish a cross-screen global coordinate system and activate the binding state machine when a touch event for the audio component meets the long press duration condition. Based on the coordinates of the current touch point, it locks the unique identifier of the corresponding application process or the unique identifier of the window, looks up the corresponding audio session identifier to obtain the target audio session identifier, and uses the state machine to lock the audio stream corresponding to the target audio session identifier into a waiting-to-route state.

[0058] The switching decision module 103 is used to extract gesture features when the touch is released. The gesture features include start coordinates, end coordinates, sliding vector, and release speed. In the preset physical space mapping matrix, boundary crossing is determined based on the end coordinates, and the angle between the sliding vector and the line vector connecting the center point of the preset physical device is calculated to determine spatial directionality. When the release speed is greater than the speed threshold and the boundary crossing and spatial directionality determination are successfully matched, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device.

[0059] like Figure 3 The diagram shown is a structural schematic of an electronic device that implements a cross-screen touch gesture vehicle multi-zone audio hardware dynamic switching method according to an embodiment of the present invention.

[0060] The electronic device may include a processor 10, a memory 11, a communication bus 12, and a communication interface 13. It may also include a computer program stored in the memory 11 and capable of running on the processor 10, such as a method program for dynamic switching of in-vehicle multi-zone audio hardware with cross-screen touch gestures.

[0061] In some embodiments, the processor 10 may be composed of integrated circuits, such as a single packaged integrated circuit or multiple integrated circuits with the same or different functions, including combinations of one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and various control chips. The processor 10 is the control unit of the electronic device, connecting various components of the entire electronic device through various interfaces and lines. It executes programs or modules stored in the memory 11 (e.g., a method for dynamic switching of multi-zone audio hardware in a vehicle using cross-screen touch gestures), and calls data stored in the memory 11 to perform various functions of the electronic device and process data.

[0062] The memory 11 includes at least one type of readable storage medium, including flash memory, portable hard drive, multimedia card, card-type memory (e.g., SD or DX memory), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 11 can be an internal storage unit of an electronic device, such as a portable hard drive. In other embodiments, the memory 11 can be an external storage device of the electronic device, such as a plug-in portable hard drive, Smart Media Card (SMC), Secure Digital (SD) card, Flash Card, etc. Furthermore, the memory 11 can include both internal and external storage units of the electronic device. The memory 11 can be used not only to store application software and various types of data installed on the electronic device, such as the code of a method for dynamic switching of multi-zone audio hardware in a vehicle using cross-screen touch gestures, but also to temporarily store data that has been output or will be output.

[0063] The communication bus 12 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into an address bus, a data bus, a control bus, etc. The bus is configured to enable communication between the memory 11 and at least one processor 10, etc.

[0064] The communication interface 13 is used for communication between the aforementioned electronic device and other devices, including a network interface and a user interface. Optionally, the network interface may include a wired interface and / or a wireless interface (such as a Wi-Fi interface, Bluetooth interface, etc.), typically used to establish communication connections between the electronic device and other electronic devices. The user interface may be a display, an input unit (such as a keyboard), or optionally, a standard wired or wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, or an OLED (Organic Light-Emitting Diode) touchscreen, etc. The display may also be appropriately referred to as a screen or display unit, used to display information processed in the electronic device and to display a visual user interface.

[0065] Figure 3 Only electronic devices with components are shown; those skilled in the art will understand that... Figure 3 The structure shown does not constitute a limitation on the electronic device and may include fewer or more components than shown, or combine certain components, or have different component arrangements.

[0066] For example, although not shown, the electronic device may also include a power supply (such as a battery) to power the various components. Preferably, the power supply can be logically connected to the at least one processor 10 through a power management device, thereby enabling functions such as charging management, discharging management, and power consumption management. The power supply may also include one or more DC or AC power supplies, recharging devices, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components. The electronic device may also include various sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be described in detail here.

[0067] It should be understood that the embodiments described are for illustrative purposes only and are not limited to this structure in the scope of the patent application.

[0068] The memory 11 in the electronic device stores a method program for dynamic switching of in-vehicle multi-zone audio hardware using cross-screen touch gestures. This program is a combination of multiple instructions, which, when run in the processor 10, can achieve the following: Based on the pre-built cross-screen global resource manager, the unique identifier of the application process or the unique identifier of the window is bound to the audio track instance and stream type to obtain the audio component, and a unique audio session identifier is assigned to the audio component. Establish a cross-screen global coordinate system and activate the bound state machine when a touch event targeting the audio component meets the long press duration condition. Based on the coordinates of the current touch point, lock the unique identifier of the corresponding application process or the unique identifier of the window, reverse look up the corresponding audio session identifier to obtain the target audio session identifier, and use the state machine to lock the audio stream corresponding to the target audio session identifier into a pending routing state. Extract the gesture features when the touch is released, including the start coordinates, end coordinates, sliding vector, and release speed; In the preset physical space mapping matrix, boundary crossing is determined based on the termination coordinates, and spatial orientation is determined by calculating the angle between the sliding vector and the line vector connecting the center point of the preset physical device. When the release speed is greater than the speed threshold and the boundary out-of-bounds judgment and spatial directivity judgment are successfully matched, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device.

[0069] Specifically, the specific implementation method of the processor 10 for the above instructions can be referred to the description of the relevant steps in the corresponding embodiment of the accompanying drawings, and will not be repeated here.

[0070] Furthermore, if the modules / units integrated in the electronic device 1 are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. The computer-readable storage medium can be volatile or non-volatile. For example, the computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, or a read-only memory (ROM).

[0071] The present invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor of an electronic device, can perform the following: Based on the pre-built cross-screen global resource manager, the unique identifier of the application process or the unique identifier of the window is bound to the audio track instance and stream type to obtain the audio component, and a unique audio session identifier is assigned to the audio component. Establish a cross-screen global coordinate system and activate the bound state machine when a touch event targeting the audio component meets the long press duration condition. Based on the coordinates of the current touch point, lock the unique identifier of the corresponding application process or the unique identifier of the window, reverse look up the corresponding audio session identifier to obtain the target audio session identifier, and use the state machine to lock the audio stream corresponding to the target audio session identifier into a pending routing state. Extract the gesture features when the touch is released, including the start coordinates, end coordinates, sliding vector, and release speed; In the preset physical space mapping matrix, boundary crossing is determined based on the termination coordinates, and spatial orientation is determined by calculating the angle between the sliding vector and the line vector connecting the center point of the preset physical device. When the release speed is greater than the speed threshold and the boundary out-of-bounds judgment and spatial directivity judgment are successfully matched, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device.

[0072] In the several embodiments provided by this invention, it should be understood that the disclosed devices, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and other division methods may be used in actual implementation.

[0073] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0074] Furthermore, the functional modules in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or in the form of hardware plus software functional modules.

[0075] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0076] Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be embraced within the invention. No appended diagram markings in the claims should be construed as limiting the scope of the claims.

[0077] The blockchain referred to in this invention is a novel application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanisms, and encryption algorithms. Essentially, a blockchain is a decentralized database, a chain of data blocks linked together using cryptographic methods. Each data block contains information about a batch of network transactions, used to verify the validity of the information (anti-counterfeiting) and generate the next block. A blockchain can include an underlying blockchain platform, a platform product service layer, and an application service layer.

[0078] The embodiments of this application can acquire and process relevant data based on artificial intelligence technology. Artificial intelligence (AI) refers to the theories, methods, technologies, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results.

[0079] Furthermore, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices recited in a system claim may also be implemented by a single unit or device through software or hardware. The terms "first," "second," etc., are used to indicate names and do not indicate any specific order.

[0080] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. A method for dynamic switching of in-vehicle multi-zone audio hardware using cross-screen touch gestures, characterized in that, The method includes: Based on the pre-built cross-screen global resource manager, the unique identifier of the application process or the unique identifier of the window is bound to the audio track instance and stream type to obtain the audio component, and a unique audio session identifier is assigned to the audio component. Establish a cross-screen global coordinate system and activate the bound state machine when a touch event targeting the audio component meets the long press duration condition. Based on the coordinates of the current touch point, lock the unique identifier of the corresponding application process or the unique identifier of the window, reverse look up the corresponding audio session identifier to obtain the target audio session identifier, and use the state machine to lock the audio stream corresponding to the target audio session identifier into a pending routing state. Extract the gesture features when the touch is released, including the start coordinates, end coordinates, sliding vector, and release speed; In the preset physical space mapping matrix, boundary crossing is determined based on the termination coordinates, and spatial directionality is determined by calculating the angle between the sliding vector and the vector connecting the center point of the preset physical device. Specifically, the boundary crossing determination based on the termination coordinates in the preset physical space mapping matrix includes: dividing the sound zone of the physical cabin into geometric quadrants and setting screen threshold boundaries for each screen edge; determining whether the termination coordinates cross the screen edge threshold boundary. If they do, and the direction of the sliding vector points to the geometric quadrant corresponding to the screen edge threshold boundary, then the physical sound zone corresponding to that geometric quadrant is determined as the target physical device through the preset physical space mapping matrix. When the release speed is greater than the speed threshold and the boundary out-of-bounds judgment and spatial directivity judgment are successfully matched, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device.

2. The in-vehicle multi-zone audio hardware dynamic switching method for cross-screen touch gestures as described in claim 1, characterized in that, The process of binding the unique identifier of the application process or the unique identifier of the window with the audio track instance and stream type according to the pre-built cross-screen global resource manager to obtain the audio component, and assigning a unique audio session identifier to the audio component, includes: When an audio component capable of playing audio is created in the predefined application layer, obtain the unique identifier of the audio component capable of playing audio; In the preset framework layer, a corresponding audio session identifier is assigned to the unique identifier and registered to the global resource manager.

3. The in-vehicle multi-zone audio hardware dynamic switching method for cross-screen touch gestures as described in claim 1, characterized in that, The establishment of a cross-screen global coordinate system and the activation of the bound state machine when a touch event targeting the audio component meets the long press duration condition include: The physical screen touch areas within the cockpit are stitched together to form a virtual cross-screen global coordinate system that includes multi-dimensional coordinates; Continuously monitor touch events. When the long press duration reaches the long press duration threshold, trigger the input management service of the state machine to enter the capture source state.

4. The in-vehicle multi-zone audio hardware dynamic switching method for cross-screen touch gestures as described in claim 1, characterized in that, The spatial orientation determination of the angle between the calculated sliding vector and the vector connecting the preset physical device center point includes: Obtain the cosine value of the line vector connecting the sliding vector and the center point of each physical device in the cockpit; The physical device corresponding to the direction with the largest cosine value is selected as the candidate target physical device.

5. The in-vehicle multi-zone audio hardware dynamic switching method for cross-screen touch gestures as described in claim 1, characterized in that, The step of modifying the hardware registers of the underlying audio mixer through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device includes: Obtain the target device identifier corresponding to the target physical device; The audio service sends control commands containing the target device identifier and the target audio session identifier to the hardware abstraction layer, so that the hardware abstraction layer can modify the hardware registers of the underlying audio mixer through the hardware abstraction layer interface, and redirect the physical data access channel corresponding to the target audio session identifier to the output interface corresponding to the target physical device.

6. The in-vehicle multi-zone audio hardware dynamic switching method for cross-screen touch gestures as described in claim 5, characterized in that, The step of modifying the hardware registers of the underlying audio mixer through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device also includes: While modifying the hardware registers to trigger the physical channel switching, the underlying chip's built-in audio digital signal processing hardware is called to execute the fade-in / fade-out algorithm.

7. A vehicle-mounted multi-zone audio hardware dynamic switching device with cross-screen touch gestures, characterized in that, The device can implement the in-vehicle multi-zone audio hardware dynamic switching method for cross-screen touch gestures as described in any one of claims 1 to 6, and the device includes: The mapping and binding initialization module is used to bind the unique identifier of the application process or the unique identifier of the window with the audio track instance and stream type according to the pre-built cross-screen global resource manager to obtain the audio component, and assign a unique audio session identifier to the audio component; The touch interaction module is used to establish a cross-screen global coordinate system and activate the binding state machine when a touch event for the audio component meets the long press duration condition. Based on the coordinates of the current touch point, it locks the unique identifier of the corresponding application process or the unique identifier of the window, looks up the corresponding audio session identifier to obtain the target audio session identifier, and uses the state machine to lock the audio stream corresponding to the target audio session identifier into a waiting-to-route state. A switching decision module is used to extract gesture features during touch release, including start coordinates, end coordinates, sliding vector, and release speed. In a preset physical space mapping matrix, boundary crossing is determined based on the end coordinates, and spatial directionality is determined by calculating the angle between the sliding vector and the vector connecting the center point of the preset physical device. Boundary crossing determination based on the end coordinates in the preset physical space mapping matrix includes: dividing the sound zones of the physical cabin into geometric quadrants and establishing screen threshold boundaries for each screen edge; determining whether the end coordinates cross the screen edge threshold boundary; if they do, and the direction of the sliding vector points to the geometric quadrant corresponding to the screen edge threshold boundary, then the physical sound zone corresponding to that geometric quadrant is identified as the target physical device through the preset physical space mapping matrix; when the release speed is greater than the speed threshold and the boundary crossing and spatial directionality determinations match successfully, the hardware registers of the underlying audio mixer are modified through the hardware abstraction layer interface to redirect the physical data access channel of the audio stream in the routing state to the output channel corresponding to the target physical device.

8. An electronic device, characterized in that, The electronic device includes: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the in-vehicle multi-zone audio hardware dynamic switching method for cross-screen touch gestures as described in any one of claims 1 to 6.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the in-vehicle multi-zone audio hardware dynamic switching method for cross-screen touch gestures as described in any one of claims 1 to 6.

Images