Dynamic audio channel configuration for vehicles

Abstract

In some aspects, an apparatus may obtain information indicative of a seat configuration of a vehicle, and determine that an orientation of the seat changes from a forward orientation to a rearward orientation or from the rearward orientation to the forward orientation according to the seat configuration. The device may cause an adjustment of the mapping of the audio channels to the speakers of the vehicle as a function of a change in the orientation of the seat. The device may determine, according to the seat configuration, that an adjustment to the mapping will cause a non-consistency between visual content on the display device associated with the additional seat and the multi-channel audio to be output by the speaker, and cause an adjustment to the visual content on the display device to cause a consistency between the visual content and the multi-channel audio. Numerous other aspects are described.

Description

[0001] Cross-reference to related applications

[0002] This patent application claims priority to U.S. Patent Application No. 18 / 327,352, filed June 1, 2023, entitled “DYNAMIC AUDIO CHANNEL CONFIGURATION FOR A VEHICLE”, which is assigned to the assignee of this application. The disclosure of the earlier application is considered part of this patent application and is incorporated herein by reference. Technical Field

[0003] Various aspects of this disclosure generally relate to multi-channel audio, and, for example, to dynamic audio channel configurations for vehicles. Background Technology

[0004] In autonomous driving, a computing system can operate the control elements of a motor vehicle without assistance from a human operator. For example, sensors (e.g., camera sensors, radar sensors, and / or lidar sensors) can be mounted on the motor vehicle to detect the conditions of its surroundings as it travels on a road. The computing system mounted on the vehicle analyzes the input received from the sensors to identify the conditions and generates control signals or commands to autonomously adjust the vehicle's direction and / or speed, with or without any input from a human operator. Because autonomous operation of a vehicle may require minimal or no human intervention, some autonomous vehicles may be equipped with seats that can rotate based on occupant preferences. For example, the seat can rotate from a forward-facing to a rearward-facing orientation. Summary of the Invention

[0005] Some aspects described herein relate to a method. The method may include obtaining, by means of a device, information indicating the seating configuration of one or more seats in a vehicle. The method may include determining, by means of a device and based on the seating configuration, that the orientation of one or more seats has changed from a forward orientation to a rearward orientation or from a rearward orientation to a forward orientation. The method may include, by means of a device and based on the change in seat orientation, causing an adjustment to the mapping of audio channels to speakers in the vehicle. The method may include determining, by means of a device and based on the seating configuration, that the adjustment to the mapping will cause an inconsistency between visual content on a display device associated with an additional seat in one or more of the seats and multi-channel audio associated with the visual content to be output by speakers. The method may include, by means of a device, causing an adjustment to the visual content on the display device to cause consistency between the visual content and the multi-channel audio.

[0006] Some aspects described herein relate to a controller. The controller may include one or more memories and one or more processors coupled to the one or more memories. The one or more processors may be configured to obtain information indicating the seating configuration of one or more seats in a vehicle. The one or more processors may be configured to determine, based on the seating configuration, that there is a change in the orientation of one or more seats. The one or more processors may be configured to, based on the change in seat orientation, cause an adjustment to the mapping of audio channels to the vehicle's speakers.

[0007] Some aspects described herein relate to a controller. The controller may include one or more memories and one or more processors coupled to the one or more memories. The one or more processors may be configured to obtain information indicating the seating configuration of one or more seats in a vehicle. The one or more processors may be configured to determine, based on the seating configuration, an inconsistency exists between visual content on a display device associated with one of the seats and multi-channel audio associated with the visual content. The one or more processors may be configured to cause adjustments to the visual content on the display device to induce consistency between the visual content and the multi-channel audio.

[0008] Some aspects described herein relate to an apparatus. The apparatus may include components for obtaining information indicating the seating configuration of one or more seats in a vehicle. The apparatus may include components for determining, based on the seating configuration, that there is a change in the orientation of one or more seats. The apparatus may include components for inducing an adjustment of the mapping of audio channels to speakers in the vehicle based on the change in seat orientation.

[0009] The aspects generally include, as described substantially with reference to the accompanying drawings and description and illustrated as shown in the drawings and description, methods, apparatus, systems, computer program products, non-transitory computer-readable media, user equipment, user gear, wireless communication equipment, and / or processing systems.

[0010] The features and technical advantages of the examples according to this disclosure have been summarized rather extensively above in order to provide a better understanding of the detailed description that follows. Additional features and advantages will be described below. The disclosed concepts and specific examples can be readily used as the basis for modifying or designing other structures for achieving the same purpose as this disclosure. Such equivalent constructions do not depart from the scope of the appended claims. The characteristics of the concepts disclosed herein (both their organization and manner of operation) and the associated advantages will be better understood in conjunction with the accompanying drawings, based on the following description. Each figure in the accompanying drawings is provided for illustrative and descriptive purposes and not as a definition of limitation of the claims. Attached Figure Description

[0011] To gain a full understanding of the foregoing features of this disclosure, a more specific description of the brief overview can be obtained by referring to various aspects, some of which are illustrated in the accompanying drawings. However, it should be noted that the drawings illustrate only certain typical aspects of this disclosure and are therefore not to be considered as limiting its scope, as other equally valid aspects may be acknowledged in this description. The same reference numerals in different drawings may identify the same or similar elements.

[0012] Figure 1 This is a diagram of an example vehicle in which the systems and / or methods described herein can be implemented.

[0013] Figure 2 This is a diagram illustrating example components of a device according to the present disclosure.

[0014] Figures 3A to 3E This is a diagram illustrating an example associated with dynamic audio channel configuration.

[0015] Figure 4 This is a flowchart of an example process associated with dynamic audio channel configuration.

[0016] Figure 5 This is a flowchart of an example process associated with dynamic audio channel configuration for vehicles.

[0017] Figure 6 This is a flowchart of an example process associated with dynamic audio channel configuration for vehicles.

[0018] Figure 7 This is a flowchart of an example process associated with dynamic audio channel configuration for vehicles. Detailed Implementation

[0019] Various aspects of this disclosure are described more fully below with reference to the accompanying drawings. However, this disclosure may be embodied in many different forms and should not be construed as limited to any particular structure or function presented throughout this disclosure. Rather, these aspects are provided so that this disclosure will be comprehensive and complete, and will fully convey the scope of this disclosure to those skilled in the art. Those skilled in the art will appreciate that the scope of this disclosure is intended to cover any aspect of this disclosure disclosed herein, whether implemented independently of or in combination with any other aspect of this disclosure. For example, any number of aspects set forth herein may be used to implement an apparatus or practice. Furthermore, the scope of this disclosure is intended to cover such apparatus or methods practiced using structures, functions, or structures and functions other than those set forth herein or different from the various aspects of the disclosure set forth herein. It should be understood that any aspect of this disclosure disclosed herein may be embodied by one or more elements of the present claims.

[0020] As described above, vehicles such as autonomous vehicles can be equipped with seats that can rotate in various directional orientations. For example, the vehicle's seats can be positioned in a forward orientation (in the vehicle's forward direction of travel), a rearward orientation (opposite to the vehicle's forward direction of travel), or a lateral orientation between forward and rearward orientations. Furthermore, the vehicle can be equipped with a speaker set for an audio system located in a fixed position throughout the vehicle (e.g., one or more speakers on the left side of the vehicle, one or more speakers on the right side of the vehicle, one or more speakers at the center of the vehicle, etc.). The audio system may be capable of having multi-channel audio (e.g., surround sound audio, such as 5.1.2 surround sound, 7.1.4 surround sound, or 9.1.6 surround sound, which may include surround sound effects such as audio panning), and the multi-channel audio can be mapped to the speaker set such that each speaker outputs a specific audio channel. For example, the left audio channel can be mapped to one or more speakers located on the left side of the vehicle, and the right audio channel can be mapped to one or more speakers located on the right side of the vehicle.

[0021] Therefore, when a vehicle occupant changes seat orientation (e.g., from forward-facing to rear-facing), the audio output of the speaker set may be inverted or otherwise discordant from the occupant's perspective, resulting in a poor user experience. For example, the right audio channel might be output from a speaker located to the occupant's left, and the left audio channel might be output from a speaker located to the occupant's right. This poor user experience can be exacerbated when multi-channel audio is associated with visual content on a display viewed by the occupant (e.g., multi-channel audio might be targeted at a movie or video game). For example, in a forward-facing orientation, the occupant might be watching a scene in a movie where an airplane flies from the left to the right of the screen, and the surround sound effects of this scene might shift the audio from the left speaker to the right speaker to match the airplane's flight. However, if the occupant's seat is rear-facing, the occupant might hear the audio of the scene shifted from the occupant's right to the occupant's left. Furthermore, when there are multiple occupants in a vehicle, each in a corresponding seat orientation and each using the vehicle's audio system to consume content (e.g., the same content or different content), additional complexities may arise in achieving an acceptable user experience.

[0022] Some aspects described herein enable dynamic audio channel configuration based on the seating arrangement of the vehicle. For example, some aspects address or prevent the loss of directional synchronization between the multi-channel audio output from the vehicle's speakers and the visual content (e.g., video) on the vehicle's display device from the perspective of a vehicle occupant using (e.g., viewing) a display device. In some aspects, the output audio configuration of the vehicle can be adjusted according to changes in the orientation of the vehicle seats. For example, the mapping of audio channels to speakers can be adjusted according to changes in seat orientation. As an example, in response to a change in seat orientation from forward to rearward, the left audio channel can be mapped to the right speaker of the vehicle, and the right audio channel can be mapped to the left speaker of the vehicle. Thus, adjustments to the mapping can follow changes in seat orientation to maintain or restore consistency between the audio system's output and the occupant's positioning and orientation within the vehicle.

[0023] Some aspects described herein address or prevent audio output conflicts that may occur when a vehicle has multiple occupants. For example, if one or more seats are in a forward-facing orientation and one or more seats are in a rearward-facing orientation, inconsistencies may arise between the visual content on the display device associated with the seat and the multi-channel audio associated with the visual content that will be output by speakers. In some aspects, in response to inconsistencies, the visual content on the display device can be adjusted, such as by flipping (e.g., horizontal mirroring), thereby synchronizing the visual content and multi-channel audio at the display device. Furthermore, in some aspects, the non-textual content of the visual content can be adjusted (e.g., flipped) without adjusting (e.g., flipping) the textual content of the visual content. In this way, even if one or more seats in the vehicle have been rotated, from the perspective of the occupant using the display device, all display devices in the vehicle can present the visual content in a manner consistent with the multi-channel audio.

[0024] Figure 1 This is a diagram of an example vehicle 100 that can implement the systems and / or methods described herein. Figure 1 As shown, vehicle 100 may include a controller 110, one or more seat sensing devices 120, one or more audio output devices 130, one or more environmental sensing devices 140, and / or one or more display devices 150, etc. The devices of vehicle 100 may be interconnected via wired connections, wireless connections, or a combination of wired and wireless connections.

[0025] Controller 110 may include one or more devices capable of receiving, generating, storing, processing, providing, and / or routing information associated with dynamic audio channel configuration, as described elsewhere herein. Controller 110 may include communication devices and / or computing devices. For example, controller 110 may include devices in an electronic control module, electronic control unit, central control module, general-purpose electronic module, microcontroller, or cloud computing system. In some aspects, controller 110 may control the audio system and / or infotainment system of vehicle 100.

[0026] Seat sensing device 120 may include one or more devices capable of receiving, generating, storing, processing, and / or providing information associated with characteristics or conditions at the seats of vehicle 100, as described elsewhere herein. For example, seat sensing device 120 may be able to detect seat orientation and / or whether the seat is occupied. Seat sensing device 120 may include communication devices and / or computing devices. For example, seat sensing device 120 may include a seat control unit, a sensor module, or one or more sensor devices. In some aspects, seat sensing device 120 may include rotation sensors and / or pressure sensors.

[0027] Audio output device 130 may include one or more devices capable of receiving audio signals and outputting audio based on the audio signals. Audio output device 130 may include speakers (e.g., amplifiers, subwoofers, soundbars, etc.).

[0028] Environmental sensing device 140 may include one or more devices capable of receiving, generating, storing, processing, and / or providing information associated with characteristics or conditions of the environment surrounding vehicle 100. For example, environmental sensing device 140 may be able to detect objects, road boundaries, and / or traffic signals and signs near vehicle 100. Environmental sensing device 140 may include communication and / or computing devices. For example, environmental sensing device 140 may include a radar unit, a lidar unit, or a camera module. In some aspects, controller 110 may use measurements or other data collected by environmental sensing device 140 to control the autonomous operation of vehicle 100.

[0029] Display device 150 may include one or more devices capable of receiving, generating, storing, processing, providing, and / or displaying information associated with visual content (e.g., video), information associated with the infotainment system of vehicle 100, and / or information associated with the audio system of vehicle 100. Display device 150 may include communication devices and / or computing devices. For example, display device 150 may include wireless communication devices, mobile phones, user equipment, laptop computers, tablet computers, wearable communication devices (e.g., head-mounted displays or virtual reality headsets), or similar types of devices.

[0030] Figure 1 The number and arrangement of equipment shown are provided as an example. In practice, variations may exist. Figure 1 The equipment shown is compared to additional equipment, fewer equipment, different equipment, or equipment arranged in a different manner. Furthermore, Figure 1 The two or more devices shown can be implemented within a single device, or Figure 1 The single device shown can be implemented as multiple distributed devices. Additionally or alternatively, the set of devices of vehicle 100 (e.g., one or more devices) can perform one or more functions described as being performed by another set of devices of vehicle 100.

[0031] Figure 2 This is a diagram illustrating example components of device 200 according to the present disclosure. Device 200 may correspond to vehicle 100, controller 110, seat sensing device 120, audio output device 130, ambient sensing device 140, and / or display device 150. In some aspects, vehicle 100, controller 110, seat sensing device 120, audio output device 130, ambient sensing device 140, and / or display device 150 may include one or more devices 200 and / or one or more components of device 200. Figure 2 As shown, device 200 may include bus 205, processor 210, memory 215, input component 220, output component 225, communication component 230 and / or one or more sensors 235.

[0032] Bus 205 may include one or more components enabling wired and / or wireless communication between components of device 200. Bus 205 may connect components such as via operative coupling, communicative coupling, electronic coupling, and / or electrical coupling. Figure 2 Two or more components are coupled together. For example, bus 205 may include electrical connections (e.g., wires, traces, and / or leads) and / or wireless buses. Processor 210 may include a central processing unit, graphics processing unit, microprocessor, controller, microcontroller, digital signal processor, field-programmable gate array, application-specific integrated circuit, and / or another type of processing component. Processor 210 may be implemented in hardware, firmware, or a combination of hardware and software. In some aspects, processor 210 may include one or more processors capable of being programmed to perform one or more operations or processes described elsewhere herein.

[0033] Memory 215 may include volatile memory and / or non-volatile memory. For example, memory 215 may include random access memory (RAM), read-only memory (ROM), hard disk drive, and / or another type of memory (e.g., flash memory, magnetic memory, and / or optical memory). Memory 215 may include internal memory (e.g., RAM, ROM, or hard disk drive) and / or removable memory (e.g., removable via a universal serial bus connection). Memory 215 may be a non-transitory computer-readable medium. Memory 215 may store information relating to the operation of device 200, one or more instructions, and / or software (e.g., one or more software applications). In some aspects, memory 215 may include one or more memories, such as those coupled (e.g., communicatively coupled) to one or more processors (e.g., processor 210), via bus 205. The communicative coupling between processor 210 and memory 215 enables processor 210 to read and / or process information stored in memory 215 and / or store information in memory 215. In some aspects, controller 110 may include processor 210 and / or memory 215.

[0034] Input component 220 enables device 200 to receive input, such as user input and / or sensed input. For example, input component 220 may include a touchscreen, keyboard, keypad, mouse, button, microphone, switch, sensor, Global Positioning System (GPS) sensor, Global Navigation Satellite System (GNSS) sensor, accelerometer, gyroscope, and / or actuator. Output component 225 enables device 200 to provide output, such as via a display, speaker, and / or light-emitting diode. Communication component 230 enables device 200 to communicate with other devices via wired and / or wireless connections. For example, communication component 230 may include a receiver, transmitter, transceiver, modem, network interface card, and / or antenna.

[0035] Sensor 235 includes one or more devices capable of detecting characteristics associated with device 200 (e.g., characteristics related to the physical environment of device 200 or characteristics related to the condition of device 200). Sensor 235 may include one or more photodetectors (e.g., one or more photodiodes), one or more cameras, one or more microphones, one or more gyroscopes (e.g., microelectromechanical systems (MEMS) gyroscopes), one or more magnetometers, one or more accelerometers, one or more position sensors (e.g., GPS or GNSS receivers or local positioning system (LPS) devices), one or more motion sensors, one or more rotation sensors, one or more pressure sensors, and / or one or more touch sensors, etc.

[0036] Device 200 may perform one or more operations or procedures described herein. For example, a non-transitory computer-readable medium (e.g., memory 215) may store a set of instructions (e.g., one or more instructions or code) for execution by processor 210. Processor 210 may execute the set of instructions to perform one or more operations or procedures described herein. In some aspects, execution of the instruction set by one or more processors 210 causes one or more processors 210 and / or device 200 to perform one or more operations or procedures described herein. In some aspects, hardwired circuitry may be used in place of or in combination with instructions to perform one or more operations or procedures described herein. Additionally or alternatively, processor 210 may be configured to perform one or more operations or procedures described herein. Thus, the aspects described herein are not limited to any particular combination of hardware circuitry and software.

[0037] In some aspects, device 200 may include components for obtaining information on the seating configuration of one or more seats of a vehicle; components for determining, based on the seating configuration, that the orientation of one or more seats has changed from a forward orientation to a rearward orientation or from a rearward orientation to a forward orientation; components for inducing an adjustment of the mapping of audio channels to speakers of the vehicle based on the change of seat orientation; components for determining, based on the seating configuration, that the adjustment of the mapping will cause an inconsistency between visual content on a display device associated with an additional seat of one or more seats and multi-channel audio associated with the visual content to be output by speakers; and / or components for inducing an adjustment of the visual content on the display device to cause consistency between the visual content and the multi-channel audio. Additionally or alternatively, device 200 may include components for obtaining information on the seating configuration of one or more seats of a vehicle; components for determining, based on the seating configuration, that the orientation of one or more seats has changed; and components for inducing an adjustment of the mapping of audio channels to speakers of the vehicle based on the change of seat orientation. Additionally or alternatively, device 200 may include components for obtaining information on the seating configuration of one or more seats of a vehicle; components for determining, based on the seating configuration, an inconsistency between visual content on a display device associated with one or more seats and multi-channel audio associated with the visual content; and components for inducing adjustments to the visual content on the display device to induce consistency between the visual content and the multi-channel audio. In some aspects, the components of device 200 for performing the processes and / or operations described herein may include components combining... Figure 2 One or more components of the described device 200, such as bus 205, processor 210, memory 215, input component 220, output component 225, communication component 230 and / or sensor 235.

[0038] Figure 2 The number and arrangement of components shown are provided as an example. Device 200 may include components with... Figure 2 The components shown are compared to additional components, fewer components, different components, or components arranged in a different manner. Additionally or alternatively, the set of components of device 200 (e.g., one or more components) can perform one or more functions described as being performed by another set of components of device 200.

[0039] Figures 3A to 3E This is a diagram of example 300 associated with a dynamic audio channel configuration. For example... Figures 3A to 3E As shown, Example 300 includes a controller (e.g., controller 110). For example, the controller may be an electronic control module. The controller (e.g., one or more processors of the controller) may be configured to perform the operations described herein. The controller may be included in a vehicle (e.g., vehicle 100). The vehicle may have the capability of autonomous operation (e.g., fully autonomous or semi-autonomous operation), wherein the operation of the vehicle (e.g., steering, acceleration, speed, braking, and / or navigation, etc.) is performed without human intervention. The vehicle may include one or more seats, and the seats of the vehicle may be configured to rotate about a vertical axis (e.g., an axis extending from the floor of the vehicle to the ceiling of the vehicle). Thus, the orientation of the seat can be adjusted by rotating the seat. For example, the seat may be configured to rotate to a forward orientation (where the occupant of the seat faces the forward direction of travel of the vehicle), a rearward orientation (where the occupant of the seat faces a direction opposite to the forward direction of travel of the vehicle), or an angular lateral orientation between the forward and rearward orientations. In addition, the vehicle’s seats may include one or more sensors (e.g., seat sensing device 120) to detect the orientation of the seats and / or whether the seats are occupied, and one or more sensors may be configured to transmit sensor data to a controller.

[0040] The vehicle may also include a speaker set (e.g., audio output device 130) for its audio system. The speaker set may have fixed locations within the vehicle (e.g., one or more speakers may be located on the left side of the vehicle, one or more speakers may be located on the right side of the vehicle, and / or one or more speakers may be located in the center of the vehicle, etc.). The audio system may be capable of multi-channel audio (e.g., surround sound, such as 5.1.2 surround sound, 7.1.4 surround sound, or 9.1.6 surround sound). The vehicle may also include one or more display devices (e.g., display device 150) for its infotainment system. In some aspects, the display device may be a floating device, whereby it can be freely moved by the occupants of the vehicle, rather than being mounted in a fixed location within the vehicle. A controller may be configured to control the audio system and / or the infotainment system.

[0041] like Figure 3A As shown, and by reference numeral 305, the controller can obtain information indicating the seating configuration of one or more seats in the vehicle. The seating configuration may indicate the seat orientation (e.g., whether each seat is forward-facing, rear-facing, or side-facing) and / or the seat occupancy status (e.g., whether each seat is occupied or unoccupied). The controller can obtain information indicating the seating configuration from one or more sensors associated with the seats. For example, each seat may include a rotation sensor and / or a pressure sensor, and the controller can obtain sensor data from the seat's rotation sensor and / or pressure sensor. As another example, the vehicle may include one or more cameras positioned to capture images of the vehicle's interior, and the controller can obtain image data from the cameras.

[0042] In some aspects, the information may include angular positioning (e.g., detected by a rotation sensor) of each seat in the vehicle to indicate orientation, and / or pressure measurements (e.g., detected by a pressure sensor) of each seat in the vehicle to indicate occupancy. The controller may determine that a seat is occupied in response to a pressure measurement of the seat satisfying a threshold. In some aspects, the information may include one or more images (e.g., captured by one or more cameras) depicting the orientation of the seats and the seating position of a vehicle occupant. The controller may use computer vision techniques (e.g., object recognition techniques) to process the images to identify the occupant's seat orientation and / or seating position.

[0043] The controller may periodically (e.g., every second or every 10 seconds) acquire information indicating seat configuration. Additionally or alternatively, the controller may acquire information indicating seat configuration in response to the occurrence of one or more events (e.g., non-periodically). For example, events may include the starting of the vehicle, a change in the angular orientation of the seats, and / or a change in pressure on the seats. The controller can determine the number of occupants in the vehicle, the seats occupied by the occupants, and / or the orientation of the seats based on the seat configuration.

[0044] As indicated by reference numeral 310, based on the seating configuration, the controller can determine that the orientation of the vehicle seats has changed (e.g., a change that would result in a mismatch between the current mapping of the audio channels to the speakers and the seating configuration, as described herein). For example, the controller can determine that the seat orientation has changed from a first orientation to a second orientation based on the seating configuration. As an example, the controller can determine that the seat orientation has changed from a forward orientation to a rearward orientation, or from a rearward orientation to a forward orientation, based on the seating configuration (e.g., the seat has been rotated 180 degrees). In some aspects, the controller can determine a change in seat orientation by comparing the seating configuration with a previous seating configuration. In some aspects, the controller can determine a change in seat orientation in response to receiving a seating configuration (e.g., when the seating configuration is sent to the controller in response to the occurrence of one or more events, as described herein).

[0045] like Figure 3B As shown, and by reference numeral 315, the controller can cause an adjustment to the output audio configuration based on a change in seat orientation. For example, the controller can cause an adjustment to the mapping of audio channels to speakers based on a change in seat orientation. The audio channels may include at least a left audio channel intended for a left speaker of the vehicle relative to the forward direction of travel, and a right audio channel intended for a right speaker of the vehicle relative to the forward direction of travel. In one example, to cause an adjustment to the mapping, the controller may map the left audio channel to the right speaker and the right audio channel to the left speaker (e.g., when the seat orientation changes from forward to rearward). Thus, the adjustment to the mapping can follow the change in seat orientation to maintain or restore consistency between the audio system output and the occupant's position and orientation in the vehicle.

[0046] Additionally or alternatively, to induce adjustments to the mapping, the controller may induce (e.g., reorder) adjustments to the order of the contents of the audio buffer (e.g., reordering) at a processor using a Reduced Instruction Set Computer (RISC) architecture, either within or separate from the controller. For example, the order of contents (e.g., which includes audio data for multiple audio channels) may be adjusted such that audio data associated with a particular audio channel is provided to the desired speaker (e.g., based on the adjustment to the mapping). The controller may adjust the order of the contents of the audio buffer during or after post-processing of the audio data (e.g., surround post-processing, adding audio effects, equalization, etc.). In one example (e.g., for 5.1 channel surround sound), if the audio buffer contents are ordered as {left audio channel, right audio channel, center audio channel, low-frequency effects (LFE) audio channel, front left audio channel, front right audio channel}, the input audio buffer contents may be reordered as {right audio channel, left audio channel, center audio channel, LFE audio channel, front right audio channel, front left audio channel}.

[0047] In some respects, to cause adjustments to the mapping, the controller may cause an update to the audio input-output matrix used by the audio hardware abstraction layer (e.g., software controlling the speakers). For example, the controller may cause an update to the weighting coefficients of the matrix. The updated matrix may be used by a digital signal processor (DSP) included in or separate from the controller to derive the output audio channels provided to the speakers.

[0048] like Figure 3C As shown, matrices 320 and 325 provide examples of adjustments to the mapping of audio channels to speakers (e.g., for 5.1 channel surround sound). In matrices 320 and 325, columns can represent (e.g., received from an audio application) input audio channels, and rows can represent (e.g., provided to speakers) output audio channels. A "0" value at the intersection of a column and a row indicates that the input audio channel of the column is not mapped to the output audio channel of the row, while a "1" at the intersection indicates that the input audio channel is mapped to the output audio channel. Matrix 320 can be used when the seat is in a forward-facing orientation. As shown in matrix 320, the left input audio channel can be mapped to the left output audio channel, the right input audio channel can be mapped to the right output audio channel, the left front input audio channel can be mapped to the left front output audio channel, and the right front input audio channel can be mapped to the right front output audio channel. Matrix 325 shows the adjustments when the seat is changed to a rearward-facing orientation. As shown in matrix 325, the left input audio channel can be mapped to the right output audio channel, the right input audio channel can be mapped to the left output audio channel, the left front input audio channel can be mapped to the right front output audio channel, and the right front input audio channel can be mapped to the left front output audio channel.

[0049] By inducing adjustments to the audio channel-to-speaker mapping, the controller can cause the multi-channel audio output from the speakers to be altered according to the mapping. For example, the controller can cause an audio signal (e.g., via a digital-to-analog converter) to be provided to the speakers according to the mapping. In this way, the controller can dynamically control the audio channel configuration so that the multi-channel audio output from the speakers is aligned with the orientation of the seat. In some aspects, inducing adjustments to the output audio configuration may include adjusting the output volume (e.g., in addition to or instead of adjusting the mapping).

[0050] like Figure 3D As shown, and by reference numeral 330, the controller can identify whether visual content (e.g., video or video game) is on one or more display devices (e.g., tablet computers) of the vehicle. For example, the controller can identify whether each display device of the vehicle is presenting visual content based on information from the infotainment system. Furthermore, each display device can be associated with a corresponding seat in the vehicle (e.g., mounted to the seat or freely movable by the occupant of the seat). Therefore, the controller can also identify which occupants in which seats are watching the visual content. The same visual content can be on each display device presenting the visual content, and the multi-channel audio associated with the visual content can be output by speakers (e.g., occupants of the vehicle can watch the visual content individually on the respective display devices, but typically listen to the multi-channel audio through the vehicle's speakers). In one example, the visual content can be video (e.g., a movie), and the multi-channel audio can be surround sound audio associated with the video (e.g., which includes surround sound effects such as audio panning).

[0051] As indicated by reference numeral 335, the controller can determine, based on seating configuration, that there is an inconsistency (e.g., from the user's perspective) between visual content on a display device (e.g., one or more display devices) associated with the seat and multi-channel audio that will be output by speakers associated with the visual content. For example, the controller can determine, based on seating configuration, that an adjustment to the mapping of audio channels to speakers will cause an inconsistency between the visual content on the display device and the multi-channel audio. Inconsistency can refer to a lack of synchronization (e.g., directional discord) between the multi-channel audio and the visual content on the display device from the perspective of a vehicle occupant using (e.g., viewing) the display device.

[0052] If the same visual content, accompanied by multi-channel audio output from speakers, is displayed on a first display device and a second display device associated with corresponding seats facing different directions (e.g., one seat is forward-facing and one seat is rear-facing), the controller can determine that an inconsistency exists. For example, if occupant A has rotated their front seat to face occupant B in the rear seat, and if the mapping of the audio channels to the speakers is adjusted according to the rotation of the front seat, occupant B may perceive that the multi-channel audio is out of sync with the visual content on occupant B's display device. As an example, for a scene in a movie where the aircraft flies from the left side of the screen to the right side, occupant B may perceive an audio translation from right to left based on the adjusted mapping.

[0053] As indicated by reference numeral 340, the controller can cause adjustments to the visual content on display devices that have experienced inconsistency. For example, adjusting the visual content could be flipping it. As an example, flipping the visual content could be a horizontal mirror flip. Thus, one or more first display devices of the vehicle could present the flipped visual content, and one or more second display devices of the vehicle could present the unflipped visual content (e.g., in its original orientation). Adjusting the visual content can cause consistency between the visual content and the multi-channel audio of the previously inconsistent display devices. In this way, even if one or more seats of the vehicle have been rotated, from the perspective of an occupant using the display devices, all display devices of the vehicle can present visual content in a manner consistent with the multi-channel audio.

[0054] In some examples, visual content may include text content (e.g., words, numbers, captions, etc.). In some aspects, to induce adjustments to the visual content, the controller may cause the non-textual content of the visual content to be flipped. In other words, the non-textual content of the visual content may be flipped, while the textual content of the visual content may not be flipped. Figure 3E Example operations are shown for flipping visual content (e.g., video) without flipping text content. In some aspects, one or more additional operations, one or more alternative operations, and / or operations can be used. Figure 3E The different sequences of operations shown are used to flip the visual content without flipping the text content.

[0055] As indicated by reference numeral 345, the controller may acquire (e.g., extract) image frames (e.g., video frames) of visual content. As indicated by reference numeral 350, the controller may perform image segmentation (e.g., using computer vision techniques) on the image frames to identify pixels of the image frames associated with text content (e.g., regions of interest). For example, the controller may perform image segmentation to divide the image frame into multiple segments, and one or more segments may include pixels associated with text content.

[0056] As indicated by reference numeral 355, the controller may perform a first operation (e.g., a first image processing operation) to mirror-flip an image frame. The first operation may include flipping the entire image frame. Therefore, in addition to mirroring non-textual content within the image frame, the first operation may also result in mirroring textual content within the image frame. As indicated by reference numeral 360, the controller may perform a second operation (e.g., a second image processing operation) to mirror-flip pixels associated with textual content (if present). The second operation may result in one or more empty pixels (e.g., pixels without assigned color values) in the image frame.

[0057] As indicated by reference numeral 365, the controller may perform a third operation (e.g., a third image processing operation) to fill empty pixels with a background color. The background color may be the same across image segments or may be specific to an image segment. In some aspects, the controller may use one or more background color detection techniques to identify (e.g., the background color of an entire image frame or a segment of image frames). As indicated by reference numeral 370, the controller may output a modified image frame (e.g., to an infotainment system or another display subsystem) for rendering on a display device. The controller may perform this operation for multiple image frames of visual content (e.g., each image frame). Figure 3E The operations shown. In some respects, the controller can cause the display device to perform... Figure 3E One or more of the operations shown.

[0058] In addition to, or in lieu of, the adjustments to visual content as described above, the controller may perform one or more other operations to handle, resolve, or prevent conflicts between multiple occupants of the vehicle. In some aspects, a specific display device (e.g., associated with the driver's seat) may be designated as a control device for the vehicle's infotainment system. The control device may be enabled to provide vehicle-wide settings for the infotainment system (e.g., which other display devices may not be able to achieve). The controller may receive from the control device instructions for a designated occupant or a designated seat of the vehicle, which will be prioritized by the audio system. Therefore, the controller may cause an adjustment to the audio channel-to-speaker mapping in response to a change in the orientation of a designated seat. However, the controller may avoid adjusting the mapping when the orientation of a non-designated seat changes. In some aspects, if no designated seat is indicated to the controller, the controller may use a default designated seat (e.g., the driver's seat or the seat associated with the control device).

[0059] In some respects, in response to a change in the orientation of the first seat, the controller may cause an adjustment to the audio channel-to-speaker mapping only for the first subset of speakers associated with the first seat of the vehicle. Similarly, in response to a change in the orientation of the second seat, the controller may cause an adjustment to the audio channel-to-speaker mapping only for the second subset of speakers associated with the second seat of the vehicle. For example, the first subset of speakers may be mounted on or directed toward the driver's seat of the vehicle, and the second subset of speakers may be mounted on or directed toward the front passenger seat of the vehicle. Continuing this example, in response to a change in the orientation of the driver's seat, the controller may adjust the mapping for the first subset of speakers (but not for the second subset or additional subsets of speakers, such as speakers mounted on or directed toward the rear seats of the vehicle), and in response to a change in the orientation of the front passenger seat, the controller may adjust the mapping for the second subset of speakers (but not for the first subset or additional subsets of speakers).

[0060] In some aspects, the controller can select speakers for a subset of speakers based on seating configuration. For example, if there is a single occupant in both the front and rear seats of the vehicle, the controller can select all front speakers as a first subset and all rear speakers as a second subset. However, if there are two occupants in the front seats, the controller can select a subset of the front speakers as the first subset. In some aspects, the controller can automatically perform the selection of speaker subsets. In some aspects, the controller can provide a recommendation to a control device instructing the selection of speaker subsets, and the occupants of the vehicle can use the control device to accept or adjust the recommendation.

[0061] In some aspects, based on the determination that at least one occupant is present in the front seats and at least one occupant is present in the rear seats of the vehicle, the controller may avoid adjusting the audio channel-to-speaker mapping in response to a change in seat orientation (e.g., the controller may disable dynamic audio channel configuration). In other aspects, in response to a change in seat orientation, and based on the determination that a display device associated with the seat is displaying visual content (e.g., video or video game) associated with multi-channel audio output from the speakers and that no other display device is displaying visual content associated with multi-channel audio output from the speakers, the controller may adjust the audio channel-to-speaker mapping. For example, if occupant A's display device is playing a video with associated audio output from the speakers, and if occupant B's display device is not playing a video, the controller may adjust the audio channel-to-speaker mapping in response to a change in the orientation of occupant A's seat (but not in response to a change in the orientation of occupant B's seat).

[0062] In some respects, the loudspeakers can have the capability to perform audio beamforming. In some respects, the controller can cause (e.g., by adjusting the mapping of audio channels to loudspeakers, as described herein) a first subset of loudspeakers to beamform audio directed toward one or more first seats of the vehicle, and a second subset of loudspeakers to beamform audio directed toward one or more second seats of the vehicle. For example, the controller can cause the left-side loudspeaker of the vehicle to beamform audio directed toward the front seats of the vehicle, and the right-side loudspeaker of the vehicle to beamform audio directed toward the rear seats of the vehicle. This can be useful when the front seats have been rotated to face the rear seats. In this way, separate multi-channel audio (e.g., stereo audio or surround sound audio) can be provided to the respective occupants of the vehicle.

[0063] As indicated above, Figures 3A to 3E This is provided as an example. Other examples are available with reference to [the relevant information]. Figures 3A to 3E The examples described are different.

[0064] Figure 4 This is a flowchart of an example process 400 associated with dynamic audio channel configuration. In some respects, Figure 4 One or more process frames are executed by a controller (e.g., controller 110). In some respects, Figure 4 One or more process frames are executed by another device or group of devices, separate from or including the controller, such as a seat sensing device (e.g., seat sensing device 120), an audio output device (e.g., audio output device 130), and / or a display device (e.g., display device 150). Additionally or alternatively, Figure 5 One or more process frames may be executed by one or more components of device 200, such as processor 210, memory 215, input component 220, output component 225, communication component 230 and / or sensor 235.

[0065] like Figure 4 As shown, process 400 may include obtaining information indicating the seating configuration of one or more seats of the vehicle (box 405), as described herein. Process 400 may include determining, based on the seating configuration, whether the vehicle has multiple occupants (box 410). In response to determining that the vehicle does not have multiple occupants (box 410 - No), process 400 may include determining, based on the seating configuration, whether there is a change in seat orientation (box 415), as described herein. In response to determining that there is a change in seat orientation (box 415 - Yes), process 400 may include causing an adjustment to the mapping of audio channels to the vehicle's speakers based on the seat orientation (box 420), as described herein. In response to determining that there is no change in seat orientation (box 415 - No), process 400 may include maintaining the mapping of audio channels to the vehicle's speakers (e.g., default mapping or previously adjusted mapping) (box 425).

[0066] In response to determining that the vehicle does indeed have multiple occupants (box 410 - Yes), process 400 may include determining, based on seating configuration, whether there is a change in the orientation of a seat designated for priority by the audio system, resulting in the seat facing a different direction (box 430), as described herein. For example, a change in seat orientation could result in one seat of the vehicle having a forward orientation and another seat of the vehicle having a rearward orientation. In response to determining that there is no such change in the orientation of the seat designated for priority by the audio system (box 430 - No), process 400 may include maintaining the mapping of audio channels to the vehicle's speakers (e.g., default mapping or previously adjusted mapping) (box 435). In response to determining that there is such a change in the orientation of the seat designated for priority by the audio system (box 430 - Yes), process 400 may include adjusting the mapping of audio channels to the vehicle's speakers based on the designated seat orientation (box 440), as described herein.

[0067] Process 400 may include determining whether a different seat (e.g., facing a designated seat and / or having an orientation opposite to that of the designated seat) is designated as preferred by the audio system (box 445). For example, an occupant of a different seat may request to be preferred via a display device, and an occupant of the designated seat may grant or deny the request via the display device. In response to determining that a different seat is not designated as preferred (box 445 - No), process 400 may include causing an adjustment (e.g., flipping) to the visual content on the display device associated with the different seat (box 450), as described herein. In response to determining that a different seat is designated as preferred (box 445 - Yes), process 400 may include causing an adjustment to or maintaining the mapping of the audio channels to the vehicle's speakers based on the orientation of the different seats (box 455), as described herein. In some aspects, in response to adjusting the mapping of the audio channels to the vehicle's speakers based on the orientation of the different seats, process 400 may include causing an adjustment (e.g., flipping) to the visual content on the display device associated with the originally designated seat.

[0068] As indicated above, Figure 4 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 4 The examples described are different.

[0069] Figure 5 This is a flowchart of an example process 500 associated with dynamic audio channel configuration for vehicles. In some respects, Figure 5 One or more process frames are executed by a controller (e.g., controller 110). In some respects, Figure 5One or more process frames are executed by another device or group of devices, separate from or including the controller, such as a seat sensing device (e.g., seat sensing device 120), an audio output device (e.g., audio output device 130), and / or a display device (e.g., display device 150). Additionally or alternatively, Figure 5 One or more process frames may be executed by one or more components of device 200, such as processor 210, memory 215, input component 220, output component 225, communication component 230 and / or sensor 235.

[0070] like Figure 5 As shown, process 500 may include obtaining information indicating the seating configuration of one or more seats in a vehicle (box 510). For example, a controller may obtain information indicating the seating configuration of one or more seats in a vehicle as described above.

[0071] like Figure 5 As further shown, process 500 may include determining, based on the seating configuration, that the orientation of one or more seats has changed from a forward orientation to a rearward orientation or from a rearward orientation to a forward orientation (box 520). For example, the controller may determine, based on the seating configuration, that the orientation of one or more seats has changed from a forward orientation to a rearward orientation or from a rearward orientation to a forward orientation, as described above.

[0072] like Figure 5 As further shown, process 500 may include adjusting the mapping of the audio channel to the vehicle's speakers based on a change in seat orientation (box 530). For example, the controller may adjust the mapping of the audio channel to the vehicle's speakers based on a change in seat orientation, as described above.

[0073] like Figure 5 As further shown, process 500 may include determining, based on seating configuration, that an adjustment to the mapping will cause an inconsistency between visual content on a display device associated with an additional seat in one or more seats and multi-channel audio associated with the visual content to be output by a speaker (box 540). For example, the controller may determine, based on seating configuration, that an adjustment to the mapping will cause an inconsistency between visual content on a display device associated with an additional seat in one or more seats and multi-channel audio associated with the visual content to be output by a speaker, as described above.

[0074] like Figure 5As further shown, process 500 may include inducing adjustments to visual content on a display device to achieve consistency between the visual content and multi-channel audio (box 550). For example, a controller may induce adjustments to visual content on a display device to achieve consistency between the visual content and multi-channel audio, as described above.

[0075] Process 500 may include additional aspects, such as any single aspect or any combination of aspects described below and / or in conjunction with one or more other process descriptions elsewhere herein.

[0076] In the first aspect, the seating configuration indicates at least one of the orientation of one or more seats or the occupancy status of one or more seats.

[0077] In a second aspect, either alone or in combination with the first aspect, causing an adjustment to the mapping includes: mapping a left audio channel intended for use with a left speaker of a vehicle to a right speaker of the vehicle, and mapping a right audio channel intended for use with a right speaker of a vehicle to a left speaker of the vehicle.

[0078] In the third aspect, adjustments to the mapping, either alone or in combination with one or more of the first and second aspects, include adjustments to the order of the contents of the audio buffer.

[0079] In the fourth aspect, adjustments to the mapping, either alone or in combination with one or more of the first to third aspects, include updates to the audio input-output matrix used by the audio hardware abstraction layer.

[0080] In the fifth aspect, alone or in combination with one or more of the first to fourth aspects, causing adjustments to the visual content includes causing the flipping of visual content other than the textual content of the visual content.

[0081] In the sixth aspect, alone or in combination with one or more of the first to fifth aspects, causing an adjustment to the visual content includes: performing image segmentation on an image frame of the visual content to identify pixels of the image frame associated with the text content; performing a first operation to mirror flip the image frame, the first operation resulting in a mirror flip of the text content; performing a second operation to mirror flip the pixels associated with the text content, the second operation resulting in one or more empty pixels of the image frame; and performing a third operation to fill the empty pixels with a background color.

[0082] In the seventh aspect, the means of transport has the ability to operate autonomously, either alone or in combination with one or more of the first to sixth aspects.

[0083] In the eighth aspect, either alone or in combination with one or more of the first to seventh aspects, the loudspeaker includes at least a left-side loudspeaker and a right-side loudspeaker of the vehicle.

[0084] In the ninth aspect, either alone or in combination with one or more of the first to eighth aspects, information indicating seating configuration is obtained from one or more sensors associated with one or more seats of the vehicle.

[0085] In the tenth aspect, alone or in combination with one or more of the first to ninth aspects, process 500 includes receiving an instruction for a designated seat of the vehicle, wherein adjustment of the audio channel-to-speaker mapping is in response to the seat being the designated seat.

[0086] In the eleventh aspect, either alone or in combination with one or more of the first to tenth aspects, the adjustment of the audio channel-to-speaker mapping is applied only to a subset of the speakers associated with the seat.

[0087] although Figure 5 An example box of process 500 is shown, but in some respects, process 500 includes... Figure 5 The depicted boxes may be fewer, different, or arranged differently compared to additional boxes, boxes, or boxes in different ways. Alternatively, two or more boxes in the process 500 may be executed in parallel.

[0088] Figure 6 This is a flowchart of an example process 600 associated with dynamic audio channel configuration for vehicles. In some respects, Figure 6 One or more process frames are executed by a controller (e.g., controller 110). In some respects, Figure 6 One or more process frames are executed by another device or group of devices, separate from or including the controller, such as a seat sensing device (e.g., seat sensing device 120), an audio output device (e.g., audio output device 130), and / or a display device (e.g., display device 150). Additionally or alternatively, Figure 5 One or more process frames may be executed by one or more components of device 200, such as processor 210, memory 215, input component 220, output component 225, communication component 230 and / or sensor 235.

[0089] like Figure 6 As shown, process 600 may include obtaining information indicating the seating configuration of one or more seats in a vehicle (box 610). For example, a controller may obtain information indicating the seating configuration of one or more seats in a vehicle as described above.

[0090] like Figure 6As further shown, process 600 may include determining, based on seating configuration, that there is a change in the orientation of one or more seats (block 620). For example, the controller may determine, based on seating configuration, that there is a change in the orientation of one or more seats, as described above.

[0091] like Figure 6 As further shown, process 600 may include adjusting the mapping of the audio channels to the vehicle's speakers based on a change in the orientation of the seat (box 630). For example, the controller may adjust the mapping of the audio channels to the vehicle's speakers based on a change in the orientation of the seat, as described above.

[0092] Process 600 may include additional aspects, such as any single aspect or any combination of aspects described below and / or in conjunction with one or more other process descriptions elsewhere herein.

[0093] In the first aspect, the seating configuration indicates at least one of the orientation of one or more seats or the occupancy status of one or more seats.

[0094] In a second aspect, either alone or in combination with the first aspect, process 600 includes: mapping a left audio channel intended for use with a left speaker of a vehicle to a right speaker of the vehicle, and mapping a right audio channel intended for use with a right speaker of the vehicle to a left speaker of the vehicle.

[0095] In a third aspect, either alone or in combination with one or more of the first and second aspects, process 600 includes causing an adjustment of the order of the contents of the audio buffer.

[0096] In the fourth aspect, either alone or in combination with one or more of the first to third aspects, process 600 includes causing an update to the audio input-output matrix used by the audio hardware abstraction layer.

[0097] In the fifth aspect, either alone or in combination with one or more of the first to fourth aspects, the loudspeaker includes at least a left-side loudspeaker and a right-side loudspeaker of the vehicle.

[0098] In a sixth aspect, either alone or in combination with one or more of the first to fifth aspects, process 600 includes obtaining information indicating seat configuration from one or more sensors associated with one or more seats of the vehicle.

[0099] In the seventh aspect, alone or in combination with one or more of the first to sixth aspects, process 600 includes receiving an instruction for a designated seat of the vehicle, wherein adjustment of the audio channel-to-speaker mapping is in response to the seat being a designated seat.

[0100] In the eighth aspect, either alone or in combination with one or more of the first to seventh aspects, the adjustment of the audio channel-to-speaker mapping is applied only to a subset of the speakers associated with the seat.

[0101] although Figure 6 An example box of process 600 is shown, but in some respects, process 600 includes... Figure 6 The depicted boxes may be fewer, different, or arranged differently compared to additional boxes, boxes, or boxes in different ways. Alternatively, two or more boxes in the process 600 may be executed in parallel.

[0102] Figure 7 This is a flowchart of an example process 700 associated with dynamic audio channel configuration for vehicles. In some respects, Figure 6 One or more process frames are executed by a controller (e.g., controller 110). In some respects, Figure 6 One or more process frames are executed by another device or group of devices, separate from or including the controller, such as a seat sensing device (e.g., seat sensing device 120), an audio output device (e.g., audio output device 130), and / or a display device (e.g., display device 150). Additionally or alternatively, Figure 5 One or more process frames may be executed by one or more components of device 200, such as processor 210, memory 215, input component 220, output component 225, communication component 230 and / or sensor 235.

[0103] like Figure 7 As shown, process 700 may include obtaining information indicating the seating configuration of one or more seats in a vehicle (box 710). For example, a controller may obtain information indicating the seating configuration of one or more seats in a vehicle as described above.

[0104] like Figure 7 As further shown, process 700 may include determining, based on seating configuration, an inconsistency exists between visual content on a display device associated with one or more seats and multi-channel audio associated with the visual content (box 720). For example, the controller may determine, based on seating configuration, an inconsistency exists between visual content on a display device associated with one or more seats and multi-channel audio associated with the visual content, as described above.

[0105] like Figure 7As further shown, process 700 may include inducing adjustments to visual content on a display device to achieve consistency between the visual content and multi-channel audio (box 730). For example, a controller may induce adjustments to visual content on a display device to achieve consistency between the visual content and multi-channel audio, as described above.

[0106] Process 700 may include additional aspects, such as any single aspect or any combination of aspects described below and / or in conjunction with one or more other process descriptions elsewhere herein.

[0107] In the first aspect, the seating configuration indicates at least one of the orientation of one or more seats or the occupancy status of one or more seats.

[0108] In the second aspect, either alone or in combination with the first aspect, causing adjustments to the visual content includes causing the flipping of visual content other than the textual content of the visual content.

[0109] In a third aspect, alone or in combination with one or more of the first and second aspects, causing an adjustment to the visual content includes: performing image segmentation on an image frame of the visual content to identify pixels of the image frame associated with text content; performing a first operation to mirror flip the image frame, the first operation resulting in mirror flipping of the text content; performing a second operation to mirror flip the pixels associated with the text content, the second operation resulting in one or more empty pixels of the image frame; and performing a third operation to fill the empty pixels with a background color.

[0110] In a fourth aspect, either alone or in combination with one or more of the first to third aspects, process 700 includes obtaining information indicating seat configuration from one or more sensors associated with one or more seats of the vehicle.

[0111] although Figure 7 An example box of process 700 is shown, but in some respects, process 700 includes... Figure 7 The depicted boxes may be fewer, different, or arranged differently compared to additional boxes, boxes, or boxes in different ways. Alternatively, two or more boxes in the process 700 may be executed in parallel.

[0112] The following provides an overview of some aspects of this disclosure:

[0113] Aspect 1: A method comprising: obtaining by a device information indicating a seating configuration of one or more seats of a vehicle; determining by the device and based on the seating configuration that the orientation of one or more seats has changed from a forward orientation to a rearward orientation or from the rearward orientation to the forward orientation; causing by the device and based on the change in the orientation of the seats to adjust a mapping of an audio channel to a speaker of the vehicle; determining by the device and based on the seating configuration that the adjustment of the mapping will cause an inconsistency between visual content on a display device associated with an additional seat of the one or more seats and multi-channel audio associated with the visual content to be output by the speaker; and causing by the device to adjust the visual content on the display device to cause consistency between the visual content and the multi-channel audio.

[0114] Aspect 2: According to the method of aspect 1, wherein the seating configuration indicates at least one of the orientation of the one or more seats or the occupancy status of the one or more seats.

[0115] Aspect 3: The method according to any one of Aspects 1 to 2, wherein causing the adjustment of the mapping comprises: mapping a left audio channel intended for use with a left speaker of the vehicle to a right speaker of the vehicle, and mapping a right audio channel intended for use with the right speaker of the vehicle to the left speaker of the vehicle.

[0116] Aspect 4: The method according to any one of Aspects 1 to 3, wherein causing the adjustment to the mapping includes causing an adjustment to the order of the contents of the audio buffer.

[0117] Aspect 5: The method according to any one of Aspects 1 to 4, wherein causing the adjustment to the mapping comprises causing an update to the audio input-output matrix used by the audio hardware abstraction layer.

[0118] Aspect 6: The method according to any one of Aspects 1 to 5, wherein causing the adjustment of the visual content comprises: causing the visual content other than the text content of the visual content to be flipped.

[0119] Aspect 7: The method according to any one of Aspects 1 to 6, wherein causing the adjustment to the visual content comprises: performing image segmentation on an image frame of the visual content to identify pixels of the image frame associated with text content; performing a first operation to mirror flip the image frame, the first operation causing mirror flipping of the text content; performing a second operation to mirror flip the pixels associated with the text content, the second operation causing one or more empty pixels of the image frame; and performing a third operation to fill the empty pixels with a background color.

[0120] Aspect 8: The method according to any one of Aspects 1 to 7, wherein the vehicle has the ability to operate autonomously.

[0121] Aspect 9: The method according to any one of Aspects 1 to 8, wherein the loudspeaker comprises at least a left loudspeaker of the vehicle and a right loudspeaker of the vehicle.

[0122] Aspect 10: The method according to any one of aspects 1 to 9, wherein the information indicating the seat configuration is obtained from one or more sensors associated with the one or more seats of the vehicle.

[0123] Aspect 11: The method according to any one of aspects 1 to 10, the method further comprising: receiving an instruction for a designated seat of the vehicle, wherein the adjustment of the mapping of the audio channel to the speaker is in response to the seat being the designated seat.

[0124] Aspect 12: The method according to any one of Aspects 1 to 11, wherein the adjustment of the mapping of the audio channel to the speaker is only for a subset of speakers associated with the seat.

[0125] Aspect 13: A controller comprising: one or more memories; and one or more processors coupled to the one or more memories, configured to: obtain information indicating a seating configuration of one or more seats of a vehicle; determine, based on the seating configuration, that a change in the orientation of one or more seats exists; and, based on the change in the orientation of the seats, cause an adjustment to the mapping of an audio channel to a speaker of the vehicle.

[0126] Aspect 14: The controller according to aspect 13, wherein the seat configuration indicates at least one of the orientation of the one or more seats or the occupancy status of the one or more seats.

[0127] Aspect 15: A controller according to any one of Aspects 13 to 14, wherein, in order to cause the adjustment of the mapping, the one or more processors are configured to: map a left audio channel intended for use with the left speaker of the vehicle to the right speaker of the vehicle, and map a right audio channel intended for use with the right speaker of the vehicle to the left speaker of the vehicle.

[0128] Aspect 16: A controller according to any one of Aspects 13 to 15, wherein, in order to cause the adjustment of the mapping, the one or more processors are configured to cause an adjustment of the order of the contents of the audio buffer.

[0129] Aspect 17: A controller according to any one of Aspects 13 to 16, wherein, in order to cause the adjustment of the mapping, the one or more processors are configured to cause an update to the audio input-output matrix used by the audio hardware abstraction layer.

[0130] Aspect 18: The controller according to any one of Aspects 13 to 17, wherein the speaker includes at least a left speaker of the vehicle and a right speaker of the vehicle.

[0131] Aspect 19: A controller according to any one of Aspects 13 to 18, wherein, in order to obtain the information indicating the seat configuration, the one or more processors are configured to: obtain the information indicating the seat configuration from one or more sensors associated with the one or more seats of the vehicle.

[0132] Aspect 20: A controller according to any one of aspects 13 to 19, wherein the one or more processors are further configured to: receive an instruction for a designated seat of the vehicle, wherein the adjustment of the mapping of the audio channel to the speaker is in response to the seat being the designated seat.

[0133] Aspect 21: The controller according to any one of Aspects 13 to 20, wherein the adjustment of the mapping of the audio channel to the speaker is only for a subset of speakers associated with the seat.

[0134] Aspect 22: A controller comprising: one or more memories; and one or more processors coupled to the one or more memories, configured to: obtain information indicating a seating configuration of one or more seats of a vehicle; determine, based on the seating configuration, an inconsistency between visual content on a display device associated with a seat of the one or more seats and multi-channel audio associated with the visual content; and cause adjustments to the visual content on the display device to cause consistency between the visual content and the multi-channel audio.

[0135] Aspect 23: The controller according to aspect 22, wherein the seat configuration indicates at least one of the orientation of the one or more seats or the occupancy status of the one or more seats.

[0136] Aspect 24: A controller according to any one of Aspects 22 to 23, wherein, in order to cause the adjustment of the visual content, the one or more processors are configured to cause the flipping of the visual content other than the text content of the visual content.

[0137] Aspect 25: A controller according to any one of Aspects 22 to 24, wherein, in order to cause the adjustment of the visual content, the one or more processors are configured to: perform image segmentation on an image frame of the visual content to identify pixels of the image frame associated with text content; perform a first operation to mirror-flip the image frame, the first operation causing mirror-flipping of the text content; perform a second operation to mirror-flip the pixels associated with the text content, the second operation causing one or more empty pixels of the image frame; and perform a third operation to fill the empty pixels with a background color.

[0138] Aspect 26: A controller according to any one of aspects 22 to 25, wherein, in order to obtain the information indicating the seat configuration, the one or more processors are configured to: obtain the information indicating the seat configuration from one or more sensors associated with the one or more seats of the vehicle.

[0139] Aspect 27: An apparatus comprising: components for obtaining information indicating a seating configuration of one or more seats of a vehicle; components for determining, based on the seating configuration, that there is a change in the orientation of one or more seats; and components for causing an adjustment of the mapping of an audio channel to a speaker of the vehicle based on the change in the orientation of the seats.

[0140] Aspect 28: The apparatus according to aspect 27, wherein the component for causing the adjustment of the mapping includes: a component for mapping a left audio channel intended for use with a left speaker of the vehicle to a right speaker of the vehicle and for mapping a right audio channel intended for use with the right speaker of the vehicle to the left speaker of the vehicle.

[0141] Aspect 29: The apparatus according to any one of Aspects 27 to 28, the apparatus further comprising: a component for receiving an instruction for a designated seat of the vehicle, wherein the adjustment of the mapping of the audio channel to the speaker is in response to the seat being the designated seat.

[0142] Aspect 30: The apparatus according to any one of Aspects 27 to 29, wherein the adjustment of the mapping of the audio channel to the speaker is only for a subset of speakers associated with the seat.

[0143] Aspect 31: A system configured to perform one or more of the operations stated in one or more of aspects 1 to 30.

[0144] Aspect 32: An apparatus comprising components for performing one or more of the operations described in one or more of aspects 1 to 30.

[0145] Aspect 33: A non-transitory computer-readable medium storing an instruction set comprising one or more instructions that, when executed by a device, cause the device to perform one or more operations stated in one or more of aspects 1 to 30.

[0146] Aspect 34: A computer program product comprising instructions or code for performing one or more of the operations stated in one or more of aspects 1 to 30.

[0147] While the foregoing disclosure provides examples and descriptions, it is not intended to be exhaustive or to limit aspects to the precise form disclosed. Modifications and variations can be made based on the foregoing disclosure, or from various aspects of practice.

[0148] As used herein, the term "component" is intended to be interpreted broadly as hardware and / or a combination of hardware and software. Whether referred to as software, firmware, middleware, microcode, hardware description language, or other names, "software" should be interpreted broadly as meaning instructions, instruction sets, code, code segments, program code, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, and / or functions, etc. As used herein, a "processor" is implemented in hardware and / or a combination of hardware and software. It will be apparent that the systems and / or methods described herein can be implemented through various forms of hardware and / or combinations of hardware and software. The actual dedicated control hardware or software code used to implement these systems and / or methods is not limiting in any way. Therefore, no specific software code is referred to in this document to describe the operation and behavior of the systems and / or methods, as those skilled in the art will understand that the software and hardware can be designed, at least in part, based on the descriptions herein, to implement the systems and / or methods.

[0149] As used in this article, depending on the context, "meeting the threshold" can mean a value greater than the threshold, greater than or equal to the threshold, less than the threshold, less than or equal to the threshold, equal to the threshold, not equal to the threshold, etc.

[0150] Although specific combinations of features are set forth in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of various aspects. Many of these features may be combined in ways not specifically set forth in the claims and / or not disclosed in the specification. The disclosure of various aspects includes each dependent claim in combination with each other claim in the set of claims. As used herein, the phrase referring to “at least one of” the list of entries means any combination of these entries, including a single member. As an example, “at least one of a, b, or c” is intended to cover: a, b, c, ab, ac, bc, and abc, as well as any combination having multiple identical elements (e.g., aa, aaa, aab, aac, abb, acc, bb, bbb, bbc, cc, and ccc, or any other ordering of a, b, and c).

[0151] No element, action, or instruction used herein should be construed as essential or necessary unless explicitly stated otherwise. Furthermore, as used herein, the articles “a” and “an” are intended to include one or more items and are used interchangeably with “one or more.” Furthermore, as used herein, the article “described” is intended to include one or more items mentioned in connection with the article “described” and is used interchangeably with “one or more.” Furthermore, as used herein, the terms “group” and “cluster” are intended to include one or more items and are used interchangeably with “one or more.” If only one item is desired, the phrase “only one” or similar terminology will be used. Furthermore, as used herein, the terms “having” and the like are intended to be open-ended terms that do not limit the elements they modify (e.g., an element “having” A may also have B). Furthermore, the phrase “based on” is intended to mean “at least partially based on” unless otherwise explicitly stated. Furthermore, as used herein, the term “or” is intended to be open-ended when used in a series and is interchangeable with “and / or” unless otherwise explicitly stated (e.g., if used in conjunction with “any” or “only one”).

Claims

1. A method comprising: obtaining, by a device, information indicative of a seat configuration of one or more seats of a vehicle; determining, by the device and in accordance with the seat configuration, that an orientation of a seat of the one or more seats has a change from a forward orientation to a rearward orientation or from the rearward orientation to the forward orientation; causing, by the device and in accordance with the change in the orientation of the seat, an adjustment to a mapping of audio channels to speakers of the vehicle; determining, by the device and in accordance with the seat configuration, that the adjustment to the mapping will cause an inconsistency between visual content on a display device associated with an additional seat of the one or more seats and multi-channel audio associated with the visual content that is to be output by the speakers; and causing, by the device, an adjustment to the visual content on the display device to cause a consistency between the visual content and the multi-channel audio.

2. The method of claim 1, wherein the seat configuration is indicative of at least one of a directional orientation of the one or more seats or an occupancy status of the one or more seats.

3. The method of claim 1, wherein causing the adjustment to the mapping comprises: causing left audio channels intended for a left speaker of the vehicle to be mapped to a right speaker of the vehicle and causing right audio channels intended for the right speaker of the vehicle to be mapped to the left speaker of the vehicle.

4. The method of claim 1, wherein causing the adjustment to the mapping comprises: causing an adjustment to an order of contents of an audio buffer.

5. The method of claim 1, wherein causing the adjustment to the mapping comprises: causing an update to an audio input-output matrix used by an audio hardware abstraction layer.

6. The method of claim 1, wherein causing the adjustment to the visual content comprises: causing a flip of the visual content except for text content of the visual content.

7. The method of claim 1, wherein causing the adjustment to the visual content comprises: performing image segmentation on an image frame of the visual content to identify pixels of the image frame associated with text content; performing a first operation to mirror flip the image frame, the first operation causing a mirror flip of the text content; performing a second operation to mirror flip the pixels associated with the text content, the second operation causing one or more empty pixels of the image frame; and performing a third operation to fill the empty pixels with a background color.

8. The method of claim 1, wherein the vehicle has an ability to operate autonomously.

9. The method of claim 1, wherein the speakers comprise at least a left speaker of the vehicle and a right speaker of the vehicle.

10. The method of claim 1, wherein the information indicative of the seat configuration is obtained from one or more sensors associated with the one or more seats of the vehicle.

11. The method of claim 1, further comprising: receiving an indication of a designated seat of the vehicle, wherein the adjustment of the mapping of the audio channels to the speakers is in response to the seat being the designated seat.

12. The method of claim 1, wherein the adjustment of the mapping of the audio channels to the speakers is only for a subset of speakers associated with the seat.

13. A controller comprising: one or more memories; and one or more processors coupled to the one or more memories, the one or more processors configured to: obtain information indicative of a seat configuration of one or more seats of a vehicle; determine, from the seat configuration, that a directional orientation of a seat of the one or more seats has changed; and in response to the change in the directional orientation of the seat, cause an adjustment to a mapping of audio channels to speakers of the vehicle.

14. The controller of claim 13, wherein the seat configuration is indicative of at least one of a directional orientation of the one or more seats or an occupancy status of the one or more seats.

15. The controller of claim 13, wherein to cause the adjustment to the mapping, the one or more processors are configured to: cause a left audio channel intended for a left speaker of the vehicle to be mapped to a right speaker of the vehicle and cause a right audio channel intended for the right speaker of the vehicle to be mapped to the left speaker of the vehicle.

16. The controller of claim 13, wherein to cause the adjustment to the mapping, the one or more processors are configured to: cause an adjustment to an order of contents of an audio buffer.

17. The controller of claim 13, wherein to cause the adjustment to the mapping, the one or more processors are configured to: cause an update to an audio input-output matrix used by an audio hardware abstraction layer.

18. The controller of claim 13, wherein the speakers comprise at least a left speaker of the vehicle and a right speaker of the vehicle.

19. The controller of claim 13, wherein to obtain the information indicative of the seat configuration, the one or more processors are configured to: obtain the information indicative of the seat configuration from one or more sensors associated with the one or more seats of the vehicle.

20. The controller of claim 13, wherein the one or more processors are further configured to: receive an indication of a designated seat of the vehicle, wherein the adjustment of the mapping of the audio channels to the speakers is in response to the seat being the designated seat.

21. The controller of claim 13, wherein the adjustment of the mapping of the audio channels to the speakers is only for a subset of speakers associated with the seat.

22. A controller comprising: one or more memories; and one or more processors coupled to the one or more memories, the one or more processors configured to: obtain information indicative of a seat configuration of one or more seats of a vehicle; determine, from the seat configuration, that there is an inconsistency between visual content on a display device associated with a seat of the one or more seats and multi-channel audio associated with the visual content; and cause an adjustment to the visual content on the display device to cause a consistency between the visual content and the multi-channel audio.

23. The controller of claim 22, wherein the seat configuration is indicative of at least one of an orientation of the one or more seats or an occupancy status of the one or more seats.

24. The controller of claim 22, wherein to cause the adjustment to the visual content, the one or more processors are configured to: cause a flip of the visual content except for text content of the visual content.

25. The controller of claim 22, wherein to cause the adjustment to the visual content, the one or more processors are configured to: perform image segmentation of an image frame of the visual content to identify pixels of the image frame associated with text content; perform a first operation to mirror flip the image frame, the first operation causing a mirror flip of the text content; perform a second operation to mirror flip the pixels associated with the text content, the second operation causing one or more empty pixels of the image frame; and perform a third operation to fill the empty pixels with a background color.

26. The controller of claim 22, wherein to obtain the information indicative of the seat configuration, the one or more processors are configured to: obtain the information indicative of the seat configuration from one or more sensors associated with the one or more seats of the vehicle.

27. An apparatus, the apparatus comprising: means for obtaining information indicative of a seat configuration of one or more seats of a vehicle; means for determining, from the seat configuration, that there is a change in an orientation of a seat of the one or more seats; and means for causing an adjustment to a mapping of audio channels to speakers of the vehicle in accordance with the change in the orientation of the seat.

28. The apparatus of claim 27, wherein the means for causing the adjustment to the mapping comprises: means for causing a left audio channel intended for a left speaker of the vehicle to be mapped to a right speaker of the vehicle and a right audio channel intended for the right speaker of the vehicle to be mapped to the left speaker of the vehicle.

29. The apparatus of claim 27, the apparatus further comprising: means for receiving an indication of a designated seat of the vehicle, wherein the adjustment to the mapping of the audio channels to the speakers is responsive to the seat being the designated seat.

30. The device of claim 27, wherein the adjustment to the mapping of the audio channels to the speakers is only for a subset of speakers associated with the seat.

Images