Single-instance multi-user support for vehicle operating systems

The single-instance multi-user vehicle operating system enables multiple users to access and control vehicle functions through separate displays, addressing the limitations of single-user systems and enhancing safety and interaction.

JP7954278B2Active Publication Date: 2026-11-19GOOGLE LLC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2025508768
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-08-15
Filing Date
2023-08-10
Publication Date
2026-11-19
Estimated Expiration
2043-08-10

AI Technical Summary

Technical Problem

Existing vehicle operating systems typically restrict access to a single user profile, limiting the ability for multiple users to interact with vehicle functions simultaneously, which can lead to distractions and hinder collaborative activities.

Method used

A single-instance multi-user vehicle operating system allows multiple user profiles to access and interact with vehicle functions through separate displays, enabling collaborative activities like content sharing and coordinated navigation, using gestures and personalized user interfaces.

Benefits of technology

Enhances user experience by allowing multiple users to safely and intuitively control vehicle systems without distracting the operator, promoting safer and more personalized interactions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007954278000001
    Figure 0007954278000001
  • Figure 0007954278000002
    Figure 0007954278000002
  • Figure 0007954278000003
    Figure 0007954278000003
Patent Text Reader

Abstract

A computing device including a memory and one or more processors may be configured to implement various aspects of the technology. The memory may store an instance of a vehicle operating system, where the instance of the vehicle operating system facilitates concurrent access by multiple user profiles. The one or more processors may execute the instance of the vehicle operating system, where the instance is configured to authorize multiple user profiles to interface with the instance of the vehicle operating system and to present multiple user interfaces across multiple displays communicatively coupled to a vehicle head unit, each of the multiple user interfaces being associated with one or more of the multiple user profiles. The multiple user interfaces may interface with multiple users associated with the multiple user profiles to enable multiple users to interface with the instance of the vehicle operating system to control functions associated with the vehicle head unit.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] This application claims priority to U.S. Provisional Application No. 63 / 371,445, filed on August 15, 2022 and entitled "CONTEXT AWARE SAFETY FEATURES FOR VEHICLE OPERATING SYSTEMS", and U.S. Provisional Application No. 63 / 371,451, filed on August 15, 2022 and entitled "SINGLE-INSTANCE MULTI-USER SUPPORT FOR VEHICLE OPERATING SYSTEMS", each of which is incorporated by reference herein as if fully set forth in its entirety. BACKGROUND ART

[0002] A vehicle head unit (sometimes referred to as an infotainment system) may be configured to run a vehicle operating system to facilitate control of entertainment (e.g., music, video, images, etc.), information, navigation, and voice calls, as well as vehicle systems such as heating, ventilation, and air conditioning (HVAC) systems, lighting systems, and seat control systems (including heating and / or cooling, seat adjustment, etc.), to provide a few examples. The vehicle operating system may allow a single user profile to access a given instance of the vehicle operating system, and the single user profile is typically the operator of the vehicle. Although an instance of the vehicle operating system may support multiple user profiles, the instance of the vehicle operating system may allow only a single user profile among the multiple user profiles to access (or in other words, "log in" to) the instance of the vehicle operating system. The instance of the vehicle operating system may restrict access to a single user profile so that the vehicle operator is not distracted by the operations of other user profiles while operating the vehicle. SUMMARY OF THE INVENTION

[0003] In general, various aspects of the technology described herein relate to a single instance of a vehicle operating system that provides simultaneous multi-user support. The single instance of the vehicle operating system described herein may allow multiple user profiles to access the single instance of the vehicle operating system, rather than restricting access to a single user profile. Vehicles increasingly integrate more displays into the cabin (in some examples, displays may be positioned behind the operator for rear-seat passengers, giving the operator a limited view of these displays or preventing them from directly viewing them), enabling more users to safely interface with the vehicle operating system without distracting the vehicle operator. Therefore, multiple users associated with multiple user profiles can access the vehicle operating system and interact with the vehicle to control various functions provided via the vehicle head unit, such as entertainment, information, navigation, and voice calls, as well as various vehicle systems (this may depend to some extent on the positions of the multiple users inside the vehicle).

[0004] Multiple users may also interface with the vehicle operating system to collaboratively coordinate activities among themselves, such as sharing content among multiple users, seeing what content other users are viewing, controlling audio playback among multiple users (e.g., changing audio volume, adjusting playlists), messaging among multiple users, and coordinating navigation routes among multiple users. In some examples, multiple users may use gestures such as swipe, pinch, and tap gestures to direct the sharing of such content, which may enable intuitive control of sharing among multiple users.

[0005] As a result, various aspects of the technology described herein may promote a better user experience while traveling in a vehicle, while protecting safety concerns arising from distractions to the vehicle operator. By enabling multiple user profiles to access the vehicle operating system, the vehicle operating system can apply preferences specific to each individual user profile and tailor the user experience accordingly. The vehicle operating system may also allow multiple users to collaborate on activities (such as those described above) that may improve the user experience while traveling in the vehicle. If an additional display (which may be separate from the main display of the vehicle's head unit) is located in the cabin where the vehicle operator cannot directly see the presented content, the vehicle operating system may be able to expand access to content while limiting the potential for distraction to the operator.

[0006] For example, the Disclosure describes a method comprising running an instance of a vehicle operating system by a vehicle head unit, the instance of the vehicle operating system facilitating parallel access by multiple user profiles, the method further comprising authorizing the instance of the vehicle operating system to interface with multiple user profiles, and the instance of the vehicle operating system presenting multiple user interfaces across multiple displays communicatively coupled to the vehicle head unit, each of the multiple user interfaces associated with one or more of the multiple user profiles, the method further comprising interface with multiple users associated with one or more of the multiple user profiles to enable multiple users to interface with the instance of the vehicle operating system via the multiple user interfaces for the purpose of controlling functions associated with the vehicle head unit.

[0007] In other examples, the disclosure describes a computing device comprising memory configured to store an instance of a vehicle operating system, the instance of the vehicle operating system facilitating parallel access by multiple user profiles, the computing device further comprising one or more processors running the instance of the vehicle operating system, the instance of the vehicle operating system authorizing multiple user profiles to interface with the instance of the vehicle operating system, the user interface being configured to present multiple user interfaces across multiple displays communicatively coupled to a vehicle head unit, each of the multiple user interfaces being associated with one or more of the multiple user profiles, and the user interface being configured to interface with multiple users associated with one or more of the multiple user profiles, enabling multiple users to interface with the instance of the vehicle operating system for the purpose of controlling functions associated with the vehicle head unit.

[0008] In other examples, the disclosure describes a non-temporary computer-readable storage medium having stored instructions, the instructions, when executed, cause one or more processors to execute an instance of a vehicle operating system, the instance of the vehicle operating system to facilitate parallel access by a plurality of user profiles, cause a plurality of user profiles to authorize interface with the instance of the vehicle operating system through the execution of a first instance of the vehicle operating system, cause a plurality of user interfaces to be presented across a plurality of displays communicatively coupled to a vehicle head unit through the execution of a first instance of the vehicle operating system, each of the plurality of user interfaces to be associated with one or more of the plurality of user profiles, and to interface with a plurality of users associated with one or more of the plurality of user profiles, enabling a plurality of users to interface with the instance of the vehicle operating system for the purpose of controlling functions associated with the vehicle head unit.

[0009] In other examples, the disclosure describes a computing device that includes means for running an instance of a vehicle operating system, the instance of the vehicle operating system facilitating parallel access by multiple user profiles, and the computing device further includes means for authorizing the interface between the instance of the vehicle operating system and the multiple user profiles, and means for presenting the multiple user interfaces across a plurality of displays communicatively coupled to a vehicle head unit, each of the multiple user interfaces being associated with one or more of the multiple user profiles, and the computing device further includes means for interface with the multiple users associated with one or more of the multiple user profiles to enable the multiple users to interface with the instance of the vehicle operating system for the purpose of controlling functions associated with the vehicle head unit via the multiple user interfaces.

[0010] Details of one or more embodiments are described in the accompanying drawings and the following description. Other features, purposes, and advantages will become apparent from the description and drawings, as well as the claims. [Brief explanation of the drawing]

[0011] [Figure 1] A block diagram shows an exemplary computing system configured to provide a single-instance multi-user vehicle operating system according to various aspects of the technique described herein. [Figure 2] This figure shows an example of a vehicle that includes a computing system configured to run a vehicle operating system that operates according to various aspects of the single-instance multi-user technology described in this disclosure. [Figure 3]This figure shows different interaction models using multiple displays, including interactions occurring via a single-instance multi-user model and a multi-instance multi-user model, using the vehicle operating system technology described herein. [Figure 4] This figure shows an exemplary vehicle including a vehicle head unit configured to control audio content by various aspects of the single-instance multi-user vehicle operating system technology described in this disclosure. [Figure 5] This figure shows audio control in a single-instance multi-user vehicle operating system according to various aspects of the technology described in this disclosure. [Figure 6] This figure shows audio control in a single-instance multi-user vehicle operating system according to various aspects of the technology described in this disclosure. [Figure 7] This flowchart shows an exemplary operation of the computing system shown in Figure 1 when running a vehicle operating system configured to perform various aspects of the technology described in this disclosure. [Modes for carrying out the invention]

[0012] Figure 1 is a block diagram illustrating an exemplary computing system configured to provide a single-instance multi-user vehicle operating system according to various aspects of the technology described herein. As shown in the example in Figure 1, the computing system 100 includes a computing device 102. Although the description is in the context of a vehicle, the computing system 100 may be used in a variety of contexts, including standalone computing systems (including laptop computers, desktop computers, workstations, etc.), gaming systems, mobile phones (including so-called “smartphones”), media systems (including streaming media systems), audio / visual (A / V) receivers, televisions (including so-called “smart TVs”), smart speakers, smartwatches, thermostats (including so-called “smart thermostats”), smart glasses, or any other computing system.

[0013] In any case, computing device 102 is an example of a vehicle computing device, such as a vehicle's head unit. Figure 1 shows only one specific example of computing device 102, and many other examples of computing device 102 may be used in other cases, and may include a subset of the components included in the exemplary computing device 102, or additional components not shown in Figure 1.

[0014] As shown in the example in Figure 1, the computing device 102 includes a presence-intuitive display 112, one or more processors 140, one or more communication units 142, one or more input components 144, one or more output components 146, and one or more storage devices 148, as well as a communication channel 149. The communication channel 149 can interconnect each of the components 112, 140, 142, 146, and / or 148 (physically, communicatively, and / or operationally) for inter-component communication, thereby enabling the components 112, 140, 142, 146, and 148 to communicate with one another. In some examples, the communication channel 149 may include a system bus, a network connection unit, one or more inter-process communication data structures, or any other components for communicating data (also referred to as information). Although shown to include components 112, 140, 142, 146, and 148, the main computing device 102 may include other components, or fewer components than those shown, and such components may be included in other control units, such as a telematics control unit (TCU).

[0015] One or more communication units 142 of the computing device 102 may communicate with external devices by transmitting and / or receiving data. For example, the computing device 102 may use one or more communication units 142 to transmit and / or receive radio signals over a radio network, such as a cellular radio network. In some examples, the communication units 142 may transmit and / or receive satellite signals over a satellite network, such as a Global Positioning System (GPS) network. Examples of communication units 142 include network interface cards (e.g., Ethernet® cards), optical transceivers, radio frequency transceivers, GPS receivers, or any other type of device capable of transmitting and / or receiving information. Other examples of communication units 142 may include shortwave radio (e.g., NFC, BLUETOOTH® (including BLE)), GPS, 3G, 4G, 5G, and Wi-Fi radio, as well as Universal Serial Bus (USB) controllers, etc., that are installed in mobile devices.

[0016] One or more input components 144 of the computing device 102 may receive input. Examples of inputs include, but are not limited to, haptic input, voice input, motor input, and optical input. The input components 144 of the computing device 102 may include, in some cases, a mouse, keyboard, touchpad, voice response system, video camera, button, scroll wheel, dial, control pad, microphone (or in other words, audio capture device), or any other type of device for detecting input from a human or machine. The input component 144 may include a camera. In some examples, the input component 144 may also be a presence-aware input component, which may include a presence-aware screen, a touch-sensitive screen, etc., separate from the presence-aware display 112.

[0017] One or more output components 146 of the computing device 102 may generate outputs. Examples of outputs include haptic outputs, audio outputs, and video outputs. In some examples, the output components 146 of the computing device 102 may include a presence-sensing screen (possibly separate from the presence-sensing display 112), a sound card, a video graphics adapter card, a speaker, a cathode ray tube (CRT), a monitor, a liquid crystal display (LCD), an organic light-emitting diode (OLED), or any other type of device for generating haptic, audio, and / or visual outputs to a human or machine.

[0018] In some examples, the presence-sensing display 112 of the computing device 102 may include the functionality of an input component 144 and / or an output component 146. In the example in Figure 1, the presence-sensing display 112 may include a presence-sensing input (PSI) component 104 ("PSI component 104"), such as a presence-sensing screen or a touch-sensitive screen. In some examples, the presence-sensing input component 104 can detect objects on and / or near the presence-sensing input component. As an example of range, the presence-sensing input component 104 may detect objects such as a finger or stylus within 2 inches of the presence-sensing input component 104. The presence-sensing input component 104 can determine the location (e.g., (x,y) coordinates) of the presence-sensing input component where the object was detected. In other examples of range, the presence-sensing input component 104 may detect objects less than 2 inches from the presence-sensing input component 104, and other ranges are also possible. The presence-aware input component 104 may determine the position of the presence-aware input component 104 selected by the user's finger using capacitive, inductive, and / or optical recognition techniques.

[0019] In some examples, the presence-aware display 112 may also provide output to the user using tactile, auditory, and / or visual stimuli, as described with respect to the output component 146. For example, the presence-aware display 112 may include a display component 103 that displays a graphical user interface. The display component 103 may be any type of output component that provides visual output, as described with respect to the output component 146. Although the presence-aware display 112 is shown as an integrated component of the computing device 102, in some examples it may be an external component that shares data or information paths with other components of the computing device 102 to transmit and / or receive inputs and outputs. For example, the presence-aware display 112 may be an embedded component of the computing device 102, located within the computing device 102's external package (e.g., an in-vehicle screen mounted on the dashboard of a vehicle) and physically connected to the computing device 102's external package. In other examples, the presence-aware display 112 may be an external component of the computing device 102 (e.g., a monitor, projector, etc., that shares wired and / or wireless data paths with the vehicle's electronic control unit) located outside the package of the computing device 102 and physically separated from the package of the computing device 102. In some examples, the presence-aware display 112, located outside the package of the computing device 102 and physically separated from the package of the computing device 102, may be implemented by two distinct components: a presence-aware input component 104 for receiving inputs and a display component 103 for providing outputs.

[0020] One or more storage devices 148 inside the computing device 102 can store information for processing during the operation of the computing device 102 (for example, the computing device 102 can store data accessed by operating systems (OS) 160A and OS160B while running on the computing device 102). As shown in the example in Figure 1, one or more storage devices 148 can store a first instance of operating system 160A (OS160A) and a second instance of operating system 160B (OS160B). In some examples, the storage component 148 is temporary storage, and it is intended that the primary purpose of the storage component 148 is not long-term storage. The storage devices 148 of the computing device 102 may be configured as volatile memory for short-term storage of information, and therefore, when the power is turned off, the stored content may not be retained. Examples of volatile memory include random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), and other forms of volatile memory known in the art.

[0021] In some examples, the storage device 148 also includes one or more computer-readable storage media. In some examples, the storage device 148 also includes one or more non-temporary computer-readable storage media. The storage device 148 can generally be configured to store larger amounts of information than can be stored by volatile memory. The storage device 148 can be further configured as a non-volatile memory space for long-term storage of information, where the information can be retained after power-on / off cycles. Examples of non-volatile memory include magnetic hard disks, optical disks, flash memory, or electrically programmable memory (EPROM) or electrically erasable and programmable memory (EEPROM). The storage device 148 can store program instructions and / or information (e.g., data) associated with OS 160A and / or 160B. The storage device 148 may include memory (not shown for the sake of illustration) configured to store data or other information associated with OS 160A and OS 160B.

[0022] The one or more processors 140 may implement the functions associated with the computing device 102 and / or execute instructions. Examples of the processor 140 include an application processor, a display controller, an auxiliary processor, one or more sensor hubs, and any other hardware configured to function as a processor, a processing unit, or a processing device. The OS 160A and / or 160B may be operable by (or in other words, executable by) the processor 140 to perform various actions, operations, or functions of the computing device 102. That is, the OS 160A and / or OS 160B may form executable bytecode, which when executed, causes the processor 140 to perform specific operations (and thereby renders the computing device 102 a special purpose computer that performs the specific operations) in accordance with various aspects of the present techniques described herein. For example, the processor 140 of the computing device 102 may retrieve and execute instructions stored by the storage device 148 that cause the processor 140 to perform the operations described herein attributed to the OS 160A and / or 160B. When executed by the processor 140, these instructions may cause the computing device 102 to store information inside the storage device 148.

[0023] As described above, the computing system 100 may be integrated into or otherwise included in a vehicle. The vehicle may include one or more of a bicycle, a tricycle, a unicycle, a motorcycle, an automobile, agricultural machinery (tractors, combines, etc.), construction machinery (dump trucks, cranes, etc.), military vehicles or equipment (tanks, weapons, etc.), trucks, semi-tractors (or in other words, semi-trailers), aviation equipment (airplanes, etc.), nautical equipment (boats, transport ships, submarines, etc.), or any other type of vehicle.

[0024] The computing device 102 (as described above, referred to as the vehicle head unit 102, and may also be referred to as the infotainment system 102 in some cases) may be configured to execute a vehicle operating system, such as one or more of OS 160A and 160B (which as a result may also be referred to as vehicle OS 160A-VOS 160A- and VOS 160B), to facilitate not only control of entertainment (music, video, images, etc.), information, navigation, and voice calls, but also control of vehicle systems such as heating, ventilation, and air conditioning (HVAC) systems, lighting systems, and seat control systems (including heating and / or cooling, seat adjustment, etc.), to provide several examples. In some examples, the vehicle operating system may allow a single user profile to immediately access a given instance of the vehicle operating system at a time, and the single user profile is typically the operator of the vehicle.

[0025] This vehicle operating system may sometimes be referred to as a single-instance, single-user vehicle operating system. That is, a single instance of the vehicle operating system may allow only a single user profile to access the single instance of the vehicle operating system, and may require a user profile switch in which the single user profile is replaced by another single user profile. In this regard, only a single user profile can access the single instance of the vehicle operating system at any time.

[0026] To enable multiple simultaneous user profiles, processor 140 can run other instances of the vehicle operating system, which may require additional processors and / or more powerful processors (usually more expensive). However, efficient communication between both instances of the vehicle operating system can be difficult, potentially limiting the user experience as users associated with multiple user profiles may be unable to share content with each other.

[0027] Therefore, if an instance of the vehicle operating system supports multiple user profiles, the instance may allow only one user profile out of the multiple user profiles to access (or, in other words, "log in to") the instance of the vehicle operating system. The instance of the vehicle operating system may restrict access to a single user profile so that the vehicle operator is not distracted by the activity of other user profiles while operating the vehicle.

[0028] According to various aspects of the techniques described herein, the computing system 100 may implement a single instance of a vehicle operating system, such as VOS 160A and / or 160B ("VOS 160"), which provides parallel multi-user support. The single instance of VOS 160 described herein may allow multiple user profiles to access the single instance of VOS 160, rather than restricting access to a single user profile for the single instance of VOS 160. Vehicles increasingly integrate more displays into the vehicle cabin, such as support presence-aware displays 150A-150N ("support presence-aware displays 150", which may also be referred to as "display 150"), allowing more users to securely interface with VOS 160 without distracting the vehicle operator (in some examples, displays may be positioned behind the operator for rear-seat passengers, and the operator has a limited view of these displays 150 or cannot directly see these displays 150). Therefore, multiple users associated with multiple user profiles can access VOS160 and interact with computing device 102 to control various functions provided through computing device 102, such as entertainment, information, navigation, voice calls, and various vehicle systems (this may depend to some extent on the locations of the multiple users inside the vehicle).

[0029] Multiple users can also interface with VOS160 to collaboratively coordinate activities among multiple users, such as sharing content among multiple users, seeing what other users have viewed, controlling audio playback among multiple users (e.g., changing audio volume, adjusting playlists), messaging among multiple users, and coordinating navigation paths among multiple users. In some examples, multiple users may use gestures such as swipe gestures, pinch gestures, and tap gestures to instruct the sharing of such content, thereby enabling intuitive control of sharing among multiple users.

[0030] During operation, the computing device 102 can interface with the display 150, as shown in the example in Figure 1, which may be similar to, or nearly similar to, the presence-aware display 112. However, rather than being integrated with the computing device 102 in the same way as the presence-aware display 112, the display 150 may be communicatively coupled (wired or wirelessly) to the computing device 102 and integrated into the entire vehicle cabin, or it may be separate from the vehicle. That is, in some examples, the display 150 may also represent a tablet, smartphone, laptop, portable game device, portable video device, or any other device that can interface with the computing device 102 to present a user interface associated with VOS 160 (and / or an application running in the application space presented by VOS 160, which may be separate from the privileged kernel space in which VOS 160 runs to facilitate interaction between the application and the underlying hardware such as units 112 and 140-148).

[0031] In any case, processor 140 can run an instance of a vehicle operating system such as VOS160A or VOS160B, which facilitates parallel access by multiple user profiles as shown in the example in Figure 1, as user profiles (UP) 161A-161N ("UP161") in VOS160A and as UP163A-163N ("UP163") in VOS160B. Each UP161 / 163 may define access rights (or in other words, privileges), preferences (e.g., for the user interface, VOS160 settings, etc.), and other user-specific configuration data or information sets. Each UP161 / 163 may be associated with a different user, but UP161 and UP163 may contain user profiles for the same user. For example, UP161A and UP163A may be associated with the same user.

[0032] Processor 140 can, for example, run VOS160A and authorize multiple user profiles of UP161 to interface with VOS160A. To authorize multiple user profiles of UP161, each user may register with VOS160A by entering a username (associated with one of the given UP161s) and password to log in to VOS160A. Alternatively, any other method of logging into VOS160A may be enabled, such as scanning a quick response (QR) code with a smartphone camera, entering a personal identification number (PIN), a biometric process (e.g., fingerprint scanning, retinal scanning, etc.), facial recognition, or any other method for registering a given user profile of UP161 with VOS160A. OS160A can compare the entered information with authorization information stored in UP161 and authorize (or in other words, approve) each of the multiple user profiles of UP161 to interface with VOS160A.

[0033] While authorization is discussed, VOS160A can also enable guest user profiles (as one of the UP161s) that are authorized without requiring any authorization. In this respect, guest user profiles may offer a limited experience (compared to authorized UP161s) in terms of maintaining preferences, applications, etc., across different sessions, but they can still enable the features described below regarding content sharing between multiple UP161s, etc.

[0034] In any case, VOS160A may present multiple user interfaces on multiple displays (such as one or more of displays 112 and 150) that are communicatively coupled to the computing device 102. VOS160A may present a unique user interface for each authenticated UP of UP161, maintaining preferences regarding application organization, user interface themes, and various VOS160A settings (e.g., display configurations such as notifications, accessibility, brightness, resolution, orientation, and any other type of OS settings). In any case, each of the multiple user interfaces is associated with one or more of the UP161.

[0035] Next, VOS160A may interface with multiple users associated with multiple UPs of UP161 via multiple user interfaces, enabling multiple users to interface with VOS160A for the purpose of controlling functions associated with computing device 102. These functions may include controlling navigation, changing content playback, changing user interface settings, controlling HVAC settings, sharing content between UP161s, and other functions described in more detail below.

[0036] In some examples, processor 140 may represent a high-performance processor (sometimes referred to as "processor 140A") and a low-performance processor (sometimes referred to as "processor 140B"). In some examples, processor 140 may represent a variable-performance processor with two or more different operating voltages, enabling high performance at high voltages and low performance at low voltages. Thus, a single processor may represent both processor 140A and processor 140B, and power savings may be facilitated by switching between different processing modes (e.g., high-performance mode and low-performance mode). Processor 140A may provide additional processor cores compared to processor 140B (or, in examples where a single processor switches between processing modes, enable additional cores in high-performance mode compared to low-performance mode).

[0037] Processor 140A can run VOS160A, while processor 140B can run VOS160B. Processor 140A may run VOS160A for tasks requiring higher processing power, such as games, video conferencing, navigation, and other processor-intensive tasks / applications. Processor 140B can run VOS160B for tasks requiring lower processing power, such as streaming audio, phone calls, image display, text messaging, or other less processor-intensive tasks / applications.

[0038] In some examples, processor 140A can run VOS160A simultaneously with processor 140B running VOS160B. When VOS160A and 160B are running simultaneously, VOS160A can present an interface that allows VOS160B to communicate with VOS160A and facilitate various functions of computing device 102. This interface may represent an application programming interface that VOS160B can call to facilitate inter-VOS communication between VOS160A and VOS160B and to coordinately facilitate support for functions provided by computing device 102.

[0039] Using processors with different processing power may facilitate energy consumption. Furthermore, installing a high-performance processor 140 capable of handling all the functions supported by computing device 102 may be costly, while a low-performance (and / or potentially low-performance) processor 140 may allow the manufacturer to upgrade over time to add additional high-performance processors. By providing a framework for inter-VOS communication, the manufacturer may be able to upgrade over time without having to configure a separate inter-VOS communication interface that facilitates access to the functions of computing device 102, which are described in more detail below.

[0040] As further illustrated in the example in Figure 1, the computing device 102 may also interface with supporting audio capture devices 152A-152N ("supporting audio capture devices 152" or "audio capture devices 152"). Each audio capture device 152 may represent a microphone or other transducer configured to capture audio data representing a sound field. Supporting audio capture devices 152 may also be called "microphones 152". In some examples, audio capture devices 152 may be integrated into one or more zones of the vehicle cabin containing the computing device 102. These zones may include an operator zone, one or more front passenger zones, and one or more rear passenger zones. As will be described in more detail later, these microphones 152 may capture (or in other words, record, detect, or otherwise sense) audio data that can be used not only for the VOS 160 to adjust audio playback but also to support additional functions provided by the computing device 102.

[0041] In this way, various aspects of the technique promote a better user experience while traveling in the vehicle, while protecting safety concerns regarding distraction of the vehicle operator. As a result of enabling multiple UP161 / 163 to access VOS160A / 160B, VOS160A / 160B may be able to tailor the user experience to each individual UP of the UP161 / 163 and apply preferences specific to each individual UP. The VOS160A / 160B system may also allow multiple users to coordinate their activities (as described above) and improve the user experience while traveling in the vehicle. If an additional display 150 (which may be separate from the main display of the vehicle head unit 102 (e.g., presence awareness display 112)) may be located in the cabin where the vehicle operator cannot directly see the displayed content, VOS160A / 160B may allow expanded access privileges to the content while potentially limiting operator distraction.

[0042] Figure 2 shows an example of a vehicle that includes a computing system configured to run a vehicle operating system that operates according to various aspects of the single-instance multi-user technology described herein. As shown in the example in Figure 2, the interior of the vehicle 200 (which may be referred to as the "vehicle compartment") may include a computing system in the form of a vehicle head unit 202, which represents an example of a computing device 102.

[0043] In the example of Figure 2, the vehicle head unit 202 is integrated into the approximate center of the front dashboard 220 (e.g., the center console). The vehicle head unit 202 includes a display 212, which may represent an example of a presence awareness display 112. The vehicle 200 may also include displays 250A, 250B, and 250C, which may represent an example of the display 150 described above with respect to Figure 1. Display 250A is integrated into the passenger side of the front dashboard 220. Although not shown in the example of Figure 2, a display similar to display 250A may be integrated into the operator side of the front dashboard 220. Displays 250B and 250C are integrated into the rear passenger compartment of the cabin (i.e., within the headrests of the front seats in the example of Figure 2) on both the operator side (display 250B) and the passenger side (display 250C).

[0044] As described above, VOS160A may interface with a first user (front passenger) to interact with content presented by a second user interface associated with a second user profile of multiple UP161s (e.g., presented by display 250B) via a first user interface (e.g., presented by display 250A) associated with a first user profile (e.g., UP161A). In some examples, VOS160A may interface with the first user for one or more of the following actions: viewing or starting playback of content presented by the second user interface in the first user interface.

[0045] VOS160A can also interface with the first user to control audio playback via a second user interface presented by display 250B. VOS160A can also interface with the first user to change the volume of the audio associated with audio playback via the second user interface presented by display 250B, via the first user interface presented by display 250A.

[0046] VOS160A may also interface with the first user to enable the first user and the second user (e.g., a rear passenger on the operator's side) to interact jointly with content presented by a second user interface presented by display 250B. In this example, VOS160A may interface with the first user to enable the first user and the second user to jointly contribute to audio playback by the second user interface (e.g., by jointly creating an audio playlist). VOS160A may also, as another example, interface with the first user so that the first user and the second user can jointly contribute to multi-user activities presented by a second user interface, such multi-user activities may include navigation activities, in which both the first and second users contribute to the navigation of the vehicle 200, including a multiplayer video game presented by the vehicle head unit 202 and / or the second user interface.

[0047] Although shown as multiple physical displays 212 / 250, various aspects of this technique can operate with respect to a single physical display (or multiple physical displays) having separate, logically isolated displays (or so-called virtual displays). That is, a single physical display 212 / 250 can be logically divided (e.g., via software) to represent two separate physical displays (from the perspective of an instance of VOS160). In this regard, a single physical display may represent multiple different displays, and each of the displays 212 / 250 may represent a logically separate virtual display.

[0048] In this regard, the various embodiments of the technique described herein are as follows: • When a parent wants to check what their child is watching. • If a parent or driver wants to control the volume of the child's display. • If two or more passengers want to contribute to a shared playlist. • When two or more passengers want to interact with the same content (e.g., multiplayer gamers). The following use cases demonstrate the technique as follows: • When Mirror is running on Android Auto, it displays content and • To enable drivers and passengers to mirror the content on their own displays, • The driver or passenger transmits input (such as key, rotary, d-pad, or touch events) to the display of another passenger. If it makes this possible, it may be enabled.

[0049] In other words, various aspects of the techniques described herein can address the problems associated with enabling a mobile app to interact with each other (the same or different apps) across multiple users in parallel on a single Android instance. Therefore, these techniques may enable back-seat operator interaction for adding waypoints to navigation, and / or back-seat interaction (such as a child) for playing a video.

[0050] VOS160A may also interface with a first user (front passenger) among multiple users via a first user interface associated with UP161A, and share content presented by the first user interface with a second user interface among multiple user interfaces associated with UP161B. For example, VOS160A may receive a gesture indicating that content presented by the first user interface, presented as an example by display 250A, is to be shared with a second user interface, presented, for example by display 250B. The gesture may include one or more of the following: a swipe gesture, a pinch gesture, a tap gesture, or any other gesture associated with using a presence-aware display such as display 250A.

[0051] In some instances, the VOS160A may be configured to present an animation in the first user interface indicating the start of shared content. Furthermore, or alternatively, the VOS160A may play audio indicating the start of shared content. In some examples, when the VOS160A plays audio indicating the start of shared content, it may play spatialized audio that reflects the position of the first user interface relative to the position of the second user interface.

[0052] In this regard, various aspects of the technique can make inter-display interactions, such as screen sharing, more immersive by using advanced user interface techniques. Based on the spatial relationships between passenger zones within the vehicle, the techniques are as follows: • Using gestures (such as swiping and clicking) to send content from one display to another, • Visualizing interactions using animation, • To enhance immersion, spatial audio is used to indicate the location where the content is moving, It is permissible to allow this.

[0053] Figure 3 shows different interaction models with multiple displays, including interactions occurring via single-instance multi-user and multi-instance multi-user models using the vehicle operating system techniques described herein. As discussed herein, vehicle displays, such as displays 212 and 250, are evolving from operator-centric to a vehicle-wide experience, with occupants experiencing the following: • Personal curation experiences during commutes, • Shared experiences to enjoy family trips, • Shared experiences in a ride-sharing environment, It can have.

[0054] Original Equipment Manufacturers (OEMs) recognize these needs and build vehicles to provide users with these experiences. These are no longer considered premium experiences, but rather desirable vehicle values.

[0055] In this regard, the user: • Navigation - Allows the driver to add waypoints from the display for ongoing trips. • Entertainment - Playing and controlling videos or games for children in the back seat to keep them engaged and entertained, • User access to proprietary curated apps, content, and data for entertainment and / or productivity, • Personalization - Control your seat settings, HVAC controls, and alerts related to your seat. Sometimes, you might want a parallel experience across displays for a seamless and immersive experience like that.

[0056] OEMs are considering following a user interaction model based on predictions of user behavior. Three types of interaction models: 1. The in-vehicle infotainment (IVI) display is the primary controller for content on the front-seat entertainment (FSE) and rear-seat entertainment (RSE) systems. a. FSE and RSE have minimal controls such as audio, play / pause, and on / off. 2. The IVI screen is mirrored across the entire FSE / RSE, and the passenger display cannot select content or controls. 3. Content can be shared across all screens, and each screen has its own individual controls. There is (as shown in the example in Figure 3).

[0057] The following user personas exist in multi-display scenarios: Driver: • Interact with the cluster and IVI screens to drive, and interact with other screens in the vehicle. • Front seat passengers: • Use FSE to assist the driver with navigation and passenger content. • Rear seat passengers: • Interact with the RSE for content, controls, and suggestions to the driver for navigation purposes. ·guest: • For temporary rides, I would like to access certain apps on the passenger display.

[0058] Figure 4 shows an exemplary vehicle including a vehicle head unit configured to control audio content according to various aspects of the single-instance multi-user vehicle operating system technique described herein. In the example of Figure 4, vehicle 400 may represent an example of vehicle 200 (shown in Figure 2) in which the vehicle head unit 202 enables privacy and sharing between different audio zones 404A to 404D ("audio zones 404") within vehicle 400. Audio zone 404A may represent the front-seat operator-side zone (also referred to as "front operator zone 404A"). Audio zone 404B may represent the front-seat passenger-side zone (also referred to as "front passenger zone 404B"). Audio zone 404C may represent the operator-side rear passenger zone, and audio zone 404D may represent the passenger-side rear passenger zone.

[0059] In each of the audio zones 404, the vehicle 200 may include one each of the audio capture devices 452A to 452D ("Audio Capture Device 452") and one each of the speakers 454A to 454D ("Speaker 454"). Audio capture device 452 may represent an example of audio capture device 152. Both audio capture device 452 and speaker 454 may represent transducers, in the example of audio capture device 452, which can convert sound pressure into an electrical signal representing a sound field, and in the example of speaker 454, which can convert an electrical signal representing a sound field into a corresponding sound field.

[0060] Although each of the audio zones 404 is described as having one of the audio capture devices 452 and one of the speakers 454, each of the audio zones 404 may contain more or fewer audio capture devices 452 and more or fewer speakers 454. Furthermore, although described as a transducer, any type of device having the ability to capture audio data (converted from electrical signals captured by the audio capture devices 452) and the ability to reproduce a sound field from electrical signals (converted from audio data) may be used in one or more of the audio zones 404. Furthermore, although four audio zones 404 are shown in the example in Figure 4, the vehicle 400 may contain more or fewer audio zones 404.

[0061] In any case, the VOS160A may interface with multiple users to control audio playback within one or more of the cabin zones 404 of the vehicle 400, including the vehicle head unit 202. The VOS160A may interface with multiple users to control audio volume within a single zone of the cabin zones 404, for example. As another example, the VOS160A may interface with multiple users to control the focus of audio playback in at least one of the cabin zones 404.

[0062] Therefore, various aspects of this technique can provide a central audio control service in parallel to all users (e.g., driver and / or passengers) for controlling audio settings (volume up / down, mute, unmute, or any other controls). To facilitate this control, the VOS160A provides the following: • To manage controls independently for each user within each audio zone, • Managing the focus of other users within separate zones, • Taking into consideration current safety restrictions, • This takes into account the current user roles (driver, passenger, passenger with a disability, rear-seat passenger), To provide this, a service may be provided for managing audio controls (e.g., volume, mute, settings, ducking, interrupt, etc.).

[0063] Furthermore, one or more of the audio capture devices 452 may capture audio data representing the sound field in each of the one or more zones 404 (other designations referring to the audio zone 404). Based on the audio data representing the sound field occurring in each of the zones 404, the VOS 160A may determine that a first user among several users in a first zone of the one or more zones (e.g., zone 404C) is attempting to audibly interface with the vehicle head unit 202 and is speaking. Based on the audio data representing the sound field occurring in each of the zones 404, the VOS 160A may adjust the audio playback in zone 404.

[0064] Regarding the adjustment of audio playback, the VOS160A may determine the noise level based on audio data representing the sound field occurring in each of the zones 404. Then, based on the noise level, the VOS160A may adjust the audio playback in one or more of the zones 404.

[0065] In this regard, various aspects of this technique can address methods for enabling multi-microphone support for the VOS160A. The VOS160A uses audio data captured by the audio capture device 452 to perform the following: • Using the microphone to identify which user is speaking and to adjust the volume control based on user recognition. • Mapping to the display being used. • To provide better assistant responses to (speaking) users. • Detects noise levels for each user (around each user's area) and performs necessary audio modifications for comfortable audio listening. Furthermore, by combining audio information for each user, the noise level inside the car is determined, and changes are made to the speakers for a better listening environment. They may decide and / or carry out.

[0066] Figures 5 and 6 illustrate audio control in a single-instance multi-user vehicle operating system according to various aspects of the technique described herein. In some examples, the vehicle operating system has a limited scope, such that it can only transmit audio from one zone to another for its specific application unique identifier (UID). Various aspects of the technique described herein are for the following purposes in zone 404: • Sharing media audio from passengers to the main cabin, • To provide a mechanism for passengers not inside the main cabin to request audio playback to the main zone (e.g., operator zone 404A), • To provide a mechanism for the driver to allow audio playback within the main zone, • To provide a mechanism for sharing audio focus between two different zones, • Disabling volume control for non-owners of the cabin, This allows audio to be shared within the cabin.

[0067] For example, a passenger listening to media in a rear-seat entertainment (RSE) zone (e.g., one of zones 404C or 404D) may transmit the audio to the main cabin so that everyone in the vehicle can hear it. Even if a passenger in a rear-seat RSE chooses to transmit audio to the main cabin, the operator (or main cabin user) still retains control over audio playback, as well as control over volume and other audio settings.

[0068] Figure 5 shows an overview diagram representing the current audio architecture. Audio zones 404 are defined in the configuration and are used to set up audio routing for each audio zone 404. Each audio zone 404 is defined as a collection of volume groups, each group containing a set of devices controlled by volume changes in the volume group. Each device can route different audio contexts to the device. The vehicle audio service may use routing information for each audio zone to define a set of audio mixes that VOS160A can use to configure audio routing for each zone 404.

[0069] Next, referring to Figure 6, the configuration setup between the vehicle audio service and the vehicle occupant zone service is shown. In the case of audio, the vehicle audio service may read the mapping from audio zone (audioZoneId) to occupant zone (occusantZoneId) from the configuration. This information may be sent to the vehicle occupant zone service to set up the occupant zone configuration during initialization. The occupant zone service may maintain information regarding the occupant zone configuration and display port mapping, which may be read from different configuration information.

[0070] The car audio service may register VehicleOccupantZoneCallback in the Occupant Zone service. VOS160A makes the following changes within the vehicle occupant zone: • Activate the display, • Changes to the audio configuration, • User assignment for the occupying zone, • The start of boarding, • Stopping the passengers, If any of the following conditions are met, this service may be triggered.

[0071] When the audio service receives the onOccupantZoneConfigChanged signal from the callback, the audio service on VOS160A will then: • Unload previous user settings, • Remove the previous user audio policy routing, • Loading the audio settings of a new user, • Set up audio policy routing for new users, • Reset the audio focus mapping for new users, To achieve this, users can be automatically assigned to corresponding audio zones.

[0072] The audio service in VOS160A may use audio focus mapping to determine where an incoming focus request should be assigned.

[0073] To allow passengers to transmit audio to the main cabin, several things are needed: • To process focus requests within the main cabin, • Routing passenger audio to the main cabin, This is necessary. Once the focus request is successfully transferred from the occupant's own audio zone within vehicle 400, audio routing can be performed. If audio playback has not yet started, the focus process automatically requests focus within the main cabin zone according to the rules already set regarding audio usage priority (for example, audio for media is rejected by the current phone call).

[0074] A passenger can request to transmit audio to the main cabin, and a prompt will pop up for the driver to allow it. Alternatively, the driver can enable automatic permission for passengers to play audio. If permitted, the audio focus request can be forwarded to the main cabin as needed, and playback can begin. If not permitted, the passenger may be prompted by a message.

[0075] Since one of the function's goals is to play media for passengers in the main cabin, passenger focus requests can be limited to media only. Focus requests for other sounds (e.g., alarms, calls, notifications, etc.) must remain within the passenger's respective zone. For media focus requests, the logic is as follows: • Send a temporary loss of focus to the passenger media app, • Requesting focus on the passenger media app in the main cabin. • If the focus request is permitted, send a focus acquisition request. • If permission is denied due to higher-priority voice messages (emergencies, phone calls), Set the focus request as a delayed focus, • Once a higher priority focus is completed, focus is granted. o Alternative: Send focus back to the user zone, This could happen.

[0076] If a user ID is used for passengers, the criterion for audio routing may be user ID device affinity routing. Identify the main cabin media device (preferably a separate high-quality device), • Resetting passenger device affinity to share media devices in the cabin, It can also be used to transmit passenger audio to the main cabin.

[0077] Furthermore, multi-zone audio (MZA) can facilitate audio playback by various users (each playing audio in their respective individual audio zones). This allows users in the main cabin to play media or any other audio, while users in the rear entertainment system can also play media in their respective zones. This allows OEMs to design complex audio infotainment systems that, in some cases, can tailor the experience to each passenger within the vehicle.

[0078] Examples of use cases include: • Inside the vehicle, the driver can play music, and passengers in the back seat can play their own music / media. • Users in the back seat can control the volume of their own music without affecting the driver's music playback. • A first-party music app launched in the back seat can play the sound in the back seat without any alteration. It includes.

[0079] One mechanism used in MZA is based on dynamic audio policies, specifically using UID / userId-based routing. This allows audio policies to define routing based on audio attribute usage, UID, or userId. This allows applications or services to leverage the automatic routing of audio configured by dynamic audio policies. However, there are APIs that can be used to route audio outside of assigned audio devices. This has some impact on vehicles, for example, as it allows applications to send audio to certain zones without user permission. • The rear-seat entertainment (RSE) application from user A transmits audio directly to the driver user's output device in the main cabin. • The RSE application from user A sends audio directly to a different RSE output device assigned to user B. This raises some safety concerns for the driver, as unwanted audio reaching the main cabin could potentially distract the primary driver.

[0080] One possible goal of this aspect of the technique is to allow the current dynamic audio policy to continue functioning, but also to restrict audio playback to play outside the set of zones to which the user (and their respective applications / services) are assigned, regardless of the mechanism used to select the device for audio playback. A potential benefit for in-vehicle users is that they can constantly listen to audio in the vehicle in a private and consistent manner.

[0081] Dynamic audio policies may provide a mechanism for configuring devices that users can use for automatic routing via the audio policy API. This audio policy API may be used, or extended, to restrict applications to use audio routing on a preferred set of devices in order to route audio outside of the limitations of audio policy user assignments. This could potentially limit "enforced" routing of devices defined within audio policies.

[0082] Figure 7 is a flowchart illustrating exemplary operation of the computing system shown in Figure 1 when running a vehicle operating system configured to perform various aspects of the techniques described herein. As described above, one or more processors 140 of the computing device 102 may run an instance of a vehicle operating system such as VOS 160A or VOS 160B, which facilitates parallel access by multiple user profiles as shown in the example of Figure 1, as user profiles (UP) 161A-161N ("UP161") in VOS 160A and as UP163A-163N ("UP163") in VOS 160B (700).

[0083] The processor 140 may, for example, run VOS 160A and authorize multiple user profiles of UP 161 to interface with VOS 160A (702). VOS 160A may present multiple user interfaces to multiple displays (such as one or more of displays 112 and 150) that are communicably coupled to the computing device 102 (704). VOS 160A may then interface with multiple users associated with multiple UPs of UP 161 via the multiple user interfaces, and enable multiple users to interface with VOS 160A for the purpose of controlling functions associated with the computing device 102 (706). These functions may include controlling navigation, changing content playback, changing user interface settings, controlling HVAC settings, sharing content between UP 161s, and other functions as described above.

[0084] In this way, the above-described technique can enable the following embodiments.

[0085] Example 1. A method comprising running an instance of a vehicle operating system by a vehicle head unit, the instance of the vehicle operating system facilitating parallel access by a plurality of user profiles, the method further comprising authorizing the plurality of user profiles to interface with the instance of the vehicle operating system, and presenting a plurality of user interfaces across a plurality of displays communicatively coupled to the vehicle head unit by the instance of the vehicle operating system, each of which user interfaces is associated with one or more of the plurality of user profiles, the method further comprising interface with a plurality of users associated with one or more of the plurality of user profiles to enable the plurality of users to interface with the instance of the vehicle operating system via the plurality of user interfaces for the purpose of controlling functions associated with the vehicle head unit.

[0086] Example 2. The method according to Example 1, wherein the instance of the vehicle operating system includes a first instance of the vehicle operating system, the method further includes running a second instance of the vehicle operating system, the first instance of the vehicle operating system includes an interface for communicating with the second instance of the vehicle operating system to facilitate parallel access by the multiple user profiles.

[0087] Example 3. The method according to Example 2, wherein the vehicle head unit includes a high-performance processor that runs the first instance of the vehicle operating system, and the vehicle head unit includes a low-performance processor that runs the second instance of the vehicle operating system, the high-performance processor providing more processing power than the low-performance processor.

[0088] Example 4. The method according to any combination of Examples 1 to 3, wherein the multiple displays are arranged around the cabin of the vehicle, including the vehicle head unit.

[0089] Example 5. The method according to any combination of Examples 1 to 4, wherein the plurality of displays include two or more of the following: a first display integrated into the operator side of the front dashboard of the vehicle cabin, including the vehicle head unit; a second display integrated into the center console of the front dashboard; a third display integrated into the passenger side of the front dashboard; and a fourth display integrated in the rear passenger compartment of the cabin.

[0090] Example 6. The method according to any combination of Examples 1 to 5, wherein the multiple displays include one or more computing devices associated with at least one of the multiple users who are passengers in the vehicle, including the vehicle head unit.

[0091] Example 7. The method of any combination of Examples 1 to 6, wherein interfacing with the users associated with one or more of the user profiles includes interfacing with the users to control audio playback within one or more zones of the vehicle's cabin, including the vehicle head unit.

[0092] Example 8. The method according to Example 7, wherein the one or more zones of the cabin include one or more of a forward operator zone, a forward passenger zone, a rear passenger zone on the operator side, and a rear passenger zone on the passenger side.

[0093] Example 9. Interface with the multiple users to control the audio playback, which includes interface with the multiple users to control the audio volume in one of the one or more zones of the cabin, as described in any combination of Examples 7 and 8.

[0094] Example 10. Interface with the multiple users to control the audio playback, which includes interface with the multiple users to control the focus of audio playback in at least one of the one or more zones of the cabin, as described in any combination of Examples 7 to 9.

[0095] Example 11. The method according to any combination of Examples 7 to 10, further comprising capturing audio data representing the sound field of each of the one or more zones by one or more audio capture devices communicably coupled to the vehicle head unit.

[0096] Example 12. The method of Example 11, further comprising determining, based on the audio data representing the sound field occurring in each of the one or more zones, that a first user of the multiple users in the first zone of the one or more zones is speaking in an attempt to audibly interface with the vehicle head unit.

[0097] Example 13. The method of any combination of Examples 11 and 12, further comprising adjusting audio playback in one or more zones based on audio data representing the sound field occurring in each of those zones.

[0098] Example 14. The method according to Example 13, wherein adjusting the audio playback includes determining a noise level based on the audio data representing the sound field occurring in each of the one or more zones, and adjusting the audio playback in the one or more zones based on the noise level.

[0099] Example 15. The method of any combination of Examples 1 to 14, wherein interfacing with the users associated with one or more of the user profiles includes interfacing with the first user of the user to interact with content presented by the second user interface of the user interface associated with the second user profile of the user profile, via the first user interface of the user interface associated with the first user profile of the user profiles.

[0100] Example 16. The method of Example 15, wherein interfacing with the first user includes interfacing with the first user in the first user interface for one or more of the following: viewing or starting playback of the content presented by the second user interface.

[0101] Example 17. The method as described in any combination of Examples 15 and 16, wherein interfacing with the first user among the multiple users includes interfacing with the first user to control audio playback by the second user interface.

[0102] Example 18. The method of Example 17, wherein interfacing with the first user to control the audio playback includes interfacing with the first user via the first user interface to change the volume of the audio associated with the audio playback by the second user interface.

[0103] Example 19. The method of any combination of Examples 15-18, wherein interfacing with the first user includes interfacing with the first user in such a way that the first user and the second user can jointly interact with the content presented by the second user interface.

[0104] Example 20. The method of Example 19, wherein interfacing with the first user to enable the first user and the second user to interact with the content together includes interfacing with the first user to enable the first user and the second user to contribute to the audio playback by the second user interface.

[0105] Example 21. Interface with the first user to enable the first user and the second user to interact with the content together, which includes interface with the first user to enable the first user and the second user to contribute together to multi-user activities presented by the second user interface, as described in any combination of Examples 19 and 20.

[0106] Example 22. The method according to Example 21, wherein the multi-user activity includes navigation activity in which both the first user and the second user contribute to the navigation of the vehicle, including the vehicle head unit.

[0107] Example 23. The method according to any combination of Examples 21 and 22, wherein the multi-user activity includes a multiplayer video game presented by the second user interface.

[0108] Example 24. Interface with the users associated with one or more of the user profiles, as described in any combination of Examples 1 to 23, including interface with the first user of the users to share content presented by the first user interface of the user interfaces associated with the first user profile of the user profiles, with the second user interface of the user interfaces associated with the second user profile of the user profiles.

[0109] Example 25. The method of Example 24, wherein interfacing with the first user includes receiving a gesture in the first user interface indicating that the content presented by the first user interface is shared with the second user interface.

[0110] Example 26. The method of Example 25, wherein the gesture includes one or more of a swipe gesture, a pinch gesture, and a tap gesture.

[0111] Example 27. The method of any combination of Examples 24-26, further comprising presenting an animation indicating the start of the shared content by the first user interface.

[0112] Example 28. The method of any combination of Examples 24-27, further comprising playing audio that indicates the start of the content being shared.

[0113] Example 29. The method of Example 28, wherein playing the audio includes playing spatialized audio to reflect the position of the first user interface relative to the position of the second user interface.

[0114] Example 30. A computing device comprising memory configured to store an instance of a vehicle operating system, the instance of the vehicle operating system facilitating parallel access by multiple user profiles, the computing device further comprising one or more processors running the instance of the vehicle operating system, the instance of the vehicle operating system authorizing the multiple user profiles to interface with the instance of the vehicle operating system, the user interface being configured to present multiple user interfaces across multiple displays communicatively coupled to the vehicle head unit, each of which user interfaces is associated with one or more of the multiple user profiles, and the user interface being configured to interface with multiple users associated with one or more of the multiple user profiles to enable those users to interface with the instance of the vehicle operating system for the purpose of controlling functions associated with the vehicle head unit.

[0115] Example 31. The computing device according to Example 30, wherein the instance of the vehicle operating system includes a first instance of the vehicle operating system, one or more processors are further configured to run a second instance of the vehicle operating system, and the first instance of the vehicle operating system includes an interface for communicating with the second instance of the vehicle operating system to facilitate parallel access by the multiple user profiles.

[0116] Example 32. The computing device according to Example 31, wherein one or more processors include a high-performance processor that runs the first instance of the vehicle operating system, and one or more processors include a low-performance processor that runs the second instance of the vehicle operating system, and the high-performance processor provides more processing power than the low-performance processor.

[0117] Example 33. A computing device according to any combination of Examples 30-32, wherein the multiple displays are arranged around the cabin of the vehicle, including the vehicle head unit.

[0118] Example 34. A computing device according to any combination of Examples 30 to 33, wherein the plurality of displays include two or more of the following: a first display integrated on the operator side of the front dashboard of the vehicle cabin, including the vehicle head unit; a second display integrated in the center console of the front dashboard; a third display integrated on the passenger side of the front dashboard; and a fourth display integrated in the rear passenger compartment of the cabin.

[0119] Example 35. The computing device according to any combination of Examples 30 to 34, wherein the plurality of displays include one or more computing devices associated with at least one of the plurality of users who are passengers in the vehicle, including the vehicle head unit.

[0120] Example 36. A computing device according to any combination of Examples 30 to 35, wherein the plurality of user interfaces are configured to interface with the plurality of users to control audio playback within one or more zones of the vehicle cabin, including the vehicle head unit.

[0121] Example 37. The computing device according to Example 36, wherein the one or more zones of the cabin include one or more of a forward operator zone, a forward passenger zone, a rear passenger zone on the operator side, and a rear passenger zone on the passenger side.

[0122] Example 38. A computing device according to any combination of Examples 36 and 37, wherein the user interfaces are configured to interface with the users to control the audio volume in one of the one or more zones of the cabin.

[0123] Example 39. A computing device according to any combination of Examples 36-38, wherein the user interfaces are configured to interface with the users to control the focus of audio playback in at least one of the one or more zones of the cabin.

[0124] Example 40. A computing device according to any combination of Examples 36-39, further comprising one or more audio capture devices configured to capture audio data representing the respective sound fields of the one or more zones.

[0125] Example 41. The computing device according to Example 40, wherein the instance of the vehicle operating system is further configured to determine, based on audio data representing the sound field occurring in each of the one or more zones, that a first user of the multiple users in a first zone of the one or more zones is speaking in an attempt to audibly interface with the vehicle head unit.

[0126] Example 42. A computing device according to any combination of Examples 40 and 41, wherein the instance of the vehicle operating system is further configured to adjust the audio playback of one or more zones based on the audio data representing the sound field occurring in each of the one or more zones.

[0127] Example 43. The computing device according to Example 42, wherein the instance of the vehicle operating system is further configured to determine a noise level based on the audio data representing the sound field occurring in each of the one or more zones, and to adjust the audio playback in the one or more zones based on the noise level.

[0128] Example 44. A computing device according to any combination of Examples 30 to 43, wherein the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles is configured to interface with the first user of the plurality of user interfaces to interact with content presented by the second user interface of the plurality of user interfaces associated with the second user profile of the plurality of user profiles.

[0129] Example 45. The computing device according to Example 44, wherein the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles is configured to interface with the first user for one or more of the following: viewing or starting playback of the content presented by the second user interface.

[0130] Example 46. A computing device according to any combination of Examples 44 and 45, wherein the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles is configured to interface with the first user to control audio playback by the second user interface.

[0131] Example 47. The computing device according to Example 46, wherein the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles is configured to interface with the first user to change the volume of audio associated with audio playback by the second user interface via the first user interface.

[0132] Example 48. A computing device according to any combination of Examples 44 and 45, wherein the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles is configured to interface with the first user in such a way that the first user and the second user can interact with the content presented by the second user interface.

[0133] Example 49. The computing device according to Example 48, wherein the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles is configured to interface with the first user in such a way that the first user and the second user can jointly contribute to audio playback by the second user interface.

[0134] Example 50. A computing device according to any combination of Examples 48 and 49, wherein the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles is configured to interface with the first user in such a way that the first user and the second user can jointly contribute to multi-user activities presented by the second user interface.

[0135] Example 51. The computing device according to Example 50, wherein the multi-user activity includes navigation activity in which both the first user and the second user contribute to the navigation of the vehicle, including the vehicle head unit.

[0136] Example 52. The computing device according to any combination of Examples 50 and 51, wherein the multi-user activity includes a multiplayer video game presented by the second user interface.

[0137] Example 53. A computing device according to any combination of Examples 30 to 52, wherein the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles is configured to interface with the first user of the plurality of users to share content presented by the first user interface with the second user interface of the plurality of user interfaces associated with the second user profile of the plurality of user profiles.

[0138] Example 54. The computing device according to Example 53, wherein the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles is configured to receive a gesture indicating that the content presented by the first user interface is shared with the second user interface.

[0139] Example 55. The computing device described in Example 54, wherein the gesture includes one or more of a swipe gesture, a pinch gesture, and a tap gesture.

[0140] Example 56. A computing device according to any combination of Examples 53-55, wherein the first user interface is further configured to present an animation indicating the start of the shared content.

[0141] Example 57. A computing device according to any combination of Examples 53-56, wherein the first user interface is further configured to play audio indicating the start of the shared content.

[0142] Example 58. The computing device according to Example 57, wherein the first user interface is configured to play spatialized audio to reflect the position of the first user interface relative to the position of the second user interface.

[0143] Example 59. A non-temporary computer-readable storage medium having stored instructions, the instructions, when executed, cause one or more processors to execute an instance of a vehicle operating system, the instance of the vehicle operating system to facilitate parallel access by a plurality of user profiles, the execution of the first instance of the vehicle operating system to authorize the plurality of user profiles to interface with the instance of the vehicle operating system, the execution of the first instance of the vehicle operating system to present a plurality of user interfaces across a plurality of displays communicatively coupled to the vehicle head unit, each of the plurality of user interfaces to be associated with one or more of the plurality of user profiles, and the plurality of user interfaces to interface with the plurality of users associated with one or more of the plurality of user profiles to enable the plurality of users to interface with the instance of the vehicle operating system for the purpose of controlling functions associated with the vehicle head unit.

[0144] In one or more examples, the described functions may be implemented in hardware, software, firmware, or a combination thereof. If implemented in software, these functions may be stored or transmitted as one or more instructions or codes on a computer-readable medium and executed by a hardware-based processing unit. Examples of computer-readable mediums include computer-readable storage media corresponding to tangible media such as data storage media, or communication media including any medium that facilitates the transfer of computer programs from one location to another, for example, according to a communication protocol. Thus, computer-readable media may generally correspond to (1) non-transient tangible computer-readable storage media, or (2) communication media such as signals or carrier waves. Data storage media may be any available medium that can be accessed by one or more computers or one or more processors to retrieve instructions, codes, and / or data structures for implementing the techniques described herein. Computer program products may include computer-readable media.

[0145] Examples, rather than being limited, of such computer-readable storage media may include RAM, ROM, EEPROM, CD-ROM, or other optical disk storage devices, magnetic disk storage devices, or other magnetic storage devices, flash memory, or any other storage media that can be used to store desired program code in the form of instructions or data structures and that are accessible by a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if instructions are transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of a medium. However, it should be understood that computer-readable storage media and data storage media do not include connections, carriers, signals, or other temporary media; instead, these media refer to non-temporary, tangible storage media. The discs used include compact discs (CDs), laser discs, optical discs, digital multipurpose discs (DVDs), floppy disks (registered trademarks), Blu-ray discs, and Ultra Blu-ray discs. Discs typically reproduce data magnetically, while discs reproduce data optically using a laser. Combinations of the above should also be included in the scope of computer-readable media.

[0146] Instructions may be executed by one or more processors, such as one or more digital signal processors (DSPs), general-purpose microprocessors, application-specific integrated circuits (ASICs), field-programmable logic arrays (FPGAs), or other equivalent integrated logic circuits or discrete logic circuits. Therefore, the term “processor” used may refer to any of the aforementioned structures or any other structure suitable for implementing the described technology. Furthermore, in some embodiments, the described functionality may be provided within dedicated hardware and / or software modules. The technology can also be fully implemented in one or more circuits or logic elements.

[0147] The technology of this disclosure can be implemented in a variety of devices or apparatus, including wireless handsets, integrated circuits (ICs), or sets of ICs (e.g., chipsets). While this disclosure describes various components, modules, or units to highlight the functional aspects of a device configured to implement the disclosed technology, it does not necessarily require implementation by different hardware units. Rather, as described above, the various units may be combined into hardware units, or provided in combination with appropriate software and / or firmware by an assembly of interoperable hardware units, including one or more processors as described above.

[0148] We have described various examples. These examples and other examples are included in the following claims.

Claims

1. It is a method, The method includes running an instance of a vehicle operating system on a vehicle head unit, wherein the instance of the vehicle operating system facilitates parallel access by multiple user profiles, and the method further includes: The instance of the vehicle operating system authorizes the plurality of user profiles to interface with the instance of the vehicle operating system, The method includes presenting a plurality of user interfaces across a plurality of displays communicatively coupled to the vehicle head unit by the instance of the vehicle operating system, each of the plurality of user interfaces being associated with one or more of the plurality of user profiles, and further, This includes interfacing with the multiple users associated with the multiple user profiles in order to enable multiple users to interface with the instance of the vehicle operating system to control functions associated with the vehicle head unit via the multiple user interfaces, The instance of the vehicle operating system includes a first instance of the vehicle operating system. The method further includes executing a second instance of the vehicle operating system, A method wherein the first instance of the vehicle operating system includes an interface for communicating with the second instance of the vehicle operating system to facilitate parallel access by the plurality of user profiles.

2. The vehicle head unit includes a high-performance processor that executes the first instance of the vehicle operating system. The vehicle head unit includes a low-performance processor that runs the second instance of the vehicle operating system. The method according to claim 1, wherein the high-performance processor provides higher processing power than the low-performance processor.

3. The method according to claim 1, wherein the plurality of displays are arranged around the cabin of a vehicle including the vehicle head unit.

4. The aforementioned multiple displays are A first display integrated into the operator's side of the front dashboard of the vehicle cabin, including the vehicle head unit, A second display integrated into the center console of the front dashboard, A third display integrated into the passenger side of the front dashboard, A fourth display integrated into the rear passenger compartment of the cabin, The method according to claim 1, comprising two or more of the following.

5. The method according to claim 1, wherein the plurality of displays include one or more computing devices associated with at least one of the plurality of users who are occupants of the vehicle, including the vehicle head unit.

6. A method, The method includes running an instance of a vehicle operating system on a vehicle head unit, wherein the instance of the vehicle operating system facilitates parallel access by multiple user profiles, and the method further includes: The instance of the vehicle operating system authorizes the plurality of user profiles to interface with the instance of the vehicle operating system, The method includes presenting a plurality of user interfaces across a plurality of displays communicatively coupled to the vehicle head unit by the instance of the vehicle operating system, each of the plurality of user interfaces being associated with one or more of the plurality of user profiles, and further, This includes interfacing with the multiple users associated with the multiple user profiles in order to enable multiple users to interface with the instance of the vehicle operating system to control functions associated with the vehicle head unit via the multiple user interfaces, A method for interfacing with the plurality of users associated with the plurality of user profiles, including interfacing with the plurality of users to control audio playback within one or more zones of the vehicle cabin, including the vehicle head unit.

7. The method according to claim 6, wherein the one or more zones of the cabin include one or more of a front operator zone, a front passenger zone, a rear passenger zone on the operator side, and a rear passenger zone on the passenger side.

8. The method according to claim 6, wherein interfacing with the plurality of users to control the audio playback includes interfacing with the plurality of users to control the volume of audio in one of the one or more zones of the cabin.

9. The method according to claim 6, wherein interfacing with the plurality of users to control the audio playback includes interfacing with the plurality of users to control the focus of audio playback in at least one of the one or more zones of the cabin.

10. The method according to claim 6, further comprising capturing audio data representing the sound field of each of the one or more zones by one or more audio capture devices communicably coupled to the vehicle head unit.

11. The method according to claim 10, further comprising determining, based on the audio data representing the sound field occurring in each of the one or more zones, that a first user of the plurality of users in a first zone of the one or more zones is attempting to audibly interface with the vehicle head unit and speaking.

12. The method according to claim 10, further comprising adjusting audio playback in one or more zones based on audio data representing the sound field generated in each of the one or more zones.

13. Adjusting the aforementioned audio playback means The noise level is determined based on the audio data representing the sound field generated in each of the one or more zones, Based on the noise level, adjust the audio playback in one or more zones, The method according to claim 12, including the method described in claim 12.

14. A method, The method includes running an instance of a vehicle operating system on a vehicle head unit, wherein the instance of the vehicle operating system facilitates parallel access by multiple user profiles, and the method further includes: The instance of the vehicle operating system authorizes the plurality of user profiles to interface with the instance of the vehicle operating system, The method includes presenting a plurality of user interfaces across a plurality of displays communicatively coupled to the vehicle head unit by the instance of the vehicle operating system, each of the plurality of user interfaces being associated with one or more of the plurality of user profiles, and further, This includes interfacing with the multiple users associated with the multiple user profiles in order to enable multiple users to interface with the instance of the vehicle operating system to control functions associated with the vehicle head unit via the multiple user interfaces, A method for interfacing with the plurality of users associated with the plurality of user profiles, comprising interfacing with the first user among the plurality of users to share content presented by the first user interface with the second user interface among the plurality of user interfaces associated with the second user profile among the plurality of user profiles, via the first user interface among the plurality of user interfaces associated with the first user profile among the plurality of user profiles.

15. The method of claim 14, wherein interfacing with the plurality of users associated with the plurality of user profiles includes interfacing with the first user of the plurality of users to interact with content presented by the second user interface of the plurality of user interfaces associated with the second user profile of the plurality of user profiles, via the first user interface of the plurality of user interfaces associated with the first user profile of the plurality of user profiles.

16. A computing device, The computing device further comprises memory configured to store an instance of a vehicle operating system, the instance of the vehicle operating system facilitates parallel access by multiple user profiles, and the a vehicle operating system facilitate The vehicle comprises one or more processors configured to run the instance of the vehicle operating system, The instance of the aforementioned vehicle operating system is Authorization of the plurality of user profiles to interface with the instance of the vehicle operating system, To present multiple user interfaces across multiple displays communicably coupled to the computing device, It is configured to do so, and each of the plurality of user interfaces is associated with one or more of the plurality of user profiles, The plurality of user interfaces are configured to interface with the plurality of users associated with the plurality of user profiles in order to enable the plurality of users to interface with the instance of the vehicle operating system to control the functions associated with the computing device, The instance of the vehicle operating system includes a first instance of the vehicle operating system. The one or more processors are further configured to run a second instance of the vehicle operating system. The first instance of the vehicle operating system is a computing device that includes an interface for communicating with the second instance of the vehicle operating system to facilitate parallel access by the plurality of user profiles.

17. The one or more processors include a high-performance processor that executes the first instance of the vehicle operating system. The one or more processors include a low-performance processor that runs the second instance of the vehicle operating system. The computing device according to claim 16, wherein the high-performance processor provides higher processing power than the low-performance processor.

18. A computing device, The computing device further comprises memory configured to store an instance of a vehicle operating system, the instance of the vehicle operating system facilitates parallel access by multiple user profiles, and the a vehicle operating system facilitate The vehicle comprises one or more processors configured to run the instance of the vehicle operating system, The instance of the aforementioned vehicle operating system is Authorization of the plurality of user profiles to interface with the instance of the vehicle operating system, To present multiple user interfaces across multiple displays communicably coupled to the computing device, It is configured to do so, and each of the plurality of user interfaces is associated with one or more of the plurality of user profiles, The plurality of user interfaces are configured to interface with the plurality of users associated with the plurality of user profiles in order to enable the plurality of users to interface with the instance of the vehicle operating system to control the functions associated with the computing device, The computing device is configured such that the plurality of user interfaces are interfaced with the plurality of users associated with the plurality of user profiles in order to control audio playback within one or more zones of the vehicle cabin, including the computing device.

19. A computing device, The computing device further comprises memory configured to store an instance of a vehicle operating system, the instance of the vehicle operating system facilitates parallel access by multiple user profiles, and the a vehicle operating system facilitate The vehicle comprises one or more processors configured to run the instance of the vehicle operating system, The instance of the aforementioned vehicle operating system is Authorization of the plurality of user profiles to interface with the instance of the vehicle operating system, To present multiple user interfaces across multiple displays communicably coupled to the computing device, It is configured to do so, and each of the plurality of user interfaces is associated with one or more of the plurality of user profiles, The plurality of user interfaces are configured to interface with the plurality of users associated with the plurality of user profiles in order to enable the plurality of users to interface with the instance of the vehicle operating system to control the functions associated with the computing device, A computing device in which a first user interface among a plurality of user interfaces associated with a first user profile among a plurality of user profiles is configured to interface with a first user among a plurality of users so as to share content presented by the first user interface with a second user interface among a plurality of user interfaces associated with a second user profile among a plurality of user profiles.

20. A computer program that causes one or more processors of a vehicle head unit to perform the method according to any one of claims 1 to 15.

Citation Information

Patent Citations

  • Device for vehicle

    JP2009026401A

  • Method for entering a personalized communication profile into a communication user interface

    KR1020070019710A

  • Pairing of input device and display in vehicle infotainment systems

    US20180060253A1

  • Infotainment based on vehicle navigation data

    US20180357233A1

  • Vehicle control device mounted on vehicle and method for controlling the vehicle

    US20190176625A1