Switchable communication routing between a host device and a vehicle head unit
By achieving seamless switching between multiple transmissions in the main device operating system, the problem of easy interruption of the transmission connection between the head unit of the transportation tool and the main device is solved, the user experience and operation efficiency are improved, and the graphical user interface is ensured. Stability and safety.
Patent Information
- Application Number
- CN202111224283.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-12-22
- Filing Date
- 2021-10-20
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2041-10-20
AI Technical Summary
In the communication between the head unit of the vehicle and the main device, the transmission connection is prone to interruption, resulting in interruption of the graphical user interface projection, poor user experience, and re-establishing the connection consumes resources, affecting security and efficiency.
The operating system of the master device presents a single communication interface, which can seamlessly switch between multiple transmissions (such as PAN, WLAN, USB), dynamically select the most suitable transmission method, ensuring the continuity and efficiency of graphical user interface projection.
Improves user experience, reduces interruptions and resource consumption caused by transmission switching, improves the safety and efficiency of transportation operation, and ensures stable projection of the graphical user interface.
Smart Images

Figure CN113961290B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to switchable communication delivery of communications between a host device and a vehicle head unit. Background Art
[0002] A vehicle may include a so-called "head unit" or other integrated head unit that presents an interface (e.g., a graphical user interface - GUI) through which vehicle systems are controlled, such as a heating, ventilation, and air conditioning (HVAC) system, a lighting system (for controlling interior and / or exterior lights), an infotainment system, a seat system (for controlling the position of the driver and / or passenger seats), etc. The interface may be presented through a console (e.g., an onboard display). A user of a vehicle such as a car, motorcycle, bus, recreational vehicle (RV), semi-trailer truck, tractor or other type of agricultural equipment, train, airplane, drone, helicopter, or personal transport link vehicle may connect a host device (e.g., a mobile phone) to the vehicle's head unit to project (or in other words, provide) a graphical user interface to the head unit. The head unit may then present the graphical user interface via a display coupled to the head unit.
[0003] To project the graphical user interface to the head unit, a host device such as a smartphone may be connected to the head unit via wired transmission or wireless transmission. Wired transmission may include universal serial bus (USB) transmission, wherein the host device is coupled to the head unit via a USB cable. Wireless transmission may include personal area network (PAN) transmission, which may include low energy and high (or in other words, normal) energy versions, ultra-wideband (UWB) connections (which may represent another type of PAN transmission), and wireless local area network (WLAN) connections, among others. When communication between the head unit and the host device deteriorates, becomes interrupted, or otherwise fails, the host device may restart the transmission to reestablish transmission with the vehicle head unit, wherein the restart of the transmission may interrupt the projection of the graphical user interface and may require the host device to establish a different form of connection (e.g., switch from wireless transmission to wired transmission). Summary of the invention
[0004] Generally, a technique is described in which a host device can seamlessly switch between transmissions during the projection of a graphical user interface to a head unit or the support of a graphical user interface output by a head unit. That is, the operating system of the host device can present a single communication interface through which a transmission is established on which the host device can project or support a graphical user interface for display at the head unit. An application executed by the host device can dock with the single communication interface to establish a transmission, requesting a transmission through which a graphical user interface is projected or supported via the single communication interface. The operating system of the host device can select a transmission from a plurality of different transmissions (including both wired and wireless transmissions) in response to a request for a transmission. In this regard, the operating system can offload the transmission selection from the application and remove any dependency on the application in establishing an appropriate transmission process.
[0005] When the operating system of the host device chooses not to accommodate transmission of a graphical user interface and one or more applications associated with the graphical user interface, the operating system of the host device may select a different one of the plurality of different transmissions that better accommodates the one or more applications associated with the graphical user interface. For example, a user of the host device may initially initiate execution of a projection application that facilitates projection of a first graphical user interface associated with another application (e.g., a phone application) that requires less transmission bandwidth (e.g., compared to a graphical user interface associated with a different application (e.g., a navigation application)).
[0006] The operating system of the master device may select the PAN transport as the initial transport for the first graphical user interface. The user may then interact with the first graphical user interface to initiate a navigation application that consumes more transport bandwidth. Rather than requiring the client to restart the projection of the first graphical user interface and select a different transport, the operating system of the master device may seamlessly switch from the PAN transport to a more powerful wireless transport (e.g., WLAN) and / or wired transport, such that the underlying application (i.e., the navigation application in this example) is unaware of the switch between transports.
[0007] In this regard, various aspects of these techniques may improve the user experience because the host device may not exit projection (or support) when the connection via the transmission is interrupted (e.g., the wired connection becomes temporarily disconnected, and / or interference occurs in the wireless transmission) or when the host device requires different transmission characteristics (e.g., different bandwidth, different latency, different reliability in terms of lost data, etc.). This improvement in user experience may be particularly beneficial in a vehicle setting where the user of the host device is operating the vehicle, as the improved user experience may reduce interference to the user while operating the vehicle, thereby inherently improving safety. In addition, by reducing reboots, various aspects of these techniques may enable the host device and head unit to operate more efficiently (e.g., in terms of processor cycle consumption, memory consumption, memory bus bandwidth utilization, wireless bandwidth consumption, etc.), as each reboot may require additional resources (e.g., processor cycles, memory space, memory bus bandwidth, wireless bandwidth, etc.) to renegotiate the transmission over which the projection of the graphical user interface occurs between the host device and the head unit.
[0008] In some examples, various aspects of the technology relate to a method comprising: presenting a single communication interface through an operating system executed by a host device, an application establishing a first transmission between the host device and a vehicle head unit through the single communication interface, the first transmission facilitating the application to provide data for execution of a mode presented by the vehicle head unit; sending data via the first transmission by the application during execution of the mode; switching from the first transmission to a second transmission by the operating system during execution of the mode; and sending data via the second transmission by the application during execution of the mode.
[0009] In some examples, various aspects of these techniques relate to a host device comprising: a memory configured to store an operating system and applications; and, one or more processors configured to: execute the operating system to present a single communication interface, through which the application establishes a first transmission between the host device and a vehicle head unit, the first transmission facilitating the application to provide data for execution of a mode presented by the vehicle head unit; and, execute the application to send data via the first transmission during execution of the mode; wherein the operating system switches from the first transmission to a second transmission during execution of the mode, and wherein the application sends data via the second transmission during execution of the mode.
[0010] In some examples, various aspects of the technology relate to a non-transitory computer-readable storage medium having instructions stored thereon that, when executed, cause one or more processors of a host device to: execute an operating system to present a single communication interface, an application to establish a first transmission between the host device and a vehicle head unit via the single communication interface, the first transmission facilitating the application to provide data for execution of a mode presented by the vehicle head unit; and execute the application to send data via the first transmission during execution of the mode; wherein the operating system switches from the first transmission to the second transmission during execution of the mode, and wherein the application sends data via the second transmission during execution of the mode.
[0011] The details of one or more examples are set forth in the accompanying drawings and the description below.Other features, objects, and advantages of the disclosure will be apparent from the description and drawings, and from the claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 is a conceptual diagram illustrating an example system configured to perform various aspects of the switchable communication delivery techniques described in this disclosure.
[0013] Figure 2 is a block diagram illustrating an example projection architecture configured to perform various aspects of the delivery management techniques described in this disclosure.
[0014] Figure 3 is a block diagram illustrating a conceptual schematic of a layered architecture of an operating system through which seamless switchable transport management can occur in accordance with various aspects of the techniques described in this disclosure.
[0015] Figure 4 is another block diagram illustrating a conceptual schematic of a layered architecture of an operating system through which seamless switchable transport management may occur in accordance with various aspects of the techniques described in this disclosure.
[0016] Figure 5 A more detailed diagram Figure 1 Block diagram of the master device.
[0017] Figure 6 is a diagram showing seamless switching between transmissions during execution of a projection mode according to the techniques of the present disclosure Figure 1 Flowchart of exemplary operation of a master device. DETAILED DESCRIPTION
[0018] Figure 1 is a conceptual diagram illustrating an example system configured to perform various aspects of the switchable communication delivery techniques described in the present disclosure. Figure 1As shown in the example of , according to one or more techniques of this disclosure, system 10 can manage multiple transmissions to facilitate execution of projection mode (or other modes, such as support mode). System 10 can include a main device 100 and a vehicle head unit 102.
[0019] exist Figure 1 In the example of the present invention, the main device 100 is a smart phone. However, other examples of the main device 100 may be a cellular phone, a smart phone, a head unit expansion or upgrade box module, a personal digital assistant (PDA), a laptop computer, a tablet computer, a portable gaming device, a portable media player, an e-book reader, a watch (including a so-called smart watch), an additional device (such as a projection device), smart glasses, a game controller, or other types of portable or mobile devices.
[0020] The vehicle head unit 102 may represent an integrated head unit that presents an interface (e.g., a graphical user interface - GUI) through which vehicle systems such as a heating, ventilation, and air conditioning (HVAC) system, a lighting system (for controlling interior and / or exterior lights), an infotainment system, a seat system (for controlling the position of the driver and / or passenger seats), etc. may be controlled. The interface may be provided through a console (e.g., an in-vehicle display, which is Figure 1 The vehicle head unit 102 may be included in a motorcycle, bus, recreational vehicle (RV), semi-trailer truck, tractor or other type of agricultural equipment, train, airplane, drone, helicopter, personal transport vehicle, or any other type of vehicle capable of managing transport according to one or more techniques described herein.
[0021] The master device 100 may Figure 1 The example shown in FIG. 1 includes an operating system 103 that provides an execution environment for one or more applications (e.g., application 104). The operating system 103 may represent a multi-threaded operating system or a single-threaded operating system, and the application 104 may interface with it to access the hardware of the host device 100. The operating system 103 may include a kernel that facilitates access to the underlying hardware of the host device 100, wherein the kernel may present a plurality of different interfaces (e.g., application programming interfaces—APIs) that the application 104 may call to access the underlying hardware of the host device 100.
[0022] Examples of the underlying hardware of the host device 100 include: one or more processors (not shown for ease of illustration) that support the execution of an operating system ("OS") 103 and applications 104; a display 106; and communication ("COMM") components 108A-108N ("comm components 108", which may also be referred to as "communication components 108"). The display 106 of the host device 100 may represent a presence-sensitive display used as an input device and an output device. A variety of display hardware may be used to implement the presence-sensitive display 106.
[0023] For example, the presence-sensitive display 106 can be used as an input device using a presence-sensitive input component, such as a resistive touch screen, a surface acoustic wave touch screen, a capacitive touch screen, a projected capacitive touch screen, a pressure-sensitive screen, an acoustic pulse recognition touch screen, or other presence-sensitive display technology. The presence-sensitive display 106 can be used as an output (e.g., display) device using any one or more display components, such as a liquid crystal display (LCD), a dot matrix display, a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, electronic ink, or a similar monochrome or color display capable of outputting visible information to a user of the host device 100.
[0024] The communication component 108 may include a wireless communication device capable of sending and / or receiving communication signals, such as a cellular radio, a 3G radio, a 4G radio, a 5G radio, an ultra-wideband (UWB) radio, radio (or any other PAN radio), NFC radio, or Wi-Fi TM Radio (or any other WLAN radio). Additionally or alternatively, the communication component 108 may include a wired communication device capable of sending and / or receiving communication signals via a direct link over a wired communication medium (eg, a Universal Serial Bus - USB - cable).
[0025] The operating system 103 and / or the applications 104 may present a graphical user interface (GUI) with which a user of the host device 100 may interface to interact with the host device 100. The operating system 103 may present the GUI via the display 106, the GUI including one or more icons or other visual representations of the applications 104, wherein the user of the host device 100 may select the one or more icons or other visual representations to access various services provided by the host device 100 through the operating system 103 or through the applications 104.
[0026] For example, the operating system 103 may include various integrated applications (wherein application 104 may represent one or more of these integrated applications) that allow telephone services (e.g., cellular telephone services, Voice over Internet Protocol - VoIP - services, etc.), web conferencing services, video conferencing services, SMS services, email services, web browsing services (e.g., via an integrated web browser), navigation services, assistant services, application store services (through which third-party applications are obtained, where application 104 may represent one or both of an integrated first-party application and / or a third-party application obtained through the application store service) and / or any other service provided through an integrated first-party application.
[0027] As described above, the application 104 may represent a first-party application developed and provided as an application integrated into the operating system 103 or a third-party application obtained by the user of the host device 100 through an application store service provided via the operating system 103. The application 104 may extend the software functionality of the host device 100, wherein the application 104 may be executed in an execution environment presented by the operating system 103. As some examples, the application 104 may provide a gaming service (e.g., a video game), an email service, a web browsing service, a text messaging and / or chat service, a web conferencing service, a video conferencing service, a music service (including a streaming music service), a video service (including a video streaming service), a navigation service, a word processing service, a spreadsheet service, a slide and / or presentation service, an assistant service, a text input service, or any other service typically provided by an application.
[0028] Also like Figure 1 As shown in the illustrated example, the vehicle head unit 102 may include an operating system 113, which may be similar or substantially similar to the operating system 103 in that the operating system 113 may present an execution environment in which one or more applications (not shown for ease of illustration) may be executed. Figure 1 ) can be executed to extend the functionality of the vehicle head unit 102 (or, in other words, the services provided by the vehicle head unit 102). The operating system 113 may include integrated first-party applications that provide services similar to those discussed above with respect to the integrated applications of the operating system 103. In addition, one or more third-party applications executed in the execution environment provided by the operating system 113 may provide services similar to those discussed above with respect to the applications 104.
[0029] In any case, the operating system 113 can present an interface through which applications can interface with the underlying hardware of the vehicle head unit 102. The underlying hardware of the vehicle head unit 102 may include: one or more processors (which are not shown in the figure for ease of illustration); Figure 1), which is configured to execute an operating system 113 and one or more applications; a display 116; and communication ("COMM") components 118A-118N ("comm components 118", which may also be referred to as "communication components 118").
[0030] Display 116 may be similar to display 106, wherein display 116 may represent a presence-sensitive display similar to display 106 (and thus may be referred to as "presence-sensitive display 116"). That is, similar to presence-sensitive display 106 of host device 100, presence-sensitive display 116 may be used as an input device (e.g., by using presence-sensitive input components, such as resistive touch screens, surface acoustic wave touch screens, capacitive touch screens, projected capacitive touch screens, pressure-sensitive screens, acoustic pulse recognition touch screens, etc.) and as an output device (e.g., by using any one or more display components, such as liquid crystal displays (LCDs), dot matrix displays, light-emitting diode (LED) displays, organic light-emitting diode (OLED) displays, electronic ink, etc.). In addition, similar to communication component 108 of host device 100, communication component 118 may include wireless and wired communication interfaces capable of sending and / or receiving communication signals, such as cellular radios, 3G radios, 4G radios, 5G radios, Radio (or any other type of PAN radio), Wi-Fi TM Radio (or any other type of WLAN radio), Ethernet, USB, etc.
[0031] An occupant of a vehicle in which the vehicle head unit 102 is located can connect a host device 100 (e.g., a smartphone) to the vehicle head unit 102 to project a graphical user interface (derived from the operating system 103 and / or applications 104) to the vehicle head unit 102. The vehicle head unit 102 can then present the graphical user interface via the display 116.
[0032] To project the graphical user interface to the vehicle head unit 102, the host device 100 may be connected to the vehicle head unit 102 via a wired transmission or a wireless transmission provided via a communication session between the communication component 108 and the corresponding communication component 118. The wired transmission may include a universal serial bus (USB) transmission, wherein the host device 100 is coupled to the vehicle head unit 102 via a USB cable. The wireless transmission may include a personal area network (PAN) transmission, which may include low energy and high (or in other words, normal) energy versions and a wireless local area network (WLAN) connection, etc.
[0033] Initially, the occupant may couple, or in other words, pair, the master device 100 to the vehicle head unit 102 via one of the communication components 108 supporting PAN wireless transmissions, where such coupling may be referred to as pairing. Once paired, the master device 100 may automatically pair with the vehicle head unit 102 as long as one of the communication components 108 is enabled. Once paired, the operating system 113 of the vehicle head unit 102 may present a notification via the display 116 indicating that other forms of transmission (e.g., WLAN transmission or wired transmission) are required to establish projection of the GUI from the master device 100 (where projection has not yet begun in this case).
[0034] In this regard, the operating system 113 may represent a thin client that operates to receive a GUI projected by the operating system 103 and / or the applications 104 of the host device 100. In other words, the operating system 113 may include a hardware abstraction layer (HAL) and a thin kernel (which acts as a client) through which the projection of the GUI provided by the host device 100 is supported. The HAL may allow the host device 100 to provide commands through which to interface with various aspects of the vehicle in which the vehicle head unit 102 is integrated (e.g., a heating, ventilation, and air conditioning system—HVAC system, a seat control system, a lighting system, navigation hardware—such as a global positioning system, or any other aspect of the vehicle mentioned above).
[0035] A "thin" client or "thin" kernel refers to a client or kernel that provides enough functionality to support projection but does not provide a full-featured operating system experience. In other words, such a thin client or kernel may not support the operating system 113 to execute applications locally, but rather provides an operating environment through which to interact with the host device 100 to obtain a GUI projected by the host device 100. The thin client or kernel may also provide data to the host device 100 about the occupant's interaction with the vehicle head unit 102 (e.g., the selection of a position on the display 116) and / or change the control state of various aspects of the vehicle in which the vehicle head unit 102 is integrated, such as the state of various physical controls in the vehicle, including buttons or other controls associated with the vehicle head unit 102, controls integrated into a steering wheel or other control interface, etc. The thin client or kernel can enable more efficient execution of the operating system 113 across a wider variety of vehicle head units that may have significant differences in hardware.
[0036] In any case, the operating system 103 can interface with one or more communication components 108 to establish a transmission between the main device 100 and the vehicle head unit 102 (which is shown as transmission 109). In some cases, the main device 100 can include a projection application 105 that indicates a specific transmission of multiple different transmissions through which data from the projection application 105 is to be transmitted to the vehicle head unit 102. In these cases, the operating system 103 can present an interface (e.g., an application programming interface) through which the projection application 105 can request the operating system 103 to establish a specific transmission. In this case, the projection application 105 can represent a bridge between facilitating the projection of a GUI to the vehicle head unit 102 (and providing approved additional applications 104 - e.g., for music streaming, navigation, phone calls, notifications, etc. - and the projection of the GUIs of these applications 104).
[0037] The projection application 105 can then project a GUI for the projection application 105 via the requested transmission 109, through which the occupant can select one or more additional applications 104 (e.g., by selecting an icon or other visual representation) via the display 116 of the vehicle head unit 102. When discussing the projection of the GUI, it should be understood that the projection application 105 passes the data to be projected (e.g., representing the GUI) to the operating system 103, which interfaces with one or more communication components 108 to output the data for projection to the vehicle head unit 102 via the transmission 109. The vehicle head unit 102 receives the data to be projected via a corresponding one of the transmission 109 and the communication component 118, and interfaces with the display 116 to present the GUI represented by the data received via the transmission 109.
[0038] In such a configuration where the projection application 105 explicitly requests a transport 109 via an interface presented by the operating system 103, the projection application 105 may only work via the requested transport (and possibly a different transport) and the operating system 103 may not provide any means by which to switch between multiple transports. Furthermore, the operating system 103 may not allow multiple applications to simultaneously project via an established transport, since the operating system 103 has no way to mitigate conflicts in projection between multiple applications (and the projection application is unaware of competing projection applications).
[0039] Thus, when the transmission 109 between the vehicle head unit 102 and the host device 100 deteriorates, becomes interrupted, or otherwise fails, the projection application 105 can restart the transmission 109 to reestablish the transmission 109 with the vehicle head unit 102. The restart of the transmission can disrupt the projection of the graphical user interface and potentially require the host device 100 to establish a different form of transmission (e.g., switch from wireless transmission to wired transmission).
[0040] Re-establishing the transmission 109 or establishing a different form of transmission may cause distraction to the operator or other occupants, which may pose a safety issue because the operator or other occupants may need to interact with the host device 100. In addition, repeatedly re-establishing the transmission 109 or establishing a different form of transmission may result in inefficiencies (e.g., in terms of processor cycles, power, memory bandwidth, memory storage space, transmission bandwidth, etc.), which may degrade the operation of the host device 100 and the vehicle head unit 102.
[0041] According to the technology of the present disclosure, the operating system 103 of the host device 100 can present a single communication interface through which a transmission 109 is established, and the projection application 105 can project a graphical user interface through this transmission 109 for display at the vehicle head unit 102. The projection application 105 executed by the host device 100 can dock with the single communication interface to establish the transmission 109, request the transmission 109 via the single communication interface, and project the graphical user interface through it. The operating system 103 of the host device 100 can select the transmission 109 from a plurality of different transmissions (including wired and wireless transmissions) in response to the request for the transmission 109. In this regard, the operating system 103 can offload the transmission selection from the projection application 105 and remove any dependence on the projection application 105 in establishing the appropriate transmission process.
[0042] When the operating system 103 of the host device 100 chooses not to accommodate the transmission 109 of the graphical user interface and one or more applications 104 associated with the graphical user interface, the operating system 103 of the host device 100 may select a different transmission 119 of the plurality of different transmissions that better accommodates the one or more applications 104 associated with the graphical user interface. For example, a user of the host device 100 may initially initiate execution of a projection application 105 that facilitates projection of a first graphical user interface associated with another application 104, such as a telephony application, that requires little transmission bandwidth (e.g., compared to a graphical user interface associated with a different application 104, such as a navigation application).
[0043] The operating system 103 of the host device 100 may select the PAN transport as the initial transport for the first graphical user interface. The user may then interact with the first graphical user interface via the display 116 to initiate the navigation application 104 that consumes more transport bandwidth. Rather than requiring the client to restart the projection of the first graphical user interface and select a different transport, the operating system 103 of the host device 100 may seamlessly switch from the PAN transport to a more robust wireless transport (e.g., WLAN) and / or wired transport, such that the underlying application (i.e., the navigation application 104 in this example) is unaware of the switch between transports 109 / 119.
[0044] In operation, the operating system 103 can present a single communication interface through which the projection application 105 establishes a first transmission 109 between the host device 100 and the vehicle head unit 102, which facilitates the execution of a projection mode in which the projection application 105 projects a graphical user interface to the vehicle head unit 102. The single communication interface can represent a transmission application programming interface (API) that exposes one or more function calls through which a transmission (e.g., transmission 109) is requested.
[0045] However, rather than specifying the type of transmission (e.g., wired or wireless, PAN or WLAN, etc.) via a function call, the function call typically abstracts the transmission from the projection application 105. That is, the projection application 105 is not informed by the operating system 103 of the transmission type or various characteristics of the transmission (e.g., in terms of latency, bandwidth, data loss, etc.), but rather the projection application 105 requests the transmission and then provides the operating system 103 via the transmission API with data representing the GUI projected to the vehicle head unit 102. In this regard, the operating system 103 offloads the transmission management from the projection application 105 (and / or other applications such as application 104).
[0046] Offloading transfer management from the projection application 105 can enable the operating system 103 to better handle problems that may arise during projection. In addition, the operating system 103 can dynamically switch between transfers 109 and 119 during execution of projection mode without requiring the projection application 105 to restart execution of projection mode.
[0047] In this way, the projection application 105 can provide data indicating the GUI to the operating system 103 via the transmission API, thereby projecting the GUI via the first transmission 109 during the execution of the projection mode. The operating system 103 can switch from the first transmission 109 to the second transmission 119 during the execution of the projection mode. That is, the projection application 105 can continue to provide data representing the GUI to the operating system 103 via the transmission API, and the operating system 103 can dynamically switch from the transmission 109 to the transmission 119 without notifying the projection application 105.
[0048] Operating system 103 can switch from transport 109 to transport 119 to better accommodate different situations without interrupting the execution of projection mode by projection application 105. For example, assuming that transport 109 is a wired transport and the wired transport is interrupted (e.g., because a USB cable becomes partially or completely disconnected), operating system 103 can dynamically switch from transport 109 to transport 119, which in this example may represent a WLAN transport (because WLAN transport provides similar bandwidth to USB wired transport). Projection application 105 can then project a graphical user interface via transport 119 during execution of projection mode.
[0049] In this regard, various aspects of these techniques can improve the user experience because the host device 100 may not exit projection when the connection via the transmitter 109 is interrupted (e.g., the wired connection becomes temporarily disconnected, and / or interference occurs in the wireless network) or when the host device 100 requires different transmission characteristics (e.g., different bandwidth, different latency, different reliability in terms of lost data, etc.). This improvement in user experience can be particularly beneficial in a vehicle setting where the user of the host device is operating the vehicle, as the improved user experience can reduce distractions to the user while operating the vehicle, thereby substantially improving safety.
[0050] Additionally, various aspects of these techniques may enable the host device 100 and the vehicle head unit 102 to operate more efficiently (e.g., in terms of processor cycle consumption, memory consumption, memory bus bandwidth utilization, wireless bandwidth consumption, etc.) by reducing reboots, as each reboot requires additional resources (e.g., processor cycles, memory space, memory bus bandwidth, wireless bandwidth, etc.) to renegotiate the transmission 109 over which projection of a graphical user interface occurs between the host device 100 and the vehicle head unit 102.
[0051] Although described with respect to a GUI, various aspects of the techniques can generally facilitate projection of data, where such data can include data representing voice communications (such as for a telephone application), data representing video communications (such as for a video conferencing application), data representing music (such as a music streaming or playback application), data representing navigation playback (which can include one or more of a voice notification, a GUI notification, and a GUI), or various combinations thereof. In this manner, various aspects of the techniques can enable general data projection through a projection application 105 and an application 104 working in conjunction with the projection application 105 to project data to a vehicle head unit 102 via one or more transmissions.
[0052] Figure 2 is a block diagram illustrating an example projection architecture configured to perform various aspects of the delivery management techniques described in this disclosure. The projection architecture 200 may represent Figure 1 103 and / or a portion of the kernel of the operating system 113 of the vehicle head unit 102 of the host device 100 shown in the example of . That is, the projection architecture 200 can represent a communication architecture that implements backward compatibility for legacy projection applications 105 for establishing and managing dedicated, projection application-selected transmitted function calls and forward-looking projection applications 105 that implement local function calls of a single communication interface.
[0053] like Figure 2As shown in the example of FIG. 2 , the projection architecture 200 includes transports 202A-202N (“transports 202”), a single communication interface 204 (which may be referred to as a universal automotive link-UAL-transport 204), one or more protocol domains 206, one or more domain modules 208, and services 210A-210N (“services 210”). Transport 202 may represent transports 109 and 119 as well as the above-mentioned transports 109 and 119. Figure 1 UAL transport 204 can represent the single communication interface described above, with which the projection application 105 can interface to establish one or more transports 202.
[0054] In other words, the UAL transport 204 can drive the platform requirements of both the host device 100 and the vehicle head unit 102 to create a reliable socket stream over which data projection can occur. That is, the UAL transport 204 can negotiate the platform requirements of the vehicle head unit 102 and the host device 100 to facilitate the establishment of a socket stream to be used by one or more transports 202 during the execution of the projection mode. The UAL transport 204 can negotiate such requirements with the vehicle head unit 102 in a manner that supports the vehicle profile of the connection. In any case, the UAL transport 204 allows multiple protocol domains 206 to share the same transport using a socket stream established over a PAN transport, a WLAN transport, and / or a USB transport.
[0055] The protocol domains 206 can each represent a controlled authentication domain, meaning that, for example, each protocol domain 206 can be terminated by a known verification mechanism to ascertain that the peer protocol domain (e.g., supported by the operating system 113 of the vehicle head unit 102) complies with the protocol version specification. Thus, in some examples, the protocol domains 206 can each represent a container that acts as a shim (e.g., for a legacy projection application) to convert legacy function calls to function calls supported by the UAL transport 204. The legacy projection application can call a legacy function call for a legacy vehicle link (LAL) transport. The protocol domains 206 can encapsulate the LAL transport in a shim container so that when the legacy function call is called by the legacy projection application, the protocol domains 206 can convert the legacy function call to a call supported by the UAL transport 204.
[0056] Each protocol domain 206 may also provide many different functions, such as security mechanisms, while also allowing multiple protocol domains 206 to coexist and share the same underlying transport of the transport 202. The protocol domains 206 may, for example, support Secure Sockets Layer (SSL) mutual authentication, Secure Real-Time Transport Protocol (SRTP), Datagram Transport Layer Security (DTLS), Transport Layer Security (TLS), Open Security (No Security), etc. The kernel of the operating system 103 and / or 113 may also dynamically add, remove, and update protocol domains 206 to facilitate seamless transfers between transports 202, while also facilitating increased functionality for projecting data from the host device 100 to the vehicle head unit 102.
[0057] To illustrate, consider that protocol domain 206 may facilitate communication via a PAN protocol (e.g. ), wherein the master device 100 can be paired with (or, in other words, associated with) the vehicle head unit 102. After successfully pairing with the master device 100, the vehicle head unit 102 can generate a key (e.g., a 32-byte key) that the vehicle head unit 102 sends to the master device 100 over the PAN connection. The master device 100 can then initiate a Ukey2 connection to establish a secure session between the master device 100 and the vehicle head unit 102. More information about Ukey2 can be found in a GitHub project named "Ukey2", which was last updated in September 2016 and is available at the following URL: github.com / google / ukey2.
[0058] In short, Ukey2 is an authenticated key exchange protocol based on Diffie-Hellman, in which the client and the server have a shared master key that can be used to derive keys that can be used in subsequent protocols. Ukey2 can allow the server and the client to establish a secure channel in which a password or other credentials are transmitted for switching between transmissions (for example, a new device wants to connect to a password-protected WLAN). Therefore, Ukey2 enables the master device 100 to switch from a first secure transmission to a second secure transmission without having to perform re-authentication for the second transmission, thereby interrupting the operation of the master device 100 (or the connection between the master device 100 and the vehicle head unit 102).
[0059] In any case, the master device 100 can perform a Ukey2 handshake, in which the master device 100 sends an Advanced Encryption Standard-Galois Counter Mode (AES-GCM) encrypted message with a Ukey verification token and a random number. The vehicle head unit 102 can then decrypt the message and verify that the master device token matches the local token stored by the vehicle head unit 102. The vehicle head unit 102 responds with an AES-GCP encrypted message with the Ukey verification token and the random number. The master device 100 decrypts the message and verifies that the vehicle head unit token matches the local token stored by the master device 100. In this way, each of the protocol domains 206 can also provide many different functions, such as security mechanisms, while also allowing multiple protocol domains 206 to coexist and share the same underlying transport of the transport 202.
[0060] Each of the protocol domains 206 may register with the UAL transport 204, whereupon each of the protocol domains 206 may receive a unique identifier (ID) by which each protocol domain 206 may be uniquely referenced. Each of the protocol domains 206 may, upon registration, also receive a unique integer ID in the master device 100 that is used as an identifier for packets destined for each registered protocol domain 206. As described above, each of the protocol domains 206 may be added, deleted, and updated without terminating the underlying transport of the transport 202. Each protocol domain 206 may also recover from brief interruptions of the transport 202, provided that in some cases the cache cookie is valid and has sufficient information and / or data to recover from the brief interruption.
[0061] Each protocol domain 206 may reference one or more domain modules 208. Each of the domain modules 208 represents a separately authenticatable module that may be independently authenticated. Authentication may refer to a process by which the security, integrity (not compromised via malicious or other activity), or other verification and / or authentication processes of the functionality provided by the domain module 208 may be verified. Although the projection architecture 200 includes the domain modules 208, in some cases, the projection architecture 200 may not include the domain modules 208 because authentication may not be necessary in all cases (e.g., authentication may not be required for certain vehicles, such as slow-moving farm equipment and / or older vehicles).
[0062] To illustrate, consider the following example of a projection domain module (e.g., one of the domain modules 208) that will serve as a cluster that can also be instantiated as a secondary activity projection. The same projection module can be used for local activity projection of the box, which will be discussed in more detail below. Another example is a radio module or a vehicle action module, and the same module can also be used for LAL transmission as well as the box.
[0063] Each of the domain modules 208 may also reference one or more services 210. Each of the services 210 may represent a suite of related services, e.g., a display source service and an input source service may be packaged as a suite of services that implement a projection mode (since these services are related to windows and input sources to windows). In this regard, the services 210 may each represent a mode (e.g., projection mode) or other suite of services for implementing a dedicated service that hosts services to be provided to the vehicle head unit 102.
[0064] Figure 3 300 is a block diagram illustrating a conceptual schematic of a layered architecture of an operating system through which seamless switchable transfer management can occur in accordance with various aspects of the techniques described in the present disclosure. Operating system 300 can represent an example of operating system 103 and / or operating system 113, which can configure one or more processors to perform various aspects of the seamless transfer management techniques described in the present disclosure when executed.
[0065] exist Figure 3 In the example of , the operating system 300 may include a UAL transport 302, a UAL base protocol module 304, and a LAL protocol module 306. The UAL transport 302 may represent an underlying transport (e.g., one or more of a PAN transport, a WLAN transport, a wired transport such as a USB transport, etc.) selected by the operating system 300 in the manner described above.
[0066] The operating system 300 may be based on, for example, Figure 1 The UAL transmission 302 is selected based on one or more characteristics of the data to be projected by the projection application 105 shown in the example of FIG. 1 . The data to be projected may be acquired by the projection application 105 or by the application 104, wherein the application 104 provides the data to the projection application 105 for projection to the vehicle head unit 102. Such characteristics may include the type of application acquiring the data (e.g., a navigation application may cause the operating system 300 to select a WLAN transmission or a wired transmission due to increased bandwidth requirements), the amount of bandwidth requested by the application acquiring the data (e.g., a navigation application may request a transmission with greater bandwidth), and the ability of the application acquiring the data to provide services.
[0067] Alternatively or in combination with the above selections based on one or more characteristics, the operating system 300 may select the UAL transport 302 based on the type of data to be transmitted via the UAL transport 302, the amount of data to be transmitted via the UAL transport 302 (e.g., as identified over time or via an initial request for the UAL transport 302), or the data packet to be transmitted via the UAL transport 302 (e.g., a VoIP packet may differ from a normal IP packet in that the VoIP packet may identify a VoIP port). The operating system 300 may also, alternatively or in combination with any of the above selection criteria, select the UAL transport 302 based on at least one of a latency threshold or a burst tolerance of the application acquiring the data. The operating system 300 may perform this selection based on any of the above selection criteria for a first transport such as the transport 109 and / or when switching between transports (e.g., for the transport 119).
[0068] UAL base protocol module 304 may represent services provided by operating system 300 to support establishment and management of UAL transport 302. Figure 3 As shown in the example of , the UAL basic protocol module 304 may include a transmission discovery module 310 , a PAN pairing module 312 , a WLAN setting module 314 , a channel module 316 , a security module 318 , and a connection maintenance module 320 .
[0069] Transport discovery module 310 may represent a module configured to discover various transports that may be used to connect host device 100 to vehicle head unit 102. Transport discovery module 310 may offload transport discovery from an application that provides acquisition of data for projection (assume it is application 104 in this example).
[0070] The PAN pairing module 312 may represent a module configured to perform various operations for establishing PAN transmissions, including initial pairing of the main device 100 with the vehicle head unit 102 to facilitate reconnection when in proximity to each other without requiring a pairing process. The WLAN setup module 314 may represent a module configured to establish WLAN transmissions between the main device 100 and the vehicle head unit 102.
[0071] The channel module 316 may represent a module configured to establish a channel on a transport through which data to be projected is provided. The security module 318 may represent a module configured to protect the channel / transport, for example by applying SSL encryption or any other security mechanism listed above. The connection maintenance module 320 may represent a module configured to negotiate or otherwise monitor the quality of service (QoS) of the UAL transport 302, the bandwidth of the UAL transport 302, the latency of the UAL transport 302, the burstiness of the UAL transport 302, and / or any other characteristics or in other words, selection criteria for the UAL transport 302. The connection maintenance module 320 may also perform reconnection due to an interruption of the UAL transport 302.
[0072] like Figure 3 As further shown in the example in FIG. 1 , the LAL protocol module 306 includes a basic projection module 330, a cluster projection module 332, an assistant integration module 334, a playback module 336, and a sensor module 338 (as well as other modules supported by the LAL protocol module 306, which are not shown in FIG. 1 for ease of description). Figure 3 The basic casting module 330 represents a conventional casting module that requests configuration of a specific transport before initiating a casting via the requested transport.
[0073] As described above, the UAL base protocol module 304 can convert the request to a general request for a transfer and then configure the UAL transfer 302 based on the aforementioned selection criteria, which can configure the specific requested transfer or a different transfer as the UAL transfer 302. After configuring the UAL transfer 302, the UAL base protocol module 304 can proceed to convert the request for projected data to accommodate the UAL transfer 302, possibly switching the underlying transport used for the UAL transfer 302 to project the data from the application 104 to the vehicle head unit 102.
[0074] The cluster projection module 332 may represent a module configured to manage projections from a cluster of one or more master devices (e.g., including master device 100). The cluster projection module 332 may enable multiple master devices to project to one or more displays of the vehicle head unit 102, such as display 116. In some cases, multiple master devices may project to the same display, such as display 116, or to two or more different displays (which the vehicle head unit 102 may include, although not described herein). Figure 1 ).
[0075] The assistant integration module 334 may represent a module configured to facilitate integration of a voice and / or text assistant during projection of data to the vehicle head unit 102. The voice / text assistant may provide a variety of assistance services during projection of data to the vehicle head unit 102, allowing an occupant of the vehicle to interact with the assistant to request navigation, text message composition, text message playback (wherein the assistant reads incoming text messages aloud), music playback (including streaming music playback), and video playback (including streaming video playback), among others, as some examples.
[0076] The playback module 336 may represent a module configured to perform music and / or video playback by projecting data representing the music and / or video to the vehicle head unit 102. The playback module 336 may interface with the audio and / or video (AV) system of the vehicle head unit 102 via a projection mode to perform playback of music and / or video. Although described with respect to music, the playback module 336 may perform any form of audio playback, including playback of auxiliary audio (e.g., reading an incoming text message aloud) and navigation (e.g., audio associated with directions), among others.
[0077] The sensor module 338 may represent a module configured to interface with sensors of the vehicle head unit 102. The sensor module 338 may issue requests for sensor data from sensors coupled to the vehicle head unit 102, including sensors such as GPS sensors, ambient light sensors, proximity sensors, altimeters, gyroscopes, and any other sensors commonly found in vehicles.
[0078] Figure 4 4 is another block diagram illustrating a conceptual schematic diagram of a layered architecture of an operating system through which seamless switchable transfer management can occur in accordance with various aspects of the techniques described in the present disclosure. Operating system 400 can represent an example of operating system 103 and / or operating system 113, which can configure one or more processors to perform various aspects of the seamless transfer management techniques described in the present disclosure when executed.
[0079] exist Figure 4In the example of , operating system 400 is similar to operating system 300 in that operating system 400 includes UAL transport 302, UAL base transport protocol module 304, and LAL protocol module 306. However, operating system 400 includes another set of protocol modules, which is represented as a box protocol module 402 that supports connections between the box, host device 100, and vehicle head unit 102. More information about the box can be found in U.S. Patent Application No. 17 / 065,932, filed on October 8, 2020, entitled "EXTENSIBLE COMPUTING ARCHITECTURE FOR VEHICLES".
[0080] In short, the box can be coupled to the vehicle head unit 102 as an extension of the vehicle head unit 102, allowing the vehicle owner to upgrade the vehicle head unit 102 via the installation of the box to present a newer vehicle experience. The vehicle owner can install the box, in other words, upgrade the physical hardware associated with the vehicle head unit 102, thereby providing an up-to-date user experience consistent with a newer vehicle head unit without the need to replace the entire vehicle head unit. The main device 100 can be coupled to the box (via transmission) and interact with the box to project data from the application 104, wherein the box can act as an intermediary device to project data from the application 104 to the vehicle head unit 102.
[0081] The box protocol module 402 may represent a protocol module configured to interface with the box to perform projection through the intermediate box. The box protocol module 402 may include an active projection module 410, a runtime update module 412, an audio routing module 414, a virtual machine (VMS) module 416, a sensor module 418, and additional modules similar to the LAL protocol module 306. The active projection module 410 may represent a module configured to support direct projection of data received from the application 104 executed by the host device 100.
[0082] The runtime update module 412 may represent a module configured to update shared resources (e.g., shared libraries) at runtime (or in other words, at execution time) to allow interconnection with the main device 100 and the vehicle head unit 102. The audio routing module 414 represents a module configured to route audio data received via the main device 100 and the vehicle head unit 102 between the main device 100 and the vehicle head unit 102. The VMS module 416 represents a module configured to execute a virtual machine to provide various functions associated with the box body described in the U.S. patent application cited above. The sensor module 418 may represent a module similar to the security module 318, except that the sensor module 418 can operate with respect to sensors present on the box body.
[0083] Figure 5 A more detailed diagram Figure 1 A block diagram of an example of a master device. Figure 5 The master device 500 shown in the example is Figure 1 An example of a main device 100 is shown. Figure 5 As shown in the example of FIG. 5 , the host device 500 includes a presence-sensitive display 512, one or more processors 540, one or more communication components 542, and one or more storage devices 548. The storage device 548 of the host device 100 includes an operating system 503 (which may be a processor) that presents a single UAL interface 550. Figure 1 ), through which communications between the host device 500 and the vehicle head unit 102 are initiated, updated, and otherwise maintained and / or managed.
[0084] The communication channel 560 can interconnect each of the components 512, 540, 542, and / or 148 for inter-component communication (physically, communicatively, and / or operationally), and thereby allow the components 512, 540, 542, and / or 548 to communicate with each other. In some examples, the communication channel 560 may include a system bus, a network connection, one or more inter-process communication data structures, or any other component for transmitting data (also referred to as information). Although shown as including components 512, 540, 542, and 548, the main device 500 may include other components or fewer components than shown, wherein these components may be included in other control units, such as a telematics control unit (TCU).
[0085] One or more communication units 542 of the main device 500 can communicate with external devices by sending and / or receiving data. For example, the main device 500 can use one or more communication units 542 to send and / or receive radio signals on a radio network such as a cellular radio network. In some examples, the communication unit 542 can send and / or receive satellite signals on a satellite network such as a global positioning system (GPS) network. Examples of communication units 542 include network interface cards (such as Ethernet cards), optical transceivers, radio frequency transceivers, GPS receivers, or any other type of device that can send and / or receive information. Other examples of communication units 542 may include shortwave radios (e.g., NFC, Bluetooth (including BLE)), GPS, 3G, 4G, 5G and WIFI radios and universal serial bus (USB) controllers, etc. found in mobile devices.
[0086] In some examples, presence-sensitive display 512 of host device 500 may include functionality of an input component and / or an output component. Figure 5In an example of , presence-sensitive display 512 may include presence-sensitive input (PSI) component 536 ("PSI component 536"), such as a presence-sensitive screen or a touch-sensitive screen. In some examples, presence-sensitive input component 536 may detect objects at and / or near the presence-sensitive input component. As an example range, presence-sensitive input component 536 may detect objects, such as a finger or a stylus, that are within two inches or less of presence-sensitive input component 536. Presence-sensitive input component 536 may determine the location (e.g., (x, y) coordinates) of the presence-sensitive input component at which the object was detected. In another example range, presence-sensitive input component 536 may detect objects that are two inches or less from presence-sensitive input component 536, and other ranges are possible. Presence-sensitive input component 536 may use capacitive, inductive, and / or optical recognition techniques to determine the location of presence-sensitive input component 536 selected by a user's finger.
[0087] In some examples, the presence-sensitive display 512 may also provide output to the user using tactile, audio or video stimulation. For example, the presence-sensitive display 512 may include a display component 534 that displays a graphical user interface. The display component 534 may be any type of output component that provides a visual output. Although illustrated as an integrated component of the main device 500, in some examples, the presence-sensitive display 512 may be an external component that shares data or information paths with other components of the main device 500 for sending and / or receiving input and output. For example, the presence-sensitive display 512 may be a built-in component of the main device 500 that is located within the external package of the main device 500 and is physically connected to the external package of the main device 500 (e.g., a car screen installed in a vehicle dashboard). In another example, the presence-sensitive display 512 may be an external component of the main device 500 that is located outside the package of the main device 500 and is physically separated from the package of the main device 500 (e.g., a monitor, projector, etc. that shares a wired and / or wireless data path with a vehicle electronic control unit). In some examples, presence-sensitive display 512, when located outside of and physically separated from the packaging of host device 500, can be implemented by two separate components: presence-sensitive input component 536 for receiving input and display component 534 for providing output.
[0088] One or more storage devices 548 within the host device 500 can store information for processing during operation of the host device 500 (e.g., the host device 500 can store data accessed by the operating system 503 during execution of the host device 500). In some examples, the storage device 548 is a temporary memory, which means that the main purpose of the storage device 548 is not long-term storage. The storage device 548 on the host device 500 can be configured as a volatile memory for short-term storage of information, and therefore the stored content is not retained if power is removed. Examples of volatile memory include random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), and other forms of volatile memory known in the art.
[0089] In some examples, storage device 548 also includes one or more computer-readable storage media. In some examples, storage device 548 includes one or more non-transitory computer-readable storage media. Storage device 548 can be configured to store a larger amount of information than is typically stored by volatile memory. Storage device 548 can be further configured to be used as a non-volatile memory space for long-term storage of information and retain information after power on / off cycles. Examples of non-volatile memory include magnetic hard disks, optical disks, flash memory, or electrically programmable memory (EPROM) or electrically erasable programmable (EEPROM) memory. Storage device 548 can store program instructions and / or information (e.g., data) associated with operating system 503, application 504 (if not substantially similar to application 104, it can be similar) and projection application 505 (if not substantially similar to application 105, it can be similar). Storage device 548 may include a memory configured to store data or other information associated with operating system 503, application 504, and projection application 505.
[0090] One or more processors 540 can implement functions and / or execute instructions associated with the main device 500. Examples of processors 540 include application processors, display controllers, auxiliary processors, one or more sensor hubs, and any other hardware configured to function as a processor, processing unit, or processing device. The operating system 503, application 504, and projection application 505 can be operated (or in other words, executed) by the processor 540 to perform various actions, operations, or functions of the main device 500. That is, the modules 503-505 can form executable bytecodes that, when executed, cause the processor 540 to perform specific operations according to various aspects of the technology described herein (and thereby turn the main device 500 into a special-purpose computer that performs the specific operation). For example, the processor 540 of the main device 500 can retrieve and execute instructions stored by the storage device 548, which cause the processor 540 to perform the operations attributed to the operating system 503, application 504, and projection application 505 described herein. These instructions, when executed by the processor 540, can cause the main device 500 to store information in the storage device 548.
[0091] like Figure 5 As further shown in the example of FIG. 5 , operating system 503 includes UAL interface 550, which is another way of referring to a portion of an operating system, which is represented as operating system 300 (in FIG. 5 ). Figure 3 ) and operating system 400 (in the example of Figure 4 ). Thus, UAL interface 550 may present a single communication interface through which a transfer is requested and operating system 503 may select the transfer based on one or more of the above selection criteria.
[0092] The operating system 503 can monitor the underlying UAL transport provided through the UAL interface 550 and identify when the UAL transport is insufficient to accommodate the projection of data by the application 504 that acquires data through the projection application 505. In response to determining that the UAL is insufficient to accommodate the projection of data by the application 504, the UAL interface 550 can select a different transport as the UAL transport. The UAL interface 550 can switch from the current transport to a different transport, seamlessly establishing a new UAL transport (meaning, not being detected or notified by the application 504 and / or the projection application 505 and projecting the data acquired by the application 504 during the execution of the projection mode). The operating system 503 can then continue to project the data acquired by the application 504 to the vehicle head unit 102 via the UAL transport.
[0093] Figure 6 is a diagram illustrating the technology according to the present disclosure Figure 1 Flowchart of exemplary operation of a host device in seamlessly switching between transmissions during execution of a projection mode. Figure 6 In the example of FIG. 1 , the host device 100 may execute the operating system 103 to present a single communication interface (eg, Figure 5 ), through which the projection application 105 can establish a transmission 109 (600) between the main device 100 and the vehicle head unit 102, which facilitates the execution of the projection mode (for example, one or more of the projection of music audio data via PAN transmission 109, the projection of GUI data via wireless or wired transmission 109, etc.) for presentation by the vehicle head unit 102.
[0094] In response to receiving transmission 109, projection application 105 can project data (e.g., obtained by application 104) via transmission 109 (602). Operating system 103 can analyze transmission 109 (e.g., periodically, in response to some threshold change in data characteristics, via user prompt, etc.) to determine whether transmission 109 is sufficient to accommodate the data projection (604). That is, operating system 103 can monitor the various selection criteria described above, such as data burstiness, latency of transmission 109, bandwidth of transmission 109, interference with transmission 109 (e.g., as indicated by dropped packets), or other characteristics, and compare these selection criteria to various thresholds that identify when a transmission is insufficient to accommodate the projected data.
[0095] When the transmission 109 is determined to be sufficient ("yes" 606), the operating system 103 can continue to allow the projection application 105 to project data via the transmission 109, continuing to analyze the transmission 109 (602, 604). When the transmission 109 is determined to be insufficient ("no"), the operating system 103 can select a second transmission 119 to accommodate the data projection (608). For example, when the operating system 109 determines that there is insufficient bandwidth to support the projection of data (e.g., because the user switches from streaming music to streaming music and performing navigation), the operating system 109 can select the wired transmission as the transmission 119. In any case, the operating system 103 can seamlessly switch from the transmission 109 to the transmission 119 (610), thereby enabling the projection application 105 to continue to project data via the transmission 119 (612).
[0096] In this way, various aspects of the technology can achieve the following terms.
[0097] Clause 1. A method comprising: presenting a single communication interface through an operating system executed by a host device, an application establishing a first transmission between the host device and a vehicle head unit through the single communication interface, the first transmission facilitating the application to provide data for execution of a mode presented by the vehicle head unit; sending the data via the first transmission by the application during execution of the mode; switching from the first transmission to the second transmission by the operating system during execution of the mode; and sending the data via the second transmission by the application during execution of the mode.
[0098] Clause 2. The method of clause 1, further comprising negotiating, via the single communication interface, platform requirements for the vehicle head unit and the host device to facilitate establishing a socket stream to be used by the second transmission during execution of the mode.
[0099] Clause 3. The method of any combination of clauses 1 and 2, further comprising selecting, by the operating system, the second transmission based on one or more characteristics of the data sent by the application.
[0100] Clause 4. A method according to clause 3, wherein the application includes a first application, and wherein the plurality of characteristics include a type of a second application that obtains data, an amount of bandwidth requested by the second application that obtains data, and a capability of the second application that obtains data to provide a service.
[0101] Clause 5. The method of clause 4, wherein the service is at least one of audio streaming, video streaming, voice assistance, cellular communication, and information display.
[0102] Clause 6. A method according to any combination of clauses 1-5, further comprising selecting the second transmission by the operating system based on at least one of a type of data to be transmitted via the second transmission, an amount of data to be transmitted via the second transmission, or a data packet to be transmitted via the second transmission.
[0103] Clause 7. The method of any combination of clauses 1-6, further comprising selecting, by the operating system, the second transmission based on at least one of a latency threshold or a burst tolerance of an application acquiring the data.
[0104] Clause 8. The method according to any combination of clauses 1-7, wherein the first transmission and the second transmission each comprise one of a personal area network transmission, a wireless local area network transmission, and a wired transmission.
[0105] Clause 9. The method of any combination of clauses 1-8, wherein the first transmission and the second transmission each comprise different versions of the same personal area network transmission.
[0106] Clause 10. The method of clause 9, wherein the different versions transmitted by the same personal area network include a low energy version transmitted by the same personal area network and a high energy version transmitted by the same personal area network.
[0107] Clause 11. The method of any combination of clauses 1-10, wherein the application comprises a projection application, and wherein the mode comprises a projection mode in which the projection application projects the data for presentation by the vehicle head unit.
[0108] Item 12. A host device comprising: a memory configured to store an operating system and an application; and, one or more processors configured to: execute the operating system to present a single communication interface, the application establishing a first transmission between the host device and a vehicle head unit through the single communication interface, the first transmission facilitating the application to provide data for execution of a mode presented by the vehicle head unit; and execute the application to send the data via the first transmission during execution of the mode; wherein the operating system switches from the first transmission to the second transmission during execution of the mode, and wherein the application sends the data via the second transmission during execution of the mode.
[0109] Clause 13. A host device according to clause 12, wherein the one or more processors are further configured to negotiate platform requirements regarding the vehicle head unit and the host device via the single communication interface to facilitate establishing a socket stream to be used by the second transmission during execution of the mode.
[0110] Clause 14. The host device of any combination of clauses 12 and 13, wherein the one or more processors are further configured to execute the operating system to negotiate selection of the second transmission based on one or more characteristics of the data sent by the application.
[0111] Clause 15. A host device according to clause 14, wherein the application includes a first application, and wherein the plurality of characteristics include a type of a second application that obtains data, an amount of bandwidth requested by the second application that obtains data, and a capability of the second application that obtains data to provide a service.
[0112] Clause 16. A host device according to any combination of clauses 12-15, wherein the one or more processors are further configured to execute the operating system to select the second transmission based on at least one of a type of data to be transmitted via the second transmission, an amount of data to be transmitted via the second transmission, or a data packet to be transmitted via the second transmission.
[0113] Clause 17. The master device of any combination of clauses 12-16, wherein the one or more processors are further configured to execute the operating system to select the second transmission based on at least one of a latency threshold or a burst tolerance of an application acquiring the data.
[0114] Clause 18. The host device according to any combination of clauses 12-17, wherein the first transmission and the second transmission each comprise one of a personal area network transmission, a wireless local area network transmission, and a wired transmission.
[0115] Clause 19. The host device of any combination of clauses 12-18, wherein the application comprises a projection application, and wherein the mode comprises a projection mode in which the projection application projects the data for presentation by the vehicle head unit.
[0116] Item 20. A non-transitory computer-readable storage medium having instructions stored thereon that, when executed, cause one or more processors of a host device to: execute an operating system to present a single communication interface, the application establishing a first transmission between the host device and a vehicle head unit through the single communication interface, the first transmission facilitating the application to provide data for execution of a mode presented by the vehicle head unit; and, execute the application to send the data via the first transmission during execution of the mode; wherein the operating system switches from the first transmission to the second transmission during execution of the mode, and wherein the application sends the data via the second transmission during execution of the mode.
[0117] As an example and not limitation, such computer-readable storage media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, disk storage or other magnetic storage devices, flash memory or any other storage medium that can be used to store the required program code in the form of instructions or data structures and can be accessed by a computer. In addition, any connection is appropriately referred to as a computer-readable medium. For example, if a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL) or wireless technology (such as infrared, radio and microwave) is used to transmit instructions from a website, server or other remote source, then the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology (such as infrared, radio and microwave) are all included in the definition of the medium. However, it should be understood that computer-readable storage media and data storage media do not include connections, carriers, signals or other transient media, but are instead directed to non-transient, tangible storage media. The disks and optical disks used herein include compact disks (CDs), laser disks, optical disks, digital versatile disks (DVDs), floppy disks and blue-ray disks, wherein disks usually reproduce data magnetically, while optical disks use lasers to reproduce data optically. The above combination should also be included in the scope of computer-readable media.
[0118] Instructions may be executed by one or more processors, such as one or more digital signal processors (DSPs), general-purpose microprocessors, application-specific integrated circuits (ASICs), field programmable logic arrays (FPGAs), or other equivalent integrated or discrete logic circuits. Therefore, the term "processor" as used herein may refer to any of the aforementioned structures or any other structure suitable for implementing the techniques described herein. In addition, in some aspects, the functions described herein may be provided within dedicated hardware and / or software modules. In addition, these techniques may be fully implemented in one or more circuits or logic elements.
[0119] The technology of the present disclosure can be implemented in a variety of devices or apparatuses, including wireless handsets, integrated circuits (ICs), or a set of ICs (e.g., chipsets). Various components, modules, or units are described in this disclosure to emphasize the functional aspects of devices configured to perform the disclosed technology, but do not necessarily need to be implemented by different hardware units. Instead, as described above, the various units can be combined in a hardware unit or provided by a collection of interoperable hardware units including one or more processors as described above together with appropriate software and / or firmware. Various examples have been described. These and other examples are within the scope of the following claims.
Claims
1. A method for switchable communication, comprising: a single communication interface presented by an operating system executed by a computing device, a projection application establishing a first transmission between the computing device and a vehicle head unit via the single communication interface, the first transmission facilitating the projection application to provide data including at least a graphical user interface for execution of a projection mode presented by the vehicle head unit; sending, by the projection application during execution of the projection mode, via the first transmission, the data including at least the graphical user interface for presentation by the vehicle head unit; switching, by the operating system, from the first transmission to a second transmission during execution of the projection mode; as well as sending, by the projection application during execution of the projection mode, via the second transmission, the data including at least the graphical user interface for presentation by the vehicle head unit, Wherein the switching is performed by the operating system in response to determining that the first transmission is insufficient to accommodate the data sent by the projection application during execution of the projection mode. 2 . The method of claim 1 , further comprising negotiating, via the single communication interface, platform requirements for the vehicle head unit and the computing device to facilitate establishing a socket stream to be used by the second transmission during execution of the projection mode. 3 . The method of claim 1 , further comprising selecting, by the operating system, the second transmission based on one or more of a plurality of characteristics of the data sent by the projection application.
4. The method according to claim 3, in, The projected application is a first application, and The multiple characteristics include the type of the second application that obtains the data, the amount of bandwidth requested by the second application, and the ability of the second application to provide services.
5. The method according to claim 4, wherein: The service is at least one of audio streaming, video streaming, voice assistance, cellular communication, and information display.
6. The method of any one of claims 1-5, further comprising selecting, by the operating system, the second transfer based on at least one of a type of data to be transferred via the second transfer, an amount of data to be transferred via the second transfer, and a data packet to be transferred via the second transfer.
7. The method of any one of claims 1-5, further comprising selecting, by the operating system, the second transmission based on at least one of a latency threshold and a burst tolerance of an application acquiring the data.
8. The method according to any one of claims 1 to 5, wherein: The first transmission and the second transmission both include one of personal area network transmission, wireless local area network transmission and wired transmission.
9. The method according to any one of claims 1 to 5, wherein: The first transmission and the second transmission each include different versions of the same personal area network transmission.
10. The method according to claim 9, wherein: The different versions transmitted by the same personal area network include a low energy version transmitted by the same personal area network and a high energy version transmitted by the same personal area network.
11. A computing device comprising: a memory configured to store an operating system and a projection application; as well as One or more processors configured to: executing the operating system to present a single communication interface, the projection application establishing a first transmission between the computing device and a vehicle head unit via the single communication interface, the first transmission facilitating the projection application to provide data including at least a graphical user interface for execution of a projection mode presented by the vehicle head unit; as well as executing the projection application to send the data including at least the graphical user interface via the first transmission for presentation by the vehicle head unit during execution of the projection mode, wherein the operating system switches from the first transmission to the second transmission during execution of the projection mode, wherein the projection application sends the data including at least the graphical user interface via the second transmission during execution of the projection mode for presentation by the vehicle head unit, and Wherein the switching is performed by the operating system in response to determining that the first transmission is insufficient to accommodate the data sent by the projection application during execution of the projection mode.
12. The computing device of claim 11, wherein: The one or more processors are further configured to negotiate, via the single communication interface, platform requirements for the vehicle head unit and the computing device to facilitate establishing a socket stream to be used by the second transmission during execution of the projection mode.
13. The computing device of claim 11, wherein: The one or more processors are further configured to execute the operating system to select the second transmission based on one or more of a plurality of characteristics of the data sent by the projection application.
14. The computing device according to claim 13, in, The projected application is a first application, and The multiple characteristics include the type of the second application that obtains the data, the amount of bandwidth requested by the second application, and the ability of the second application to provide services.
15. The computing device according to any one of claims 11 to 14, wherein: The one or more processors are further configured to execute the operating system to select the second transfer based on at least one of a type of data to be transferred via the second transfer, an amount of data to be transferred via the second transfer, and a data packet to be transferred via the second transfer.
16. The computing device according to any one of claims 11 to 14, wherein: The one or more processors are further configured to execute the operating system to select the second transmission based on at least one of a latency threshold and a burst tolerance of an application acquiring the data.
17. The computing device according to any one of claims 11 to 14, wherein: The first transmission and the second transmission both include one of personal area network transmission, wireless local area network transmission and wired transmission.
18. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors of a computing device to: executing an operating system to present a single communication interface through which a projection application establishes a first transmission between the computing device and a vehicle head unit, the first transmission facilitating the projection application to provide data including at least a graphical user interface for execution of a projection mode presented by the vehicle head unit; and executing the projection application to send the data including at least the graphical user interface via the first transmission for presentation by the vehicle head unit during execution of the projection mode; in, the operating system switches from the first transmission to the second transmission during execution of the projection mode, wherein the projection application transmits, via the second transmission, the data including at least the graphical user interface for presentation by the vehicle head unit during execution of the mode, and Wherein the switching is performed by the operating system in response to determining that the first transmission is insufficient to accommodate the data sent by the projection application during execution of the projection mode.
