System and method for vehicle seat-based companion device

The seat-companion mechanism on passengers' mobile devices provides personalized multimedia and vehicle control, addressing the limitations of driver-centric vehicles by allowing seamless access and content sharing, enhancing passenger experience.

WO2025145002A1PCT designated stage expired Publication Date: 2025-07-03HARMAN INT IND INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/US2024/062054
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-28
Filing Date
2024-12-27
Publication Date
2025-07-03

AI Technical Summary

Technical Problem

Current vehicles are driver-centric, limiting rear seat passengers' access to multimedia controls and content sharing, requiring them to use a full-screen application that disrupts their media experience.

Method used

A seat-companion mechanism on passengers' mobile devices allows seamless access to vehicle multimedia systems, enabling personalized audio/video controls, content sharing, and vehicle adjustments through a pop-up GUI, automatically pairing with the vehicle upon entry and tracking seat occupancy.

Benefits of technology

Enables personalized and immersive media enjoyment for passengers with independent volume and content control, along with vehicle adjustments, enhancing passenger experience without disrupting the driver-centric interface.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure US2024062054_03072025_PF_FP_ABST
    Figure US2024062054_03072025_PF_FP_ABST
Patent Text Reader

Abstract

In at least one embodiment, a multimedia system is provided. The multimedia system includes a first mobile device. The first mobile device includes at least one first controller programmed to receive first information indicative of a location of a second mobile device positioned about a vehicle and to receive second information corresponding to a first multimedia signal. The at least one first controller is further programmed to generate a user prompt on a display thereof indicating (i) the first multimedia signal that is available to the first mobile device from the second mobile device; and (ii) the location of the second mobile device positioned about the vehicle based on the second information. The at least one first controller is further programmed to transmit a command to receive the first multimedia signal from the second mobile device responsive to a user selection at the user prompt.
Need to check novelty before this filing date? Find Prior Art

Description

SYSTEM AND METHOD FOR VEHICLE SEAT-BASED COMPANION DEVICECROSS-REFERENCE TO RELATED APPLICATIONS[00011 This application claims the benefit of U.S. provisional application Serial No. 63 / 615,629 filed December 28, 2023, the disclosure of which is hereby incorporated in its entirety by reference herein.TECHNICAL FIELD

[0002] Aspects disclosed herein generally relate to a system and method for a vehicle seatbased companion device. These aspects and others will be discussed in more detail herein.BACKGROUND|'0003| Vehicles implement personalized features in addition to seat-centric functionalities. In today’s vehicles, it is necessary to make adjustments from a main user interface that is typically positioned on an instrument panel. Some vehicles may provide an application in which a driver or passenger in the vehicle can access such an application from a location remote from the vehicle. Vehicle passengers are not able to access the main user interface on the vehicle and therefore may be precluded from experiencing media related parameters that are offered by the vehicle’s multimedia system. Similarly, the vehicle multimedia system may not allow passengers to share their content to the vehicle which can then be ported or transmitted to other passengers in the vehicle.SUMMARY

[0004] In at least one embodiment, a multimedia system is provided. The multimedia system includes a first mobile device for being positioned in a vehicle. The first mobile device includes at least one first controller programmed to receive first information indicative of a location of a second mobile device positioned about the vehicle and to receive second information corresponding to a first multimedia signal that is available for the first mobile device from the second mobile device. The at least one first controller is further programmed to generate a user prompt on a display thereofindicating (i) the first multimedia signal that is available to the first mobile device from the second mobile device based on the first information and (ii) the location of the second mobile device positioned about the vehicle based on the second information. The at least one first controller is further programmed to transmit a command to receive the first multimedia signal from the second mobile device responsive to a user selection at the user prompt.

[0005] In at least another embodiment, a method for a multimedia system is provided. The method includes receiving, at a first mobile device, first information indicative of a location of a second mobile device positioned about a vehicle and receiving, at a first mobile device, second information corresponding to a first multimedia signal that is available for the first mobile device from the second mobile device. The method further includes generating, at the first mobile device, a user prompt on a display thereof indicating (i) the first multimedia signal that is available to the first mobile device from the second mobile device based on the first information; and (ii) the location of the second mobile device positioned about the vehicle based on the second information. The method further includes transmitting a command to receive the first multimedia signal from the second mobile device responsive to a user selection at the user prompt.

[0006] In at least another embodiment, a computer-program product embodied in a non- transitory computer readable medium that is stored in memory and that is programmed and executable by at least one controller in multimedia system is provided. The computer-program product includes instructions to receive, at a first mobile device, first information indicative of a location of a second mobile device positioned about a vehicle and to receive, at a first mobile device, second information corresponding to a first multimedia signal that is available for the first mobile device from the second mobile device. The computer-program product includes instructions to generate, at the first mobile device, a user prompt on a display thereof indicating: (i) the first multimedia signal that is available to the first mobile device from the second mobile device based on the first information; and (ii) the location of the second mobile device positioned about the vehicle based on the second information. The computer-program product further includes instructions to transmit a command to receive the first multimedia signal from the second mobile device responsive to a user selection at the user prompt.BRIEF DESCRIPTION OF THE DRAWINGS

[0007] The embodiments of the present disclosure are pointed out with particularity in the appended claims. However, other features of the various embodiments will become more apparent and will be best understood by referring to the following detailed description in conjunction with the accompany drawings in which:

[0008] FIGURE 1 generally illustrates a vehicle multimedia system in a vehicle in accordance with one or more embodiments;

[0009] FIGURE 2 generally illustrates a more detailed view of aspects related to the vehicle multimedia system in accordance with one or more embodiments;

[0010] FIGURE 3 illustrates one pairing mechanism that may be used to pair remote mobile devices to the vehicle multimedia system in accordance with one or more embodiments;

[0011] FIGURE 4 illustrates various user interfaces on passenger mobile devices in accordance with one or more embodiments;[0012 [ FIGURE 5 depicts a method for sharing information between a multimedia controller and one or more mobile devices for the vehicle multimedia systems of FIGURES 1 and 2 in accordance with one or more embodiments; and

[0013] FIGURE 6 depicts another method for transmitting information between one or more mobile devices and a multimedia controller of FIGURES 1 and 2 in accordance with one or more embodiments.DETAILED DESCRIPTION

[0014] As required, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention that may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components.Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.|0015] In general, vehicles today are driver centric in that the driver controls many of the entertainment related aspects of the vehicle that involve audio and / or video. Typically, all audio related decisions are routed and derived from a primary graphical user interface (GUI) that is positioned on a front stack on an instrument panel of the vehicle. Rear seat passengers are more or less restricted from accessing a multimedia controller (or multimedia player) given that location relative to the instrument panel. Current vehicles are not personalized and also interfere with a passenger’s media content. Similarly, current vehicles are generally disruptive and require passengers to have a full screen application (e.g., app) that makes adjustments and then returns content. Aspects disclosed herein generally provide a seat-companion mechanism (or application) for passengers in the vehicle. For example, a mobile device belonging to a vehicle passenger may generally display a pop-up style GUI that operates as a floating widget for easy and seamless access to the vehicle’s head unit that provides multimedia capabilities. In this regard, the passengers can access the multimedia content from the vehicle and other vehicle passengers who also have their respective mobile devices paired to the vehicle can access each other’s multimedia content.

[0016] Upon pairing the passenger’s mobile device to the vehicle, the vehicle is capable of monitoring the particular location of the passenger in any corresponding seat in the vehicle even as passengers move into different seats. Once the passenger pairs his / her mobile device to the vehicle, the vehicle will automatically connect to the seat-companion mechanism every time the passenger with the paired mobile device enters the vehicle. The seat-based companion mechanism (or seat companion mechanism) enables passengers the ability to playback audio that is provided by the vehicle such that the passenger can utilize controls on the mechanism via the mobile device to individually customize the playback of the audio and / or or video on their respective mobile device. Various controls that may be selected by the seat-companion mechanism on the mobile device may include, but not limited to, in-car communication, announcement, personal assistant, and other communication solutions. Similarly, the seat-companion mechanism on the passenger’s mobile device may also provide audio / video seat-based solutions including seat volume, tone controls, audiofeature on / off and adjustment handling, audio / video content sharing, playlist generation and source selection, etc.

[0017] In addition, the seat-companion mechanism may also control aspects related to various seats positioned throughout the vehicle. For example, the seat-based vehicle control elements such as seat position, temperature, ventilation, comfort adjustments, etc. The vehicle control elements provided by the seat-companion mechanism may also include window opening / closing, blinds up / down, window tinting, reading light, zone mood light settings, etc. In addition, the vehicle control elements are also configured to set personal presets and favorite settings for the passenger’s seat which can also be stored on the passenger’s mobile device.

[0018] The disclosed system and method generally provide, but not limited to, easy and seamless vehicle and media control from a passenger’s own mobile device and improved integration for companion app users which provide retained media enjoyment and immersion throughout the drive. The disclosed system and method also provide basic controls that are available at a passenger’s fingertips at any time while being in a vehicle and automatic pairing to the vehicle and to the passenger’s seat, while entering the vehicle. The disclosed system and method provide improved and personalized vehicle control while watching media due to a smart device integration.|0019| FIGURE 1 generally depicts a vehicle multimedia system 10 in a listening environment 12 of a vehicle 14 in accordance with one embodiment. The listening environment 12 includes a plurality of seats 16 (e.g., a first seat 16a, a second seat 16b, a third seat 16c, and a fourth seat 16d) positioned in rows 18 (e.g., a first row 18a and a second row 18b) of the vehicle 14. It is recognized that the number of seats 16 and rows 18 in the vehicle 14 may vary based on the particular implementation of the vehicle 14. The first seat 16a is substantially adjacent to the second seat 16b. The first seat 16a may be a driver seat, and the second seat 16b may be a front passenger seat. The third seat 16c may be a left rear passenger seat, and the fourth seat 16d may be a right rear passenger seat. As illustrated, the first seat 16a and the second seat 16b may be substantially aligned in the first row 18a. The second row 18b is generally positioned behind the first row 18a in the vehicle 14.

[0020] The vehicle 14 includes a plurality of loudspeakers 20 (e.g., a first loudspeaker 20a, a second loudspeaker 20b, a third loudspeaker 20c, and a fourth loudspeaker 20d) positioned within the listening environment 12. The first loudspeaker 20a may be proximal to the first seat 16a and distal to the second seat 16b. The second loudspeaker 20b may be proximal to the second seat 16b and distal to the first seat 16a. The first loudspeaker 20a may be located in a left-hand door (not shown) or positioned within a headrest (not shown) of the first seat 16a. The second loudspeaker 20b may be located in a right-hand door (not shown) or positioned within a headrest (not shown) of the second seat 16b. A first transverse axis 22 running from a left side of the vehicle 14 to the right side of the vehicle 14 may intersect the first loudspeaker 20a and the second loudspeaker 20b. The first transverse axis 22 may run perpendicular to a centerline 24 of the vehicle 14.

[0021] Additionally or alternatively, the first loudspeaker 20a and the second loudspeaker 20b may be aligned on a first plane (not shown). The first plane may run perpendicular to a center plane of the vehicle 14. The centerline 24 may be located on the center plane. Additionally or alternatively, the first loudspeaker 20a may be located at a position that is a mirror location of the second loudspeaker 20b. The centerline 24 (and / or the center plane) may extend from a front of the vehicle 14 to the rear of the vehicle 14 and serve as the mirror line and / or mirror plane, respectively, for the first loudspeaker 20a and the second loudspeaker 20b. In one example, the orientation of the first loudspeaker 20a in the vehicle 14 may, therefore, be a mirrored orientation of the orientation of the second loudspeaker 20b. It is recognized that this may vary and that the first loudspeaker 20a in the vehicle may be in a non-mirrored orientation of the second loudspeaker 20b. Generally speaking, the first loudspeaker 20a and the second loudspeaker 20b may each be positioned on a similar three-dimensional coordinate axis on each of the first door and the second door, respectively, to provide the mirrored orientation. Likewise, the third loudspeaker 20c and the fourth loudspeaker 20d may each be positioned on a similar three-dimensional coordinate axis on each of the third door and the fourth door, respectively, to provide the mirrored orientation.

[0022] At least one multimedia controller 26 (“multimedia controller 26”) is operably coupled to the loudspeakers 20. The multimedia controller 26 transmits an audio signal to the loudspeakers 20. The loudspeakers 20 playback audio data in the listening environment 12 in response to the audio signal. The multimedia controller 26 generally processes information used inconnection with an AM radio, FM radio, satellite radio, navigation system, user interface, display, wireless communication with mobile devices 28 via Bluetooth, WiFi or other wireless protocols, etc. The mobile device 28 may be a cell phone, electronic tablet, laptop, etc. An audio amplifier 27 is operably coupled to the multimedia controller 26. The audio amplifier 27 may be integrated with the multimedia controller 26. In another embodiment, the audio amplifier 27 may be positioned exterior to the multimedia controller 26. The audio amplifier 27 is generally configured to receive an audio output from the multimedia controller 26 and to amplify the amplitude for the audio output to a level that is adequate to driver the various loudspeakers 20. It is recognized that the multimedia controller 26 may generally include any number of hardware-based processors and memory. The multimedia controller 26 may execute any number of software algorithms that are stored on the memory with the various hardware-based processors to provide surround sound, audio tuning, such as for example, gain, equalization, or any number of various audio adjustments to enhance the listening experience within the listening environment. The multimedia controller 26 may include any number of channels with each corresponding channel being coupled to a respective loudspeaker 20 via the audio amplifier 27 for transmitting the audio signal to the respective loudspeaker 20. The multimedia controller 26 may also store / provide video content that can be played back with audio into the listening environment 12.

[0023] As noted above, the multimedia controller 26 may wirelessly communicate with any number of the mobile devices 28 (or 28a, 28b, 28c, 28d) positioned in the vehicle 14 via BLUETOOTH, Bluetooth, WiFi or other wireless protocols. Each mobile device 28 includes one or more controllers (not shown) that are operably coupled to mechanism to execute a seat companion mechanism (or app) to communicate with the multimedia controller 26. As is generally known, a driver with a mobile device 28a may be positioned in the first seat 16a and a passenger with a mobile device 28b, 28c, and 28d may be positioned in at least one of the second seat 16b, the third seat 16c, and the fourth seat 16d, respectively. The driver may include mobile device 28a to engage in wireless and bi-directional communication with the multimedia controller 26. In a similar fashion, each passenger may include a corresponding mobile device 28 that engages in bi-directional communication with the multimedia controller 26. Each of the mobile devices 28 includes one or more processors and memory to execute a seat-companion application (or mechanism) to enable thepassengers while positioned in any one or more of the second seats 16b, 16c, and 16d to access and control aspects related to the multimedia controller 26 to enable their mobile devices 28 to playback audio / video (e g., multimedia data) in a customizable format on their mobile devices 28. These aspects will be discussed in more detail in connection with FIGURE 2.

[0024] FIGURE 2 generally illustrates a more detailed view of aspects related to the vehicle multimedia system 10 in accordance with one embodiment. FIGURE 2 illustrates that the driver including the mobile device 28a is positioned in the first seat 16a, a first passenger including the mobile device 28b is positioned in the second seat 16b, a second passenger including the mobile device 28c positioned in the third seat 16c, and a third passenger including the mobile device 28d positioned in the fourth seat 16d. Each of the mobile devices 28a - 28d includes at least one controller 29a - 29d, respectively, (or the “controller 29”) and may be electrically paired to the multimedia controller 26 to control any number of aspects related to multimedia playback. Each of the mobile devices 28a - 28d may include the seat-companion mechanism to enable the transmission of information (e.g., control signals) from the mobile devices 28a - 28d to the multimedia controller 26 to control any number of aspects related to the multimedia controller 26. In addition, the passengers may upload (or share) multimedia content from their respective mobile devices 28b, 28c, and / or 28d to the multimedia controller 26 such that other passengers can obtain the shared content with one another.

[0025] Each of the mobile devices 28a - 28d (for the driver and / or any one or more of the passengers (“or occupants”) may undergo a pairing operation with the vehicle 14 (or the multimedia controller 26) such that the vehicle 14 automatically detects the mobile devices 28a - 28d upon entering the vehicle 14. Upon pairing any one or more of the occupant’s mobile device 28a, 28b, 28c, and / or 28d to the vehicle 14, the vehicle 14 (e.g., the multimedia controller 26) is capable of monitoring the particular location of the occupant in any corresponding seat 16a, 16b, 16c, and 16d in the vehicle 14 even as occupants move into different seats 16a, 16b, 16c, and / or 16d. Once the occupant pairs his / her mobile device 28a - 28d to the vehicle 14, the multimedia controller 26 automatically connects to the seat-companion mechanism (or app) as executed on the mobile devices 28a - 28d every time the passenger with the paired mobile device enters the vehicle 14. The seat based companion mechanism, as executed by the mobile devices 28a, 28b, 28c, and / or 28d, enablesoccupants the ability to playback audio that is provided by the vehicle 14 such that the occupant can utilize controls on the seat based companion mechanism via the mobile device 28a - 28d to individually customize the playback of the audio and / or or video on their respective mobile device 28a - 28d. Various controls that may be selected by the seat-companion mechanism on any one or more of mobile devices 28a - 28d may include, but not limited to, in-car communication, announcement, personal assistant, and other communication solutions. Similarly, the seatcompanion mechanism on the occupant’s mobile device 28a, 28b, 28c, and / or 28d may also provide audio / video seat-based solutions including seat volume, tone controls, audio feature on / off and adjustment handling, audio / video content sharing, playlist generation and source selection, etc. In this regard, the passenger may listen to the audio at an audio volume including tone controls in a corresponding seat 16a, 16b, 16c, and 16d that is different than the volume and / or tone controls heard by another passenger that is positioned at a different seat 16a, 16b, 16c, and 16d. By virtue of the system 10 employing an individual sound zone about each seat 16a, 16b, 16c, and 16d, it is possible to individually control the volume, tone control, etc. and to enable different audio playbacks for each occupant at any of the seats 16a, 16b, 16c, and 16d. Thus, the occupant can listen to (or view) different content from occupants positioned in different seats 16a, 16b, 16c, and 16d and the system 10 enables each occupant to adjust the volume independently per seat 16a, 16b, 16c, and 16d.

[0026] In addition, the seat-companion mechanism may also control aspects related to the various seats 16a - 16b positioned throughout the vehicle 14. For example, each seat 16a - 16b may include a heated / cooled seat system 50 that includes heating elements, cooling ducts that are positioned on a seat bottom and a seat back, etc. to either provide heat or to cool the seats 16 for the driver and / or the passenger. Similarly, each seat 16a - 16b may also include a seat positioning assembly 52 to adjust an overall height, recline (fore and after position), etc. Thus, in this regard, the seat-based vehicle control elements as selected by the driver and / or passenger via the seatcompanion mechanism on the mobile devices 28a - 28d such as seat position, temperature, ventilation, comfort adjustments, etc. The vehicle control elements provided by the seat-companion mechanism on the mobile devices 28a, 28b, 28c, and / or 28d may also include window opening / closing, blinds up / down, window tinting, reading light, zone mood light settings, etc.

[0027] The multimedia controller 26 may wirelessly receive control signals indicative of commands selected by the driver and / or passengers via their respective mobile devices 28a - 28d. In turn, the multimedia controller 26 may process such commands and transmits information indicative of these commands to any one or more of the heated / cooled seat system 50 and the seat positioning assembly 52 via a data communication bus (e.g., Controller Area Network (CAN) bus, Local Interconnect Network (LIN) bus, etc.) to have the desired commands performed. Similarly, the vehicle 14 may also include a lighting system 53 having a lighting controller (not shown) and lighting devices (e.g., light emitting devices (LEDs)) positioned about the various seats 16a, 16b, 16c, and 16d. The mobile devices 28a - 28d may transmit commands via the seat-companion mechanism to control the mood lighting for the lighting devices (e.g., change in color, duration, etc.). Similarly, body electronics controller (not shown) may also receive commands over the data communication bus from the multimedia controller 26 to effectuate window opening / closing, blinds up / down, window tinting, reading light, etc. The vehicle 14 also includes a camera 60 positioned within the listening environment 12. The camera 60 may be used to identify the driver and / or passengers in the vehicle 14 in addition to creating an account for to link the user (i.e., passenger) associated with the seat companion mechanism to the vehicle 14.(0028] To link the seat companion mechanism of the mobile device 28 to the vehicle 14, the driver and / or passenger may employ the following operations. For example, the driver and / or the passenger may download the seat-companion mechanism on their respective mobile device. In this regard, the seat-companion mechanism may be stored externally from the vehicle 14 and may be accessible for download on Apple Store ®, etc. Once downloaded, the seat-companion mechanism may prompt the driver and / or passenger to create an account to register and provide a login and password credentials. One example of the manner in which the driver may create the account may involve (i) the camera 60 taking a photo / video of the driver and / or passenger at different angles, and (ii) prompting the driver and / or passenger to read a prompt for voice recognition capabilities. It is recognized that the vehicle 14 may include any number of microphones positioned about the vehicle cabin to capture audio inputs provided by the driver and / or passenger. Thus, for purposes of authenticating the driver and / or the passengers and their respective mobile devices 28a - 28d including the respective seat companion mechanism, the vehicle (e.g., multimedia controller 26) maycompare captured images and / or captured audio to the previously stored facial images and / or audio recordings to authenticate the driver and / or passenger to the vehicle 14. In addition, pairing may also involve the driver and / or passenger scanning a code (e.g., QR code 70) that is visible on a display 72 of the vehicle 14 (see FIGURE 3).|0029| After the driver and / or passengers pair their mobile devices 28a - 28d to the vehicle 14 and then enter the vehicle 14 at a later point in time, the camera 60 captures images of the driver and passenger in their seats 16 to determine which seat 16 each is positioned in. Each mobile device 28 in the vehicle wirelessly communicates with the multimedia controller 26. When paired to the correct seat 16, or when the multimedia controller 26 determines which mobile device (or driver and / or passenger) is at a particular seat 16, the seat companion mechanism automatically launches on the mobile device 28 for each access to the vehicle controls. Depending on the number of occupants (e.g., paired mobile devices 28a - 28d) in the vehicle 14, each paired mobile device 28(or a primary display that is fixed to the vehicle 14) will show relevant features. For example, assuming that only two occupants are in the vehicle 14, each mobile device 28 for a given occupant may display the audio / video content (or other aspects) on the other mobile device 28 for possible selection or use. It is recognized that other relevant features may be applicable based on the number of paired mobile devices 28 to the vehicle 14.

[0030] It is recognized that the display 72 may be operably coupled to multimedia controller 26 and that the driver can view which mobile devices 28 belonging to the passengers are paired to the multimedia controller 26 on a real time basis. The driver may communicate by selecting options on the display 72 to transmit information (or media) to select passengers in the various seats 16. In addition, the passengers via their respective mobile device 28 can also see which passengers in the vehicle 14 have paired and have established a live connection with the multimedia controller 26. In this regard, the passengers can freely distribute or transmit media content from their mobile device 28 to the multimedia controller 26 and / or to other mobile devices 28 via the seat companion mechanism.

[0031] FIGURE 4 illustrates various user interfaces 80a, 80b, 80c that depict aspects of the seat control mechanism on the mobile device 28 in accordance with one embodiment. The userinterface 80a generally depicts the seat companion mechanism as a small interface so that other aspects can be displayed on the mobile device 28 that may or may not be related to vehicle controls. Generally, the user interface 80a includes a first control panel field 102a that enables the driver and / or the passenger the ability to select various quick selection features 104a (or “selection features 104a”). In one example, the selection features 104a may correspond to volume selection, play operation, pause / stop operation, mute operation, media selection (e.g., channel selection, library selection, etc.) with respect to multimedia features shared by the mobile device 28 to the vehicle 14 or from the vehicle 14 to the mobile device 28. The first control panel field 102a may remain visible on the user interface 80a at all times in which the mobile device 28 is paired to the vehicle 14 (or to the multimedia controller 26) to enable the user the ability to select a desired operation from the first control panel field 102a. The user may move the first control panel field 102a anywhere on the user interface 80a to avoid distracting or getting in the way of other aspects that may be selected on the mobile device 28. In one example, the user may move the first control panel field 102a to a location on the display of the mobile device 28 that does not interfere with a game, movie, etc. that is currently being displayed on the mobile device 28.

[0032] The user interface 80b generally depicts the seat companion mechanism as an “expanded widget” (or a second control panel field 102b) in which more options are presented to the driver and / or passenger for selection with respect to vehicle. The second control panel field 102b includes the selection features 104a in addition to viewing grids 106 (or 106a - 106d). The viewing grids 106 enable the driver and / or passenger the ability to see what other passengers in the vehicle 14 are viewing and or listening to. For example, grid 106a may display the audio content (e.g., artist and song) that is being consumed by the driver, grid 106b may display the video and / or audio content that is being consumed or experienced by the front seat passenger, grid 106c may display the video and / or audio content that is being consumed or experienced by a second row left seat passenger, and grid 106d may display the video and / or audio content that is being consumed or experienced by a second row right seat passenger. It is recognized that the any one of the driver and / or passengers may select the audio and / or video content that is being consumed by the driver and / or various passengers by selecting the grid 106a - 106d of interest. In this regard, upon selection, the mobile device 28 may then play back the audio and / or video that is being consumedfor a first vehicle passenger for a second vehicle passenger in response to the second vehicle passenger selecting the appropriate grid 106a, 106b, 106c, and 106d that corresponds to the first vehicle passenger.10033] The multimedia controller 26 generally seams or stitches all of the audio and / or video content that is being consumed by the driver and / or passengers and provides information corresponding to which audio and / or video is being consumed by the driver and / or passenger(s) that have their respective mobile device(s) 28 that is paired to the vehicle 14. Similarly, the multimedia controller 26 provides information (e.g., left front seat 16a, right front seat 16b, left rear seat 16c, right rear seat 16d, etc.) with respect to the location of the mobile devices 28 (i.e., when paired to the vehicle 14) with respect to the seats 16. Thus, in this regard, the multimedia controller 26 provides the information (e.g., left front seat 16a, right front seat 16b, left rear seat 16c, right rear seat 16d, etc.) with respect to the location of the mobile device 28 along with the multimedia content that is being provided by each of the mobile devices 28 to other mobile devices 28. Each mobile device 28 in the vehicle processes the information provided by the multimedia controller 26 to provide an indication as to what audio and / or video is being consumed by other mobile devices 28 in the vehicle 14. In addition, each mobile device 28 processes the information provided by the multimedia controller 26 to determine the location of the other mobile devices 28 in the vehicle 14 and to provide the indication as to which mobile device 28 is providing the multimedia content on a corresponding grid 106 that indicates the location of the seat 16 in the vehicle 14.[0034 The user interface 80c generally depicts the seat companion mechanism as a “full app” (or a third control panel field 102c) in which any number of options (including more advanced controls) can be presented and selected by the driver and / or passenger for selection with respect to the vehicle controls. The advanced controls in the “full app” mode may involve an adjustment in various pred-defined equalizer presets. In order to make detailed adjustments to the pre-defined equalizer, the occupant may need to perform such task when the seat companion mechanism is opened in the full app mode. In general, the third control panel field 102c generally includes the selection features 104a, the viewing grids 106 (or 106a - 106d) and equalization selection fields 108. The selection features 104a and the grids 106 operate or function in the same manner as disclosed in connection with the user interfaces 80a and / or 80b. The equalization selection fields 108 allows thedriver and / or passengers the ability to select various equalization settings or parameters by selecting one of more of the equalization selection fields 108. For example, the driver and / or passenger may select various equalization settings to control bass, treble, right / left settings, etc.|0035] FIGURE 5 depicts a method 200 for sharing information between the multimedia controller 26 and the one or more mobile devices 28 for the vehicle multimedia system 10 of FIGURES 1 and 2 in accordance with one embodiment.]0036| In operation 202, the multimedia controller 26 receives a first image signal from the camera 60 that provides an image of a first vehicle occupant that is positioned in a first seat 16a of the vehicle 14. The multimedia controller 26 receives a second image signal from the camera 60 that provides an image of a second vehicle occupant positioned in a second seat 16b of the vehicle 14. The multimedia controller 26 receives a third image signal from the camera 60 that provides an image of a third vehicle occupant positioned in the third seat 16c. The multimedia controller 26 determines that first vehicle occupant is a driver positioned in the first seat 16a in response to the first image signal. The multimedia controller 26 determines that the second vehicle occupant is a passenger positioned in the second seat 16b. The multimedia controller 26 determines that the third vehicle occupant is a passenger positioned in a third seat 16c. In this case, the driver and both passengers have previously created an account with the vehicle 14 and previously paired their respective mobile devices 28a, 28b, and 28c as noted above.

[0037] In operation 204, the multimedia controller 26 receives a first multimedia signal from the mobile device 28a belonging to the driver in the first seat 16a, receives a second multimedia signal from the mobile device 28b belonging to the passenger in the second seat 16b, and receives a third multimedia signal from the mobile device 28c belonging to the passenger in the third seat 16c. As noted above, the multimedia signal may comprise video and / or audio data. The first multimedia signal may correspond to multimedia data that is being played back by the first mobile device 28a in real time. The second multimedia signal may correspond to multimedia data that is being played back by the second mobile device 28b in real time. The third multimedia signal may correspond to multimedia data that is being played back by the third mobile device 28c in real time. It is recognized that in other embodiments, the multimedia controller 26 may receive additionalinformation corresponding to available multimedia content that is available by one or more of the mobile devices 28a, 28b, 28c to share with other mobile devices 28a, 28b, 28c in the vehicle 14. For example, each of the mobile devices 28a, 28b, 28c may provide a listing of available movies, songs, etc. to the multimedia controller 26 such that the multimedia controller 26 provides the listing of the available movies and songs to other mobile devices 28a, 28b, 28c in the vehicle 14 that may not have this multimedia content.

[0038] In operation 206, the multimedia controller 26 transmits first information indicative of the first multimedia signal that is being played back by the first mobile device 28a to the second and third mobile device 28b and 28c (e.g., to the first passenger and the second passenger) to indicate what is being played back by the driver’s mobile device 28a. The multimedia controller 26 transmits second information indicative of the second multimedia signal that is being played back by the second mobile device 28b to the first mobile device 28a and the third mobile device 28c (e.g., to the driver and the third passenger). The multimedia controller 26 transmits third information indicative of the third multimedia signal that is being played back by the third mobile device 28c to the first mobile device 28a and the second mobile device 28b (e.g., to the driver and the first passenger). In light of the foregoing, the first mobile device 28a belonging to the driver displays the second information and the third information on the various grids 106 thereof, the second mobile device 28b belonging to the first passenger displays the first information and the third information on the various grids 106 thereof, and third mobile device 28c belonging to the second passenger displays the first information and the second information on the various grids 106 thereof. It is recognized that in other embodiments, the multimedia controller 26 may also transmit information or the listing corresponding to the available multimedia content (see operation 204 above) that can be shared to other mobile devices 28a, 28b, 28c. for selection, storage thereon, and playback by any one or more of the mobile devices 28a, 28b, 28c at a later point in time.

[0039] As noted above, the multimedia controller 26 provides information (e.g., left front seat 16a, right front seat 16b, left rear seat 16c, right rear seat 16d, etc.) with respect to the location of the mobile devices 28 (i.e., when paired to the vehicle 14) relative to the seats 16. Thus, in this regard, the multimedia controller 26 provides the information (e.g., left front seat 16a, right front seat 16b, left rear seat 16c, right rear seat 16d, etc.) with respect to the location of the mobile device28 along with the multimedia content that is being provided by each of the mobile devices 28 to other mobile devices 28. Each mobile device 28 processes the information provided by the multimedia controller 26 to determine the location of the other mobile devices 28 in the vehicle 14 and to provide the indication as to which mobile device 28 is providing the multimedia content on a corresponding grid 106 that indicates the location of the seat 16 in the vehicle 14 or to which mobile device 28 can provide the multimedia content for retrieval, storage, and playback at a later point in time.

[0040] In operation 208, the multimedia controller 26 may receive a command from any one or more of the first mobile device 28a, the second mobile device 28b, and the third mobile device 28c to provide the first multimedia signal, the second multimedia signal, and / or the third multimedia signal thereto. For example, the first mobile device 28a may transmit a command to the multimedia controller 26 to receive the second multimedia signal or the third multimedia signal for playback thereon, the second mobile device 28b may transmit a command to the multimedia controller 26 to receive the first multimedia signal and the third multimedia signal for playback thereon, or the third mobile device 28c may transmit a command to the multimedia controller 26 to receive the first multimedia signal and the second multimedia signal for playback thereon. In another embodiment, the multimedia controller 26 may receive a command from any one or more of the mobile devices 28a, 28b, 28c that is indicative of a request to provide the available multimedia content from one mobile device 28 to another mobile device 28. The multimedia controller 26 may transmit this request or command to the mobile device 28 that includes the requested available multimedia content to directly transfer the requested available multimedia content to the requesting mobile device 28 in the vehicle 14 or to enable the multimedia controller 26 to transmit the available multimedia content from the mobile device 28 to the requesting mobile device 28.

[0041] FIGURE 6 depicts another method 250 for transmitting information between the one or more mobile devices 28 and multimedia controller 26 of FIGURES 1 and 2 in accordance with one or more embodiments.

[0042] In operation 252, a first mobile device 28a receives information (e.g., first information) indicative of a location of a second mobile device 28b positioned about the vehicle 14.In this case, it is recognized that the first mobile device 28a and the second mobile device 28b is electronically paired to the vehicle 14 prior to this operation being executed.[0043| In operation 254, the first mobile device 28a receives information (e.g., second information) corresponding to a first multimedia signal (e.g., video and / or audio data) that is available for the first mobile device 28a from the second mobile device 28b. In one example, the second mobile device 28b provide the first multimedia signal to the media controller 26. In turn, the media controller 26 provides (or wirelessly transmits) the first multimedia signal to the first mobile device 28a.

[0044] In operation 256, the first mobile device 28a generates a user prompt (e.g., a grid 106) on a display thereof indicating (i) the first multimedia signal that is available to the first mobile device 28a from the second mobile device 28b based on the first information and (ii) the location of the second mobile device 28b positioned about the vehicle 14 based on the second information.

[0045] In operation 258, the first mobile device 28a transmits a command to receive the first multimedia signal from the second mobile device 28b responsive to a user selection at the user prompt.

[0046] In general, the seat companion mechanism (or app) as executed on the mobile device 28 enable selection of any number of vehicle controls directly from the app. The seat companion mechanism may expand and provide more detailed control over the selection of multimedia related features. The seat companion mechanism may be dragged on the display on the mobile device 28 so as to avoid disturbing other mobile device features, thereby offering a truly personalized experience where the user can both watch movies, play games, be on a conference call or similar activity and still control relevant vehicle features via the seat companion mechanism.

[0047] It is recognized that the control lers / devices as disclosed herein and in the attached Appendix may include any number of microprocessors, integrated circuits, memory devices (e.g., FLASH, random access memory (RAM), read only memory (ROM), electrically programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM), or other suitable variants thereof), and software which co-act with one another to perform operation(s)disclosed herein. In addition, such controllers as disclosed utilizes one or more microprocessors to execute a computer-program that is embodied in a non-transitory computer readable medium that is programmed to perform any number of the functions as disclosed. Further, the controller(s) as provided herein includes a housing and the various number of microprocessors, integrated circuits, and memory devices ((e.g., FLASH, random access memory (RAM), read only memory (ROM), electrically programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM)) positioned within the housing. The controller(s) as disclosed also include hardware-based inputs and outputs for receiving and transmitting data, respectively from and to other hardware-based devices as discussed herein.

[0048] While exemplary embodiments are described above, it is not intended that these embodiments describe all possible forms of the invention. Rather, the words used in the specification are words of description rather than limitation, and it is understood that various changes may be made without departing from the spirit and scope of the invention. Additionally, the features of various implementing embodiments may be combined to form further embodiments of the invention.

Claims

WHAT IS CLAIMED IS:

1. A multimedia system comprising: a first mobile device for being positioned in a vehicle, the first mobile device including: at least one first controller programmed to: receive first information indicative of a location of a second mobile device positioned about the vehicle; receive second information corresponding to a first multimedia signal that is available for the first mobile device from the second mobile device; generate a user prompt on a display thereof indicating: the first multimedia signal that is available to the first mobile device from the second mobile device based on the first information; and the location of the second mobile device positioned about the vehicle based on the second information, and transmit a command to receive the first multimedia signal from the second mobile device responsive to a user selection at the user prompt.

2. The system of claim 1, wherein the at least one first controller is further programmed to receive the first information and the second information from a multimedia controller positioned in the vehicle.

3. The system of claim 1, wherein the at least one first controller is further programmed to generate a plurality of grids positioned on the display.

4. The system of claim 3, wherein the plurality of grids corresponds to a plurality of seats positioned in a corresponding row of the vehicle.

5. The system of claim 4, wherein the user prompt corresponds to a first grid of the plurality of grids that is selectable by a user, and wherein the first grid indicates the location of the second mobile device as positioned about a seat of the vehicle.

6. The system of claim 1, wherein the at least one first controller is further programmed to transmit a second multimedia signal to a media controller positioned in the vehicle for selection by the second mobile device.

7. The system of claim 1, wherein the at least one first controller is further programmed to generate a control panel field including selection features to enable one or more of volume selection, play operation, pause / stop operation, mute operation, and media selection.

8. The system of claim 7, wherein the at least one first controller is programmed to control the selection features to remain visible on the display while the first mobile device is operably coupled to a multimedia controller positioned in the vehicle.

9. A method for a multimedia system, the method comprising: receiving, at a first mobile device, first information indicative of a location of a second mobile device positioned about a vehicle; receiving, at a first mobile device, second information corresponding to a first multimedia signal that is available for the first mobile device from the second mobile device; generating, at the first mobile device, a user prompt on a display thereof indicating: the first multimedia signal that is available to the first mobile device from the second mobile device based on the first information; and the location of the second mobile device positioned about the vehicle based on the second information, and transmitting a command to receive the first multimedia signal from the second mobile device responsive to a user selection at the user prompt.

10. The method of claim 9 wherein receiving, at the first mobile device, the second information from a multimedia controller positioned in the vehicle.

11. The method of claim 9 further comprising generating a plurality of grids positioned on the display.

12. The method of claim 1 1, wherein the plurality of grids corresponds to a plurality of seats positioned in a corresponding row of the vehicle.

13. The method of claim 12, wherein the user prompt corresponds to a first grid of the plurality of grids that is selectable by a user, and wherein the first grid indicates the location of the second mobile device as positioned about a seat of the vehicle.

14. The method of claim 9 further comprising transmitting, from the first mobile device, a second multimedia signal to a media controller positioned in the vehicle for selection by the second mobile device.

15. The method of claim 9 further comprising generating a control panel field including selection features to enable one or more of volume selection, play operation, pause / stop operation, mute operation, and media selection.

16. The method of claim 15 further comprising controlling the selection features to remain visible on the display while the first mobile device is operably coupled to a multimedia controller in the vehicle.

17. A computer-program product embodied in a non-transitory computer readable medium that is stored in memory and that is programmed and executable by at least one controller in an multimedia system, the computer-program product comprising instructions to: receive, at a first mobile device, first information indicative of a location of a second mobile device positioned about a vehicle;receive, at a first mobile device, second information corresponding to a first multimedia signal that is available for the first mobile device from the second mobile device; generate, at the first mobile device, a user prompt on a display thereof indicating: the first multimedia signal that is available to the first mobile device from the second mobile device based on the first information; and the location of the second mobile device positioned about the vehicle based on the second information, and transmit a command to receive the first multimedia signal from the second mobile device responsive to a user selection at the user prompt.

18. The computer-program product of claim 17 further comprising generating a plurality of grids positioned on the display.

19. The computer-program product of claim 18, wherein the plurality of grids corresponds to a plurality of seats positioned in a corresponding row of the vehicle.

20. The computer-program product of claim 19, wherein the user prompt corresponds to a first grid of the plurality of grids that is selectable by a user, and wherein the first grid indicates the location of the second mobile device as positioned about a seat of the vehicle.

Citation Information

Patent Citations

  • Vehicle passenger controls via mobile devices

    US10572123B2

  • System and method for controlling multi source and multi display

    US20150271561A1

  • Content sharing system and method

    US20180088777A1

  • Vehicle multimedia display system

    US20180129467A1

  • Direct media connection of a rear-seat entertainment unit

    US20220360838A1