Management of content displayed in vehicle

Abstract

The invention relates to management of content displayed within a vehicle. The present disclosure provides a method of managing content displayed within a vehicle. It is determined that at least one occupant in the vehicle is consuming content. Identification information for identifying at least one occupant is acquired. A detection is made that at least one occupant has left the vehicle. Identification information identifying the at least one occupant, a content identifier (ID) of the content consumed by the at least one occupant, and a final position of the content at a point in time at which the at least one occupant leaves the vehicle are saved. And detecting that at least one passenger has taken the vehicle again. Discrimination information for distinguishing the at least one occupant, a content ID of the content, and a final position of the content associated with the discrimination information for distinguishing the at least one occupant are read out. The content identified by the content ID is restarted at a final position for the content of the at least one occupant associated with the identification information.

Description

TECHNICAL FIELD

[0001] The present specification relates to management of content displayed in a vehicle. BACKGROUND

[0002] Presentation of audio content and / or video content in a vehicle is common in many mobile experiences. For example, a driver of a vehicle often listens to audio content (e.g., music and / or audio text) while driving, and a passenger often watches a video while in the vehicle before reaching a destination. Additional content includes web browsing, streaming content, and the like. The content can be accessed using a mobile device or other media reproduction device, such as an in-vehicle infotainment (IVI: In-Vehicle Infotainment) system (also referred to simply as an infotainment system).

[0003] However, a user often leaves the vehicle for various reasons such as refueling, eating, shopping, and the like. Even if the user has left the vehicle, the content continues to be presented. There is no method of resuming the viewing of the content from the point in time at which the user left the vehicle and returned to the vehicle in response to the user leaving the vehicle in the middle of the viewing of the content. SUMMARY

[0004] In at least one embodiment, a method of managing content displayed in a vehicle includes the steps of: determining that at least one occupant in the vehicle is consuming content; acquiring identification information that identifies the at least one occupant; detecting that the at least one occupant has left the vehicle; saving the identification information that identifies the at least one occupant, a content identifier (ID) of the content consumed by the at least one occupant, and a final position of the content at a point in time at which the at least one occupant left the vehicle; detecting that the at least one occupant has reboarded the vehicle; reading out the identification information that identifies the at least one occupant, the content ID of the content, and the final position of the content associated with the identification information that identifies the at least one occupant; and resuming the content identified by the content ID at the final position of the content of the at least one occupant associated with the identification information.

[0005] In at least one embodiment, an apparatus for managing content displayed within a vehicle has a memory that stores computer-readable instructions and a processor that is connected to the memory. The processor is configured to execute the computer-readable instructions to implement actions for determining that at least one occupant within the vehicle is consuming content, obtaining identification information that identifies the at least one occupant, detecting that the at least one occupant has exited the vehicle, saving the identification information that identifies the at least one occupant, a content identifier (ID) of the content consumed by the at least one occupant, and a final location of the content at a point in time when the at least one occupant exited the vehicle, detecting that the at least one occupant has reboarded the vehicle, reading out the identification information that identifies the at least one occupant, the content ID of the content, and the final location of the content that is associated with the identification information that identifies the at least one occupant, and resuming the content identified by the content ID at the final location of the content for the at least one occupant that is associated with the identification information.

[0006] In at least one embodiment, a non-transitory computer-readable medium stores computer-readable instructions. When the computer-readable instructions are executed by a processor, the computer-readable instructions cause the processor to implement actions comprising determining that at least one occupant within a vehicle is consuming content, obtaining identification information that identifies the at least one occupant, detecting that the at least one occupant has exited the vehicle, saving the identification information that identifies the at least one occupant, a content identifier (ID) of the content consumed by the at least one occupant, and a final location of the content at a point in time when the at least one occupant exited the vehicle, detecting that the at least one occupant has reboarded the vehicle, reading out the identification information that identifies the at least one occupant, the content ID of the content, and the final location of the content that is associated with the identification information that identifies the at least one occupant, and resuming the content identified by the content ID at the final location of the content for the at least one occupant that is associated with the identification information. BRIEF DESCRIPTION OF DRAWINGS

[0007] Figure 1 illustrates a cabin of a vehicle according to at least one embodiment.

[0008] Figure 2 is a diagram of an interior of a vehicle according to at least one embodiment.

[0009] Figure 3 is a system architecture according to at least one embodiment.

[0010] Figure 4 is a flowchart of a method for managing content displayed within a vehicle according to at least one embodiment.

[0011] Figure 5is a high-level functional block diagram of a processor-based system according to at least one embodiment. DETAILED DESCRIPTION

[0012] Features, aspects, and advantages of specific exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings. In the drawings, like reference numerals indicate like elements.

[0013] The following detailed description of exemplary embodiments refers to the accompanying drawings. The disclosure described above provides examples and non-limiting criteria, but is not intended to exhaust the implementation examples. Modifications and changes can be made according to the above disclosure or can be obtained from the practice of the implementation examples. Moreover, one or more features or constituent elements of one embodiment can be incorporated into or combined with another embodiment (or one or more features of another embodiment). Furthermore, it is understood that in the flowchart and action descriptions shown below, modifications such as omission of one or more actions, addition of one or more actions, simultaneous (at least partially) implementation of one or more actions, and rearrangement of the order of one or more actions can be implemented without affecting the scope of the present disclosure.

[0014] It is obvious that the system and / or method described in the present specification can be implemented in various forms of hardware, software, or a combination of hardware and software. Actual specific control hardware or software code for implementing such a system and / or method does not limit the implementation examples. Therefore, the actions and behaviors of the system and / or method are described in the present specification without reference to specific software code. It is understood that software and hardware can be designed to implement the system and / or method based on the description in the present specification.

[0015] Even if a specific combination of features is recited in the claims and / or disclosed in the specification, such a combination is not intended to limit the disclosure of possible implementation examples. In fact, many of such features can be combined in methods that are not specifically recited in the claims and / or disclosed in the specification. The following dependent claims are sometimes directly dependent only on one claim, but the disclosure of possible implementation examples includes each dependent claim in combination with all other claims in the claim group.

[0016] No element, act, or instruction used in the description of the present application should be construed as critical or essential unless explicitly so described. Also, as used herein, the article "a" and "an" are intended to include one or more items, and can be used interchangeably with "one or more." Where only one item is intended, the term "one" or similar language is used. Also, as used herein, the term "has," "have," "having" or the like are intended to mean "one or more" or "one or more than one," depending on the context. Further, the phrase "based on" is intended to mean "based, at least in part, on" unless explicitly stated otherwise.

[0017] Also, as used in the description of the application and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "or" as used herein refers to a non-exclusive "or", unless otherwise indicated. Also, as used herein, "and / or" between elements is intended to cover any of the possible combinations of one or more of the elements.

[0018] The above disclosure provides examples and illustrations, but is not intended to be exhaustive or to limit the implementations to the precise forms disclosed. Modifications and variations are possible in light of the above disclosure or from practice of the implementations.

[0019] In at least one embodiment, the method includes the steps of: determining that at least one occupant in a vehicle is consuming content; acquiring identification information that identifies the at least one occupant; detecting that the at least one occupant has exited the vehicle; saving the identification information that identifies the at least one occupant, a content identifier (ID) of the content consumed by the occupant, and a final location of the content at a point in time at which the at least one occupant exited the vehicle; detecting that the occupant has reboarded the vehicle; reading out the identification information that identifies the at least one occupant, the content ID of the content, and the final location of the content that is associated with the identification information that identifies the at least one occupant; and resuming the content identified by the content ID at the final location of the occupant that is associated with the identification information.

[0020] In implementations described in this specification, a method is provided that provides one or more advantages. For example, the cabin domain controller can discern a time at which an occupant consuming content exited the vehicle and associate a point within the content (final state) with the time at which the occupant exited the vehicle. When it is detected that the occupant has reboarded the vehicle, the cabin domain controller can resume the content from the point within the content (final state) that was associated with the time at which the occupant exited the vehicle.

[0021] Figure 1 A vehicle cabin 100 according to at least one embodiment is shown.

[0022] In Figure 1 the vehicle cabin is provided with a steering wheel 110, an accelerator pedal 112, a brake pedal 114, an instrument panel 120, an infotainment system 130, and an air conditioning system 140. The air conditioning system 140 is sometimes also referred to as a heating, ventilation, and air conditioning (HVAC) system. The steering wheel is part of a steering system for an operator to manipulate to control the direction of the vehicle. The operator indicates the direction of the vehicle by manipulating the steering wheel 110 via a linkage system to the front wheels. The accelerator pedal 112 is used to control the supply of fuel and air to the engine by the application of pressure. The accelerator pedal 112 is also commonly known as a throttle or gas pedal. The brake pedal 114 is depressed to apply brakes that slow and / or stop the vehicle.

[0023] The instrument panel 120 is part of the dashboard located behind the steering wheel 110. The instrument panel 120 is provided with various gauges and lights that inform the operator of the status of the vehicle. For example, the instrument panel 120 is commonly provided with a traction control indicator, an engine temperature, a tachometer, a fuel gauge, a speedometer, an odometer, a direction indicator, a gear display, various warning lights, etc. The tachometer displays the revolutions per minute (RPM) of the crankshaft of the engine. The speedometer indicates the speed of the vehicle. The odometer indicates the total miles traveled since the vehicle was first driven. The fuel gauge indicates the amount of fuel remaining in the vehicle. The temperature gauge indicates the current engine temperature.

[0024] Instead, a designated light can be provided for warning of engine temperature problems, such as engine overheating. Turn signals are lights that flash on both sides of the vehicle to communicate to other drivers the direction in which the driver intends to turn. In gear display or gear indicator, the currently used gear is indicated, such as park, neutral, drive, etc. Warning lights communicate various status items of the vehicle. Various functions are pre-installed in vehicles, such as ESC (Electronic Stability Controller) and ABS (Anti-lock Brake System), not to mention standard components or elements. When the vehicle confirmation system is indeed safe and ready for action, the warning lights are briefly illuminated at start-up. Depending on the situation, one warning light can remain illuminated, for example, indicating a problem with the engine, headlight, temperature, etc.

[0025] The vehicle has an infotainment system 130. In at least one embodiment, the infotainment system 130 is an in-vehicle infotainment (IVI) system (also referred to simply as an infotainment system). However, the embodiments described in this specification are not limited to IVI systems. The infotainment system 130 has one or more displays 132 for presenting content to occupants of the vehicle. For example, the one or more displays 132 are positioned to present content to each seat within the vehicle.

[0026] A cockpit domain controller (Cockpit Domain Controller) 140 provides a collection of hardware and software within the vehicle that provides content, such as audio, video, and other content or information, to occupants of the vehicle. The cockpit domain controller 140 controls the presentation of content and stores the status of each occupant. The vehicle can also include a camera system 150. The camera system 150 is configured to provide facial recognition of the occupants, such as the driver and other occupants of the front passenger seat. The cockpit domain controller 140 can use the camera system 150 or other sensors (e.g., communication sensors, occupant sensors, vibration sensors, motion sensors, etc.) to detect the presence of an occupant and detect when an occupant exits the vehicle.

[0027] The data communication interface 160 communicates with devices external to the vehicle to provide content to users within the vehicle. Such devices include smartphones, tablets, televisions, laptop computers, servers, and the like. The data communication interface 160 supports wireless connections in accordance with any of the IEEE 802.11 Wi-Fi protocols, Bluetooth (registered trademark) protocols, Bluetooth Low Energy (BLE), or other short-range protocols that act in accordance with wireless technology standards for exchanging data using licensed bands or unlicensed bands, such as mobile cellular systems that use the Citizens Broadband Radio Service (CBRS) band, the 2.4 GHz band, the 5 GHz band, the 6 GHz band, and the like. Moreover, the wireless connections can act in accordance with the RF4CE (Radio Frequency for Consumer Electronics: standard and protocol for remote control of consumer electronics) protocol, the ZigBee (registered trademark) protocol, the Z-Wave protocol, or the IEEE 802.15.4 protocol, but are not limited to the protocols set forth here. Those skilled in the art will understand that this does not mean that the data communication interface 160 is limited to a particular communication system or protocol.

[0028] Figure 2 FIG. 1 is a diagram of an interior of a vehicle 200 in accordance with at least one embodiment.

[0029] Figure 2 An infotainment system 210 is shown configured in the center of the dashboard 212 of the vehicle. The infotainment system 210 can be an in-vehicle infotainment (IVI) system (also referred to simply as an infotainment system). The infotainment system 210 includes a cockpit domain controller 220 that is used to output content, store end states that are associated with content consumed by an occupant, and manage data for restoring end states that are associated with content.

[0030] The infotainment system 210 also has a central display 230 for presenting content and information related to the presentation of content. Additional displays 232, 234 can be provided separately for each occupant of the back row of seats. Those skilled in the art will understand that other configurations and numbers of displays 230, 232, 234 can also be provided.

[0031] In Figure 2In the illustrated embodiment, four cameras 240, 242, 244, 246 are provided to implement the camera system. The first camera 240 is directed toward the driver. The second camera 242 is directed toward the passenger in the front seat. The third camera 244 and the fourth camera 246 are directed toward the two passengers in the back seat, respectively. However, those skilled in the art will appreciate that the number of cameras implemented by the camera system can be more than four or less than four. For example, a single front camera 240 can be installed to monitor the driver and the passenger in the front seat. Other configurations can also be sought by the embodiments described in this specification.

[0032] Other sensors include occupant sensors 250, 252, 254, 256. The occupant sensors 250, 252, 254, 256 can provide information to the cabin domain controller 220 indicating the presence or absence of an occupant associated with the occupant sensor. Those skilled in the art will appreciate that other types of sensors can be used to determine the presence or absence of an occupant, such as an occupant exiting the vehicle.

[0033] The presence of an occupant exiting the vehicle can be determined by the cabin domain controller 220 based on input from the camera system 240, 242, 244, 246. The cabin domain controller 220 can determine that an occupant has exited the vehicle based on input from the occupant sensors 250, 252, 254, 256. The cabin domain controller 220 can determine that an occupant has exited the vehicle based on the loss of a connection 260, such as a Bluetooth connection, a Wi-Fi connection, or the like made by the occupant's device 262. Other connections can also be used by the cabin domain controller 220 to determine that an occupant has exited the vehicle.

[0034] When the presence of an occupant exiting the vehicle is detected, the cabin domain controller 220 determines a final state of content presented to the existing occupants. The position state of content, such as video, music, or the like, being consumed by the occupant is associated with the time the occupant exits the vehicle. The final state can be determined by the cabin domain controller 220.

[0035] Thereafter, the cabin domain controller 220 detects the presence of an occupant returning to the vehicle based on at least one of the camera system 240, 242, 244, 246, the occupant sensors 250, 252, 254, 256, the reestablishment of the connection 260 by the device 262, or the like. The cabin domain controller 220 then presents content using the final state of content based on the time the occupant exited the vehicle.

[0036] Figure 3 System architecture 300 in accordance with at least one embodiment.

[0037] In Figure 3In this embodiment, the infotainment system 302 includes a cabin domain controller 310 that is used to output content, store end states associated with content consumed by occupants, and manage data used to restore end states associated with content. The entertainment portal can be unique to an occupant or associated with multiple occupants. One or more displays 330 are used to present content, with a user interface 332 used to present each occupant's identification. As noted above, additional displays 370 can be provided, for example, to each occupant of a back seat. Content includes YouTube (registered trademark), web browsing activities, video games, movies, music data, and other content that can be displayed on a screen.

[0038] The cabin domain controller 310 identifies end states of content presented when an occupant exits the vehicle. A data communication interface 340 is coupled to the cabin domain controller 310 and communicates with devices inside or outside the vehicle. For example, the data communication interface 340 can communicate with a smartphone 360, a television 362, a content server 364, a computer device 366 (e.g., a personal computer, a tablet, a laptop, etc.). The data communication interface 340 can use a wireless network. In addition, the cabin domain controller 310 can also communicate with user devices using a wireless network. As examples of wireless networks, Wi-Fi, Internet hotspots, Bluetooth, Zigbee, Z-Wave, infrared (IR) wireless, Ultra-Wideband (UWB), Wireless Gigabit (or WiGig), and the like are cited. The data communication interface 340 supports communication using wireless connections according to any of the IEEE 802.11 Wi-Fi protocols, Bluetooth protocols, Bluetooth Low Energy (BLE), or other short-range protocols that act according to wireless technology standards for exchanging data using licensed bands or unlicensed bands, such as mobile cellular systems according to the Citizens Broadband Radio Service (CBRS) band, 2.4 GHz band, 5 GHz band, 6 GHz band, and the like. Also, the data communication interface 340 supports wireless connections according to the RF4CE protocol, Zigbee protocol, Z-Wave protocol, or IEEE 802.15.4 protocol, but is not limited to the protocols cited here. Those skilled in the art will understand that this does not mean that the data communication interface 340 is limited to a particular communication system or protocol.

[0039] The cabin domain controller 310 acquires the identification information 352 to identify at least one occupant who is viewing and listening to some content. The content is associated with the occupant through the identification information 352. The identification information 352 is based on a reading of information that is associated with a registered user. The user establishes an account through registration to associate data (occupant identification, content identification (ID), and final state) with the occupant.

[0040] The occupant's location can also be detected. The identification information 352 includes information that identifies the occupant, such as a facial image, a device ID, etc. For example, a camera system 320 that includes one or more cameras can be coupled to the cabin domain controller 310 to detect the occupant. The cabin domain controller 310 implements facial recognition based on images from the camera system 320 to identify the occupant in each zone of the vehicle. Image analysis, such as machine learning, can be used to analyze the images of the occupants and determine the identification information 352 for each occupant. Other sensors 320 can also be used. For example, the cabin domain controller 310 receives presence data from other sensors and implements presence analysis 314 for the occupant's devices to detect the presence of the occupant.

[0041] The occupant's departure from the vehicle is detected. The cabin domain controller 310 can determine that the occupant has departed from the vehicle based on input from the camera / sensor system 320, loss of a Bluetooth connection or a Wi-Fi connection, etc. When the occupant is detected to have departed from the vehicle, the final state 354 of the content associated with the identification information 352 is determined.

[0042] The final state 354 includes a position indicator of the content, such as a video, music, etc., that was consumed by the occupant, which is associated with the time that the occupant departed from the vehicle. The final state 354 is represented by a content identifier (content ID) of the content itself, along with a position indicator, such as a timestamp, a scroll position, a state function, etc. The content ID can be a name of a video, a link to the content, a web address, a name of a game, a product code. The cabin domain controller 310 stores information of the final state 354, including the content ID, such as represented by the position indicator. However, according to at least one embodiment, the information can be stored in a data store 350, a cloud, other storage systems, or other storage configurations.

[0043] Afterwards, the cabin domain controller 310 detects that the occupant has returned to the vehicle. The cabin domain controller 310 can identify the occupant who has re-boarded the vehicle using the identification information 352, obtain the content ID and the final state 354 of the content with which the occupant who has re-boarded was associated. When using the final state 354, the content can be resumed from the point at which the occupant left the vehicle or slightly before the final state. The final state 354 includes a timestamp, an approximate final position, a calculated estimate of the final state 354, and the like associated with the content with which the occupant left the vehicle. For example, the final state 354 can be indicated as a position 10 minutes, e.g., from 9:50, in response to the timestamp, from which to resume.

[0044] Information related to the final state 354 of the content can be sent to the occupant. For example, the information is sent to a user device such as a smartphone, a personal or laptop computer, a television, and the like. Information related to the final state 354 of the content can be presented on one or more displays 330. Information related to the final state 354 can be sent to the occupant via a notification 316 sent to the occupant via at least one of a text message, an email, a push notification to an application, a voicemail message, and the like. The occupant can read out the final state 354 of the content via a user interface 332 of the vehicle. In addition, information related to the content and the final state can be presented as an option on one or more displays 330 of the vehicle, e.g., an infotainment system.

[0045] When the occupant re-boards the vehicle, the cabin domain controller 310 accesses the data store 350 to determine existing entries that can be associated with the occupant who has re-boarded. Depending on the circumstances, the cabin domain controller 310 can sometimes not identify an entry with which the occupant is associated. In that case, the cabin domain controller 310 can query the occupant for information such as a content ID and a position via the user interface 332. In other circumstances, the cabin domain controller 310 identifies multiple entries with which the occupant is associated. In that case, the cabin domain controller 310 can also communicate with the occupant via the occupant's device or one or more displays 330 to determine which entry the occupant wants to use.

[0046] The cabin domain controller 310 can also use an initial setting that uses the most recent entry. The cabin domain controller 310 can also delete an old entry in response to a user having left the vehicle and save the current entry so that multiple entries are not used. In response to the user having re-boarded the vehicle, the entry is read from the data store 350 and then deleted. In this way, the occupant who has re-boarded the vehicle can resume consumption of the content from the final position.

[0047] Figure 4is a flowchart 400 of a method of managing content displayed in a vehicle according to at least one embodiment.

[0048] In Figure 4 , the process begins at S402 and determines that at least one occupant in the vehicle is consuming content (S410). Referring to Figure 3 , the cabin domain controller 310 obtains identification information 352 from the data store 350 that identifies at least one occupant that is viewing and / or listening to some content.

[0049] The identification information that identifies the at least one occupant is obtained (S414). Referring to Figure 3 , the content is associated with the occupant via the identification information 352. The identification information 352 is obtained by reading out the identification information 352 that is associated with the registered user. The identification information 352 includes information that identifies the occupant, such as a facial image, a device ID, etc. A camera system 320 that includes one or more cameras can be coupled to the cabin domain controller 310 to detect the occupants. The cabin domain controller 310 performs facial recognition based on images from the camera system 320 to identify the occupants in the various zones of the vehicle. Image analysis 312, such as machine learning, can be used to analyze images of the occupants to determine the identification information 352 for the various occupants. Other sensors 320 can also be used. For example, the cabin domain controller 310 receives presence data from the other sensors and performs presence analysis 314 of the devices of the occupants to detect the presence of the occupants. The identification information 352 also includes an identifier of the device of the at least one occupant. The identification information 352 is based on reading out information that is associated with the registered user. The user establishes an account by registering so that the data (identification of the occupant, identification of the content (ID), and final state) is associated with the occupant.

[0050] It is determined that the at least one occupant has exited the vehicle (S418). Referring to Figure 3 , the cabin domain controller 310 can determine that the at least one occupant has exited the vehicle based on input from the camera / sensor system 320, loss of a Bluetooth connection or a Wi-Fi connection, etc.

[0051] The identification information that identifies the at least one occupant, the content identifier (ID) of the content consumed by the occupant, and the final position of the content at the point in time that the at least one occupant exited the vehicle are saved (S422). Referring to Figure 3, the cabin domain controller 310 stores the identifying information 352 including the ID of the occupant, the content ID of the content consumed by the occupant, and the final state represented by the position indicator, for example. However, according to at least one embodiment, the information can be stored in the cloud, other storage systems, or other storage configurations. When it is detected that the occupant has exited the vehicle, a determination is made of the final state 354 of the content with which the identifying information 352 is associated. The final state 354 includes the position indicator of the content, such as a video, music, or the like, consumed by the occupant, which is associated with the time the occupant exited the vehicle. The final state 354 is represented by the position indicator, such as a timestamp, scroll position, state function, or the like, along with the content identifier (content ID) of the content itself. The content ID can be the name of the video, a link to the content, a web address, the name of a game, a product code.

[0052] A detection is made that the occupant has re-boarded the vehicle (S426). Referring to Figure 3 , the cabin domain controller 310 detects that the occupant has returned to the vehicle. The cabin domain controller 310 identifies the occupant who has re-boarded the vehicle from the identifying information 352.

[0053] The identifying information identifying at least one occupant, the content ID of the content, and the final position of the content with which the identifying information identifying at least one occupant is associated is read out (S430). Referring to Figure 3 , the cabin domain controller 310 identifies the occupant who has re-boarded the vehicle from the identifying information 352, after which the content ID and the final state 354 of the content with which the re-boarded occupant is associated is obtained. When using the final state, the content can be reproduced from the point the occupant exited the vehicle or slightly before the final state 354. The final state 354 includes a timestamp, an approximate final position, a calculated estimate of the final position, or the like, associated with the content at the time the occupant exited the vehicle. For example, the final state 354 can be represented as a position 10 minutes, such as starting at 9:50, in response to a timestamp. The identifying information 352 includes information identifying the occupant, such as a facial image, a device ID, or the like. Information related to the final state 354 of the content can be presented to one or more displays 330. Information related to the final state 354 can be sent to the occupant via a notification 316 sent to the occupant via at least one of a text message, an email, a push notification to an application, a voice mail message, or the like.

[0054] The content identified by the content ID is restarted at the final position for the occupant with which the identifying information is associated (S434). Referring to Figure 3In response to the user having re-boarded the vehicle, the entry is read from the data store 350 and then deleted. In this way, the occupant who has re-boarded the vehicle is able to resume consumption of the content from the final position.

[0055] Thereafter, the process ends (S440).

[0056] In at least one embodiment of the method, the following steps are included: determining that at least one occupant in the vehicle is consuming content; acquiring identification information that identifies the at least one occupant; detecting that the at least one occupant has exited the vehicle; saving the identification information that identifies the at least one occupant, a content identifier (ID) of the content being consumed by the occupant, and a final position of the content at a point in time at which the at least one occupant exited the vehicle; detecting that the occupant has re-boarded the vehicle; reading out the identification information that identifies the at least one occupant, the content ID of the content, and the final position of the content that is associated with the identification information that identifies the at least one occupant; and resuming the content identified by the content ID at the final position of the occupant associated with the identification information.

[0057] Figure 5 is a high-level functional block diagram of a processor-based system 500 according to at least one embodiment.

[0058] In at least one embodiment, the processing circuit 500 manages content displayed in a vehicle. The processing circuit 500 implements a method of managing content displayed in a vehicle using the processor 502. The processing circuit 500 also includes a non-transitory computer- readable storage medium 504 for implementing the method of managing content displayed in a vehicle. In the non-transitory computer-readable storage medium 504, in particular, instructions 506, i.e., computer program code, executed by the processor 502 are encoded, i.e., stored. The instructions 506 cause the processor 502 to perform actions for managing content displayed in a vehicle. The execution of the instructions 506 by the processor 502 represents, at least in part, an application program implementing at least a portion of the method (hereinafter, the recited process and / or method) recited in this specification in accordance with one or more embodiments.

[0059] The processor 502 is electrically coupled to the non-transitory computer- readable storage medium 504 via a bus 508. The processor 502 is electrically coupled to an input output (I / O) interface 510 by the bus 508. A network interface 512 is also electrically coupled to the processor 502 via the bus 508. The network interface 512 is connected to a network 514 to enable the processor 502 and the non-transitory computer-readable storage medium 504 to be connected to external elements via the network 514.

[0060] The processor 502 is configured to execute instructions 506 encoded in the non-transitory computer readable storage medium 504 to enable the processing circuit 500 to perform at least a portion of a process and / or method. In one or more embodiments, the processor 502 is a central processing unit (CPU), a multi-core processor, a distributed processing system, an application specific integrated circuit (ASIC), and / or a suitable processing unit.

[0061] The processing circuit 500 includes an I / O interface 510. The I / O interface 510 is coupled to external circuits. In one or more embodiments, the I / O interface 510 includes a keyboard, a keypad, a mouse, a trackball, a touchpad, a touchscreen, and / or cursor direction keys for communicating information and commands to the processor 502.

[0062] The processing circuit 500 also includes a network interface 512 coupled to the processor 502. The processing circuit 500 can communicate with a network 514 having one or more other computer systems connected thereto via the network interface 512. The network interface 512 includes a wireless network interface such as Bluetooth, Wi-Fi, WiMAX (Worldwide Interoperability for Microwave Access), GPRS (General Packet Radio Service), or WCDMA (registered trademark) (Wideband Code Division Multiple Access), or a wired network interface such as Ethernet, Universal Serial Bus (USB), or Institute of Electrical and Electronics Engineers (IEEE).

[0063] The processing circuit 500 is configured to receive information via the I / O interface 510. The information received via the I / O interface 510 includes one or more of instructions for processing by the processor 502, data, design rules, a cell library, and / or other parameters. The information is transferred to the processor 502 via the bus 508. The processing circuit 500 is configured to receive information associated with a user interface (UI) via the I / O interface 510. The information is stored as the UI 520 in the non-transitory computer readable storage medium 504.

[0064] In one or more embodiments, the instructions 506 (in compressed or non-compressed form) are stored in the one or more non-transitory computer-readable storage media 504. The instructions 506 can be for programming a computer, processor or other electronic device to implement the processes or methods described in this specification. The one or more non-transitory computer-readable storage media 504 include one or more of electronic storage media, magnetic storage media, optical storage media, quantum storage media, and the like. Further, a computer program product, which includes the computer program for making the processor execute the processes or methods described in this specification, can be distributed over a network or by a computer program product in a storage medium.

[0065] For example, the non-transitory computer-readable storage media 504 includes a hard disk, a floppy disk, a compact disc read only memory (CD-ROM), a random access memory (RAM), a programmable read only memory (PROM), an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), a flash memory, a magnetic or optical card, a solid state memory device, and the like. In one or more embodiments using an optical disc, the one or more non-transitory computer-readable storage media 504 include a compact disc read only memory (CD-ROM), a compact disc - read / write (CD-R / W), and / or a digital video disc (DVD), although the one or more non-transitory computer-readable storage media 504 are not limited to optical discs.

[0066] In one or more embodiments, the non-transitory computer-readable storage media 504 stores instructions 506 configured to cause the processor 502 to implement at least part of a process and / or method for managing content displayed within a vehicle. In one or more embodiments, the non-transitory computer-readable storage media 504 also stores information such as an algorithm or the like that is useful in implementing at least part of a process and / or method for managing content displayed within a vehicle.

[0067] Accordingly, in at least one embodiment, the processor 502 executes instructions 506 stored in the one or more non-transitory computer-readable storage media 504 to implement a method for managing content displayed within a vehicle. The processor 502 implements an infotainment system including a cabin domain controller 530 that outputs content, saves an end state associated with content consumed by an occupant, and manages data for restoring the end state associated with the content. The processor 502 is configured to use the cabin domain controller 530 to recognize an end state of content presented when an occupant exits the vehicle.

[0068] The processor 502 is coupled to the cabin domain controller 530 to implement a data communication interface 540 that communicates with devices inside or outside the vehicle. For example, the data communication interface 540 can use a wireless network. The processor uses the cabin domain controller 530 to obtain recognition information 560 that recognizes at least one occupant who is viewing audiovisual content. The content is associated with the occupant by the recognition information 560. The recognition information 560 includes information that identifies the occupant, such as a facial image, a device ID, etc.

[0069] A camera system 550 including one or more cameras can be coupled to the cabin domain controller 530 to detect occupants. The processor 502 uses image analysis 532 of the cabin domain controller 530 to implement facial recognition that recognizes occupants of areas of the vehicle based on images from the camera system 550. The recognition information 560 for each occupant can be determined using image analysis 532, such as machine learning, to analyze images of occupants. The processor 502 also uses other sensors 552. For example, the processor 502 uses presence analysis 534 of the cabin domain controller 530 to process presence data from the other sensors 552 to detect the presence of an occupant.

[0070] The processor 502 can detect that an occupant has exited the vehicle based on a connection through the data communication interface 540, such as a loss of a Bluetooth connection or a Wi-Fi connection. When it is detected that an occupant has exited the vehicle, the processor 502 determines an end state 570 of content associated with the recognition information 560. The end state 570 includes a position indicator 572 of content, such as a video, music, etc., that was consumed by the occupant, which is associated with a time that the occupant exited the vehicle. The end state 570 is represented by the position indicator 572, such as a time stamp, a scroll position, a state function, etc., along with a content identifier (content ID 574) of the content itself. The processor 502 determines the name of a video, a link to content, a web address, the name of a game, a product code, etc., using the content ID 574.

[0071] The processor 502 causes the cabin domain controller 530 to store information including the content ID 574 and the final state 570 represented by the location indicator 572, for example. However, according to at least one embodiment, the information can be stored in the data store 516 or a cloud, other storage system, or other storage configuration.

[0072] Thereafter, the processor 502 uses the cabin domain controller 530 to detect that the occupant has returned to the vehicle. The cabin domain controller 530 identifies the occupant who has re-boarded the vehicle according to the identification information 560, and thereafter obtains the content ID 574 and the final state 570 of the content with which the occupant who has re-boarded has established an association. The processor 502 can use the final state 570 to cause the cabin domain controller 530 to resume the content from the point in time at which the occupant exited the vehicle or from a time slightly before the final state 570. The final state 570 includes a location indicator 572 that can be a timestamp of the content with which the occupant exited the vehicle, an approximate final location, a calculated estimate of the final state 570, or the like. For example, in response to the location indicator 572 indicating that the final state 570 is a location 10 minutes, the processor 502 can cause the cabin domain controller 530 to resume from 9 minutes and 50 seconds, for example. Information related to the final state 570 of the content can be sent to the occupant. For example, the information is sent to a user device such as a smartphone, personal computer or laptop, television, or the like via the data communication interface 540.

[0073] The processor 502 can present the content using one or more displays 580, present the identification of each occupant using a user interface 582 that contains identification information 584. Information related to the final state 570 of the content can be presented to the one or more displays 580. Information related to the final state 570 can be sent to the occupant via a notification 536 that is sent to the occupant via at least one of a text message, an email, a push notification to an application, a voicemail message, or the like. The user interface 582 presents a notification 592 to the one or more displays 580. The occupant can use the user interface 582 to read out the final state 586 of the content within the vehicle.

[0074] As an option, the processor 502 can present information related to the content and the final state 586 including a location indicator 588 to the one or more displays 580 within the vehicle, such as an infotainment system. When the occupant re-boards the vehicle, the processor 502 causes the cabin domain controller 530 to access the data store 516 to determine whether an existing entry can have established an association with the occupant who has re-boarded.

[0075] Depending on the circumstances, the cabin domain controller 530 sometimes does not recognize any entry that is associated with the occupant. In this case, the cabin domain controller 530 can ask the occupant for the content ID 590 and location information, etc. via the user interface 582. In other circumstances, the processor 502 causes the cabin domain controller 530 to recognize a plurality of entries that are associated with the occupant. In this case, the cabin domain controller 530 can also communicate with the occupant via the occupant's device or the display(s) 580 to determine which entry the occupant wants to use.

[0076] The processor 502 can also cause the cabin domain controller 530 to use an initial setting that uses the latest entry. The cabin domain controller 530 can also delete the old entry in response to the occupant having exited the vehicle and save the current entry so that the plurality of entries are not used. In response to the user having reboarded the vehicle, the entry is read from the data storage 516 and then deleted. In this way, the occupant who has reboarded the vehicle can start over with the consumption of the content from the final position.

[0077] The embodiments described in this specification provide a method that provides one or more advantages. For example, a cabin domain controller can recognize a time at which an occupant who is consuming content exits a vehicle and associate a point (final state) within the content with the time at which the occupant exited the vehicle. When it is detected that the occupant has reboarded the vehicle, the cabin domain controller can start over with the content from the point (final state) within the content that is associated with the time at which the occupant exited the vehicle.

[0078] Individual instances of these programs can execute on a single computer system or be spread across multiple, independent computer systems. Thus, although illustrated as a single process for ease of discussion, the steps need not be performed by a single device, software program, process, or entity. One of skill in the art will appreciate that various alternative implementations can be employed.

[0079] Moreover, those skilled in the art will appreciate that the technology described above can be practiced with various computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like. Any device, or devices, can be used that includes an instruction set reader to read instructions from any kind of computer-readable medium. The instructions can be executed by one or more processors of the computer system, including a digital signal processor, a parallel-processor implementing multithreading, or old-fashioned sequencing techniques, i.e., a single processor. The term "computer-readable medium" includes, but is not limited to, portable or fixed storage devices, optical storage devices, and various other mediums capable of storing instructions and data. The computer-readable medium can have stored therein computer software including instructions that can be executed by one or more processors to implement the techniques described herein.

Claims

1. A method of managing content displayed in a vehicle, comprising the steps of: determining that at least one occupant in the vehicle is consuming content; acquiring identification information identifying the at least one occupant; detecting that the at least one occupant has exited the vehicle; storing the identification information identifying the at least one occupant, a content identifier ID of the content consumed by the at least one occupant, and a final position of the content at a point in time when the at least one occupant exited the vehicle; detecting that the at least one occupant has reboarded the vehicle; reading out the identification information identifying the at least one occupant, a content ID of the content, and a final position of the content associated with the identification information identifying the at least one occupant; and resuming the content identified by the content ID at the final position of the content associated with the identification information of the at least one occupant.

2. The method according to claim 1, wherein the step of acquiring the identification information identifying the at least one occupant includes performing image analysis of a facial image captured by a camera to identify the at least one occupant.

3. The method according to claim 1, wherein the step of acquiring the identification information identifying the at least one occupant includes acquiring a device identifier of a device of the at least one occupant.

4. The method according to any one of claims 1 to 3, wherein the step of reading out the final position of the content associated with the identification information identifying the at least one occupant includes reading out a final state associated with a position indicator of the final position of the content.

5. The method according to any one of claims 1 to 4, wherein the step of reading out the identification information identifying the at least one occupant, a content ID of the content, and a final position of the content associated with the identification information identifying the at least one occupant includes sending a notification to the at least one occupant.

6. The method according to claim 5, wherein sending the notification includes sending at least one of a text message, an email, a push notification to an application, or a voice mail message to the at least one occupant.

7. The method according to claim 1, wherein the step of acquiring the identification information identifying the at least one occupant includes reading out the identification information associated with an enrolled user.

8. An apparatus for managing content displayed in a vehicle, comprising: a memory storing computer readable instructions; and a processor connected to the memory, the processor configured to execute the computer readable instructions to perform actions for the steps of: determining that at least one occupant in the vehicle is consuming content; acquiring identification information identifying the at least one occupant; detecting that the at least one occupant has exited the vehicle; ​ saving the identification information identifying the at least one occupant, a content identifier ID of the content consumed by the at least one occupant, and a final position of the content at a point in time at which the at least one occupant exited the vehicle; detecting that the at least one occupant has reboarded the vehicle; reading out the identification information identifying the at least one occupant, the content ID of the content, and the final position of the content associated with the identification information identifying the at least one occupant; and resuming the content identified by the content ID at the final position of the content associated with the identification information of the at least one occupant.

9. The apparatus according to claim 8, wherein the processor is further configured to acquire the identification information identifying the at least one occupant by performing image analysis on a facial image captured by a camera, thereby identifying the at least one occupant.

10. The apparatus according to claim 8, wherein the processor is further configured to acquire the identification information identifying the at least one occupant by acquiring a device identifier of a device of the at least one occupant.

11. The apparatus according to any one of claims 8 to 10, wherein the processor is further configured to read out the final position of the content associated with the identification information identifying the at least one occupant by reading out a final state associated with a position indicator of the final position of the content.

12. The apparatus according to any one of claims 8 to 11, wherein the processor is further configured to send a notification related to the identification information identifying the at least one occupant, the content ID of the content, and the final position of the content associated with the identification information to the at least one occupant.

13. The apparatus according to claim 12, wherein the notification includes at least one of a text message, an email, a push notification to an application, or a voice mail message to the at least one occupant.

14. The apparatus according to claim 8, wherein the processor is further configured to acquire the identification information identifying the at least one occupant by reading out the identification information associated with a registered user.

15. A computer program product comprising a computer program which causes a processor to perform actions comprising: determining that at least one occupant in a vehicle is consuming content; acquiring identification information identifying the at least one occupant; detecting that the at least one occupant has exited the vehicle; saving the identification information identifying the at least one occupant, a content identifier ID of the content consumed by the at least one occupant, and a final position of the content at a point in time at which the at least one occupant exited the vehicle; detecting that the at least one occupant has reboarded the vehicle; Read out the identification information that identifies the at least one passenger, the content ID of the content, and the final location of the content that is associated with the identification information that identifies the at least one passenger; as well as The content identified by the content ID is restarted at the final position of the content for the at least one passenger associated with the identification information.

16. The computer program product according to claim 15, wherein, The step of obtaining the identification information for identifying the at least one passenger includes: performing image analysis on facial images captured by a camera to identify the at least one passenger.

17. The computer program product according to claim 15, wherein, The step of obtaining the identification information for identifying the at least one passenger includes: obtaining the device identifier of the device of the at least one passenger.

18. The computer program product according to any one of claims 15 to 17, wherein, The step of reading out the final location of the content associated with the identification information of the at least one passenger includes: reading out the final state associated with the location indicator of the final location of the content.

19. The computer program product according to any one of claims 15 to 18, wherein, The step of reading the identification information identifying the at least one passenger, the content ID of the content, and the final location of the content associated with the identification information identifying the at least one passenger includes: sending a notification to the at least one passenger. Sending the notification includes at least one of the following: sending a text message, an email, a push notification to the application, or a voicemail message to the at least one passenger.

20. The computer program product according to claim 15, wherein, The step of obtaining the identification information for identifying the at least one passenger includes: reading out the identification information associated with a registered user.

Images