Management of content displayed in vehicle

Abstract

To enhance usability about viewing of content in a vehicle.SOLUTION: It is determined that at least one occupant in a vehicle consumes content. Identification information identifying the at least one occupant is acquired. It is detected that the at least one occupant exists the vehicle. The identification information identifying the at least one occupant, a content identifier of the content consumed by the at least one occupant, and a last position of the content at a time point when the at least one occupant exits the vehicle are stored. Re-getting on the vehicle of the at least one occupant is detected. The identification information for identifying the at least one occupant, the content ID, and the last position of the content associated with the identification information for identifying the at least one occupant are read. The content identified by the content ID is resumed at the last position of the content about the at least one occupant associated with the identification identifier.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] This description relates to managing content displayed in a vehicle. [Background technology]

[0002] The presentation of audio and / or video content in vehicles has become commonplace in many travel experiences. For example, vehicle drivers often listen to audio content (e.g., music and / or spoken text) while driving, and passengers often watch videos in the vehicle until they reach their destination. Additional content includes web browsing, streaming content, etc. Mobile devices or other media playback devices, such as in-vehicle infotainment (IVI) systems (also simply referred to as infotainment systems), can be used to access the content.

[0003] However, users often leave their vehicles for various reasons, such as refueling, eating, shopping, etc. Content continues to be presented even when the user leaves the vehicle. There is no way for a user in a vehicle to resume viewing the content from the point at which the user left and returned to the vehicle in response to leaving the vehicle in the middle of viewing the content. Summary of the Invention

[0004] In at least one embodiment, a method for managing content displayed in a vehicle includes determining that at least one occupant in the vehicle is consuming content; obtaining identification information identifying the at least one occupant; detecting that the at least one occupant has exited the vehicle; storing the identification information identifying the at least one occupant, a content identifier (ID) for the content consumed by the at least one occupant, and a final location of the content at the time the at least one occupant exited the vehicle; detecting that the at least one occupant has re-entered the vehicle; retrieving the identification information identifying the at least one occupant, a content ID for the content, and a final location of the content associated with the identification information identifying the at least one occupant; and resuming the content identified by the content ID at the final location of the content for the at least one occupant associated with the identification information.

[0005] In at least one embodiment, an apparatus for managing content displayed in a vehicle includes a memory storing computer-readable instructions and a processor coupled to the memory, the processor configured to execute the computer-readable instructions to perform operations to determine that at least one occupant in the vehicle is consuming content, obtain identification information identifying the at least one occupant, detect that the at least one occupant has exited the vehicle, store the identification information identifying the at least one occupant, a content identifier (ID) for the content consumed by the at least one occupant, and a last location of the content at the time the at least one occupant exited the vehicle, detect that the at least one occupant has re-entered the vehicle, retrieve the identification information identifying the at least one occupant, a content ID for the content, and a last location of the content associated with the identification information identifying the at least one occupant, and resume the content identified by the content ID at the last location of the content for the at least one occupant associated with the identification information.

[0006] In at least one embodiment, a non-transitory computer-readable medium stores computer-readable instructions that, when executed by a processor, cause the processor to perform operations including determining that at least one occupant in a vehicle is consuming content, obtaining identification information identifying the at least one occupant, detecting that the at least one occupant has exited the vehicle, storing the identification information identifying the at least one occupant, a content identifier (ID) for the content consumed by the at least one occupant, and a last location of the content at the time the at least one occupant exited the vehicle, detecting that the at least one occupant has re-entered the vehicle, retrieving the identification information identifying the at least one occupant, a content ID for the content, and a last location of the content associated with the identification information identifying the at least one occupant, and resuming the content identified by the content ID at the last location of the content for the at least one occupant associated with the identification information. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 illustrates a vehicle cockpit according to at least one embodiment. [Figure 2] FIG. 2 is an illustration of the interior of a vehicle according to at least one embodiment. [Figure 3] FIG. 3 is a system architecture according to at least one embodiment. [Figure 4] FIG. 4 is a flowchart of a method for managing content displayed in a vehicle according to at least one embodiment. [Figure 5] FIG. 5 is a high-level functional block diagram of a processor-based system according to at least one embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Features, aspects, and advantages of certain exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which like reference numerals indicate like elements, and in which:

[0009] The following detailed description of exemplary embodiments refers to the accompanying drawings. The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit implementations to the precise form disclosed. Modifications and variations are possible in light of the above disclosure or may be acquired from practice of implementations. Moreover, one or more features or components of one embodiment may be incorporated into or combined with another embodiment (or one or more features of another embodiment). Furthermore, in the flowcharts and operational descriptions set forth below, it is understood that one or more operations may be omitted, one or more operations may be added, one or more operations may be performed concurrently (at least in part), and the order of one or more operations may be rearranged unless such modifications affect the scope of the invention.

[0010] It will be apparent that the systems and / or methods described herein can be implemented in various forms of hardware, software, or a combination of hardware and software. The actual specific control hardware or software code used to implement such systems and / or methods is not intended to limit the implementation. Thus, the operation and behavior of the systems and / or methods are described herein without reference to specific software code. It will be understood that software and hardware can be designed to implement the systems and / or methods based on the description herein.

[0011] Although particular combinations of features may be recited in the claims and / or disclosed in the specification, such combinations are not intended to limit the disclosure of possible implementations. Indeed, many of such features can be combined in ways not specifically recited in the claims and / or disclosed in the specification. Although each dependent claim listed below may depend directly on only one claim, the disclosure of possible implementations includes each dependent claim in combination with all other claims in the claim set.

[0012] No element, act, or instruction used herein should be construed as critical or essential unless explicitly stated as such. Additionally, as used herein, the articles "a" and "an" are intended to include one or more items and may be used interchangeably with "one or more." Where only one item is intended, the term "one" or similar terminology is used. Additionally, as used herein, terms such as "have," "having," "include," and "including" are intended to be open-ended terms. Furthermore, the phrase "based on" is intended to mean "based at least in part on," unless expressly stated otherwise. Furthermore, phrases such as "at least one of A and B," "A and / or B," or "at least one of A or B" should be understood to include A only, B only, or both A and B.

[0013] Additionally, spatially relative terms such as "below," "lower," "bottom," "above," and "top" are used herein for ease of description to describe the relationship of one element or feature to another, as shown in the figures. Spatially relative terms are intended to encompass various orientations of the device during use or operation in addition to the orientation shown in the figures. If the device is otherwise oriented (rotated 90 degrees or at another orientation), the spatially relative descriptors used herein will be interpreted accordingly.

[0014] The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit the implementations to the precise form disclosed. Modifications and variations are possible in light of the above disclosure or may be acquired from practice of the implementations.

[0015] In at least one embodiment, the method includes determining that at least one occupant in a vehicle is consuming content; obtaining identification information identifying the at least one occupant; detecting that the at least one occupant has exited the vehicle; storing the identification information identifying the at least one occupant, a content identifier (ID) for the content consumed by the occupant, and a final location of the content at the time the at least one occupant exited the vehicle; detecting that the occupant has re-entered the vehicle; retrieving the identification information identifying the at least one occupant, a content ID for the content, and a final location of the content associated with the identification information identifying the at least one occupant; and resuming the content identified by the content ID at the final location for the occupant associated with the identification information.

[0016]

[0006] Embodiments described herein provide a method that provides one or more advantages. For example, a cockpit domain controller can identify a time when a passenger consuming content exits a vehicle and associate a point in the content (final state) with the time when the passenger exits the vehicle. Upon detecting that the passenger has re-entered the vehicle, the cockpit domain controller can resume the content from the point in the content (final state) associated with the time when the passenger exited the vehicle.

[0017] FIG. 1 illustrates a vehicle cockpit 100 according to at least one embodiment.

[0018] In FIG. 1 , the vehicle cockpit includes a steering wheel 110, an accelerator pedal 112, a brake pedal 114, an instrument panel 120, an infotainment system 130, and an air conditioning system 140. The air conditioning system 140 is sometimes referred to as a heating, ventilation, and air conditioning (HVAC) system. The steering wheel is part of the steering system operated by the driver to control the steering system and the direction of the vehicle. By operating the steering wheel 110, the driver directs the direction of the vehicle via a linkage system to the front wheels. The accelerator pedal 112 is used to control the supply of fuel and air to the engine through the application of pressure. The accelerator pedal 112 is also known as a throttle or gas pedal. The brake pedal 114 is pressed to apply brakes to slow and / or stop the vehicle.

[0019] The instrument panel 120 is part of the dashboard located behind the steering wheel 110. The instrument panel 120 includes various gauges and lights that inform the driver of the vehicle's status. For example, the instrument panel 120 often includes a traction control indicator, engine temperature, a tachometer, a fuel gauge, a speedometer, an odometer, turn signals, a gear indicator, various warning lights, etc. The tachometer displays the rotations of the engine's crankshaft in revolutions per minute (RPM). The speedometer indicates the vehicle's speed. The odometer displays the total miles traveled since the car was first driven. The fuel gauge displays the amount of fuel remaining in the vehicle. The temperature gauge displays the current engine temperature.

[0020] Alternatively, designated lights may be provided to warn of engine temperature issues, such as an overheating engine. Turn signals represent flashing lights on either side of the vehicle, informing other drivers of the direction the driver intends to turn. A gear display or gear position indicator indicates the gear currently being used, e.g., Park, Neutral, Drive, etc. Warning lights communicate various vehicle status items. Vehicles come pre-installed with various features, such as ESC and ABS, not to mention more standard components or elements. Warning lights illuminate briefly at start-up as the vehicle verifies that the system is safe and ready for operation. In some cases, a single warning light may remain illuminated, indicating a problem with the engine, headlights, temperature, etc.

[0021] The vehicle includes an infotainment system 130. In at least one embodiment, the infotainment system 130 is an in-vehicle infotainment (IVI) system (also referred to simply as an infotainment system). However, the embodiments described herein are not limited to IVI systems. The infotainment system 130 includes one or more displays 132 for presenting content to vehicle occupants. For example, one or more displays 132 are positioned to present content to each seat within the vehicle.

[0022] A cockpit domain controller 140 provides a collection of hardware and software within the vehicle that provides content, such as audio, video, and other content or information, to vehicle occupants. The cockpit domain controller 140 controls the presentation of content and stores the state of each occupant. The vehicle may also include a camera system 150. The camera system 150 is configured to provide facial recognition of occupants, such as the driver and other passengers. The cockpit domain controller 140 can use the camera system 150 or other sensors (e.g., communication sensors, occupant sensors, vibration sensors, motion sensors, etc.) to detect the presence of occupants and to detect occupants exiting the vehicle.

[0023] The data communication interface 160 communicates with devices outside the vehicle to provide content to a user within the vehicle. Such devices include smartphones, tablets, televisions, laptop computers, servers, and the like. The data communication interface 160 supports communication using a wireless connection according to any IEEE 802.11 Wi-Fi protocol, Bluetooth® protocol, Bluetooth Low Energy (BLE), or other short-range protocol operating according to a wireless technology standard for exchanging data using licensed or unlicensed spectrum, such as mobile cellular systems using the Citizens Broadband Radio Service (CBRS) band, the 2.4 GHz band, the 5 GHz band, the 6 GHz band, and the like. Furthermore, the wireless connection can operate according to, but is not limited to, the RF4CE protocol, the ZigBee® protocol, the Z-Wave protocol, or the IEEE 802.15.4 protocol. Those skilled in the art will appreciate that the data communication interface 160 is not intended to be limited to any particular communication system or protocol.

[0024] FIG. 2 is an illustration of the interior of a vehicle 200 according to at least one embodiment.

[0025] 2 shows an infotainment system 210 centrally located on a vehicle dashboard 212. The infotainment system 210 may be an in-vehicle infotainment (IVI) system (also simply referred to as an infotainment system). The infotainment system 210 includes a cockpit domain controller 220 for outputting content, storing final states associated with content consumed by an occupant, and managing data for restoring final states associated with content.

[0026] The infotainment system 210 also includes a central display 230 for presenting content and information about the presentation of that content. Additional displays 232, 234 may be provided separately for each rear seat passenger. Those skilled in the art will appreciate that other arrangements and numbers of displays 230, 232, 234 may also be provided.

[0027] In the embodiment shown in FIG. 2, four cameras 240, 242, 244, and 246 are provided to implement the camera system. The first camera 240 is aimed at the driver. The second camera 242 is aimed at the front seat passenger. The third camera 244 and the fourth camera 246 are aimed at each of the two rear seat passengers. However, one skilled in the art will appreciate that the number of cameras implemented by the camera system may be more or less than four. For example, a single front camera 240 may be implemented to monitor the driver and front seat passengers. Other arrangements are contemplated by the embodiments described herein.

[0028] Other sensors include occupant sensors 250, 252, 254, and 256. The occupant sensors 250, 252, 254, and 256 can provide information indicating the presence or absence of an occupant associated with the occupant sensor to the cockpit domain controller 220. Those skilled in the art will appreciate that other types of sensors can be used to determine the presence or absence of an occupant, such as an occupant exiting a vehicle.

[0029] The cockpit domain controller 220 can determine that an occupant has exited the vehicle based on input from the camera systems 240, 242, 244, and 246. The cockpit domain controller 220 can determine that an occupant has exited the vehicle based on input from the occupant sensors 250, 252, 254, and 256. The cockpit domain controller 220 can determine that an occupant has exited the vehicle based on a loss of a connection 260, such as a Bluetooth connection, a Wi-Fi connection, or the like, by the occupant's device 262. Other connections can also be used by the cockpit domain controller 220 to determine that an occupant has exited the vehicle.

[0030] When the cockpit domain controller 220 detects that an occupant has exited the vehicle, it determines the final state of the content being presented to the existing occupant. The location state of the content being consumed by the occupant, e.g., video, music, etc., is associated with the time the occupant exited the vehicle. The final state can be determined by the cockpit domain controller 220.

[0031] The cockpit domain controller 220 then detects that the occupant has returned to the vehicle based on at least one of the camera systems 240, 242, 244, 246, the occupant sensors 250, 252, 254, 256, the re-establishment of the connection 260 by the device 262, etc. The cockpit domain controller 220 then presents the content using the final state of the content based on the time the occupant exited the vehicle.

[0032] FIG. 3 is a system architecture 300 according to at least one embodiment.

[0033] In FIG. 3 , infotainment system 302 includes a cockpit domain controller 310 for outputting content, storing final states associated with content consumed by occupants, and managing data for restoring final states associated with content. An entertainment portal may be specific to one occupant or associated with multiple occupants. One or more displays 330 are used to present content and present each occupant's identity using a user interface 332. As discussed above, additional displays 370 can be provided, for example, for each rear seat occupant. Content includes screen-displayable content such as YouTube®, web browsing activity, video games, movies, music data, etc.

[0034] The cockpit domain controller 310 identifies the final state of the content being presented when the occupant exits the vehicle. A data communication interface 340 is coupled to the cockpit domain controller 310 to communicate with devices inside or outside the vehicle. For example, the data communication interface 340 can communicate with a smartphone 360, a television 362, a content server 364, and a computing device 366 (e.g., a personal computer, a tablet, a laptop, etc.). The data communication interface 340 can use a wireless network. The cockpit domain controller 310 can also communicate with user devices using a wireless network. Examples of wireless networks include Wi-Fi, Internet hotspots, Bluetooth, Zigbee, Z-Wave, infrared (IR) radio, ultra-wideband (UWB), wireless gigabit (or WiGig), etc. The data communications interface 340 supports communications using a wireless connection according to any IEEE 802.11 Wi-Fi protocol, Bluetooth protocol, Bluetooth Low Energy (BLE), or other short-range protocol operating in accordance with a wireless technology standard for exchanging data using licensed or unlicensed spectrum, such as a mobile cellular system using the Citizens Broadband Radio Service (CBRS) band, the 2.4 GHz band, the 5 GHz band, the 6 GHz band, etc. Additionally, the data communications interface 340 supports wireless connections according to, but not limited to, the RF4CE protocol, the ZigBee protocol, the Z-Wave protocol, or the IEEE 802.15.4 protocol. Those skilled in the art will appreciate that the data communications interface 340 is not meant to be limited to any particular communications system or protocol.

[0035] The cockpit domain controller 310 obtains identification information 352 to identify at least one crew member who is viewing some content. The content is associated with the crew member through the identification information 352. The identification information 352 is based on retrieving information associated with a registered user. A user can establish an account through registration so that data (crew member identification, content identification (ID), and final state) is associated with the crew member.

[0036] The location of the occupants can also be detected. The identification information 352 includes information identifying the occupants, such as facial images, device IDs, etc. For example, a camera system 320 including one or more cameras can be coupled to the cockpit domain controller 310 to detect occupants. The cockpit domain controller 310 performs facial recognition based on images from the camera system 320 to identify occupants in each area of ​​the vehicle. Image analysis, e.g., machine learning, can be used to analyze the images of the occupants to determine the identification information 352 of each occupant. Other sensors 320 can also be used. For example, the cockpit domain controller 310 receives presence data from other sensors and performs presence analysis 314 on the occupant's devices to detect the presence of the occupant.

[0037] An occupant is detected exiting the vehicle, which may be determined by the cockpit domain controller 310 based on input from the camera / sensor system 320, loss of Bluetooth or Wi-Fi connectivity, etc. Upon detecting that the occupant has exited the vehicle, a final state 354 of the content associated with the identification 352 is determined.

[0038] The final state 354 includes a location indicator of the content being consumed by the occupant, e.g., video, music, etc., associated with the time the occupant exited the vehicle. The final state 354 is indicated by a content identifier (content ID) for the content itself, along with a location indicator, e.g., a timestamp, scroll position, state function, etc. The content ID can be the name of the video, a link to the content, a web address, the name of a game, or a product code. The cockpit domain controller 310 stores information including the content ID, e.g., the final state 354 as indicated by the location indicator. However, according to at least one embodiment, the information can be stored in the data storage 350, the cloud, another storage system, or other storage configuration.

[0039] The cockpit domain controller 310 then detects that the occupant has returned to the vehicle. The cockpit domain controller 310 identifies the occupant who has re-entered the vehicle according to the identification information 352, and obtains a content ID associated with the re-entered occupant and a final state 354 of the content. The final state 354 can be used to play the content from the point at which the occupant exited the vehicle or from a short time before the final state. The final state 354 includes a timestamp associated with the content when the occupant exited the vehicle, an approximate final location, a calculated estimate of the final state 354, and the like. For example, if the timestamp indicates that the final state 354 is at the 10-minute position, playback can begin at, for example, 9 minutes 50 seconds.

[0040] Information regarding the final state 354 of the content can be sent to the occupant. For example, the information can be sent to a user device such as a smartphone, a personal computer or laptop, a television, etc. Information regarding the final state 354 of the content can be presented on one or more displays 330. Information regarding the final state 354 can be sent to the occupant via a notification 316 sent to the occupant via at least one of a text message, an email, a push notification to an application, a voicemail message, etc. The occupant can retrieve the final state 354 of the content via a user interface 332 of the vehicle. Additionally, information regarding the content and the final state can optionally be presented on one or more displays 330 of the vehicle, for example, an infotainment system.

[0041] When an occupant re-enters the vehicle, the cockpit domain controller 310 accesses the data storage 350 to determine existing entries that may be associated with the re-entering occupant. In some situations, the cockpit domain controller 310 may not identify an entry associated with the occupant. In this situation, the cockpit domain controller 310 can query the occupant for information such as content ID and location via the user interface 332. In other situations, the cockpit domain controller 310 identifies multiple entries associated with the occupant. Again, the cockpit domain controller 310 can communicate with the occupant via the occupant's device or one or more displays 330 to determine which entry the occupant wants to use.

[0042] The cockpit domain controller 310 can also use a default setting that uses the most recent entry. The cockpit domain controller 310 can also delete older entries and save current entries in response to the user exiting the vehicle, so that multiple entries are not used. In response to the user re-entering the vehicle, entries are read from the data storage 350 and then deleted. In this way, a passenger re-entering the vehicle can resume consuming content from their last location.

[0043] FIG. 4 is a flowchart 400 of a method for managing content displayed in a vehicle according to at least one embodiment.

[0044] In Figure 4, the process begins at S402, where it is determined that at least one occupant in the vehicle is consuming content (S410). Referring to Figure 3, the cockpit domain controller 310 retrieves identification information 352 from data storage 350 to identify at least one occupant who is viewing some content.

[0045] Identification information identifying at least one occupant is obtained (S414). Referring to FIG. 3, content is associated with the occupant via identification information 352. The identification information 352 is obtained by retrieving identification information 352 associated with a registered user. The identification information 352 includes information identifying the occupant, such as a facial image, a device ID, etc. For example, a camera system 320 including one or more cameras can be coupled to the cockpit domain controller 310 to detect occupants. The cockpit domain controller 310 performs facial recognition to identify occupants in each area of ​​the vehicle based on images from the camera system 320. Image analysis 312, e.g., machine learning, can be used to analyze occupant images and determine identification information 352 for each occupant. Other sensors 320 can also be used. For example, the cockpit domain controller 310 receives presence data from other sensors and performs presence analysis 314 of occupant devices to detect the presence of occupants. The identification information 352 also includes an identifier for at least one occupant device. The identification information 352 is based on retrieving information associated with a registered user. A user can establish an account through registration so that data (occupant identification, content identification (ID) and final state) is associated with the occupant.

[0046] At least one occupant is detected to have exited the vehicle (S418). Referring to Figure 3, the exit of at least one occupant from the vehicle can be determined by the cockpit domain controller 310 based on input from the camera / sensor system 320, loss of Bluetooth or Wi-Fi connectivity, etc.

[0047] Identification information identifying at least one occupant, content identifiers (IDs) of the content consumed by the occupant, and the final location of the content at the time the at least one occupant exited the vehicle are saved (S422). Referring to FIG. 3, the cockpit domain controller 310 stores identification information 352 in data storage 350, including the occupant's ID, the content IDs of the content consumed by the occupant, and the final state, e.g., as indicated by a location indicator. However, according to at least one embodiment, the information can be stored in the cloud, another storage system, or other storage configuration. Upon detecting that the occupant has exited the vehicle, a final state 354 of the content associated with the identification information 352 is determined. The final state 354 includes a location indicator of the content, e.g., video, music, etc., being consumed by the occupant, and the location indicator is associated with the time the occupant exited the vehicle. The final state 354 is indicated by a location indicator, e.g., a timestamp, scroll position, state function, etc., along with the content identifier (content ID) of the content itself. The content ID can be the name of a video, a link to the content, a web address, the name of a game, or a product code.

[0048] It is detected that the occupant has re-entered the vehicle (S426). Referring to Figure 3, the cockpit domain controller 310 detects that the occupant has returned to the vehicle. The cockpit domain controller 310 identifies the occupant who has re-entered the vehicle according to the identification information 352.

[0049] Identification information identifying at least one occupant, a content ID of the content, and a final location of the content associated with the identification information identifying the at least one occupant are read (S430). Referring to FIG. 3 , the cockpit domain controller 310 identifies the occupant who re-enters the vehicle according to the identification information 352, and then obtains the content ID associated with the re-entered occupant and a final state 354 of the content. Using the final state, the content can be played back from the point at which the occupant exited the vehicle or shortly before the final state 354. The final state 354 includes a timestamp associated with the content when the occupant exited the vehicle, an approximate final location, a calculated estimate of the final location, etc. For example, in response to the timestamp indicating that the final state 354 is at the 10-minute position, playback can start from, for example, 9 minutes 50 seconds. The identification information 352 includes information identifying the occupant, such as a facial image, a device ID, etc. Information regarding the final state 354 of the content can be presented on one or more displays 330. Information regarding the final status 354 can be sent to the occupant via a notification 316 sent to the occupant via at least one of a text message, email, a push notification to an application, a voicemail message, and the like.

[0050] The content identified by the content ID is resumed at the last location for the occupant associated with the identification information (S434). Referring to Figure 3, in response to the user re-entering the vehicle, the entry is read from data storage 350 and then deleted. In this way, the occupant re-entering the vehicle can resume consuming the content from the last location.

[0051] The process then ends (S440).

[0052] At least one embodiment of this method includes determining that at least one occupant in a vehicle is consuming content; obtaining identification information identifying the at least one occupant; detecting that the at least one occupant has exited the vehicle; storing the identification information identifying the at least one occupant, a content identifier (ID) for the content consumed by the occupant, and a final location of the content at the time the at least one occupant exited the vehicle; detecting that the occupant has re-entered the vehicle; retrieving the identification information identifying the at least one occupant, a content ID for the content, and a final location of the content associated with the identification information identifying the at least one occupant; and resuming the content identified by the content ID at the final location for the occupant associated with the identification information.

[0053] FIG. 5 is a high-level functional block diagram of a processor-based system 500 according to at least one embodiment.

[0054] In at least one embodiment, a processing circuit 500 manages content displayed in a vehicle. The processing circuit 500 uses a processor 502 to implement a method for managing content displayed in a vehicle. The processing circuit 500 also includes a non-transitory computer-readable storage medium 504 used to implement the method for managing content displayed in a vehicle. The non-transitory computer-readable storage medium 504 is encoded with, or stores, instructions 506, or computer program code, that are executed by the processor 502, among other things. The instructions 506 cause the processor 502 to perform operations for managing content displayed in a vehicle. Execution of the instructions 506 by the processor 502 represents (at least in part) an application that implements at least a portion of a method described herein (hereinafter, a process and / or method) in accordance with one or more embodiments.

[0055] The processor 502 is electrically coupled to a non-transitory computer-readable storage medium 504 via a bus 508. The processor 502 is electrically coupled by the bus 508 to an input / output (I / O) interface 510. A network interface 512 is also electrically coupled to the processor 502 via the bus 508. The network interface 512 is connected to a network 514 such that the processor 502 and the non-transitory computer-readable storage medium 504 are connected to external elements via the network 514.

[0056] The processor 502 is configured to execute instructions 506 encoded on the non-transitory computer-readable storage medium 504 to enable the processing circuitry 500 to perform at least a portion of a process and / or method. In one or more embodiments, the processor 502 is a central processing unit (CPU), a multiprocessor, a distributed processing system, an application specific integrated circuit (ASIC), and / or other suitable processing unit.

[0057] Processing circuit 500 includes an I / O interface 510. I / O interface 510 is coupled to external circuitry. In one or more embodiments, I / O interface 510 includes a keyboard, keypad, mouse, trackball, trackpad, touchscreen, and / or cursor direction keys for communicating information and commands to processor 502.

[0058] Processing circuit 500 also includes a network interface 512 coupled to processor 502. Network interface 512 enables processing circuit 500 to communicate with a network 514 to which one or more other computer systems are connected. Network interface 512 includes a wireless network interface such as Bluetooth, Wi-Fi, Worldwide Interoperability for Microwave Access (WiMAX), General Packet Radio Service (GPRS), or Wideband Code Division Multiple Access (WCDMA), or a wired network interface such as Ethernet, Universal Serial Bus (USB), or Institute of Electrical and Electronics Engineers (IEEE) 864.

[0059] The processing circuit 500 is configured to receive information via an I / O interface 510. The information received via the I / O interface 510 includes one or more of instructions, data, design rules, libraries of cells, and / or other parameters for processing by the processor 502. The information is transferred to the processor 502 via a bus 508. The processing circuit 500 is configured to receive information related to a user interface (UI) via the I / O interface 510. The information is stored in the non-transitory computer-readable storage medium 504 as a UI 520.

[0060] In one or more embodiments, instructions 506 (in compressed or uncompressed form) are stored on one or more non-transitory computer-readable storage media 504. The instructions 506 may be used to program a computer, processor, or other electronic device to perform the processes or methods described herein. The one or more non-transitory computer-readable storage media 504 include one or more of an electronic storage medium, a magnetic storage medium, an optical storage medium, a quantum storage medium, etc.

[0061] For example, the non-transitory computer-readable storage medium 504 may include, but is not limited to, a hard drive, a floppy disk, an optical disk, a read-only memory (ROM), a random-access memory (RAM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, a magnetic or optical card, a solid-state memory device, or any other type of physical medium suitable for storing electronic instructions. In one or more embodiments using an optical disk, the one or more non-transitory computer-readable storage media 504 may include a compact disk read-only memory (CD-ROM), a compact disk read / write (CD-R / W), and / or a digital moving image disc (DVD).

[0062] In one or more embodiments, the non-transitory computer-readable storage medium 504 stores instructions 506 configured to cause the processor 502 to perform at least a portion of a process and / or method for managing content displayed in a vehicle. In one or more embodiments, the non-transitory computer-readable storage medium 504 also stores information, such as algorithms, that facilitate the performance of at least a portion of the process and / or method for managing content displayed in a vehicle.

[0063] Thus, in at least one embodiment, processor 502 executes instructions 506 stored on one or more non-transitory computer-readable storage media 504 to implement a method for managing content displayed in a vehicle. Processor 502 implements an infotainment system that includes a cockpit domain controller 530 that outputs content, saves final states associated with content consumed by an occupant, and manages data for restoring the final states associated with the content. Processor 502 is configured to use cockpit domain controller 530 to identify the final state of content to be presented when an occupant exits the vehicle.

[0064] The processor 502 implements a data communication interface 540 coupled to the cockpit domain controller 530 to communicate with devices inside or outside the vehicle. For example, the data communication interface 540 can use a wireless network. The processor uses the cockpit domain controller 530 to obtain identification information 560 to identify at least one occupant who is viewing some content. The content is associated with the occupant through the identification information 560. The identification information 560 includes information that identifies the occupant, such as a facial image, a device ID, etc.

[0065] A camera system 550 including one or more cameras may be coupled to the cockpit domain controller 530 to detect occupants. The processor 502 uses image analysis 532 of the cockpit domain controller 530 to perform facial recognition and identify occupants in each area of ​​the vehicle based on images from the camera system 550. The image analysis 532, e.g., machine learning, may be used to analyze images of the occupants to determine each occupant's identity 560. The processor 502 also uses other sensors 552. For example, the processor 502 uses presence analysis 534 of the cockpit domain controller 530 to process presence data from the other sensors 552 to detect the presence of an occupant.

[0066] The processor 502 can detect that the occupant has exited the vehicle based on the connection through the data communication interface 540, such as in response to a loss of Bluetooth or Wi-Fi connection. When the processor 502 detects that the occupant has exited the vehicle, it determines a final state 570 of the content associated with the identification information 560. The final state 570 includes a location indicator 572 of the content, e.g., video, music, etc., being consumed by the occupant, and the location indicator 572 is associated with the time the occupant exited the vehicle. The final state 570 is indicated by the location indicator 572, such as a timestamp, scroll position, state function, etc., along with a content identifier (content ID 574) for the content itself. The processor 502 uses the content ID 574 to determine the name of the video, a link to the content, a web address, the name of a game, a product code, etc.

[0067] The processor 502 causes the cockpit domain controller 530 to store information including the content ID 574 and the final state 570, for example as indicated by the location indicator 572. However, according to at least one embodiment, the information can be stored in the data storage 516 or in the cloud, another storage system, or other storage configuration.

[0068] The processor 502 then detects, using the cockpit domain controller 530, that the occupant has returned to the vehicle. The cockpit domain controller 530 identifies the occupant who re-entered the vehicle according to the identification information 560, and then obtains a content ID 574 associated with the re-entered occupant and a final state 570 of the content. The processor 502 can use the final state 570 to cause the cockpit domain controller 530 to play the content from the time the occupant exited the vehicle or from a short time before the final state 570. The final state 570 includes a position indicator 572, which can be a timestamp associated with the content when the occupant exited the vehicle, an approximate final location, a calculated estimate of the final state 570, or the like. For example, in response to the position indicator 572 indicating that the final state 570 is at the 10-minute position, the processor 502 can cause the cockpit domain controller 530 to start playback, for example, from 9 minutes 50 seconds. Information regarding the final state 570 of the content can be sent to the occupant. For example, the information may be transmitted via data communication interface 540 to a user device such as a smartphone, a personal computer or laptop, a television, or the like.

[0069] The processor 502 may present the content using one or more displays 580 and present the identity of each occupant using a user interface 582 including identification information 584. Information regarding the final state 570 of the content may be presented on the one or more displays 580. The information regarding the final state 570 may be sent to the occupant via a notification 536 sent to the occupant via at least one of a text message, an email, a push notification to an application, a voicemail message, etc. The user interface 582 presents a notification 592 on the one or more displays 580. The occupant may use the user interface 582 to retrieve the final state 586 of the content in the vehicle.

[0070] The processor 502 may optionally present information about the content and the final state 586, including a location indicator 588, on one or more displays 580 in the vehicle, such as an infotainment system. When an occupant re-enters the vehicle, the processor 502 causes the cockpit domain controller 530 to access the data storage 516 to determine any existing entries that may be associated with the re-entering occupant.

[0071] In some situations, cockpit domain controller 530 may not identify any entries associated with the crew member. In this situation, cockpit domain controller 530 can query the crew member for information such as content ID 590 and location via user interface 582. In other situations, processor 502 causes cockpit domain controller 530 to identify multiple entries associated with the crew member. Again, cockpit domain controller 530 can communicate with the crew member via the crew member's device or one or more displays 580 to determine which entry the crew member wants to use.

[0072] The processor 502 can also cause the cockpit domain controller 530 to use a default setting that uses the most recent entry. The cockpit domain controller 530 can also delete an older entry and save a current entry in response to an occupant exiting the vehicle, so that multiple entries are not used. In response to a user re-entering the vehicle, an entry is read from the data storage 516 and then deleted. In this way, an occupant re-entering the vehicle can resume consuming content from their last location.

[0073]

[0006] Embodiments described herein provide a method that provides one or more advantages. For example, a cockpit domain controller can identify a time when a passenger consuming content exits a vehicle and associate a point in the content (final state) with the time when the passenger exited the vehicle. When the cockpit domain controller detects that the passenger has re-entered the vehicle, the cockpit domain controller can resume the content from the point in the content (final state) associated with the time when the passenger exited the vehicle.

[0074] Separate instances of these programs may be running on or distributed across any number of separate computer systems. Thus, although particular steps have been described as being performed by particular devices, software programs, processes, or entities, this is not necessarily the case. Those skilled in the art will recognize various alternative implementations.

[0075] Furthermore, those skilled in the art will readily appreciate that the above-described techniques can be utilized in a variety of devices, environments, and contexts. Although the embodiments have been described in language specific to structural features or methodological acts, the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claims.

Claims

1. 1. A processor-implemented method for managing content displayed in a vehicle, comprising: determining that at least one occupant in a vehicle is consuming content; obtaining identification information identifying the at least one occupant; detecting that the at least one occupant has exited the vehicle; storing identification information identifying the at least one occupant, a content identifier (ID) of the content consumed by the at least one occupant, and a final location of the content at the time the at least one occupant exited the vehicle; detecting that the at least one occupant has re-entered the vehicle; Retrieving the identification information identifying the at least one occupant, a content ID of the content, and a final location of the content associated with the identification information identifying the at least one occupant; resuming the content identified by the content ID at a last location of the content for the at least one occupant associated with the identification information; A method comprising:

2. 2. The method of claim 1, wherein the step of obtaining the identification information identifying the at least one occupant includes performing image analysis on facial images captured by a camera to identify the at least one occupant.

3. The method of claim 1 , wherein the step of obtaining the identification information identifying the at least one occupant includes obtaining a device identifier for a device of the at least one occupant.

4. The method of claim 1 , wherein the step of retrieving the final location of the content associated with the identification information identifying the at least one occupant includes retrieving a final state associated with a position indicator of the final location of the content.

5. 4. The method of claim 1, wherein the step of retrieving the identification information identifying the at least one occupant, a content ID of the content, and a final location of the content associated with the identification information identifying the at least one occupant includes sending a notification to the at least one occupant.

6. The method of claim 5 , wherein sending the notification comprises sending at least one of a text message, an email, a push notification to an application, or a voicemail message to the at least one occupant.

7. The method of claim 1 , wherein the step of obtaining the identification information identifying the at least one occupant includes retrieving the identification information associated with a registered user.

8. 1. An apparatus for managing content displayed in a vehicle, comprising: a memory storing computer readable instructions; a processor, coupled to the memory, operable to execute the computer-readable instructions, determining that at least one occupant in the vehicle is consuming content; obtaining identification information identifying the at least one occupant; detecting that the at least one occupant has exited the vehicle; storing identification information identifying at least one occupant, a content identifier (ID) of the content consumed by the at least one occupant, and a final location of the content at the time the at least one occupant exited the vehicle; detecting that the at least one occupant has re-entered the vehicle; reading the identification information identifying the at least one occupant, a content ID of the content, and a final location of the content associated with the identification information identifying the at least one occupant; and a processor configured to perform an operation to resume the content identified by the content ID at a last location of the content for the at least one occupant associated with the identification information.

9. 9. The apparatus of claim 8, wherein the processor is further configured to obtain the identification information identifying the at least one occupant by performing image analysis on a facial image captured by a camera to identify the at least one occupant.

10. The apparatus of claim 8 , wherein the processor is further configured to obtain the identification information identifying the at least one occupant by obtaining a device identifier of a device of the at least one occupant.

11. 11. The apparatus of claim 8, wherein the processor is further configured to retrieve a final location of the content associated with the identification information identifying the at least one occupant by retrieving a final state associated with a position indicator of the final location of the content.

12. 11. The apparatus of claim 8, wherein the processor is further configured to send to the at least one occupant a notification regarding the identification information identifying the at least one occupant, a content ID of the content, and a final location of the content associated with the identification information.

13. The device of claim 12 , wherein the notification comprises at least one of a text message, an email, a push notification to an application, or a voicemail message to the at least one occupant.

14. The apparatus of claim 8 , wherein the processor is further configured to obtain the identification information identifying the at least one occupant by retrieving the identification information associated with a registered user.

15. determining that at least one occupant in a vehicle is consuming content; obtaining identification information identifying the at least one occupant; detecting that the at least one occupant has exited the vehicle; storing identification information identifying the at least one occupant, a content identifier (ID) of the content consumed by the at least one occupant, and a final location of the content at the time the at least one occupant exited the vehicle; detecting that the at least one occupant has re-entered the vehicle; Retrieving the identification information identifying the at least one occupant, a content ID of the content, and a final location of the content associated with the identification information identifying the at least one occupant; resuming the content identified by the content ID at a last location of the content for the at least one occupant associated with the identification information; A computer program product that causes a processor to perform operations including:

16. 16. The computer program product of claim 15, wherein obtaining the identification information identifying the at least one occupant includes performing image analysis on facial images captured by a camera to identify the at least one occupant.

17. The computer program product of claim 15 , wherein obtaining the identification information identifying the at least one occupant comprises obtaining a device identifier for a device of the at least one occupant.

18. 18. The computer program product of claim 15, wherein the step of retrieving a final location of the content associated with the identification information identifying the at least one occupant comprises retrieving a final state associated with a position indicator of the final location of the content.

19. 18. The computer program product of claim 15, wherein the step of retrieving the identification information identifying the at least one occupant, a content ID for the content, and a final location of the content associated with the identification information identifying the at least one occupant includes sending a notification to the at least one occupant, and sending the notification includes sending at least one of a text message, an email, a push notification to an application, or a voicemail message to the at least one occupant.

20. The computer program product of claim 15 , wherein obtaining the identification information identifying the at least one occupant comprises retrieving the identification information associated with a registered user.

Images