Reduction of power consumption of user interface

Abstract

The invention relates to reduction of power consumption of a user interface. Power consumption of a user interface in a vehicle is reduced. It is determined that at least one occupant in the vehicle is consuming content. A content identifier (ID) associated with the content and an identifier associated with at least one occupant consuming the content are determined. A status of at least one occupant associated with no-consuming content is determined. On the basis of the state of the at least one occupant determined to no-consume the content, the device of the at least one occupant associated with the no-consume content is set to a power saving mode.

Description

Technical Field

[0001] This manual relates to reducing the power consumption of the user interface. Background Technology

[0002] The presentation of audio and / or video content within vehicles has become common in many mobile experiences. For example, drivers often listen to audio content (e.g., music and / or audio text) while driving, and passengers often watch videos in the vehicle before reaching their destination. Additional content includes web browsing, streaming media, and more. This content is accessible when using mobile devices or other media playback devices, such as in-vehicle infotainment (IVI) systems (also simply referred to as infotainment systems).

[0003] Content can be displayed on a monitor for each passenger in the vehicle. Passengers can stop consuming content. For example, in response to a passenger falling asleep, the passenger is determined to have stopped consuming content. However, since content playback continues regardless of the passenger's intention, the vehicle's power consumption may increase. Summary of the Invention

[0004] In at least one embodiment, the method for reducing power consumption of the user interface includes the following steps: determining that at least one passenger in the vehicle is consuming content; determining a content identifier (ID) associated with the content and an identifier associated with the at least one passenger consuming the content; determining the status of at least one passenger who is no longer consuming content; and setting the device of the at least one passenger who is no longer consuming content to a power-saving mode based on the status of the at least one passenger who is determined to no longer consume content.

[0005] In at least one embodiment, the apparatus for reducing power consumption of a user interface includes: a memory storing computer-readable instructions; and a processor connected to the memory. The processor is configured to execute the computer-readable instructions to perform actions for the following processes: determining that at least one passenger in the vehicle is consuming content; determining a content identifier (ID) associated with the content and an identifier associated with the at least one passenger consuming the content; determining the state of at least one passenger who is no longer consuming content; and setting the device of the at least one passenger who is no longer consuming content to a power-saving mode based on the state of the at least one passenger who is determined to no longer consume content.

[0006] In at least one embodiment, in a non-transitory computer-readable medium storing computer-readable instructions, when the computer-readable instructions are executed by a processor, the computer-readable instructions cause the processor to perform the following actions: determine that at least one passenger in the vehicle is consuming content; determine the content identifier (ID) associated with the content and the identifier associated with the at least one passenger consuming the content; determine the state of the at least one passenger who is no longer consuming the content; and based on the state of the at least one passenger who is determined to no longer consume the content, set the device of the at least one passenger who is no longer consuming the content to a power-saving mode. Attached Figure Description

[0007] Figure 1 This refers to the cockpit of a vehicle based on at least one implementation method.

[0008] Figure 2 This is an interior view of a vehicle based on at least one implementation method.

[0009] Figure 3 It is a system architecture based on at least one implementation method.

[0010] Figure 4 This is a flowchart of a method for reducing the power consumption of a user interface based on at least one implementation.

[0011] Figure 5 It is a high-level functional block diagram of a processor-based system based on at least one implementation. Detailed Implementation

[0012] Hereinafter, with reference to the accompanying drawings, the features, aspects, and advantages of specific exemplary embodiments of the present disclosure will be described. In the drawings, similar reference numerals denote similar elements.

[0013] The following detailed description of exemplary embodiments is given with reference to the accompanying drawings. The foregoing disclosure provides examples and descriptions, but is not intended to be exhaustive, nor is it intended to limit implementations to the exact forms disclosed. Modifications and variations can be made based on the foregoing disclosure or can be obtained from the practice of implementations. Furthermore, one or more features or constituent elements of one embodiment can be embedded in or combined with another embodiment (or one or more features of another embodiment). Moreover, as will be understood from the following flowcharts and descriptions of actions, modifications such as omitting one or more actions, adding one or more actions, performing one or more actions simultaneously (at least partially), and switching the order of one or more actions can be implemented without affecting the scope of the invention.

[0014] It is evident that the systems and / or methods described herein can be implemented in various forms, including hardware, software, or a combination of hardware and software. The specific control hardware or software code used to implement such systems and / or methods is not limited to any particular implementation. Therefore, the operation and behavior of the systems and / or methods are described herein without reference to any specific software code. It is understood that software and hardware can be designed to implement the systems and / or methods based on the descriptions in this specification.

[0015] Even if a specific combination of features is stated in the claims and / or disclosed in the specification, such a combination is not intended to limit the disclosure of possible implementations. In practice, sometimes many features are combined in a manner not specifically stated in the claims and / or not disclosed in the specification. The dependent claims listed below sometimes directly depend on only one claim, but the disclosure of implementations includes all dependent claims combined with all other claims in the claim group.

[0016] Unless explicitly stated otherwise, any element, action, or instruction used in this specification should not be construed as critical or essential. Furthermore, the articles “a” and “an” used in this specification are intended to include one or more items and are sometimes used interchangeably with “one or more.” “A” or similar terms are used when only one item is implied. Additionally, the terms “has,” “have,” “having,” “include,” and “including” used in this specification are open-ended expressions. Moreover, unless explicitly stated otherwise, phrases such as “based on…” are intended to mean “at least partially based on…”. Furthermore, expressions such as “at least one of A and B,” “A and / or B,” or “at least one of A or B” should be understood to include only A, only B, or both A and B.

[0017] Furthermore, as shown in the figures, to facilitate the description of the relationship between one element or feature and another, this specification uses spatially relative terms such as "below," "below," "lower part," "above," and "upper part." Spatially relative terms mean not only the orientation shown in the figures but also various orientations of the device in use or operation. If the device is oriented in other directions (90-degree rotation or other directions), the spatially relative descriptors used in this specification are similarly interpreted accordingly.

[0018] The foregoing disclosure provides examples and illustrations, but is not intended to be exhaustive, nor is it intended to limit implementations to the exact forms disclosed. Modifications and changes can be made based on the foregoing disclosure, or may be derived from the practice of the implementations.

[0019] In at least one embodiment, the method for reducing power consumption of the user interface includes the following steps: determining that at least one passenger in the vehicle is consuming content; determining a content identifier (ID) associated with the content and an identifier associated with the at least one passenger consuming the content; determining the status of at least one passenger who is no longer consuming content; and setting the device of the at least one passenger who is no longer consuming content to a power-saving mode based on the status of the at least one passenger who is determined to no longer consume content.

[0020] The embodiments described in this specification provide a method that offers more than one advantage. For example, the cockpit domain controller can determine that a vehicle occupant is not consuming content on their device and reduce the power consumption of devices associated with the vehicle occupant who is determined not to be consuming content.

[0021] Figure 1 This refers to a vehicle cabin 100 based on at least one implementation.

[0022] exist Figure 1 The vehicle cabin includes a steering wheel 110, an accelerator pedal 112, a brake pedal 114, an instrument panel 120, an infotainment system 130, and an air conditioning system 140. The air conditioning system 140 is sometimes referred to as a heating, ventilation, and air conditioning (HVAC) system. The steering wheel is part of the steering system, operated by the driver to control the steering system and the direction of the vehicle. By operating the steering wheel 110, the driver indicates the direction of the vehicle via a linkage system to the front wheels. The accelerator pedal 112 is used to control the supply of fuel and air to the engine by applying pressure. The accelerator pedal 112 is also referred to as a throttle or accelerator. The brake pedal 114 is pressed to apply braking to decelerate and / or stop the vehicle.

[0023] Instrument panel 120 is part of the dashboard located behind steering wheel 110. Instrument panel 120 contains various measuring devices and lights that inform the driver of the vehicle's latest status. For example, instrument panel 120 typically includes a traction control indicator, engine temperature gauge, tachometer, fuel gauge, speedometer, odometer, turn indicator, gear indicator, and various warning lights. The tachometer displays the engine crankshaft rotation in revolutions per minute (RPM). The speedometer indicates the vehicle's speed. The odometer indicates the total miles traveled since the start of driving. The fuel gauge indicates the amount of fuel remaining in the vehicle. The engine temperature gauge indicates the current engine temperature. Additionally, it may include designated lights to warn of engine temperature issues such as overheating. The turn indicator displays flashing lights on both sides of the vehicle to communicate the driver's intended turning direction to other drivers. The gear indicator or gear display shows the currently used gear, such as park, neutral, or drive. Warning lights convey various vehicle status information. It goes without saying that the vehicle comes pre-installed with more standard components or features, and it also comes pre-installed with various functions such as ESC (Electronic Stability Controller) and ABS (Anti-lock Braking System). When the vehicle confirms that the systems are indeed safe and ready to operate, the warning light illuminates briefly upon startup. Depending on the situation, for example, a warning light indicating a problem with the engine, headlights, or temperature may remain illuminated.

[0024] The vehicle is equipped with an infotainment system 130. In at least one embodiment, the infotainment system 130 is an in-vehicle infotainment (IVI) system (also referred to simply as an infotainment system). However, the embodiments described in this specification are not limited to an IVI system. The infotainment system 130 includes one or more displays 132 for presenting content to the occupants of the vehicle. For example, the one or more displays 132 can be positioned to present content to each seat in the vehicle.

[0025] The cockpit domain controller 140 provides a collection of hardware and software within the vehicle for providing audio, video, and other content or information to the vehicle's occupants. The cockpit domain controller 140 controls the presentation of content and stores the status of each occupant. The vehicle may also include a camera system 150. The camera system 150 is configured to provide facial recognition for occupants, such as the driver and other front passenger seats. The cockpit domain controller 140 can use the camera system 150 to detect occupant states such as falling asleep or ceasing content consumption. The camera 150 can monitor signs of eye fatigue (blinking), signs of inattention based on facial and head movements, and the vehicle's turning path within its lane (disengagement or driver steering). Other devices (wearable devices, sensors mounted on seats, smartphone sensors, etc.) can also monitor occupants' drowsiness. Such devices can detect changes in pulse and respiration that typically occur before a person falls asleep.

[0026] The data communication interface 160 communicates with devices outside the vehicle to provide content to users inside the vehicle. Such devices include smartphones, tablets, televisions, laptops, servers, etc. The data communication interface 160 supports communication using wireless connections that comply with any wireless technology standard for exchanging data using licensed or unlicensed frequency bands, such as the 2.4GHz, 5GHz, and 6GHz bands used by mobile cellular systems, including those used by Citizens Broadband Radio Service (CBRS) and mobile cellular systems. These connections may use any wireless connection conforming to the IEEE 802.11 Wi-Fi protocol, Bluetooth (registered trademark), Bluetooth Low Energy (BLE), or other short-range protocols. Furthermore, the wireless connection can operate according to the RF4CE (Radio Frequency for Consumer Electronics) protocol, ZigBee (registered trademark), Z-Wave protocol, or IEEE 802.15.4 protocol, but is not limited to the protocols listed herein. Those skilled in the art will understand that the data communication interface 160 is not intended to be limited to a specific communication system or protocol.

[0027] Figure 2 This is an internal view of a vehicle 200 based on at least one implementation method.

[0028] exist Figure 2The infotainment system 210 is displayed in the center of the vehicle's instrument panel 212. The infotainment system 210 may be an in-vehicle infotainment (IVI) system (also simply referred to as an infotainment system). The infotainment system 210 includes a cockpit domain controller 220, which outputs content, stores the final state associated with the content consumed by the occupant, and manages the power to the display in response to detecting that the occupant has entered sleep mode, turning off the display or setting it to a power-saving mode.

[0029] The infotainment system 210 also includes a central display 230 for presenting content and information related to the presentation of that content. Additional displays 232, 234 can be provided individually for each rear seat occupant. Those skilled in the art will understand that other configurations and quantities of displays 230, 232, 234 can also be provided.

[0030] exist Figure 2 In the illustrated embodiment, four cameras 240, 242, 244, and 246 are provided to implement the camera system. The first camera 240 faces the driver. The second camera 242 faces the passenger in the front seat. The third camera 244 and the fourth camera 246 each face the two passengers in the rear seats. However, those skilled in the art will understand that the number of cameras installed in the camera system can be more than four or less than four. For example, a single front camera 240 can be installed to monitor the driver and passenger in the front seats. Other configurations are also conceivable in the embodiments described in this specification.

[0031] Other devices (e.g., wearable devices, sensor-equipped seats, smartphone sensors, etc.) can also be used to monitor vehicle occupants' drowsiness. Such devices can detect changes in pulse and respiration that typically occur before a person falls asleep. Figure 2 The seat is equipped with sensors 250, 252, 254, and 256 to detect changes in the occupant's pulse and respiration, which typically occur before a person falls asleep. A connection 260 from the cockpit domain controller 220 to a smartphone 262 is shown. Here, the smartphone 262 includes an application that monitors changes in the occupant's pulse and respiration to detect whether the occupant has fallen asleep. Those skilled in the art will understand that other types of sensors, for example, can be used to determine the presence or absence of occupants, such as those exiting the vehicle. The cockpit domain controller 220 determines whether the occupant is drowsy or asleep based on input from at least one of the cameras 240, 242, 244, 246, seat sensors 250, 252, 254, 256, or smartphone 262.

[0032] When the cockpit domain controller 220 detects that a passenger is dozing off, it determines that the final state of the content being presented to the passenger is being displayed. It associates the final state of the content the passenger is consuming, such as video or music, with the time the cockpit domain controller 220 determines the passenger is dozing off. Correspondingly, the cockpit domain controller 220 can set at least one display 230, 232, 234 associated with the passenger determined to be dozing off to a power-saving mode, such as a power-off mode or a sleep mode. The cockpit domain controller 220 determines the final state of the content associated with the time when one or more displays 230, 232, 234 are set to power-saving mode. Therefore, power consumption is reduced.

[0033] The system can respond to one or more displays 230, 232, 234 resuming from power-saving mode via the passenger's operation, and reproduce the content from the final state. Furthermore, information related to the final state is sent to one or more displays 230, 232, 234 of the passenger, allowing the user to manually restart the content reproduction from the final state.

[0034] In response to the detection that a passenger is no longer consuming content, such as when a passenger is dozing off or turns off the display, the final state of the content displayed on one or more displays 230, 232, 234 is stored in data storage or other storage available to the passenger. The final state can be represented by a content identifier (content ID) of the content itself, and by location indicators such as timestamps, scroll positions, state functions, etc. The content ID can be the name of a video, a link to the content, a URL, the name of a game, or a product code. When the cockpit domain controller 220 detects drowsiness, the final state, passenger identification information, and the content ID are stored, for example, in the data storage. The final state can be restored via the cockpit domain controller 220 in response to the user stopping dozing off, or via direct input from the user requesting the restoration of the final state of the content.

[0035] Figure 3 It is a system architecture 300 based on at least one implementation method.

[0036] exist Figure 3In this infotainment system 302, a cockpit domain controller 310, a camera system / other sensors 320, one or more displays 330, and a data communication interface 340 are included. The cockpit domain controller 310 determines whether at least one passenger in the vehicle is consuming content. The cockpit domain controller 310 provides content output and manages data used to restore the content to the final state 354 stored for each passenger. One or more displays 330 are used to present the content, and a user interface 332 is used to identify each passenger. For example, an additional display 370 can be provided for each rear passenger. Content includes YouTube (registered trademark), web browsing activity, video games, movies, music data, and other content that can be displayed on the screen.

[0037] The camera system 320 assists in facial recognition of occupants in each seat of the vehicle by providing images of at least one occupant to the cockpit domain controller 310. The cockpit domain controller 310 includes image analysis for determining whether an occupant in the image is actually dozing off. For example, image analysis 312 is implemented using machine learning. Other sensors 320 (e.g., wearable devices, sensor-equipped seats, smartphone sensors, etc.) can also be used to monitor occupant drowsiness. Such other sensors 320 can detect changes in pulse and respiration that typically occur before a person falls asleep. For example, occupant analysis 314 is implemented via the cockpit domain controller 310 to monitor occupant drowsiness. Such occupant analysis 314 can be implemented using machine learning.

[0038] Data communication interface 340 communicates with user equipment. Data communication interface 340 can use wireless networks to enable cockpit domain controller 310 to communicate with user equipment. For example, data communication interface 340 can communicate with smartphone 360, television 362, content server 364, and computer device 366 (e.g., personal computer, tablet, laptop, etc.). Data communication interface 340 can use wireless networks. Cockpit domain controller 310 can also use wireless networks to communicate with user equipment. Examples of wireless networks include Wi-Fi, internet hotspots, Bluetooth, Zigbee, Z-Wave, infrared (IR) wireless, ultra-wideband (UWB), and wireless gigabit (or WiGig). Data communication interface 340 supports communication using the 2.4 GHz band, 5 GHz band, 6 GHz band, etc., used by Citizen Broadband Radio Service (CBRS), mobile cellular systems, etc., and operates in accordance with wireless technology standards for exchanging data using licensed or unlicensed frequency bands, using any wireless connection conforming to the IEEE 802.11 Wi-Fi protocol, Bluetooth protocol, Bluetooth Low Energy (BLE), or other short-range protocols. Furthermore, data communication interface 340 supports wireless connections according to the RF4CE protocol, ZigBee protocol, Z-Wave protocol, or IEEE 802.15.4 protocol, but is not limited to the protocols listed herein. Those skilled in the art will understand that data communication interface 340 is not intended to be limited to a specific communication system or protocol.

[0039] The cockpit domain controller 310 can store information including identification information 352 associated with the vehicle's occupants, content identifiers (IDs), and final status 354, such as that indicated by a location indicator, in the data storage 350. According to at least one embodiment, the information can be stored locally in the data storage 350, or it can be stored in the cloud, another storage system, or any other storage configuration.

[0040] The cockpit domain controller 310 distinguishes the user's state or level of attention as either no longer paying attention to content or no longer consuming content. For example, it detects that the user is dozing off in the vehicle. Examples of detecting dozing off include the use of image recognition via a camera and the acquisition of information from at least one wearable device belonging to the occupant, such as a smartwatch or fitness tracker. However, those skilled in the art will understand that the cockpit domain controller 310 can acquire information from other devices that can also monitor the occupant's drowsiness (e.g., wearable devices, sensor-equipped seats, smartphone sensors, etc.). Such devices can detect changes in pulse and respiration that typically occur before a person falls asleep.

[0041] In response to the cockpit domain controller 310 recognizing that the user is no longer consuming content, it sets devices such as the content server and one or more displays 330 to power-saving modes such as power-off mode or hibernation mode. The cockpit domain controller 310 can also detect that the user has turned off the display. It can provide a notification 316 to one or more displays 330 that have been associated with the passenger, giving the passenger an opportunity not to turn off one or more displays 330, rather than immediately setting one or more displays 330 to power-saving mode.

[0042] One or more displays 330 can be set to power-saving mode in response to no input from the user within a specified time. For example, one or more displays 330 may not be set to power-saving mode in response to receiving input within a specified time. Furthermore, they can remain active in response to the user not falling asleep.

[0043] In response to the detection that a passenger is no longer consuming content—for example, the passenger is dozing off or the passenger has turned off the display—the final state 354 of the content displayed on one or more displays 330 is stored in data storage 350 or other storage available to the passenger. The final state 354 can be represented by a content identifier (content ID) from the content itself, and by location indicators such as timestamps, scroll positions, state functions, etc. The content ID is sometimes the name of a video, a link to the content, a URL, the name of a game, or a product code.

[0044] When drowsiness is detected by the cockpit domain controller 310, the final state 354, the passenger identification information 352, and the content ID are stored, for example, in the data storage 350. The final state 354, passenger identification information 352, and content ID can be restored via the cockpit domain controller 310 in response to the user ceasing drowsiness or through direct input from the user requesting the restoration of the final state 354.

[0045] According to at least one implementation, in power-saving mode, in response to the detection of a passenger dozing off, one or more displays 330 are turned off, but audio content continues to be provided. Therefore, other passengers, including the driver, can continue to enjoy the audio content.

[0046] The cockpit domain controller 310 determines whether at least one passenger is ready to resume content consumption. It can resume content playback from final state 354 in response to one or more displays 330 resuming from power-saving mode via passenger operation. Furthermore, information related to final state 354 can be sent to one or more displays 330 of the passenger, allowing the user to manually resume content playback from final state 354. Therefore, based on the user's selected preferences, content can be continued or aborted.

[0047] The cockpit domain controller 310 can, upon detecting that an occupant is dozing off or has fallen asleep, present a message on one or more displays 330 requesting permission to set them to a power-saving mode. The one or more displays 330 are set to power-saving mode in response to no operation by the occupant being provided for a specified period, and are not set to power-saving mode in response to operation by the occupant being provided for a specified period. Therefore, the cockpit domain controller 310 can prevent content from stopping when the occupant is not asleep.

[0048] Figure 4 This is a flowchart 400 of a method for reducing the power consumption of a user interface based on at least one implementation.

[0049] exist Figure 4 In the process (S402), it is determined that at least one passenger in the vehicle is consuming content (S410). See reference... Figure 3 The infotainment system 302 includes a cockpit domain controller 310, a camera system / other sensors 320, one or more displays 330, and a data communication interface 340. The cockpit domain controller 310 determines whether at least one occupant in the vehicle is consuming content. The cockpit domain controller 310 provides content output and manages data used to restore the content to its final state 354, stored for each occupant in the vehicle.

[0050] The system determines the content identifier (ID) associated with the content and the identifier associated with at least one passenger consuming the content (S414). See reference. Figure 3 The cockpit domain controller 310 can store information including identification information 352 associated with the vehicle's occupants, content identifiers (IDs), and final status 354, such as that indicated by a location indicator, in the data storage 350.

[0051] The status of at least one passenger who has established a connection with no longer consuming content is determined (S418). See reference. Figure 3 The cockpit domain controller 310 distinguishes the user's state or level of attention as either no longer paying attention to content or no longer consuming content. For example, it detects that the user is dozing off in the vehicle. Examples of detecting dozing off include the use of image recognition via a camera and the acquisition of information from at least one wearable device belonging to the occupant, such as a smartwatch or fitness tracker. However, those skilled in the art will understand that the cockpit domain controller 310 can acquire information from other devices that can also monitor the occupant's drowsiness (e.g., wearable devices, sensor-equipped seats, smartphone sensors, etc.). Such devices can detect changes in pulse and respiration that typically occur before a person falls asleep.

[0052] Based on the determination that at least one passenger is no longer consuming content, the device of at least one passenger is set to power-saving mode (S422). See [reference needed]. Figure 3 In response to the cockpit domain controller 310 identifying that the user is no longer consuming content, it sets devices such as the content server and one or more displays 330 into power-saving modes, such as power-off mode or hibernation mode. In response to the detection that the passenger is no longer consuming content, such as when the passenger is dozing off or has turned off the display, the final state 354 of the content displayed on one or more displays 330 is stored in data storage 350 or other storage available to the passenger. The final state 354 can be represented by the content identifier (content ID) of the content itself, and by position indicators such as timestamps, scroll positions, and state functions. The content ID can be the name of a video, a link to the content, a URL, the name of a game, or a product code. The cockpit domain controller 310 can also detect that the user has turned off the display. It can provide a notification 316 to one or more displays 330 associated with the passenger, giving the passenger an opportunity not to turn off one or more displays 330, rather than immediately setting one or more displays 330 into power-saving mode. One or more displays 330 can be set into power-saving mode in response to not receiving input from the user within a specified time. For example, one or more displays 330 may not be set to power-saving mode in response to receiving input within a specified time. They may also not stop displaying content in response to the user not being asleep.

[0053] At the point when the device is set to power-saving mode, the final state associated with the content is determined (S426). See reference... Figure 3 In response to the detection that a passenger is no longer consuming content, such as when the passenger is dozing off or turns off the display, the final state 354 of the content displayed on one or more displays 330 is stored in a data storage device 350 or other storage device accessible to the passenger. The final state 354 can be represented by a content identifier (content ID) from the content itself, and by location indicators such as timestamps, scroll positions, state functions, etc. The content ID can be the name of a video, a link to the content, a URL, the name of a game, or a product code.

[0054] The final state, which associates the content identifier ID with the content, the identifier associated with at least one passenger consuming the content, and the content associated with the time when at least one passenger's device is set to power-saving mode, is saved (S430). See reference. Figure 3When drowsiness is detected by the cockpit domain controller 310, the final state 354, the passenger identification information 352, and the content ID are stored, for example, in the data storage 350. The final state 354 can be restored by the cockpit domain controller 310 in response to the user not being drowsy, or by direct input from the user requesting the restoration of the final state 354 of the content.

[0055] It is determined that at least one passenger is ready to resume content consumption (S434). See reference. Figure 3 The cockpit domain controller 310 determines whether at least one passenger is ready to resume consuming content.

[0056] The content identifier (ID) associated with the content, the identifier associated with at least one passenger ready to resume consuming the content, and the final state associated with the content are read out (S438). See reference. Figure 3 It can respond to the user stopping dozing off, or through direct input from the user to restore the final state 354 of the requested content, by restoring the final state 354 via the cockpit domain controller 310, identifying the passenger's identification information 352 and the content ID.

[0057] Based on the determination that at least one passenger is ready to resume consuming content, the supply of content to at least one passenger resumes from the time when the final state was established (S442). See also... Figure 3 The cockpit domain controller 310 determines whether at least one passenger is ready to resume consuming content. It can resume content from final state 354 in response to one or more displays 330 resuming from power-saving mode via passenger operation. Final state 354 can be represented by the content's own content identifier (content ID) and by position indicators such as timestamps, scroll positions, and state functions. The content ID can be the name of a video, a link to the content, a URL, the name of a game, or a product code.

[0058] Then, terminate the process (S450).

[0059] At least one implementation of a method for reducing power consumption of a user interface includes the following steps: determining that at least one passenger in the vehicle is consuming content; determining a content identifier (ID) associated with the content and an identifier associated with the at least one passenger consuming the content; determining the status of at least one passenger who is no longer consuming content; and setting the device of the at least one passenger who is no longer consuming content to a power-saving mode based on the status of the at least one passenger who is determined to no longer consume content.

[0060] Figure 5This is a high-level functional block diagram of a processor-based system 500 based on at least one implementation.

[0061] In at least one embodiment, the processing circuit 500 manages the content displayed inside the vehicle. The processing circuit 500 uses a processor 502 to implement a method for reducing the power consumption of the user interface. The processing circuit 500 also includes a non-transitory computer-readable storage medium 504 for implementing the method for reducing the power consumption of the user interface. Specifically, instructions 506 executed by the processor 502, i.e., computer program code, are encoded and stored in the non-transitory computer-readable storage medium 504. Instructions 506 cause the processor 502 to perform actions for reducing the power consumption of the user interface. The execution of instructions 506 by the processor 502 (at least partially) represents an application program that implements at least a portion of the methods described herein (hereinafter referred to as processes and / or methods) according to one or more embodiments.

[0062] Processor 502 is electrically coupled to non-transitory computer-readable storage medium 504 via bus 508. Processor 502 is also electrically coupled to input / output (I / O) interface 510 via bus 508. Network interface 512 is also electrically connected to processor 502 via bus 508. Network interface 512 is connected to network 514, thus processor 502 and non-transitory computer-readable storage medium 504 are connected to external elements via network 514.

[0063] Processor 502 is configured to execute instructions 506 encoded in a non-transitory computer-readable storage medium 504, enabling processing circuitry 500 to perform at least a portion of a process and / or method. In one or more embodiments, processor 502 is a central processing unit (CPU), a multiprocessor, a distributed processing system, an application-specific integrated circuit (ASIC), and / or a suitable processing unit.

[0064] Processing circuitry 500 includes an I / O interface 510. The I / O interface 510 is coupled to external circuitry. In one or more embodiments, the I / O interface 510 includes a keyboard, keypad, mouse, trackball, trackpad, touchscreen, and / or cursor direction keys for transmitting information and commands to processor 502.

[0065] The processing circuitry 500 also includes a network interface 512 coupled to the processor 502. The processing circuitry 500 can communicate with a network 514 connected to one or more other computer systems via the network interface 512. The network interface 512 includes wireless network interfaces such as Bluetooth, Wi-Fi, WiMAX (Worldwide Interoperability for Microwave Access), GPRS (General Packet Radio Service), or WCDMA (Wideband Code Division Multiple Access), or wired network interfaces such as Ethernet, Universal Serial Bus (USB), or IEEE 864.

[0066] Processing circuitry 500 is configured to receive information via I / O interface 510. The information received via I / O interface 510 includes one or more of the following: instructions, data, design rules, cell libraries, and / or other parameters for processing by processor 502. The information is transmitted to processor 502 via bus 508. Processing circuitry 500 is configured to receive information associated with a user interface (UI) via I / O interface 510. The information is stored as UI 520 in non-transitory computer-readable storage medium 504.

[0067] In one or more embodiments, instructions 506 (in compressed or uncompressed form) are stored in one or more non-transitory computer-readable storage media 504. The instructions 506 can be used to program a computer, processor, or other electronic device to implement the processes or methods described herein. The one or more non-transitory computer-readable storage media 504 include one or more of electronic storage media, magnetic storage media, optical storage media, quantum storage media, etc.

[0068] For example, non-transitory computer-readable storage medium 504 includes hard disk drives, floppy disks, optical disks, read-only memory (ROM), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, magnetic cards or optical cards, solid-state storage devices, or other types of physical media suitable for storing electronic instructions, but is not limited to the media listed herein. In one or more embodiments using optical disks, one or more non-transitory computer-readable storage media 504 include compact disk-read-only memory (CD-ROM), compact disk-read / write (CD-R / W), and / or digital video disc (DVD). Furthermore, a computer program product including a computer program that causes a processor to perform the processes or methods described herein can be distributed in a state stored on a storage medium or via a communication line.

[0069] In one or more embodiments, the non-transitory computer-readable storage medium 504 stores instructions 506 configured to cause the processor 502 to implement at least a portion of a process and / or method for reducing power consumption of the user interface. In one or more embodiments, the non-transitory computer-readable storage medium 504 also stores information such as algorithms that are easy to implement for at least a portion of the process and / or method for reducing power consumption of the user interface.

[0070] Therefore, in at least one embodiment, processor 502 executes instructions 506 stored in one or more non-transitory computer-readable storage media 504 to implement a method for reducing power consumption of the user interface. Processor 502 implements an infotainment system including a cockpit domain controller 530. The cockpit domain controller 530 sets a power-saving mode, outputs content, stores a final state associated with the content consumed by the passenger, and manages power to the displays in response to detecting that the passenger has entered sleep mode, such as turning off the displays or setting them to a power-saving mode. Processor 502 is configured to use the cockpit domain controller 530 to set one or more displays 580 to a power-saving mode based on input from a camera system 550, other sensors 552, etc.

[0071] Processor 502 implements a data communication interface 540 coupled to cockpit domain controller 530 to communicate with devices inside or outside the vehicle. For example, data communication interface 540 can use a wireless network. The processor uses cockpit domain controller 530 to obtain identification information 560 to identify at least one occupant who is watching or listening to some content. The content is associated with the occupant through identification information 560. Identification information 560 includes occupant identification information such as facial images and device IDs.

[0072] A camera system 550, including one or more cameras, is coupled to a cockpit domain controller 530 and can monitor the occupants of the vehicle regarding drowsiness.

[0073] Processor 502 uses image analysis 532 from cockpit domain controller 530 to perform facial recognition, identifying occupants in different areas of the vehicle based on images from camera system 550, and determining whether an occupant is drowsy, about to fall asleep, or already asleep. Image analysis 532 can be used, for example, machine learning, to analyze the images of the occupants, thereby determining the identification information 560 for each occupant. Processor 502 also uses other sensors 552. For example, processor 502 uses occupant analysis 534 from cockpit domain controller 530 to process data from other sensors 552 to detect whether an occupant is drowsy.

[0074] When the processor 502 detects that the passenger is drowsy, about to fall asleep, or has already fallen asleep, it determines the final state 570 of the content associated with the identification information 560. The final state 570 includes a location indicator 572 for the content the passenger is consuming, such as video or music. Here, the location indicator 572 is associated with the time when it is determined that the passenger is drowsy and no longer consuming content. The final state 570 is represented by the content identifier (content ID 574) of the content itself, and by the location indicator 572, such as a timestamp, scroll position, or state function. The processor 502 uses the content ID 574 to determine the video name, links to content, URLs, game names, product codes, etc.

[0075] Processor 502 enables cockpit domain controller 530 to store information including content ID 574 and final state 570, such as indicated by location indicator 572. However, according to at least one embodiment, the information can be stored in data storage 516 or the cloud, another storage system, or other storage configurations.

[0076] Next, processor 502 uses cockpit domain controller 530 to determine whether the passenger is ready to resume content consumption. Cockpit domain controller 530 determines, based on identification information 560, that the passenger is ready to resume content consumption, and then obtains the content ID 574 associated with the passenger and the final state 570 of the content. Processor 502 can use the final state 570 to cause cockpit domain controller 530 to resume content consumption from the point when one or more displays 580 are set to power-saving mode.

[0077] The final state 570 includes a location indicator 572, which may be a timestamp associated with the content when the passenger alights from the vehicle, an approximate final location, or a calculated estimate of the final state 570. For example, in response to location indicator 572 indicating that the final state 570 is a 10-minute location, processor 502 can cause cockpit domain controller 530 to restart playback from, for example, 9 minutes and 50 seconds. Information related to the final state 570 of the content can be sent to the passenger. For example, this information can be sent via data communication interface 540 to user devices such as smartphones, personal computers or laptops, and televisions.

[0078] The processor 502 can use one or more displays 580 to present content and use a user interface 582, including identification information 584, to present the identity of each passenger. Information related to the final state 570 of the content can be presented on one or more displays 580. Information related to the final state 570 can be sent to the passengers via notification 536, which is sent to the passengers via at least one of the following: text message, email, push notification to an application, voicemail message, etc. The user interface 582 presents notification 592 to one or more displays 580. Passengers can use the user interface 582 to read the final state 586 of the content within the vehicle.

[0079] The processor 502 can present content-related information and, as options, the final state 586, including the location indicator 588, on one or more displays 580 within the vehicle, such as an infotainment system. When the cockpit domain controller 530 determines that the occupant is ready to resume content consumption, the processor 502 causes the cockpit domain controller 530 to access the data storage 516, enabling the cockpit domain controller 530 to determine existing entries that may be associated with the occupant determined to be ready to resume content consumption.

[0080] Depending on the situation, the cockpit domain controller 530 may sometimes fail to identify any entries associated with the passenger. In this case, the cockpit domain controller 530 can query the passenger for information such as content ID 590 and location via the user interface 582. In another case, the processor 502 enables the cockpit domain controller 530 to identify multiple entries associated with the passenger. In this case, the cockpit domain controller 530 can also communicate with the passenger via the passenger's device or one or more displays 580 to determine which entry the passenger wants to use.

[0081] Processor 502 also enables cockpit domain controller 530 to use an initial setting that uses the latest entry. In response to a passenger exiting the vehicle, cockpit domain controller 530 deletes old entries and stores the current entry, thus eliminating the need for multiple entries. In response to cockpit domain controller 530 determining that a passenger is ready to resume content consumption, processor 502 reads an entry from data storage 516 and then deletes it. In this way, a passenger determined to be ready to resume content consumption can resume content consumption from their final position.

[0082] The embodiments described in this specification provide a method that offers one or more advantages. For example, a cockpit domain controller can determine that a vehicle occupant is not consuming content on their device and reduce power consumption of devices associated with the occupant of the vehicle who is determined not to be consuming content. Individual instances of such a program can be executed through any number of separate computer systems, or individual instances of such a program can be distributed across the same system. Therefore, while specific steps have been described as being implemented by specific devices, software programs, processes, or entities, this is not mandatory. Various alternative implementations will be understood by those skilled in the art.

[0083] Furthermore, those skilled in the art will readily understand that the above-described techniques can be utilized in various devices, environments, and situations. In the embodiments, the behavior of structural features or methodologies is described using inherent language, but the subject matter defined in the appended claims is not necessarily limited to the specific features or behaviors described. Rather, specific features and behaviors are disclosed as exemplary forms of implementing the claims.

Claims

1. A method for reducing the power consumption of a user interface, comprising the following steps: It was determined that at least one passenger in the vehicle was consuming content. The content identifier ID associated with the content and the identifier associated with the at least one passenger consuming the content are determined. Determine the status of at least one passenger who has been associated with no longer consuming the content; as well as Based on the state of the at least one passenger who is determined to no longer consume the content, the device of the at least one passenger associated with no longer consuming the content is set to power saving mode.

2. The method according to claim 1, wherein, The step of determining the state of the at least one passenger who has established an association with no longer consuming the content includes: performing image recognition of the at least one passenger's image or obtaining information from at least one wearable device of the at least one passenger.

3. The method according to claim 1 or 2, wherein, The step of setting the device to the power-saving mode includes: reducing power to the device of the at least one passenger or stopping the supply of content to the device of the at least one passenger.

4. The method according to any one of claims 1 to 3, wherein, The step of setting the device of the at least one passenger to the power-saving mode includes: providing the at least one passenger with a message requesting permission to set the device to the power-saving mode.

5. The method according to any one of claims 1 to 4, wherein, The step of setting the device of the at least one passenger to the power saving mode includes: in response to not receiving input from the at least one passenger within a specified time, setting the device of the at least one passenger to the power saving mode.

6. The method according to any one of claims 1 to 5, further comprising the following step: The final state associated with the content is determined at the point in time when the device is set to the power-saving mode; Determine whether at least one passenger is ready to resume consuming the content; Read the content identifier ID associated with the content, the identifier associated with the at least one passenger who is ready to resume consuming the content, and the final state associated with the content; as well as Based on the determination that at least one passenger is ready to resume consuming the content, the supply of the content to the at least one passenger resumes from the time when the final state was associated with it.

7. The method according to claim 6, wherein, The step of restarting the supply of the content includes determining at least one of a timestamp, scroll position, or state function associated with the content at the time when the device of the at least one passenger who was determined to no longer consume the content was set to the power-saving mode.

8. An apparatus for reducing power consumption of a user interface, comprising: Memory, which stores computer-readable instructions; and A processor, connected to the memory, is configured to execute the computer-readable instructions to perform actions for the following processes: It was determined that at least one passenger in the vehicle was consuming content. The content identifier ID associated with the content and the identifier associated with the at least one passenger consuming the content are determined. The status of at least one passenger who has been associated with no longer consuming the content is determined. Based on the state of the at least one passenger who is determined to no longer consume the content, the device of the at least one passenger associated with no longer consuming the content is set to power saving mode.

9. The apparatus according to claim 8, wherein, The processor is also configured to perform at least one of image recognition of the image of the at least one passenger or to obtain information from at least one wearable device of the at least one passenger, thereby determining the state of the at least one passenger who has been associated with no longer consuming the content.

10. The apparatus according to claim 8 or 9, wherein, The processor is also configured to reduce power to the device of the at least one passenger or to stop supplying content to the device of the at least one passenger, thereby setting the device to the power-saving mode.

11. The apparatus according to any one of claims 8 to 10, wherein, The processor is also configured to provide a message to the at least one passenger requesting permission to set the device to the power-saving mode, thereby setting the device of the at least one passenger to the power-saving mode.

12. The apparatus according to any one of claims 8 to 11, wherein, The processor is also configured to set the device of the at least one passenger to the power-saving mode in response to not receiving input from the at least one passenger within a specified time.

13. The apparatus according to any one of claims 8 to 12, wherein, The processor is also configured to: The final state associated with the content is determined at the point in time when the device is set to the power-saving mode. A determination is made as to whether at least one passenger is ready to resume consuming the content. Read the content identifier ID associated with the content, the identifier associated with the at least one passenger who is ready to restart consuming the content, and the final state associated with the content. Based on the determination that at least one passenger is ready to resume consuming the content, the supply of the content to the at least one passenger resumes from the time when the final state was associated with it.

14. The apparatus according to claim 13, wherein, The processor is also configured to determine, based on at least one of a timestamp, scroll position, or state function associated with the content at the time when the device of the at least one passenger determined to no longer consume the content was set to the power-saving mode, thereby restarting the content supply.

15. A computer program product comprising a computer program, wherein, The computer program causes the processor to perform the following actions: It was determined that at least one passenger in the vehicle was consuming content. The content identifier ID associated with the content and the identifier associated with the at least one passenger consuming the content are determined. The status of at least one passenger who has been associated with no longer consuming the content is determined. Based on the state of the at least one passenger who is determined to no longer consume the content, the device of the at least one passenger associated with no longer consuming the content is set to power saving mode.

16. The computer program product according to claim 15, wherein, Determining the state of at least one passenger who has established an association with no longer consuming the content includes: performing image recognition of the image of the at least one passenger or obtaining information from at least one wearable device of the at least one passenger.

17. The computer program product according to claim 15 or 16, wherein, Setting the device to the power-saving mode includes: reducing power to the device of the at least one passenger or stopping the supply of content to the device of the at least one passenger.

18. The computer program product according to any one of claims 15 to 17, wherein, Setting the device of the at least one passenger to the power-saving mode includes at least one of the following actions: A message is sent to at least one passenger requesting permission to set the device to the power-saving mode, or In response to the absence of input from the at least one passenger within a specified time, the device of the at least one passenger is set to the power-saving mode.

19. The computer program product according to any one of claims 15 to 18, wherein, The computer program also causes the processor to perform the following actions: The final state associated with the content is determined at the point in time when the device is set to the power-saving mode. A determination is made as to whether at least one passenger is ready to resume consuming the content. Read the content identifier ID associated with the content, the identifier associated with the at least one passenger who is ready to restart consuming the content, and the final state associated with the content. Based on the determination that at least one passenger is ready to resume consuming the content, the supply of the content to the at least one passenger resumes from the time when the final state was associated with it.

20. The computer program product according to claim 19, wherein, Resuming the supply of the content includes determining at least one of a timestamp, scroll position, or state function associated with the content at the time when the device of the at least one passenger who was determined to no longer consume the content was set to the power-saving mode.

Images