Computer-implemented method for providing passenger exit assistance

Abstract

A computer-implemented method is provided that, when executed by computing hardware, causes the computing hardware to perform operations. The operations include determining a rear passenger status, determining a seatbelt status, determining a door lock status, determining whether egress assistance conditions are met based on the rear passenger status, the seatbelt status, and the door lock status, and displaying egress assistance on one or more displays.

Description

INTRODUCTION

[0001] The information contained in this section is intended to provide a general context for the disclosure. Work by the presently named inventors, to the extent described in this introduction, as well as aspects of the description that may not otherwise be considered prior art at the time of filing, are neither expressly nor impliedly admitted as prior art against this disclosure.

[0002] The present disclosure relates generally to a system and method for displaying passenger exit assistance, and more particularly to a system and method for displaying the exit assistance for rear-seat passengers of a vehicle. Reference is made to JP 2013-180634 A for related art.

[0003] In general, vehicles can be equipped with driver assistance systems that detect nearby vehicles or pedestrians and alert the driver. Some driver assistance systems can alert the driver to nearby vehicles or pedestrians while the vehicle is moving and while the vehicle is stationary (e.g., in a parking mode). It may be desirable to detect nearby vehicles or pedestrians and also alert other vehicle occupants. The shortcomings of existing systems are addressed by aspects of the present disclosure. SUMMARY

[0004] The present invention is defined by the features of the appended independent claim 1. Advantageous further developments are specified in the following description and in the dependent claims.

[0005] According to the invention, a computer-implemented method is provided that, when executed by computing hardware, causes the computing hardware to perform operations. The operations include determining a status of the rear-seat passengers, determining a seatbelt status, determining a door lock status, determining whether the egress assistance conditions are met based on the status of the rear-seat passengers, the seatbelt status, and the door lock status, and displaying the egress assistance on one or more displays of a vehicle.

[0006] The method may include one or more of the following optional features. For example, the egress assistance conditions may include a first egress assistance condition that is met, and the egress assistance may be displayed on a left rear display of the one or more displays when a passenger is detected in a left rear seat of the vehicle, a left rear seatbelt is unfastened, and a left rear passenger compartment door is unlocked. The egress assistance conditions may include a second egress assistance condition that may be met, and the egress assistance may be displayed on a right rear display of the one or more displays when a passenger is detected in a right rear seat of the vehicle, a right rear seatbelt is unfastened, and a right rear passenger compartment door is unlocked.The exit assistance may be displayed on the left rear display as long as the first conditions are met, and may be displayed on the right rear display as long as the second conditions are met. The left rear display exit assistance may include a driver-side view of the vehicle if the first exit assistance conditions are met, and the right rear display exit assistance may include a passenger-side view of the vehicle if the second exit assistance conditions are met.

[0007] According to the invention, the exit aid is displayed on one or more displays as long as the exit conditions are met. Furthermore, the exit aid is displayed for an initial period after the exit conditions are no longer met.

[0008] In one configuration, a system is provided including computing hardware and memory hardware in communication with the computing hardware, the memory hardware storing instructions that, when executed on the computing hardware, cause the computing hardware to perform operations. The operations include determining a rear passenger status, determining a seatbelt status, determining a door lock status, determining whether the egress assistance conditions are met based on the rear passenger status, the seatbelt status, and the door lock status, and displaying the egress assistance on one or more displays of a vehicle.

[0009] The system may include one or more of the following optional features. For example, the egress assistance conditions may include a first egress assistance condition that is met, and the egress assistance may be displayed on a left rear display of the one or more displays when a passenger is detected in a left rear seat of the vehicle, a left rear seatbelt is unfastened, and a left rear passenger compartment door is unlocked. The egress assistance condition that is met and the egress assistance may be displayed on a right rear display of the one or more displays when a passenger is detected in a right rear seat of the vehicle, a right rear seatbelt is unfastened, and a right rear passenger compartment door is unlocked.The exit assistance may be displayed on the left rear display as long as the first conditions are met and may be displayed on the right rear display as long as the second conditions are met. The left rear display exit assistance may include a driver's side view out of the vehicle when the first exit assistance conditions are met, and the right rear display exit assistance may include a passenger side view out of the vehicle when the second exit assistance conditions are met. The exit assistance may be displayed on one or more displays as long as the exit conditions are met. The exit assistance may be displayed for an initial duration after the exit assistance conditions are no longer met.

[0010] In another embodiment, a vehicle management system is provided that includes a body control module, a video control unit in communication with the body control module, computing hardware, and memory hardware in communication with the computing hardware, the memory hardware storing instructions that, when executed on the computing hardware, cause the computing hardware to perform operations.The operations include determining the status of rear seat passengers using weight sensors in one or more rear seats, determining the seat belt status using seat belt sensors in one or more rear seats, determining the door lock status at the body control module, determining whether the egress assistance conditions are met based on the status of rear seat passengers, the seat belt status, and the door lock status, and displaying an egress assistance on one or more rear displays of a vehicle.

[0011] The vehicle management system may include one or more of the following optional features. The egress assistance conditions may include a first egress assistance condition that may be met, and the egress assistance may be displayed on a left rear display of the one or more displays when a passenger is detected in a left rear seat of the vehicle, a left rear seatbelt is unfastened, and a left rear passenger compartment door is unlocked. The egress assistance conditions may include a second egress assistance condition that may be met, and the egress assistance may be displayed on a right rear display of the one or more displays when a passenger is detected in a right rear seat of the vehicle, a right rear seatbelt is unfastened, and a right rear passenger compartment door is unlocked.The exit assistance may be displayed on the left rear display as long as the first conditions are met and may be displayed on the right rear display as long as the second conditions are met. The left rear display exit assistance may include a driver's side view out of the vehicle when the first exit assistance conditions are met, and the right rear display exit assistance may include a passenger side view out of the vehicle when the second exit assistance conditions are met. The exit assistance may be displayed on a rear left display for an initial duration after the first exit conditions are no longer met, and the exit assistance may be displayed on a rear right display for an initial duration after the second exit conditions are no longer met. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Fig. 1 shows a vehicle environment with a vehicle management system according to the principles of the present disclosure in a schematic representation. Fig. 2 shows the vehicle of Fig. 1 in a schematic plan view. Fig. 3 shows the rear passenger compartment of the vehicle from Fig. 1 in a perspective view. Fig. 4 shows an example of the vehicle management system of Fig. 1 according to the principles of the present disclosure in an enlarged schematic representation. Fig. Figure 5 shows a flowchart illustrating the operations of the vehicle management system of Fig. 4 in a perspective view. Fig. Figure 6 shows a detailed view of the flowchart of Fig. 5, which lists entries for exit assistance. Fig. Figure 7 shows a detailed view of the flowchart of Fig. 5, which lists the exit assistance conditions.

[0013] Corresponding reference symbols indicate corresponding parts in all drawings. DETAILED DESCRIPTION

[0014] Example designs will now be described in more detail with reference to the accompanying drawings. Example designs are provided so that this disclosure will be thorough and will fully convey the scope of the disclosure to those of ordinary skill in the art. Specific details are set forth, such as examples of specific components, devices, and methods, to provide a thorough understanding of the designs of the present disclosure. As those of ordinary skill in the art will appreciate, specific details need not be used, example designs may be embodied in many different forms, and the specific details and example designs should not be construed to limit the scope of the disclosure.

[0015] The terminology used herein is for the purpose of describing specific exemplary embodiments only and is not intended to be limiting. As used herein, the singular articles “a,” “an,” and “the” can also include the plural forms, unless the context clearly indicates otherwise. The terms “comprise,” “comprising,” “containing,” and “having” are inclusive and therefore specify the presence of features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof. The method steps, processes, and operations described herein should not be construed as necessarily being performed in the particular order explained or illustrated unless they are expressly identified as being in that order of performance.Additional or alternative steps may be applied.

[0016] When an element or layer is described as being "on" or "engaging with" another element or layer, or as being "connected" or "coupled" or "attached" to it, it may be directly on or engaging with, connected, coupled, or attached to the other element or layer, or there may be intervening elements or layers. On the other hand, when an element is described as being "directly on" or "directly engaging with" another element or layer, or as being "directly connected" or "directly coupled" or "attached" to it, there must be no intervening elements or layers. Other words used to describe the relationship between elements should be interpreted in a similar way (e.g.(e.g., "between" versus "directly between," "adjacent" or "contiguous" versus "directly adjacent" or "directly adjacent," etc.). As used herein, the term "and / or" includes all combinations of one or more of the related listed items.

[0017] The terms "first," "second," "third," etc., may be used herein to describe various elements, components, regions, layers, and / or sections. These elements, components, regions, layers, and / or sections should not be limited by these terms. These terms may only be used to distinguish one element, component, region, layer, or section from another region, layer, or section. Terms such as "first," "second," and other numerical terms do not imply a sequence or order unless the context clearly indicates otherwise.Thus, a first element, component, region, layer, or section discussed below could be referred to as a second element, component, region, layer, or section without departing from the teachings of the exemplary interpretations.

[0018] For the purposes of this application, which includes the definitions below, the term "module" may be replaced by the term "circuit". The term "module" may refer to, be part of, or include: an application-specific integrated circuit (ASIC), a digital, analog, or mixed analog / digital discrete circuit, a digital, analog, or mixed analog / digital integrated circuit, a combinational logic circuit, a field-programmable gate array (FPGA), a processor (common, dedicated, or group) executing code, a memory (common, dedicated, or group) storing code executed by a processor, other suitable hardware components providing the described functionality, or a combination of some or all of the above, e.g., in a system-on-chip.

[0019] The term “code,” as used above, may include software, firmware, and / or microcode and may refer to programs, routines, functions, classes, and / or objects. The term “shared processor” includes a single processor that executes some or all of the code from multiple modules. The term “group processor” includes a processor that, in combination with additional processors, executes some or all of the code from one or more modules. The term “shared memory” includes a single memory that stores some or all of the code from multiple modules. The term “group memory” includes memory that, in combination with additional memory, stores some or all of the code from one or more modules. The term “memory” may be a subset of the term “computer-readable medium.”The term "computer-readable medium" does not encompass transitory electrical and electromagnetic signals propagating through a medium and can therefore be considered tangible and non-transitory storage. Non-limiting examples of non-transitory storage include tangible, computer-readable medium, including non-volatile memory, magnetic memory, and optical memory.

[0020] The devices and methods described in this application may be implemented partially or entirely by one or more computer programs executed by one or more processors. The computer programs include processor-executable instructions stored on at least one non-transitory, tangible, computer-readable medium. The computer programs may also include and / or be based on stored data.

[0021] A software application (i.e., a software resource) may refer to computer software that causes a computing device to perform a task. In some examples, a software application may be referred to as an "application," "app," or "program." Example applications include, but are not limited to, system diagnostic applications, system management applications, system maintenance applications, word processing applications, spreadsheet applications, messaging applications, media streaming applications, social networking applications, and gaming applications.

[0022] Non-transitory memory can be physical devices used to temporarily or permanently store programs (e.g., instruction sequences) or data (e.g., program state information) for use by a computing device. Non-transitory memory can be volatile and / or non-volatile addressable semiconductor memory. Examples of non-volatile memory include, but are not limited to, flash memory and read-only memory (ROM) / programmable read-only memory (PROM) / erasable programmable read-only memory (EPROM) / electronically erasable programmable read-only memory (EEPROM) (e.g., typically used for firmware such as boot programs). Examples of volatile memory include, but are not limited to, random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), phase-change memory (PCM), and floppy disks or tapes.

[0023] These computer programs (also referred to as programs, software, software applications, or code) comprise machine instructions for a programmable processor and may be implemented in a sequential and / or object-oriented programming language and / or in assembly / machine language. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, non-transitory computer-readable medium, apparatus, and / or device (e.g., magnetic disks, optical disks, memories, programmable logic devices (PLDs)) designed to deliver machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal.The term “machine-readable signal” refers to any signal used to provide machine instructions and / or data to a programmable processor.

[0024] Various implementations of the systems and techniques described herein may be realized in digital electronic and / or optical circuits, integrated circuits, purpose-built ASICs (Application Specific Integrated Circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include implementation in one or more computer programs executable and / or interpretable on a programmable system comprising at least one programmable processor, which may be used for special or general purposes and is coupled to receive data and instructions from and transmit data and instructions to a storage system, and at least one input device and at least one output device.

[0025] The processes and logic flows described in this specification may be performed by one or more programmable processors, also known as data processing hardware, which run one or more computer programs to perform functions by responding to input data and generating output. The processes and logic flows may also be performed by special-purpose logic circuits, such as an FPGA (field-programmable gate array) or an ASIC (application-specific integrated circuit). Processors suitable for executing a computer program include, for example, both general-purpose and special-purpose microprocessors, as well as one or more processors of any type of digital computer. In general, a processor receives instructions and data from read-only memory or random-access memory, or both.The essential elements of a computer are a processor for executing instructions, and one or more storage devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical, or optical disks, or will receive or transfer data to or from them, or both. However, it is not necessary for a computer to have such devices. Computer-readable media suitable for storing computer program instructions and data includes all forms of non-volatile memory, media, and storage devices, including, for example, semiconductor storage devices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks.The processor and memory can be supplemented by or integrated into special logic circuits.

[0026] To enable interaction with a user, one or more aspects of the disclosure may be implemented on a computer having a display device, e.g., a CRT (cathode ray tube), LCD (liquid crystal display), or touchscreen for displaying information to the user, and optionally a keyboard and pointing device, e.g., a mouse or trackball, with which the user can provide input to the computer. Other types of devices may also be used to enable interaction with the user; for example, the user may receive any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback, and user input may be received in any form, including auditory, voice, or tactile input.In addition, a computer can interact with a user by sending and receiving documents to and from a device used by the user, e.g., by sending web pages to a web browser on a client device of the user in response to requests received from the web browser.

[0027] With reference to Fig. 1, an exemplary vehicle operating environment 10 is provided to illustrate the principles of the present disclosure. The vehicle operating environment 10 includes a vehicle 100 and a vehicle service center 20. For illustrative purposes, the vehicle operating environment 10 is shown as including a single vehicle service center 20. However, in other examples, the vehicle operating environment 10 may include a plurality of vehicle service centers 20 that communicate with each other via a network 30 (e.g., the Internet, cellular networks).

[0028] With reference to Fig. 2, the vehicle 100 may include a vehicle body 102 having a first or front end 104 that is longitudinally spaced from a second or rear end 106 with respect to a longitudinal axis 108. The vehicle 100 includes a first or front passenger compartment 110 proximate the front end 104 and a second or rear passenger compartment 112 that is longitudinally spaced from the front passenger compartment 110 toward the rear end 106. In this example, the front passenger compartment 110 and the rear passenger compartment 112 each include a first or driver side 114 and a second or passenger side 116 that is transversely spaced from the driver side 114 with respect to a transverse axis 118. The transverse axis 118 is perpendicular to the longitudinal axis 108, as shown in Fig. 2. The driver side and passenger side 114, 116 may be located on different sides of the vehicle 100 (i.e., left or right), depending on the region of the world in which the vehicle 100 is intended to be used. For the purposes of the present disclosure, the driver side 114 is located on the left side of the vehicle 100 and the passenger side 116 is located on the right side of the vehicle 100 with respect to the transverse axis 118. It should be noted that the present disclosure also applies to vehicles in which the driver side is located on the right side of the vehicle and the passenger side is located on the left side of the vehicle.

[0029] The vehicle 100 may include one or more cameras 119 disposed on the vehicle body 102. For example, a first or front camera 119a may be disposed at the front end 104 (e.g., on a grille of the vehicle), a second or rear camera 119b may be disposed at the rear end 106 (e.g., on a tailgate of the vehicle), a third or left camera 119c may be disposed on the driver side 114 (e.g., on a driver-side mirror), and a fourth or right camera 119d may be disposed on the passenger side 116 (e.g., on a passenger-side mirror). The one or more cameras 119, 119a-119d may be configured to provide a 360-degree view of the surroundings of the vehicle 100 (e.g., a "bird's-eye view") or other view that may be desirable for one or more passengers of the vehicle 100 when, for example, operating the vehicle 100 or exiting the vehicle 100.

[0030] With further reference to Fig. 2, one or more closure means (e.g., doors, tailgate, etc.) may be coupled to the body 102 of the vehicle 100. For example, a front left passenger compartment door 120a and a front right passenger compartment door 120b may be coupled to the vehicle body 102 to enclose the front passenger compartment 110. Likewise, a rear left passenger compartment door 122a and a rear right passenger compartment door 122b may be coupled to the vehicle body 102 to enclose the rear passenger compartment 112. The front passenger compartment doors 120a, 120b and the rear passenger compartment doors 122a, 122b may each include a door handle 124 and / or lock / unlock buttons 126 to enable passengers to enter and exit the vehicle 100.

[0031] The front passenger compartment 110 may include a first or left front seat 128 and a second or right front seat 130. The left front seat 128 and the right front seat 130 each have a front side 132 facing toward the front end 104 and a rear side 134 facing toward the rear end 106. The left front seat 128 may include a first or left rear display 136 coupled to the rear side 134, and the right front seat 130 may include a second or right rear display 138 coupled to the rear side 134. The left and right rear displays 136, 138 may be arranged so that one or more rear passengers can view and interact with the rear displays 136, 138. The left and right rear displays 136, 138 may each include a power button 140 and / or an array of LEDs 142.

[0032] With reference to Fig. 2 and Fig. 3, the rear passenger compartment 112 may include one or more rear seats 144 spaced longitudinally from the left and right front seats 128, 130. The one or more rear seats 144 may, for example, be a bench seat extending transversely with respect to the transverse axis 118 and configured to accommodate up to three rear-seated passengers, although this is not readily apparent in the figures. Alternatively, as in Fig. 2 and Fig. 3, the one or more rear seats 144 are separate rear passenger seats (e.g., bucket seats) that are transversely spaced apart from each other with respect to the transverse axis 118 such that the seats are generally aligned with the left front seat 128 and the right front seat 130, respectively. In other words, a third or left rear seat 146 may be located behind the left front seat 128, and a fourth or right rear seat 148 may be located behind the right front seat 130. The one or more rear seats 144, such as the left rear seat 146 and the right rear seat 148, each include a safety belt 150 that can be fastened (i.e., closed) and unfastened (i.e., opened) by a passenger. As discussed in more detail below, the rear seats 144 may each include a weight sensor 152 and a safety belt sensor 154.The weight sensor 152 may be desirable to determine whether a passenger is sitting in the left rear seat 146 adjacent the rear left passenger compartment door 122a or in the right rear seat 148 adjacent the rear right passenger compartment door 122b. The seat belt sensor 154 may be desirable to determine whether the seat belt 150 of the left rear seat 146 or the right rear seat 148 is fastened or unfastened.

[0033] With reference to Fig. 1 and Fig. 4, the vehicle 100 comprises a vehicle management system 160 with a sensor system 170, a computer system 180, a vehicle system module, such as a body control module 190, and a video control unit 200. While the vehicle 100 is moving in the environment 10 or is stationary in the environment 10, the sensor system 170 comprises various sensor subsystems 172, 172a, 172b, 172c, which are designed to acquire sensor data relating to features of the environment 10 and / or the status of the vehicle 100. The sensor subsystem 172 can, for example, be an exterior vehicle sensor subsystem 172a, which is designed to acquire external environmental data 173a, such as surrounding objects (e.g., vehicles, two-wheelers, pedestrians, etc.).), an interior sensor subsystem 172b configured to measure or determine internal environmental data 173b, such as vehicle occupancy, and / or a vehicle status sensor subsystem 172c configured to measure or determine vehicle operating data 173c, such as vehicle location and operating parameters.

[0034] While the sensor system 170 collects the sensor data 173, a computer system 180 is configured to store, process, and / or transmit the sensor data 173 within the vehicle operating environment 10. To perform computing tasks associated with the sensor data 173, the computer system 180 of the vehicle 100 includes computing hardware 182 and storage hardware 184. The computing hardware 182 is configured to execute instructions stored in the storage hardware 184 to perform computing tasks associated with the operation and handling of the vehicle 100. Generally, the computer system 180 refers to one or more locations with computing hardware and / or storage hardware.

[0035] In some examples, the computer system 180 is a local system located within the vehicle 100 (e.g., vehicle control unit). When the computer system 180 is located within the vehicle 100, it may be centralized (i.e., in a single location / area within the vehicle 100, e.g., a vehicle control unit), decentralized (i.e., located at various locations within the vehicle 100), or a hybrid combination of both (e.g., with a majority of centralized hardware and a minority of decentralized hardware). To illustrate some differences, a decentralized computer system 180 may enable processing at one activity location, whereas a centralized computer system provides a central processing hub that communicates with systems at various locations within the vehicle 100.

[0036] Additionally or alternatively, computer system 180 includes computing resources located remotely from vehicle 100. For example, computer system 180 may communicate with a remote vehicle computing system 80 (e.g., a remote computer / server or a cloud-based environment) via network 30. Similar to computer system 180, remote vehicle computing system 80 includes remote computing resources such as remote data processing hardware 82 and remote storage hardware 84. Here, sensor data 173 or other processed data (e.g., data processed locally by computer system 180) may be stored in remote vehicle computing system 80 and accessible to computer system 180.In some examples, the computer system 180 is configured to utilize the remote resources 82, 84 as extensions of the computing resources 182, 184, such that the resources of the computer system 180 may reside on the resources of the remote vehicle computer system 80.

[0037] The body control module 190 is capable of monitoring and controlling various electronic aspects of the vehicle 100 (e.g., the sensor system 170, the lock / unlock button 126, etc.). In other words, the body control module 190 is capable of receiving sensor data 173 from the sensor system 170 and transmitting one or more inputs 192 to one or more output devices, such as the video control unit 200. As discussed in more detail below, the sensor data 173 may be received by the body control module 190 as one or more egress assist inputs 307, and the inputs 307 may be used to determine whether it is appropriate to display the egress assist 202, 204 on one or both of the rear displays 136, 138.

[0038] The video control unit 200 is capable of controlling various electronic aspects of the vehicle (e.g., infotainment, displaying the view of a front or rear camera on a display, etc.). In other words, the video control unit 200 may receive one or more inputs and display one or more outputs on one or more displays of the vehicle 100. For example, the video control unit 200 may receive the input 192 from the body control module 190 and simultaneously or immediately thereafter display relevant sensor data (i.e., egress aids 202, 204), such as the exterior sensor data 173b received from one or more cameras, about a first or left egress aid 202 for the left rear display 136 and / or a second or right egress aid 204 for the right display 138. The relevant sensor data 173 for the left egress aid 202 may include a view that, for example,Vehicles, pedestrians, or animals located on or near the driver's side 114 of the vehicle 100. Likewise, the relevant sensor data 173 for the right exit aid 204 may include a view showing, for example, vehicles, pedestrians, or animals located on or near the passenger side 116 of the vehicle 100.

[0039] With further reference to Fig. 3, the video control unit 200 may receive one or more inputs 136a, 138a from the left rear display 136 and the right rear display 138, respectively, and simultaneously or immediately thereafter display relevant sensor data (e.g., the exit aid 202, 204), such as the exterior sensor data 173a received from one or more cameras. Thus, a passenger may access the exit aid 202, 204 on command, for example, by activating (e.g., pressing) the power button 140 of one or both of the rear left displays 136 and the rear right display 138.

[0040] With reference now to Fig. 5, a method 300 for providing exit assistance for passengers is provided. In a first step 302, the method 300 is initiated. In practice, the method 300 can be started by the driver when the vehicle 100 is switched on.

[0041] In step 304, the sensor system 170 begins collecting sensor data 173, 173a-173c from the interior sensor subsystem 172b, the exterior sensor subsystem 172b, and / or the vehicle status sensor subsystem 172c. As mentioned above, the sensor data 173 may be used by at least the body control module 190 to determine whether one or more exit conditions are met.

[0042] In step 306, the first and second egress aid conditions 306a, 306b are monitored by the body control module 190 to determine whether it would be desirable for the left egress aid 202 or the right egress aid 204 to be displayed as egress aid on the left and / or right rear displays 136, 138. For example, it may be desirable to display the left egress aid 202 as egress aid on the left rear display 136 if a passenger is detected in the left rear seat 146, the seatbelt of the left rear seat 146 is unbuckled, and the left rear passenger compartment door 122a is unlocked. Likewise, it may be desirable to display the right exit aid 204 as an exit aid on the right rear display 138 when a passenger is detected on the right rear seat 148, the seat belt 150 of the right rear seat 148 is unbuckled, and the right rear passenger compartment door 122b is unlocked.

[0043] In step 307, one or more egress assist inputs 307 based on the sensor data 173 may be communicated to the body control module 190 for monitoring the one or more egress assist conditions 306. For example, a first or rear passenger status 307a, a second or seatbelt status 307b, and a third or door lock status 307c may be communicated to the body control module 190. The rear passenger status 307a may indicate whether a passenger is detected in the left rear seat 146 or the right rear seat 148. The status of the rear seated passengers 307a may be determined based on the interior sensor data 173b from the interior sensor subsystem 172b, and in particular based on the data received from the weight sensors 152 located, for example, in the left rear seat 146 and the right rear seat 148.The seatbelt status 307b may indicate whether the seatbelts 150 of the left rear seat 146 and / or the right rear seat 148 are fastened or unfastened. The seatbelt status 307b may be determined based on the interior sensor data 173b from the interior sensor subsystem 172b, and more particularly based on the data received from the seatbelt sensor 154, which is coupled to or adjacent to, for example, the left rear seat 146 and the right rear seat 148. The door lock status 307c is monitored by the body control module 190. The door lock status 307c may change when the rear left passenger compartment door 122a and / or the rear right passenger compartment door 122b is unlocked.For example, the door lock status 307c may change when the unlock button of the lock / unlock button 126 coupled to the rear left passenger compartment door 122a or the rear right passenger compartment door 122b is actuated by a passenger. Furthermore, the door lock status 307c for the rear left passenger compartment door 122a or the rear right passenger compartment door 122b may change when a passenger engages the door handle 124 by actuating the door handle 124 (i.e., pulling the handle 124 in a manner that would normally open the door when unlocking the door) and causing the door 122a, 122b to unlock. Additionally, the door lock status 307c may change when a vehicle operator 100 places the vehicle into a "park" mode (e.g., shifts a transmission into park) and the doors 122a, 122b are subsequently unlocked.

[0044] In step 308, the body control module 190 determines whether the exit conditions are met. If the exit assistance conditions are met, the input 192 is transmitted to the video control unit 200, and the method continues with step 310. If the exit assistance conditions are not met, the input 192 is not transmitted to the video control unit 200, and the method 300 returns to step 304, where the collection of the data 173 continues.

[0045] In step 310, the video control unit 200 receives the input 192 and displays the left exit aid 202 on the left rear display 136 and / or the right exit aid 204 on the right rear display 138, as appropriate. For example, if a passenger is detected only in the left rear seat 146, the seatbelt 150 of the left rear seat 146 is unbuckled, and the left rear passenger compartment door 122a is unlocked, only the left exit aid 202 may be displayed on the left rear display 136.

[0046] If the body control module 190 still transmits an input 192 to the video control unit 200 that the exit conditions are met, the left exit aid 202 and / or the right exit aid 204 will continue to be displayed on the left and / or right rear displays 136, 138 in step 312. However, if the body control module 190 no longer transmits the input 192 to the video control unit 200, the method 300 may continue to step 314.

[0047] In step 314, once the input 192 is no longer received at the video control unit 200, the video control unit 200 may stop transmitting the first exit aid 202 and / or the second exit aid to the left and / or right rear displays 136, 138 after a first duration has elapsed. In the present example, the first duration is 10 seconds, but may also be between 5 and 45 seconds or between 10 and 60 seconds, for example.

[0048] After step 314, the method 300 may return to step 304 and continue collecting data, or the method 300 may end at step 316.

[0049] Providing the left exit aid 202 and / or the right exit aid 204 on the left and / or right rear displays 136, 138 allows an occupant exiting the vehicle 100 to view the exterior surroundings of the vehicle 100. Accordingly, the left exit aid 202 and the right exit aid 204 can assist exiting occupants in avoiding hazards such as an animal, an approaching cyclist, or another vehicle by displaying an area around the vehicle 100 on the respective displays 136, 138. The occupant may view the surroundings of the vehicle 100 on one or more of the displays 136, 138 and time their exit from the vehicle 100 to a time when an actual or perceived hazard has passed (i.e., when a cyclist or other vehicle has passed the vehicle 100 sufficiently to allow safe exit from the vehicle 100).

[0050] A number of implementations have been described. However, it should be understood that various changes may be made without departing from the spirit and scope of the disclosure. Accordingly, other implementations are also within the scope of the following claims.

[0051] The foregoing description is for purposes of illustration and description. It is not intended to be exhaustive or limiting of the disclosure. Individual elements or features of a particular design are generally not limited to that particular design, but are optionally interchangeable and may be used in a selected design even if not specifically shown or described. They may also be modified in many ways. Such modifications are not to be considered a departure from the disclosure, and all such changes are intended to be included within the scope of the disclosure.

Claims

[1] A computer-implemented method that, when executed by data processing hardware (182), causes the data processing hardware (182) to perform operations comprising: Determining the status of the passengers sitting in the rear (307a), Determining a seat belt status, Determining a door locking status, determine whether the exit assistance conditions are met based on the status of the rear passengers (307a), the seat belt status and the door locking status, and Displaying the exit aid on one or more displays (136, 138) of a vehicle (100), wherein the exit aid is displayed on one or more displays (136, 138) as long as the exit conditions are met; characterized by that the exit assistance is also displayed for an initial period after the exit assistance conditions are no longer met. [2] The method of claim 1, wherein the exit assistance conditions include, for example, a first exit assistance condition that is met, and the exit assistance is displayed on a left rear display (136) of the one or more displays (136, 138) when a passenger is detected (307a) on a left rear seat (146) of the vehicle (100), a left rear seatbelt (150) is unfastened, and a left rear passenger compartment door (122a) is unlocked. [3] The method of claim 2, wherein the exit assistance conditions include a second exit assistance condition being met, and the exit assistance being displayed on a right rear display (138) of the one or more displays (136, 138) when a passenger is detected (307a) in a right rear seat (148) of the vehicle (100), a right rear seatbelt (150) is unbuckled, and a right rear passenger compartment door (122b) is unlocked. [4] The method of claim 3, wherein the exit assistance is displayed on the left rear display (136) as long as the first conditions are met, and is displayed on the right rear display (138) as long as the second conditions are met. [5] The method of claim 3, wherein the left rear display (136) exit assistance comprises a driver side view of the vehicle (100) when the first exit assistance conditions are met, and the right rear display (138) exit assistance comprises a passenger side view of the vehicle (100) when the second exit assistance conditions are met. [6] The method of claim 1, wherein determining the status of the rear seated passengers (307a) further comprises monitoring weight sensors (152) in one or more rear seats (146, 148). [7] The method of claim 6, wherein determining the seat belt status further comprises monitoring seat belt sensors (154) coupled to the one or more rear seats (146, 148). [8] The method of claim 7, wherein determining the door lock status further comprises determining the door lock status at a body control module (190).

Images