System and method for facilitating getting-off of user

Abstract

The invention provides a system and a method for facilitating a user to get off a vehicle. A vehicle is disclosed that includes a door, a detection unit, and a vehicle processor. The detection unit may be configured to detect a presence of an object in the vicinity of the vehicle and object information associated with the object. The vehicle processor may be configured to obtain the object information from the detection unit when the detection unit detects the presence of the object, and determine that the object is likely to approach toward the door based on the object information. The vehicle processor may also output the object information to a user device in response to determining that the object is likely to be approaching toward the door.

Description

Technical Field

[0001] The present disclosure relates to systems and methods for facilitating a user's exit from a vehicle. Background Art

[0002] Vehicles often include rearview mirrors that help the driver see if other vehicles, drivers, objects, people, etc. may be approaching the rear side of the vehicle. Such mirrors help the driver to conveniently drive the vehicle and / or exit the vehicle. For example, the driver can check the rearview mirror before exiting the vehicle to ensure that no one is approaching the vehicle from the rear side of the vehicle.

[0003] While rearview mirrors can help drivers exit the vehicle easily, other passengers or occupants in the vehicle may not be able to clearly see the rear side of the vehicle when exiting the vehicle. For example, an occupant sitting in a seating area behind the driver's seating area may not be able to see the rearview mirror and therefore may not know if someone may be approaching the door through which the occupant may exit. In addition, there may be situations where the driver may miss or forget to check the rearview mirror when exiting the vehicle. Such situations may cause inconvenience to the driver and / or vehicle occupants, especially when another vehicle or driver may be approaching the door through which the driver / occupant may be exiting.

[0004] Therefore, a system is needed that can help vehicle users get off the vehicle conveniently. Summary of the invention

[0005] The present disclosure describes a vehicle and a user device configured to facilitate convenient disembarkation of a vehicle occupant. The user device may be, for example, augmented reality (AR) glasses (or AR glasses) that a vehicle occupant may wear. The vehicle may be configured to detect the presence of an object near the vehicle when the object may be approaching the vehicle or a door. For example, the vehicle may be configured to detect that a driver may be approaching the passenger door from the rear of the vehicle. In response to detecting the presence of a driver near the vehicle, the vehicle may determine object / driver information. The driver information may include, for example, a real-time driver position relative to the vehicle, a speed and direction of the driver's movement, and / or a driver image. In response to determining the driver information, the vehicle may transmit the driver information to AR glasses (e.g., AR glasses worn by a passenger sitting near the passenger door).

[0006] The AR glasses may obtain the driver information and determine the location of a vehicle door that the driver may be approaching based on the driver information. For example, the AR glasses may determine the location of a passenger door in a vehicle that the driver may be approaching based on the driver information. In some aspects, the AR glasses may determine the location of the passenger door in an AR or virtual space in an interior portion of the vehicle associated with the AR glasses.

[0007] In response to determining the passenger door position, the AR glasses may output the passenger door position so that the passenger may know that the driver may be approaching the passenger door. In this case, the passenger may not open the passenger door until the driver passes through the passenger door. In this way, the AR glasses may help the passenger to get out of the vehicle conveniently even when the passenger cannot see the driver in the passenger's direct line of sight.

[0008] In some aspects, the AR glasses may output the passenger door position by superimposing a digital image of the passenger door on a display associated with the AR glasses. The AR glasses may also cause the digital image of the passenger door to illuminate in a predetermined pattern based on the driver's speed and position near the passenger door, thereby alerting the passenger accordingly. In further aspects, the AR glasses may output the driver image on the display. In additional aspects, the AR glasses may output the passenger door position via an audible signal output from an AR glasses speaker. The AR glasses may also output tactile feedback to alert the passenger.

[0009] The present disclosure discloses a vehicle and a user device that can facilitate the convenient exit of a vehicle occupant. The vehicle can transmit driver information to the AR glasses even when the vehicle ignition may be off, thereby enabling the AR glasses to warn the vehicle occupant even when the power of the vehicle may be off. In addition, the vehicle and the user device can even enable those occupants who may be sitting in the middle or rear row seating areas located in the interior portion of the vehicle to perceive the approaching object / driver, thereby enabling them to conveniently exit the vehicle.

[0010] These and other advantages of the present disclosure are provided in detail herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Detailed description is set forth with reference to the accompanying drawings. The use of the same reference numerals may indicate similar or identical items. Various embodiments may utilize elements and / or components other than those shown in the accompanying drawings, and some elements and / or components may not be present in various embodiments. The elements and / or components in the accompanying drawings are not necessarily drawn to scale. Throughout this disclosure, singular and plural terms may be used interchangeably, depending on the context.

[0012] Figure 1 An exemplary environment is depicted in which techniques and structures for providing the systems and methods disclosed herein may be implemented.

[0013] Figure 2 A block diagram depicts an exemplary system for facilitating exiting a vehicle user in accordance with the present disclosure.

[0014] Figure 3 A first exemplary display of augmented reality (AR) glasses according to the present disclosure is depicted.

[0015] Figure 4A second exemplary display of augmented reality (AR) glasses according to the present disclosure is depicted.

[0016] Figure 5 A flow chart depicts an exemplary method of facilitating exiting a vehicle user according to the present disclosure. DETAILED DESCRIPTION

[0017] The present disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the disclosure are shown and which are not intended to be limiting.

[0018] Figure 1 An exemplary environment 100 is depicted in which techniques and structures for providing the systems and methods disclosed herein may be implemented. The environment 100 may include a vehicle 102 that may be parked in a parking space 104 on a road (or at rest). The vehicle 102 may take the form of any passenger or commercial vehicle, such as, for example, a car, a work vehicle, a crossover, a truck, a van, a minivan, a taxi, a bus, etc. The vehicle 102 may be a manually driven vehicle and / or may be configured to operate in a partially or fully autonomous mode.

[0019] In some aspects, one or more occupants may be seated in the vehicle 102 (e.g., in an interior portion of the vehicle). Figure 1 As shown, a driver 106 may be seated in the driver's seating area and a passenger 108 may be seated in a seating area behind the driver's seating area within the vehicle 102 . Figure 1 The exemplary seating arrangement of the driver 106 and the passenger 108 shown should not be construed as limiting. The passenger 108 may be seated anywhere in the vehicle 102 relative to the driver 106 without departing from the scope of the present disclosure.

[0020] The driver 106 and the passenger 108 may be associated with respective user devices, which may be, for example, mobile phones, tablet computers, wearable devices such as smart watches or augmented reality (AR) glasses (AR glasses), or any other device with communication capabilities. Figure 1In the exemplary aspects depicted in FIG, the driver 106 may wear the driver AR glasses 110, and the passenger 108 may wear the passenger AR glasses 112. The driver AR glasses 110 and the passenger AR glasses 112 may be configured to be communicatively coupled with the vehicle 102 (e.g., when the driver 106 and the passenger 108 may be sitting inside the vehicle 102), and may output one or more notifications based on signals / information / data received from the vehicle 102. The driver AR glasses 110 and the passenger AR glasses 112 may output notifications as AR images that are superimposed or "augmented" on the real-life view of the vehicle's surroundings that the driver 106 / passenger 108 may see via the respective driver AR glasses 110 and passenger AR glasses 112, or output notifications as audible and / or tactile signals. It will be appreciated by those of ordinary skill in the art that in the driver AR glasses 110 and the passenger AR glasses 112, the glasses themselves act as a display screen, and AR images may be displayed or superimposed on the display screen as notifications to the wearer (e.g., the driver 106 / passenger 108).

[0021] Environment 100 may also include a driver (collectively referred to in this disclosure as driver 114) who may be driving a motorcycle near vehicle 102 and approaching one or more vehicle doors, such as driver door 116 and / or passenger door 118. Driver 114 Figure 1 The driver 114 may be replaced with any other object or another vehicle that may be located near the vehicle 102 and is approaching the driver door 116 and / or the passenger door 118.

[0022] exist Figure 1In the exemplary aspect depicted in , the driver 114 may be approaching the driver door 116 and / or the passenger door 118 from the rear side of the vehicle, and thus the driver 106 and / or the passenger 108 may not be aware that the driver is approaching the corresponding door. In order to make the driver 106 and / or the passenger 108 aware that the driver is approaching the driver door 116 and / or the passenger door 118, the vehicle 102 may be configured to determine the driver information (or object information) and transmit the driver information to the driver AR glasses 110 and the passenger AR glasses 112. The driver AR glasses 110 and the passenger AR glasses 112 may be configured to determine the door (e.g., the driver door 116 and / or the passenger door 118) that the driver 114 may be approaching based on the driver information, and output a notification including the position of the determined door on the driver AR glasses 110 and / or the passenger AR glasses 112. The notification may also include information associated with the driver 114, such as the driver type (e.g., whether a car, bus, motorcycle, etc. may be approaching the door), the driver's approach speed and / or direction toward the door, etc. The notification may be output in the form of an AR image superimposed on the display screen of the driver AR glasses 110 and / or the passenger AR glasses 112 and / or an audible signal or tactile feedback. The driver 106 and / or the passenger 108 may see / hear the notification and may accordingly open the door to facilitate exiting the vehicle 102 when the driver 114 may have passed through the door. In this way, the vehicle 102 and the driver AR glasses 110 and / or the passenger AR glasses 112 help the driver 106 and / or the passenger 108 perceive the approaching driver 114 even if the driver 106 and / or the passenger 108 cannot directly see the driver 114 in their respective lines of sight.

[0023] The driver information may include a driver image, a driver speed toward the vehicle 102, a driver moving direction toward the vehicle 102, a driver real-time location near the vehicle 102, etc. In some aspects, the vehicle 102 may be based on the information from the vehicle detection unit (in Figure 2 The driver information is determined based on input obtained by the detection unit 210 (shown in the figure), and the vehicle detection unit may include one or more radio detection and ranging (radar) sensors, light detection and ranging (lidar) sensors, vehicle-mounted cameras, etc. In some aspects, the detection unit can be configured to detect the above-mentioned motorization information even when the vehicle ignition associated with the vehicle 102 may be turned off or in an "off state." In addition, the vehicle 102 can be configured to transmit the motorization information to the driver AR glasses 110 and / or the passenger AR glasses 112 even when the vehicle ignition may be turned off. In this way, the driver AR glasses 110 and / or the passenger AR glasses 112 can receive the motorization information and output notifications to the driver 106 and / or the passenger 108 accordingly, regardless of the vehicle operating state.

[0024] Combine the following Figure 2 Details of the vehicle 102 , the driver AR glasses 110 , and / or the passenger AR glasses 112 , and the process of outputting notifications are described.

[0025] The vehicle 102, the driver AR glasses 110 and the passenger AR glasses 112, the driver 106 and the passenger 108 implement and / or perform operations in accordance with the user manual and safety guidelines, as described in this disclosure. In addition, any actions taken by the driver 106 or the passenger 108 should comply with all rules specific to the location (e.g., federal, state, country, city, etc.) and operation of the vehicle 102. Notifications or recommendations such as those provided by the vehicle 102 and the driver AR glasses 110 and / or the passenger AR glasses 112 should be considered suggestions and followed only in accordance with any rules specific to the location and operation of the vehicle 102.

[0026] Figure 2 A block diagram depicts an exemplary system 200 for facilitating a vehicle user (driver 106 and / or passenger 108) to exit vehicle 102 according to the present disclosure. Figure 2 When Figure 3 and Figure 4 By taking passenger 108 as an example or describing from the background of passenger 108 Figure 2 ; however, the same system 200 and description set forth below apply to the driver 106 .

[0027] The system 200 may include a vehicle 102, a user device 202, and one or more servers 204 (or servers 204) that are communicatively coupled to each other via one or more networks 206 (or networks 206). The user device 202 may be a mobile phone, a tablet, a wearable device (such as a smart watch or augmented reality (AR) glasses (AR glasses)) associated with the passenger 108, or any other device with communication capabilities. For ease of description Figure 2 , assuming that the user device 202 is the passenger AR glasses 112 associated with the passenger 108.

[0028] The server 204 may be part of a cloud-based computing infrastructure and may be associated with and / or include a telematics service delivery network (SDN) that provides services to the vehicle 102 and other vehicles that may be part of a fleet of vehicles. Figure 2102). In another aspect, the server 204 may be configured to store 3-dimensional (3D) digital images of vehicle interior portions associated with multiple vehicles (including 3D digital images of vehicle interior portions associated with the vehicle 102), as well as multiple digital images (or "digital twins") associated with multiple vehicle components visible from the vehicle interior portions. For example, the server 204 may store digital images of the driver's door 116, the passenger door 118, and other doors / components associated with the vehicle 102 that are visible from the vehicle interior portions. The server 204 may be configured to transmit the above-mentioned 3D digital images to the user device 202 via the network 206 at a predefined frequency or when the user device 202 sends a request to the server 204 to obtain a 3D digital image of a vehicle interior portion associated with the vehicle 102 (or a 3D image of a vehicle interior portion) and a digital image of a vehicle component (e.g., a digital image of a door).

[0029] The network 206 illustrates an exemplary communication infrastructure in which the connected devices discussed in various embodiments of the present disclosure may communicate. The network 206 may be and / or include the Internet, a private network, a public network, or other configurations operating using any one or more known communication protocols, such as, for example, Transmission Control Protocol / Internet Protocol (TCP / IP), BLE, Wi-Fi based on the Institute of Electrical and Electronics Engineers (IEEE) standard 802.11, ultra-wideband (UWB), and cellular technologies such as time division multiple access (TDMA), code division multiple access (CDMA), high-speed packet access (HSPDA), long-term evolution (LTE), global system for mobile communications (GSM), and fifth generation (5G), to name a few examples.

[0030] The vehicle 102 may include a plurality of units / modules, including, but not limited to, a vehicle communication module 208, a detection unit 210 (or "condition sensing" unit), a vehicle control unit (VCU) 212, a vehicle memory 214, and a vehicle processor 216 (or "condition determination" unit), which may be communicatively coupled to one another. The vehicle communication module 208 may be configured to communicatively pair or couple the vehicle 102 with one or more external devices or systems (e.g., a user device 202) via the network 206. The vehicle communication module 208 may be further configured to receive / transmit data / information / signals from / to external systems and devices via the network 206. For example, the vehicle communication module 208 may transmit or receive information / signals to / from the user device 202 and / or the server 204. The vehicle communication module 208 may also be configured to transmit / receive signals / information to / from the above-mentioned vehicle units.

[0031] The detection unit 210 may include a plurality of vehicle sensors, including but not limited to radio detection and ranging (radar) sensors, light detection and ranging (lidar) sensors, vehicle interior and exterior cameras, etc. The detection unit 210 may be configured to detect the presence of an object near the vehicle 102 (i.e., the presence of an object such as the driver 114) and object information associated with the detected object (or driver information, as described above in conjunction with Figure 1 The object information may include, but is not limited to, the position of an object near the vehicle 102, the speed of movement of the object, the direction of movement of the object, and the image of the object. For example, the detection unit 210 may be configured to detect the real-time driver position relative to the vehicle 102 when the driver 114 may be approaching the vehicle 102 (e.g., toward the passenger door 118), the approach speed and direction associated with the driver 114 relative to the vehicle 102 / passenger door 118, and the driver image when the driver 114 approaches the vehicle 102. Figure 1 As depicted, driver 114 may be approaching vehicle 102 from behind the vehicle.

[0032] The VCU 212 may include a plurality of electronic control units (ECUs, not shown) that may enable the VCU 212 to control aspects of vehicle operation and implement one or more instruction sets received from the server 204 and / or the vehicle processor 216. In some aspects, the VCU 212 may be configured to determine an operational or mobile state associated with the vehicle 102. For example, the VCU 212 may be configured to determine whether the vehicle 102 may be moving, stationary, in a park drive mode, and / or whether the vehicle ignition may be off.

[0033] The vehicle processor 216 may utilize the vehicle memory 214 to store programs and / or store data in code for performing operations according to the present disclosure. The vehicle memory 214 may be a non-transitory computer-readable storage medium or memory storing program code that may enable the vehicle processor 216 to perform operations according to the present disclosure. The vehicle memory 214 may include any one or combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.), and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electronically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.).

[0034] The user device 202 may include a plurality of units / modules including, but not limited to, a device communication module 218, a device processor 220, a device memory 222, a display screen 224, and a speaker 226 that are communicatively coupled to one another. The device communication module 218 may be configured to communicatively pair or couple the user device 202 with one or more external devices or systems (e.g., the vehicle 102) via the network 206. In an exemplary aspect, the device communication module 218 may be configured to communicatively couple with the vehicle 102 when the user device 202 may be disposed within a predefined distance of the vehicle 102. For example, when the user device 202 is the passenger AR glasses 112, the device communication module 218 may communicatively couple the user device 202 with the vehicle 102 when the passenger 108 may be sitting in the vehicle 102 wearing the passenger AR glasses 112, or the user device 202 may be located in an interior portion of the vehicle.

[0035] In some aspects, the vehicle communication module 208 and the device communication module 218 may pair or couple the vehicle 102 and the user device 202 by exchanging predefined identifiers (e.g., vehicle and / or user device identifiers) and / or authentication codes that may be pre-stored in the vehicle memory 214 and the device memory 222. The vehicle communication module 208 and the device communication module 218 pair or couple the vehicle 102 and the user device 202 using known pairing techniques and are therefore not described in detail herein.

[0036] As above combined Figure 1 As described, when the user device 202 is the passenger AR glasses 112, the display screen 224 may be a transparent glass of the passenger AR glasses 112, through which the passenger 108 may see real objects (e.g., vehicle components or real objects located near the vehicle 102), or one or more AR images (or notifications) may be displayed on the transparent glasses for the passenger 108. The speaker 226 may be configured to audibly output messages or notifications (e.g., notifications received from the vehicle 102, the server 204, and / or the device processor 220).

[0037] The device processor 220 may utilize the device memory 222 to store programs in code and / or store data for performing operations in accordance with the present disclosure. The device memory 222 may be a non-transitory computer-readable storage medium or memory storing program code that may enable the device processor 220 to perform operations in accordance with the present disclosure. The device memory 222 may include any one or combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.), and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.).

[0038] In some aspects, the device memory 222 may include multiple modules and databases, including but not limited to a display module 228, a position determination module 230, a spatial alignment module 232, and a 3D image database 234. The 3D image database 234 may be configured to store 3D images of vehicle interior portions associated with the vehicle 102 and digital images of vehicle components (or digital images of vehicle doors) that the user device 202 may receive from the server 204 via the device communication module 218, as described above.

[0039] The display module 228, the position determination module 230, and the spatial alignment module 232 as described herein are stored in the form of computer executable instructions, and the device processor 220 may be configured and / or programmed to execute the stored computer executable instructions for performing operations according to the present disclosure.

[0040] In operation, when the passenger 108 enters the vehicle 102 or sits inside the vehicle 102 wearing the user device 202 / passenger AR glasses 112, the device communication module 218 and the vehicle communication module 208 may be paired with each other to achieve pairing / coupling of the user device 202 and the vehicle 102. In response to the user device 202 and the vehicle 102 being coupled to each other, the device processor 220 may execute instructions stored in the spatial alignment module 232 to "align" the user device coordinate system (i.e., the coordinate system in the AR space associated with the passenger AR glasses 112) with the vehicle interior portion coordinate system. In this case, in response to the user device 202 and the vehicle 102 being coupled to each other, the device processor 220 may first obtain a 3D image of the vehicle interior portion associated with the vehicle 102 from the 3D image database 234, and align the corresponding coordinate systems of the user device 202 and the vehicle interior portion based on the 3D image of the vehicle interior portion.

[0041] In some aspects, the device processor 220 can align the above-mentioned coordinate system by using image markers having a fixed relationship with the vehicle interior portion. For example, the device processor 220 can transmit a visual and / or auditory request to the passenger 108, for example, via the speaker 226, to observe a fixed point in the vehicle interior portion (e.g., a vehicle steering wheel, a vehicle infotainment system, etc.). When the passenger 108 observes the fixed point through the user device 202, the device processor 220 can determine the user device line of sight and can correlate the user device line of sight with the vehicle interior portion 3D image obtained from the 3D image database 234 to align the coordinate system associated with the user device 202 and the vehicle 102. For example, by using the user device line of sight, the device processor 220 can determine the position of different vehicle components (e.g., a vehicle steering wheel, a vehicle infotainment system, a passenger door 118, etc.) located in the user device line of sight. Based on this determination and the vehicle interior portion 3D image, the device processor 220 can align the coordinate system associated with the user device 202 and the vehicle interior portion. In some aspects, the device processor 220 can align the coordinate system to determine a user device location within the vehicle interior portion where the user device 202 can be located (and therefore the passenger 108 can be seated). For example, based on the alignment described above, the device processor 220 can determine that the user device 202 (and therefore the passenger 108) can be located in a seating area behind the driver's seating area, such as Figure 1 as shown (or adjacent to passenger door 118).

[0042] In other aspects, the device processor 220 may align the coordinate system by using known algorithms or methods, such as simultaneous localization and mapping (SLAM) methods / algorithms (which may be pre-stored in the spatial alignment module 232). Using the SLAM method, the device processor 220 may match the user device coordinate system with the geometry of the vehicle interior portion, as described above.

[0043] In further aspects, in response to the user device 202 and the vehicle 102 being paired / coupled with each other, the vehicle processor 216 may obtain object information (or driver information as described above) from the detection unit 210. In some aspects, the vehicle processor 216 may obtain object information from the detection unit 210 when the detection unit 210 detects the presence of an object (or the presence of a driver) near the vehicle 102. In further aspects, the vehicle processor 216 may obtain object information from the detection unit 210 when the vehicle 102 may be stationary or parked, and / or when the vehicle ignition may be off or in an off state. The vehicle processor 216 may determine the operational or mobile state of the vehicle (i.e., whether the vehicle 102 may be moving or stationary, in a parking drive mode, and / or whether the vehicle ignition may be off) based on input obtained from the VCU 212.

[0044] In response to obtaining the object information, the vehicle processor 216 may determine that the object / driver 114 may be approaching toward a vehicle door (e.g., the passenger door 118) based on the object information. For example, the vehicle processor 216 may determine that the driver 114 may be approaching from the rear of the vehicle toward the passenger door 118 based on the driver's position near the vehicle 102 and / or the driver's movement speed and direction relative to the vehicle 102. In response to determining that the object may be approaching toward the passenger door 118, the vehicle processor 216 may output / transmit the object information to the user device 202 (specifically, to the device communication module 218) via the vehicle communication module 208 via the network 206.

[0045] The device communication module 218 may receive the object information from the vehicle communication module 208 and may transmit the received object information to the device processor 220. The device processor 220 may obtain the object information from the device communication module 218 and may execute instructions stored in the position determination module 230 to determine a door position in the vehicle interior portion associated with a door (to which the object may be approaching) based on the obtained object information. For example, based on the driver image and / or the direction and speed of the driver's movement, the device processor 220 may determine that the driver 114 may be approaching the passenger door 118. In response to determining that the driver 114 may be approaching the passenger door 118, the device processor 220 may determine a "passenger door position" in the AR space associated with the user device 202 / passenger AR glasses 112 based on the vehicle interior portion 3D image and the user device position in the vehicle interior portion (the device processor 220 determines the user device position when aligning the coordinate system associated with the user device 202 and the vehicle interior portion, as described above).

[0046] In response to determining the passenger door position, the device processor 220 may output the passenger door position to indicate to the passenger 108 that the object / driver 114 may be approaching the passenger door 118 (and therefore the passenger 108 should not open the passenger door 118 to exit the vehicle 102). In some aspects, the device processor 220 may output the passenger door position via an audible signal output from the speaker 226. For example, the device processor 220 may output an audible signal from the speaker 226 stating "A driver is approaching from behind. Do not open the door," so that the passenger 108 can hear the signal and not open the passenger door 118 until the object / driver 114 passes through the passenger door 118. In this way, the device processor 220 can enable the passenger 108 to know that the driver is approaching the passenger door 118 even when the driver 114 may not be in the passenger's 108 line of sight.

[0047] In further aspects, the device processor 220 may execute instructions stored in the display module 228 and output the passenger door position on the display screen 224. In an exemplary aspect, the device processor 220 may output the passenger door position on the display screen 224 based on the user device position and the passenger door position in the interior portion of the vehicle by superimposing a passenger door digital image (which the device processor 220 may obtain from the 3D image database 234) on the display screen 224. For example, when the user device position may be a seating area behind the driver's seating area and the object / driver 114 may be approaching toward the passenger door 118, the device processor 220 may determine that the passenger door 118 may be positioned toward the left corner of the display screen 224 when the passenger 108 may be viewing through the user device 202 / passenger AR glasses 112, and may superimpose the passenger door digital image 302 toward the left corner of the display screen 224 accordingly, as shown in FIG. Figure 3 As shown. Because the coordinate systems associated with the user device 202 and the vehicle interior portion are aligned, the passenger door digital image 302 can be superimposed at the "actual" location where the physical passenger door 118 can be located in the vehicle interior portion. In an exemplary aspect, the passenger door digital image 302 can have the same shape and size as the physical passenger door 118.

[0048] In some aspects, the device processor 220 may additionally cause the passenger door digital image 302 to illuminate in a predefined pattern based on the object information. For example, if an object may be traveling at a high speed toward the passenger door 118 or may be very close to the passenger door 118 (or within a predefined threshold distance from the passenger door 118), the device processor 220 may cause the passenger door digital image 302 to illuminate and flash at a predefined frequency to notify / warn the passenger 108 that the object is approaching. As another example, based on the distance from the passenger door 118 and / or the approach speed, the device processor 220 may cause the passenger door digital image 302 to illuminate in red, yellow, or green (or any other predetermined color). In further aspects, the device processor 220 may superimpose an indicator 304 on the display screen 224 that indicates to the passenger 108 the direction of movement of the object / driver, such as Figure 3 shown.

[0049] Figure 3 This depicts only one exemplary aspect or manner of outputting the passenger door position on the display screen 224. In other aspects, the device processor 220 may output another type of indicator (e.g., arrow 402, such as Figure 4 ) is superimposed on the display screen 224 to indicate the passenger door position to the passenger 108. In another aspect, the device processor 220 can superimpose the object / driver image 404 (which can be part of the object information obtained from the vehicle 102) on the display screen 224, such as Figure 4As shown. In yet another aspect, the device processor 220 can overlay a graphical representation of the driver 114 on the display screen 224. Also in this case, the arrow 402, the object image 404, and / or the graphical representation can be illuminated with a predefined pattern and / or color based on the object information. In some aspects, the device processor 220 can also increase or decrease the size of the arrow 402 / object image 404 based on the distance of the object from the passenger door 118 and / or the closing speed of the object. The device processor 220 can also output tactile feedback or vibration based on the distance of the object from the passenger door 118 and / or the closing speed of the object.

[0050] Because the coordinate systems associated with the user device 202 and the interior portion of the vehicle are aligned, only "relevant" occupants in the interior portion of the vehicle can receive or see the passenger door position. For example, an occupant sitting near the passenger 108 and exiting the vehicle 102 from a door opposite to the passenger door 118 may not see the passenger door position on the corresponding user device because the object / driver 114 may be approaching toward the passenger door 118 instead of the opposite door. On the other hand, if the driver 114 may be approaching the driver door 116, the driver AR glasses 110 may output the driver door position so that the driver 106 can know that the driver 114 is approaching toward the driver door 116.

[0051] Figure 5 A flow chart depicting an exemplary method 500 of facilitating a vehicle user to exit a vehicle 102 according to the present disclosure. Figure 5 The following process is exemplary and is not limited to the steps described below. Furthermore, alternative embodiments may include more or fewer steps than shown or described herein, and may include the steps in an order different from the order described in the following exemplary embodiments.

[0052] The method 500 begins at step 502. At step 504, the method 500 may include obtaining, by the vehicle processor 216, object information from the detection unit 210 when the detection unit 210 detects the presence of an object near the vehicle 102. At step 506, the method 500 may include determining, by the vehicle processor 216, that the object / driver 114 may be approaching toward the passenger door 118 based on the object information. At step 508, the method 500 may include outputting, by the vehicle processor 216, the object information to the user device 202 in response to determining that the object / driver 114 may be approaching toward the passenger door 118.

[0053] As described above, in response to obtaining object information from the vehicle 102 / vehicle processor 216, the user device 202 can determine and output the passenger door position of the passenger 108. The passenger 108 can see / hear the notification including the passenger door position and can accordingly decide not to open the passenger door 118 until the driver 114 passes through the passenger door 118.

[0054] Method 500 ends at step 510 .

[0055] In the above disclosure, reference has been made to the accompanying drawings that form a part of the above disclosure, which illustrate specific embodiments in which the present disclosure can be practiced. It should be understood that other implementations can be utilized and structural changes can be made without departing from the scope of the present disclosure. References to "one embodiment," "embodiment," "exemplary embodiment," etc. in this specification indicate that the described embodiment may include specific features, structures, or characteristics, but each embodiment may not necessarily include the specific features, structures, or characteristics. In addition, such phrases do not necessarily refer to the same embodiment. In addition, when features, structures, or characteristics are described in conjunction with an embodiment, whether or not explicitly described, those skilled in the art will recognize such features, structures, or characteristics in conjunction with other embodiments.

[0056] In addition, where appropriate, the functions described herein may be performed in one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and programs described herein. Certain terms are used throughout the specification and claims to refer to specific system components. As will be appreciated by those skilled in the art, components may be referred to by different names. This document is not intended to distinguish between components that have different names but the same function.

[0057] It should also be understood that the word "example" as used herein is intended to be non-exclusive and non-limiting in nature. More specifically, the word "example" as used herein indicates one of several examples, and it should be understood that no undue emphasis or preference is placed on the specific example described.

[0058] Computer-readable media (also referred to as processor-readable media) include any non-transitory (e.g., tangible) media that participate in providing data (e.g., instructions) that can be read by a computer (e.g., by a processor of a computer). Such media may take many forms, including, but not limited to, non-volatile media and volatile media. A computing device may include computer-executable instructions, where the instructions may be executable by one or more computing devices (such as those listed above) and stored on a computer-readable medium.

[0059] With respect to the processes, systems, methods, heuristics, etc. described herein, it should be understood that although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes may be practiced by performing the described steps in an order different from that described herein. It should also be understood that certain steps may be performed simultaneously, other steps may be added, or certain steps described herein may be omitted. In other words, the descriptions of the processes herein are provided for the purpose of illustrating various embodiments and should in no way be construed as limiting the claims.

[0060] Therefore, it should be understood that the above description is intended to be illustrative rather than restrictive. Upon reading the above description, many embodiments and applications other than the examples provided will be apparent. The scope should not be determined with reference to the above description, but should be determined with reference to the entire scope of the appended claims and equivalents to which such claims are entitled. It is anticipated and expected that the technology discussed herein will develop in the future, and the disclosed systems and methods will be incorporated into such future embodiments. In short, it should be understood that the present application is capable of modification and change.

[0061] Unless explicitly indicated to the contrary in this article, all terms used in the claims are intended to be given their ordinary meanings as understood by the skilled person described herein. Specifically, unless the claim states an explicit limitation to the contrary, the use of singular articles such as "one", "the", "said" and the like should be interpreted as describing one or more of the indicated elements. Unless otherwise specifically stated or understood in other ways within the context when used, conditional language such as, in particular, "can", "may", "can" or "may" is generally intended to express that certain embodiments may include certain features, elements and / or steps, while other embodiments may not include certain features, elements and / or steps. Therefore, such conditional language is generally not intended to imply that one or more embodiments require each feature, element and / or step in any way.

[0062] According to an embodiment, the present invention also features a speaker, wherein the device processor outputs an audible signal indicative of the object that is output from the speaker of the user device.

[0063] According to the present invention, a method includes: in response to detecting that an object may pass through the vehicle within a predetermined distance from the side of the vehicle, a vehicle processor of the vehicle obtains object information from a vehicle detection unit; the vehicle processor determines that the object is approaching the side of the vehicle based on the object information; and in response to determining that the object is approaching the side of the vehicle, the vehicle processor sends the object information to a user device.

[0064] In one aspect of the present invention, the object information includes at least one of a position of an object near the vehicle, a moving speed of the object, a moving direction of the object, or an image of the object.

[0065] In one aspect of the present invention, sending the object information is based on determining that the vehicle is stationary, the vehicle ignition is in an off state, or the vehicle is in a parking driving mode.

[0066] In one aspect of the invention, the method includes generating an audible signal to be output by a speaker of the vehicle indicating that the object is approaching the side of the vehicle.

Claims

1. A vehicle, comprising: a detection unit configured to detect the presence of an object near the vehicle and object information associated with the object; as well as a vehicle processor communicatively coupled to the detection unit, wherein when the vehicle is stationary, the vehicle processor is configured to: When the detection unit detects the existence of the object, obtaining the object information from the detection unit; determining, based on the object information, that the object is likely to pass by the vehicle within a predetermined distance of the vehicle; and The object information is output to a user device in response to determining that the object is approaching toward a vehicle door.

2. The vehicle of claim 1, wherein the detection unit comprises at least one of a radio detection and ranging (radar) sensor, a light detection and ranging (lidar) sensor, or an onboard camera. 3 . The vehicle of claim 1 , wherein the object information comprises at least one of an object position, an object moving speed, an object moving direction, or an object image near the vehicle. 4 . The vehicle of claim 1 , wherein the vehicle processor outputs the object information based on a determination that the vehicle is in a parking drive mode or the ignition is in an off state. 5 . The vehicle of claim 1 , wherein determining that the object is likely to pass by the vehicle within a predetermined distance of the vehicle comprises determining that the object will pass by a side of the vehicle proximate a door of the vehicle.

6. The vehicle of claim 1, wherein the user device is augmented reality (AR) glasses.

7. A user device, comprising: a communication module configured to receive object information from a vehicle, wherein the communication module receives the object information indicating that an object may pass by the vehicle within a predetermined distance of the vehicle; as well as a device processor communicatively coupled to the communication module, wherein the device processor is configured to: Obtaining the object information from the communication module; determining a door position associated with a door in the interior portion of the vehicle based on the object information; and A warning overlay for the door is output at the door location to indicate that the object is approaching toward the door. 8 . The user device of claim 7 , wherein the object information comprises at least one of an object position, an object moving speed, an object moving direction, or an object image near the vehicle.

9. The user device of claim 7, wherein the user device is augmented reality (AR) glasses.

10. The user device of claim 9, further comprising a display screen, wherein the device processor presents the warning overlay of the vehicle door on the display screen. 11 . The user device of claim 10 , further comprising a device memory configured to store a 3-dimensional (3D) image of the vehicle interior portion.

12. The user device of claim 11, wherein the communication module is further configured to communicatively couple the user device with the vehicle when the user device is located in the interior portion of the vehicle.

13. The user device of claim 12, wherein the device processor is further configured to: When the user device is communicatively coupled to the vehicle, obtaining the 3D image of the vehicle interior portion from the device memory; aligning a user device coordinate system with a vehicle interior portion coordinate system based on the vehicle interior portion 3D image; determining a user device location within the interior portion of the vehicle based on the alignment; and The warning overlay for the vehicle door is presented on the display screen based on the vehicle door position and the user device position.

14. The user device of claim 13, wherein the device processor is further configured to illuminate the warning overlay of the vehicle door in a predefined pattern based on the object information.

15. The user device of claim 10, wherein the device processor is further configured to include a digital image of the object in the alert based on the object information.

Images