Vehicle safety systems and methods
By identifying and verifying keys in autonomous vehicles, combined with image processing and vital sign monitoring, the problem of safe transportation of children in autonomous vehicles has been solved, achieving safety and reliability in child transport.
Patent Information
- Application Number
- CN201780094230.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2017-08-29
- Publication Date
- 2025-10-31
- Estimated Expiration
- 2037-08-29
AI Technical Summary
When transporting children in autonomous vehicles, there is a lack of effective safety precautions to ensure the safe pick-up and drop-off of children at their destination, especially when they are not accompanied by an adult.
By identifying the key associated with the driving route and transmitting it to the designated user, the system confirms that the user possesses the key to control access to the autonomous vehicle. Combined with image processing and vital sign monitoring, it ensures the safe pick-up and drop-off of children at their destination.
This technology ensures the safety and reliability of autonomous vehicles during child transportation, guarantees that only authorized personnel can take over the children, and monitors the children's status in real time, thereby improving safety and convenience.
Smart Images

Figure CN111065563B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to vehicle systems, and more specifically, to systems and methods for ensuring the safety of vehicles and their occupants. Background Technology
[0002] For commercial, governmental, and private entities, cars and other vehicles provide a significant portion of transportation. Vehicles such as autonomous vehicles travel on roads, parking lots, and other areas when transporting passengers or objects from one location to another. An example application of autonomous vehicles is operating as taxi or shuttle services, which pick up one or more passengers in response to a transportation request. When operating as a taxi or shuttle service, the autonomous vehicle drives to the pick-up location, allowing the requesting passenger to board. The vehicle then proceeds to the destination, allowing the passenger to disembark. In some cases, additional safety precautions are required, such as when transporting unaccompanied children in an autonomous vehicle. Summary of the Invention
[0003] A system receives a destination and a driving route to the destination for an autonomous vehicle to follow. The system identifies a key associated with the driving route and transmits the key to a user designated to meet the autonomous vehicle at the destination. Additionally, the system verifies that the user designated to meet the autonomous vehicle possesses the key. Attached Figure Description
[0004] Non-limiting and non-exhaustive embodiments of this disclosure are described with reference to the following accompanying drawings, wherein, unless otherwise specified, the same reference numerals refer to the same parts in the various drawings.
[0005] Figure 1 This is a block diagram illustrating an embodiment of a vehicle control system including a vehicle safety system.
[0006] Figure 2 This is a block diagram illustrating an embodiment of a vehicle safety system.
[0007] Figure 3 An embodiment of a vehicle is shown, which has multiple cameras and other sensors to monitor the interior and exterior of the vehicle.
[0008] Figures 4A to 4B An embodiment of a method for providing safe transportation of children in autonomous vehicles to their destination is shown.
[0009] Figure 5 This is a block diagram illustrating an embodiment of verifying a user picking up a child in an autonomous vehicle at a destination.
[0010] Figure 6An embodiment of a method for controlling children’s access to autonomous vehicles is shown.
[0011] Figure 7 An embodiment of a method for monitoring children riding in autonomous vehicles and detecting potential problems in children is shown. Detailed Implementation
[0012] In the following disclosure, reference is made to the accompanying drawings, which form a part of this disclosure and illustrate specific embodiments in which the disclosure may be practiced. It should be understood that other embodiments and structural changes may be utilized without departing from the scope of this disclosure. References to "an embodiment," "an example embodiment," "exemplary embodiment," etc., in the specification indicate that the described embodiment may include a particular feature, structure, or characteristic, but each embodiment need not necessarily include that particular feature, structure, or characteristic. Furthermore, such phrases do not necessarily refer to the same embodiment. Moreover, when a particular feature, structure, or characteristic is described in connection with an embodiment, whether explicitly described or not, implementing such a feature, structure, or characteristic in conjunction with other embodiments is within the knowledge of those skilled in the art.
[0013] Implementations of the systems, apparatuses, and methods disclosed herein may include or utilize dedicated or general-purpose computers including computer hardware such as, for example, one or more processors and system memories discussed herein. Embodiments within the scope of this disclosure may also include physical and other computer-readable media for carrying or storing computer-executable instructions and / or data structures. Such computer-readable media may be any available medium accessible by a general-purpose or dedicated computer system. A computer-readable medium storing computer-executable instructions is a computer storage medium (device). A computer-readable medium carrying computer-executable instructions is a transmission medium. Therefore, by way of example and not limitation, embodiments of this disclosure may include at least two distinct types of computer-readable media: computer storage media (devices) and transmission media.
[0014] Computer storage media (devices) include RAM, ROM, EEPROM, CD-ROM, solid-state drives (“SSDs”) (e.g., RAM-based), flash memory, phase-change memory (“PCM”), other types of memory, other optical disc storage devices, magnetic disk storage devices or other magnetic storage devices, or any other medium that can be used to store desired program code in the form of computer-executable instructions or data structures and that can be accessed by a general-purpose or special-purpose computer.
[0015] The apparatuses, systems, and methods disclosed herein can be implemented via computer networks. A “network” is defined as one or more data links capable of transmitting electronic data between computer systems and / or modules and / or other electronic devices. When information is transmitted or provided to a computer via a network or another communication connection (hardwired, wireless, or a combination of hardwired and wireless), the computer appropriately considers the connection as a transmission medium. The transmission medium may include networks and / or data links that can be used to carry the necessary program code in the form of computer-executable instructions or data structures and are accessible by general-purpose or special-purpose computers. Combinations of the above should also be included within the scope of computer-readable media.
[0016] Computer-executable instructions include, for example, instructions and data that, when executed in a processor, cause a general-purpose computer, a special-purpose computer, or a special-purpose processing device to perform a function or group of functions. Computer-executable instructions can be, for example, binary files, intermediate format instructions (such as assembly language), or even source code. Although the subject matter has been described in language specific to structural features and / or methodological actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the features or actions described above. Rather, the features and actions are disclosed as exemplary forms for implementing the claims.
[0017] Those skilled in the art will understand that this disclosure can be practiced in network computing environments using many types of computer system configurations, including built-in vehicle computers, personal computers, desktop computers, laptop computers, message processors, handheld devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile phones, PDAs, tablet computers, pagers, routers, switches, various storage devices, and so on. This disclosure can also be practiced in distributed system environments, where both local and remote computer systems, linked via a network (via a hardwired data link, a wireless data link, or a combination of hardwired and wireless data links), perform tasks. In a distributed system environment, program modules can reside on both local and remote memory storage devices.
[0018] Furthermore, where appropriate, the functions described herein may be performed by one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application-specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and processes described herein. Certain terms are used throughout the description and claims to refer to specific system components. Those skilled in the art will understand that components may be referred to by different names. This document is not intended to distinguish between components with different names but the same function.
[0019] It should be noted that the sensor embodiments discussed herein may include computer hardware, software, firmware, or any combination thereof to perform at least a portion of their functions. For example, a sensor may include computer code configured to execute in one or more processors, and may include hardware logic / circuit controlled by the computer code. These exemplary devices are provided herein for illustrative purposes and are not intended to be limiting. As will be known to those skilled in the art, embodiments of this disclosure may be implemented in other types of devices.
[0020] At least some embodiments of this disclosure relate to computer program products that include such logic (e.g., in software form) stored on any computer-usable medium. Such software, when executed in one or more data processing devices, causes the devices to operate as described herein.
[0021] Figure 1 This is a block diagram illustrating an embodiment of a vehicle control system 100 including a vehicle safety system 104 within a vehicle. An automated driving / assistance system 102 can be used to automate or control the operation of the vehicle or to provide assistance to a human driver. For example, the automated driving / assistance system 102 can control one or more of the vehicle's braking, steering, seatbelt tensioning, acceleration, lights, alarms, driver notifications, radios, vehicle locks, or any other assistance systems. In another example, the automated driving / assistance system 102 may not be able to provide any control over driving (e.g., steering, acceleration, or braking), but may provide notifications and alerts to assist the human driver in safe driving. The vehicle control system 100 includes a vehicle safety system 104 that interacts with various components within the vehicle to control access to the vehicle in certain circumstances and to control the driving route followed by the vehicle. Although the vehicle safety system 104... Figure 1 While shown as a separate component, in alternative embodiments, the vehicle safety system 104 may be integrated into the autonomous driving / assistance system 102 or any other vehicle component.
[0022] The vehicle control system 100 also includes one or more sensor systems / devices for detecting the presence of nearby objects (or obstacles) or determining the position of the master vehicle (e.g., the vehicle including the vehicle control system 100). For example, the vehicle control system 100 may include one or more radar (radio detection and ranging) systems 106, one or more lidar (light detection and ranging) systems 108, one or more camera systems 110, a global positioning system (GPS) 112, and / or an ultrasonic system 114. The one or more camera systems 110 may include a rear-facing camera, a front-facing camera, and one or more side-facing cameras mounted on the vehicle (e.g., at the rear of the vehicle). The camera systems 110 may also include one or more interior cameras that capture images of the vehicle interior (such as passengers and other objects within the vehicle). The lidar system 108 may include one or more interior lidar sensors that capture data associated with areas inside the vehicle. The vehicle control system 100 may include a data storage area 116 for storing relevant or useful data related to navigation and safety, such as map data, driving history, or other data. The vehicle control system 100 may also include a transceiver 118 for wireless communication with mobile or wireless networks, other vehicles, infrastructure, or any other communication system.
[0023] The vehicle control system 100 may include vehicle control actuators 120 to control various aspects of vehicle driving (such as electric motors, switches, or other actuators), thereby controlling braking, acceleration, steering, seatbelt tensioning, door locking, etc. The vehicle control system 100 may also include one or more displays 122, speakers 124, microphones 126, or other devices to provide notifications to a human driver or passenger. Display 122 may include a head-up display, instrument panel display or indicator, screen, or any other visual indicator visible to the driver or passenger of the vehicle. Speaker 124 may include one or more speakers from the vehicle's audio system, or may include speakers specifically for driver or passenger notifications. Microphone 126 may include any type of microphone located inside or outside the vehicle to capture sound originating from inside or outside the vehicle.
[0024] It should be understood that Figure 1 The embodiments shown are given by way of example only. Other embodiments may include fewer or additional components without departing from the scope of this disclosure. Additionally, the components shown may be combined with or included in other components without limitation.
[0025] In one embodiment, the autonomous driving / assistance system 102 is configured to control the driving or navigation of the primary vehicle. For example, the autonomous driving / assistance system 102 may control the vehicle control actuator 120 to travel along a predetermined path on a road, parking lot, driveway, or other location. In some embodiments, the autonomous driving / assistance system 102 may determine a path based on information or perception data provided by any of the components 106 to 118. The path may also be determined based on maneuvering the vehicle to avoid or mitigate a potential collision with another vehicle or object. Sensor systems / devices 106 to 110 and 114 may be used to acquire real-time sensor data, enabling the autonomous driving / assistance system 102 to assist the driver or the vehicle in real time.
[0026] Figure 2 This is a block diagram illustrating an embodiment of a vehicle safety system 104. As described herein, the "vehicle safety system" 104 may also be referred to as a "safety system." Figure 2 As shown, the vehicle safety system 104 includes a communication manager 202, a processor 204, and a memory 206. The communication manager 202 allows the vehicle safety system 104 to communicate with other systems (such as the autonomous driving / assistance system 102) and with other users and systems outside the vehicle. The processor 204 executes various instructions to implement the functionality provided by the vehicle safety system 104, as discussed herein. The memory 206 stores these instructions, as well as other data used by the processor 204 and by other modules and components included in the vehicle safety system 104.
[0027] Additionally, the vehicle safety system 104 includes an image processing module 208 that receives image data from one or more camera systems 110. The vehicle safety system 104 may receive images associated with the interior of the vehicle (e.g., passengers in the vehicle) or with areas outside the vehicle (e.g., people or objects located near the exterior of the vehicle). Image data may include one or more still images, a series of still images captured over a period of time, or a video stream, such as a live video stream or a recorded video stream. As discussed herein, the image processing module 208 identifies or analyzes people or objects in the image data and may determine a person's emotional state or stress level. The image processing module 208 may also transmit image data (e.g., a live video stream) to a remote user via a communication manager 202. For example, the image processing module 208 may transmit live video stream data showing a child passenger in the vehicle to the child passenger's parents. In some embodiments, the image processing module 208 includes an image management algorithm or process that performs one or more functions, such as those discussed herein.
[0028] The vehicle safety system 104 also includes a route selection module 210, which can automatically identify one or more routes to a specific destination. Additionally, the route selection module 210 allows a user (such as a parent of a child passenger) to define a specific route for the autonomous vehicle to follow as it travels to the destination. For example, if a child is traveling alone in the autonomous vehicle, the child's parents can choose a route along main roads, avoiding highways and potentially dangerous areas in towns. A key manager 212 handles the creation, distribution, and verification of one or more keys. As discussed herein, keys are used to control access to the autonomous vehicle (e.g., controlling who can access the autonomous vehicle at the destination to take over a child traveling in the vehicle). In some embodiments, the key manager 212 can generate a key for a specific autonomous vehicle transport activity, transmit that key to the person designated to take over the child at the destination, and verify that the person at the destination has the correct key before unlocking the doors of the autonomous vehicle upon arrival at the destination. As discussed herein, a key represents any type of digital or cryptographic key used to secure access to the autonomous vehicle. For example, keys can include public and private key pairs.
[0029] When following the selected route to the destination, the navigation manager 214 assists the autonomous vehicle. In some cases, due to road closures, road construction, or traffic accidents, the autonomous vehicle must change its route. In these situations, the navigation manager 214 can assist in rerouting the autonomous vehicle and, if necessary, can assist in communicating with the parents of child passengers to confirm alternative route recommendations.
[0030] The vehicle safety system 104 also includes a passenger vital signs manager 216 that monitors one or more vital signs of the passenger (e.g., a child passenger) discussed herein. In some embodiments, the passenger vital signs manager 216 monitors vital signs such as heart rate, respiratory rate, etc. For example, a heart rate sensor in the seat or seatbelt may detect heart rate alone or in combination with image data from one or more cameras. Additionally, the image data may be used to analyze the passenger's breathing and level of consciousness (e.g., whether the passenger is crying, screaming, or unconscious). Moreover, the passenger vital signs manager 216 may monitor the passenger's stress level, emotional state, etc. For example, the passenger's stress level, emotional state, etc., may be estimated based on heart rate, breathing, level of consciousness, etc.
[0031] The lock manager 218 controls the locking and unlocking of doors, trunk, hatches, and other vehicle entry points associated with the autonomous vehicle. For example, when the autonomous vehicle arrives at its destination with a child passenger, the lock manager 218 may keep the doors locked until specifically instructed to unlock by the key manager 212 or another vehicle system or component. The alarm generator 220 generates one or more alarms based on specific circumstances associated with the autonomous vehicle and its surroundings. For example, if the autonomous vehicle carrying a child needs to change its route or experiences a significant delay, an alarm may be generated and sent to the parents. Additionally, if the autonomous vehicle arrives at its destination but no one with the appropriate key is present at the destination, the alarm generator 220 may generate an alarm. In some embodiments, if it is determined that the child passenger is distressed or anxious, the alarm generator 220 generates an alarm for the parents.
[0032] Vehicle access module 222 determines when a person (e.g., a passenger or someone picking up passengers at the destination) may access the autonomous vehicle. In some embodiments, vehicle access module 222 may prevent access to the autonomous vehicle while it is traveling with a child passenger. After the autonomous vehicle arrives at the desired destination and the correct key is verified, vehicle access module 222 may allow a person with the key to access the autonomous vehicle by instructing lock manager 218 to unlock one or more doors of the autonomous vehicle.
[0033] Figure 3 An embodiment of a vehicle 300 is shown, which has multiple cameras and other sensors to monitor the interior and exterior of the vehicle. In some embodiments, the vehicle 300 can operate as an autonomous vehicle and perform at least a portion of the functions and operations discussed herein. Figure 3 As shown, vehicle 300 has two interior cameras 302 and 306 and two interior sensors 304 and 308. In some embodiments, cameras 302 and 306 are positioned and oriented within vehicle 300 such that a passenger's seating position is within the field of view of at least one camera 302 or 306. Other areas inside vehicle 300 may also be within the field of view of one or more cameras 302 or 306. Sensors 304 and 308 represent any type of sensor associated with, for example, radar system 106, lidar system 108, ultrasonic system 114, etc. In some embodiments, data captured by sensors 304 and 308 is combined with data captured by cameras 302 and 306 to identify passengers in vehicle 300 and the emotional state of the identified passengers. Although Figure 3 Two internal cameras 302 and 306 are shown, but in alternative embodiments, vehicle 300 may have any number of internal cameras located at various locations throughout the vehicle and pointed at different angles. Similarly, although Figure 3Two internal sensors 304 and 308 are shown, but in alternative embodiments, vehicle 300 may have any number of internal sensors located at various locations throughout the vehicle.
[0034] The vehicle 300 also includes two external cameras 310 and 312, which are positioned and oriented such that an area outside the vehicle but close to the vehicle is within the field of view of at least one camera 310, 312. Although not in Figure 3 As shown in the figure, but in some embodiments, vehicle 300 also includes one or more external sensors, such as sensors associated with radar system 106, lidar system 108, ultrasonic system 114, etc.
[0035] Figures 4A to 4B An embodiment of a method 400 for providing safe transportation of a child to a destination in an autonomous vehicle is illustrated. First, an adult user initiates a trip 402 in the autonomous vehicle for the child passenger. For example, the adult user may initiate the trip 402 by interacting with the autonomous vehicle or a dispatch service associated with a fleet of autonomous vehicles using a smartphone application or otherwise. Method 400 continues as the safety system in the autonomous vehicle receives the starting location and destination 404 from the user. In some embodiments, the starting location is the user's current location. The starting location and destination can be transmitted to the safety system via a user-operated smartphone application or any other user interface that allows the user to identify the starting location and destination.
[0036] The safety system in the autonomous vehicle also receives a specific route from the user. For example, when the autonomous vehicle is heading towards its destination, the user can specify a particular road to follow (or a specific area to avoid). In some embodiments, the user may prefer the autonomous vehicle to follow main roads, avoid highways, and avoid certain parts of towns or certain geographic areas. In a particular implementation, the user can specify a specific route by drawing it on a map or graphically highlighting the specific road to the destination to be followed.
[0037] The security system also receives a 408 key from the user (e.g., the user's smartphone application). As discussed herein, this key is used to unlock the autonomous vehicle at the destination if a suitable person possesses it. In some embodiments, the key is provided by a key manager 212 ( Figure 2The key is generated. In a particular embodiment, the key is associated with a specific trip (or route) of the autonomous vehicle. For example, the key is used to verify the person picking up a child from the autonomous vehicle at the destination. The key is deleted after the trip is completed. A new key is generated for each future trip initiated by the user. The key is also transmitted to a second user who is designated to meet the autonomous vehicle at the destination and pick up (e.g., take over) the child passenger at the destination. In some embodiments, the key is transmitted to a smartphone or other device controlled by the second user.
[0038] In some embodiments, any type of computing device can be used to initiate a 402 trip. When initiating a 402 trip, an adult user can upload a photo of their face as well as a photo of the face of the person who will meet the autonomous vehicle at the destination. Biometric identities can be created to authenticate the person who will meet the autonomous vehicle at the destination.
[0039] The autonomous vehicle then proceeds to destination 412. Upon arrival at the destination, the security system confirms 414 that the second user is present and verifies the key. For example, the security system confirms 414 that the second user has a smartphone or other device containing the appropriate key. If the key is verified 416, the security system unlocks 418 the autonomous vehicle door, allowing the child passenger to exit the vehicle. In some embodiments, after the autonomous vehicle is unlocked and the child passenger has exited, the security system deletes or deactivates the key. In alternative embodiments, the security system may confirm the second user's presence at the destination based on detecting a phone number associated with the second user's mobile device or by requiring the second user to provide a specific code pre-approved by the adult user initiating the trip. In other embodiments, the security system confirms the second user based on facial recognition performed by the security system (e.g., facial biometric identification) or facial recognition performed by the adult user initiating the trip.
[0040] In some embodiments, in addition to unlocking the doors of the 418 autonomous vehicle, the safety system also unlocks (or releases) the “smart” seatbelts restraining child passengers. The smart seatbelts can be unlocked or released by a remote computing system such as the vehicle control system 100.
[0041] If the key is not verified 416, the security system cannot confirm the presence of a second user to take over the child passenger. In this case, the security system captures 420 images and / or a live video stream of the area near the autonomous vehicle at the destination. The images and / or live video stream may include the interior of the autonomous vehicle and / or the exterior area near the vehicle. The images and / or live video stream are transmitted 422 to the adult user who initiated the trip. The images and / or live video stream allow the adult user who initiated the trip to analyze the situation inside and outside the autonomous vehicle at the destination. If the adult user who initiated the trip sees the second user at the destination, they can allow the doors of the autonomous vehicle to unlock. However, if the adult user who initiated the trip does not see the second user at the destination, they can instruct the autonomous vehicle to return to the starting position or travel to a different location.
[0042] In this scenario, the safety system requests instruction 424 from the adult user who initiated the trip. As described above, the safety system may request instructions including unlocking the doors to return the autonomous vehicle to its starting position, or instructing the autonomous vehicle to travel to a different location. Based on the received instruction 426, the safety system may unlock the autonomous vehicle doors 428, instruct the autonomous vehicle to travel 430 back to the starting position, or instruct the autonomous vehicle to travel 432 to a different location specified by the adult user who initiated the trip. In some embodiments, the different location specified by the adult user who initiated the trip may include different drop-off locations, police stations, schools, etc. In certain implementations, the safety system may generate a new key associated with traveling back to the starting position or with the route to the different location. In these implementations, the new key is transmitted to the person authorized to take over the child passenger at the starting position or the different location.
[0043] like Figures 4A to 4B If the key is not verified at 416, the security system captures images and / or real-time video streams of the area near the autonomous vehicle at 420. In an alternative embodiment, the security system captures images and / or real-time video streams of the area near the autonomous vehicle even if the key is verified at 416. Furthermore, the image and / or real-time video data is transmitted at 422 to the adult user who initiated the trip, allowing the adult user to analyze the situation at the destination (e.g., activities taking place near the autonomous vehicle) before approving the security system to unlock the autonomous vehicle's doors. If the adult user who initiated the trip is dissatisfied with the situation at the destination, they can instruct the autonomous vehicle to return to the starting position or travel to a different location, as discussed above regarding 420 to 432.
[0044] Figure 5 This is a block diagram illustrating embodiment 500 of verifying a user picking up a child in an autonomous vehicle at a destination. Figure 5The example illustrates an autonomous vehicle 502 after arriving at a destination, such as a destination identified by an adult user who initiated the trip in the autonomous vehicle 502 for a child passenger. As discussed herein, the autonomous vehicle 502 includes a vehicle control system 100 (which includes a vehicle safety system 104). A user 504 arrives at the destination and is operating a mobile device 506, such as a smartphone, tablet, or other computing system. The mobile device 506 communicates with the vehicle control system 100 via a data communication network 508 or a communication link 510. In some embodiments, the data communication network 508 includes a cellular communication network, the Internet, or any combination of two or more communication networks. The communication link 510 includes communication protocols such as... Any type of communication link, such as WiFi, DSRC (Dedicated Short Range Communication), etc. In some embodiments, the mobile device 506 communicates with the vehicle control system 100 via communication link 510 using TCP / IP (Transmission Control Protocol / Internet Protocol). For example, TCP can create message packets that are transmitted over IP.
[0045] As discussed herein, if user 504 wishes to pick up a child passenger (as determined by the adult user initiating the trip), user 504 should have already received the appropriate key when the trip is initiated. For example, user 504 could use an application or other key management system or program running on mobile device 506 to receive the key on their mobile device 506. When autonomous vehicle 502 arrives at its destination, vehicle safety system 104 in vehicle control system 100 may attempt to communicate with mobile device 506 and verify that mobile device 506 contains the appropriate key for the specific trip associated with the child passenger. If mobile device 506 contains the appropriate key, vehicle safety system 104 unlocks the doors of autonomous vehicle 502, allowing user 504 to take over the child passenger. However, if mobile device 506 does not contain the appropriate key, vehicle safety system 104 keeps the doors of autonomous vehicle 502 locked to protect the child passenger. For example, when the vehicle arrives at its destination, vehicle control system 100 will send an alarm to mobile device 506 operated by user 504. Mobile device 506 then attempts to provide authentication signals or communication. The authentication can be a cloud-based authentication process (in which both the vehicle control system 100 and the mobile device 506 communicate with a cloud-based server) or the mobile device 506 can directly transmit the key to the vehicle control system 100.
[0046] exist Figure 5In the example, another person 512 is located near the rear of the autonomous vehicle 502. In some embodiments, one or more vehicle cameras or other sensors can detect the person and transmit images (still image data or video data) to the user initiating the trip. The user can review the images and determine whether to unlock the doors of the autonomous vehicle 502. For example, if the person 512 appears to be hiding behind the autonomous vehicle 502, or if the user initiating the trip is concerned about the person 512, the user initiating the trip can instruct the autonomous vehicle 502 to keep the doors locked and drive to a different location (e.g., an alternative drop-off point or return to the starting position). If the user initiating the trip knows the person 512 or is not concerned about the person 512's presence, they can instruct the autonomous vehicle 502 to unlock the doors and allow child passengers to exit the autonomous vehicle 502.
[0047] Figure 6 An embodiment of a method 600 for controlling children's access to autonomous vehicles is illustrated. For example, method 600 may be suitable for transporting older children, such as those aged 14 to 18. First, an adult user identifies parameters associated with approved transport of a child who may be traveling alone in the autonomous vehicle, 602. Exemplary parameters include the time of day, weekday, approved pick-up location, approved drop-off location, etc. Some parameters may include multiple factors, such as the approved pick-up time from school between 3:00 PM and 4:00 PM, Monday through Friday. The identified parameters are stored 604 by a security system in the autonomous vehicle. In some embodiments, the identified parameters may be stored in a database, a remote server, a remote storage system, or other storage mechanism accessible to one or more users and one or more autonomous vehicles. These parameters may be accessed by the autonomous vehicle that will transport the child in the future. In certain embodiments, the adult user identifies the parameters using a smartphone application, accessing a website, etc. In some embodiments, any modification to the parameters is restricted to the adult who identified the parameters or another person authorized by that adult.
[0048] As the safety system receives a transportation request at 606 from a child (e.g., a child of an adult user whose approved transportation parameters have been identified), method 600 continues. The safety system accesses 608 the parameters associated with the child and determines 610 whether the child's transportation request was previously approved based on the accessed parameters. If the child's transportation request was previously approved based on the accessed parameters, the autonomous vehicle proceeds to 612 the requested destination. However, if the child's transportation request was not previously approved (e.g., the transportation request does not meet existing parameters), the safety system contacts 614 the adult user who identified the parameters and requests approval for the child's transportation request. In alternative embodiments, 614 may contact other adult users to approve the child's transportation request. In some examples, the request to approve the child's transportation request may be a message or alert delivered to the adult user indicating the name of the child requesting transportation, the requested pick-up location, and the requested drop-off location. The adult user approves the request, disapproves the request, or modifies the request (e.g., approves the pick-up location but provides a different drop-off location).
[0049] If the adult user approves the request (616), the autonomous vehicle proceeds to the requested destination (612) (or an alternative destination provided by the adult user). However, if the adult user does not approve the request, the safety system rejects the child's transportation request (618) and provides alternative transportation options. Alternative transportation options may include, for example, alternative pick-up and / or drop-off locations provided by the adult user. Furthermore, alternative transportation options may include previously approved pick-up and / or drop-off locations based on the current weekday, time of day, etc. In some embodiments, when transporting a child based on an approved transportation request, the autonomous vehicle is prevented from making additional stops, such as allowing the child to leave the vehicle at an unapproved location. Additionally, when transporting a child based on an approved transportation request, the autonomous vehicle may be prevented from allowing other passengers to enter the vehicle. These restrictions can be overturned individually by the adult user.
[0050] In some embodiments, a child passenger may be required to approve unlocking the autonomous vehicle's doors at the destination. For example, the child passenger may confirm that the autonomous vehicle is at the correct destination and that the child feels safe leaving the vehicle. If confirmed, the child passenger approves unlocking the autonomous vehicle's doors by activating an appropriate button, voice command, etc. If the child passenger feels unsafe leaving the autonomous vehicle, the child may request a different destination, or the vehicle's safety system may contact an adult user to receive additional instructions.
[0051] Figure 7An embodiment of a method 700 for monitoring children riding in an autonomous vehicle and detecting potential problems in the child is shown. First, an adult user initiates a trip 702 in the autonomous vehicle for the child passenger. The safety system in the autonomous vehicle receives 704 the starting location, destination, and desired route (from the starting location to the destination) from the adult user. The autonomous vehicle begins traveling along the desired route towards the destination 706. While the autonomous vehicle is traveling towards the destination, the safety system monitors 708 the child's vital signs, emotional state, and other characteristics to detect problems such as high stress levels, illness, physical condition, etc.
[0052] If a problem is detected 710, the safety system sends a notification 712 about the problem to the adult user (e.g., via text message, telephone, alert sent to a mobile device application, etc.). This notification may include the autonomous vehicle's location, details of the detected problem, and images (still image data or live video stream) showing the child passenger's face and body. Additionally, the safety system may initiate a 714 audio or video chat session between the child and the adult user. This audio or video chat session allows the child to talk to the adult user and describe their feelings. For example, if the child has high stress levels, the adult user can calmly talk to the child to determine the cause of the stress and try to calm the child down. After initiating the 714 chat session, the safety system requests 716 instructions from the adult user regarding whether the autonomous vehicle should continue to its destination. In some embodiments, the adult user may provide instructions to the safety system, such as continuing to the destination, returning to the starting point, or driving to a different location (e.g., a police station, hospital, school, etc.). Based on the instructions from the adult user, the safety system instructs 718 the autonomous vehicle to continue to the destination, return to the starting point, or drive to a different location.
[0053] Although various embodiments of this disclosure have been described herein, it should be understood that these embodiments are presented by way of example only and not by way of limitation. Those skilled in the art will understand that various changes in form and detail can be made without departing from the spirit and scope of this disclosure. Therefore, the breadth and scope of this disclosure should not be limited to any of the exemplary embodiments described, but should be defined only by the appended claims and their equivalents. This description is presented for purposes of illustration and description. It is not intended to be exhaustive or to limit this disclosure to the precise forms disclosed. Many modifications and variations are possible in light of the teachings disclosed. Furthermore, it should be noted that any or all of the alternative implementations discussed herein may be used in any desired combination to form additional hybrid implementations of this disclosure.
Claims
1. A method for safely transporting passengers using an autonomous vehicle, comprising: When transporting passengers, the vehicle safety system receives the destination and the driving route to the destination from the first user for the autonomous vehicle to follow; The vehicle safety system identifies the key associated with the driving route; The key is transmitted to the user designated to meet the autonomous vehicle at the destination. Monitor at least one of the passenger's vital signs or the passenger's emotional state, generate an alert indicating the problem associated with the passenger based on the detected problem regarding the passenger's vital signs or emotional state, and transmit the alert to the first user; The vehicle safety system confirms that the user designated to meet the autonomous vehicle possesses the key; as well as In response to confirmation that the user designated to meet the autonomous vehicle possesses the key and is present at the destination, the doors of the autonomous vehicle are unlocked at the destination to allow the user designated to meet the autonomous vehicle to take over the passenger.
2. The method of claim 1, further comprising: The seatbelt of the passenger is unlocked in response to confirmation that the user designated to meet the autonomous vehicle possesses the key and is present at the destination.
3. The method of claim 1, wherein the autonomous vehicle follows a received driving route to the destination.
4. The method of claim 1, further comprising: Capture images or real-time video of the interior of the autonomous vehicle; as well as The captured images or live video are transmitted to the first user.
5. The method of claim 4, further comprising: After transmitting the captured images or live video to the first user, the system receives an instruction from the first user indicating whether to unlock the doors of the autonomous vehicle at the destination.
6. The method of claim 4, further comprising: After transmitting the captured images or real-time video to the first user, instructions are received from the first user, including one of the following: an instruction to unlock the doors of the autonomous vehicle, an instruction to return the autonomous vehicle to the starting position of the driving route, and an instruction to drive the autonomous vehicle to a different position.
7. The method of claim 1, further comprising: Capture images or real-time video of the area near and outside the autonomous vehicle; as well as The captured images or live video are transmitted to the first user.
8. The method of claim 7, further comprising: After transmitting the captured images or live video to the first user, the system receives an instruction from the first user indicating whether to unlock the doors of the autonomous vehicle at the destination.
9. The method of claim 7, further comprising: After transmitting the captured images or real-time video to the first user, instructions are received from the first user, including one of the following: an instruction to unlock the doors of the autonomous vehicle, an instruction to return the autonomous vehicle to the starting position of the driving route, and an instruction to drive the autonomous vehicle to a different position.
10. The method of claim 1, further comprising initiating an audio chat session or a video chat session between the passenger and the first user, and after initiating the audio chat session or video chat session, requesting instructions from the first user, and instructing the autonomous vehicle to continue to the destination, return to the starting position, or travel to a different position based on the instructions from the first user.
11. A vehicle safety system comprising: A communication manager configured to receive the destination from an adult user and a driving route to the destination for an autonomous vehicle carrying child passengers to follow; A key manager configured to identify a key associated with the driving route, wherein the communication manager is further configured to transmit the key to a user designated to meet the autonomous vehicle at the destination, and wherein the key manager is further configured to confirm that the user designated to meet the autonomous vehicle at the destination possesses the key and is present at the destination. A passenger vital signs manager, configured to monitor at least one of a passenger's vital signs or a passenger's emotional state; An alarm generator is configured to generate an alarm indicating a problem associated with the passenger based on the detection of a problem concerning the passenger's vital signs or emotional state, and to transmit the alarm to a first user; and A vehicle lock manager is configured to unlock the doors of the autonomous vehicle in response to the key manager confirming that the user designated to meet the autonomous vehicle at the destination possesses the key and is present at the destination, so as to allow the user designated to meet the autonomous vehicle to take over the child passenger.
12. The vehicle safety system of claim 11, further comprising an image processing module, the image processing module being configured to: Capture images or real-time video of the interior of the autonomous vehicle; and The captured images or live video are transmitted to the adult user.
13. The vehicle safety system of claim 12, wherein after the adult user receives the captured image or live video, the communication manager further receives from the adult user an instruction indicating whether to unlock the doors of the autonomous vehicle at the destination.
Citation Information
Patent Citations
Vehicle cargo anti-theft method and apparatus
CN106375450A
Remote control of associated vehicle devices
US20140309891A1
In-vehicle authorization for autonomous vehicles
US20160301698A1
Arbitration of passenger pickup and drop-off and vehicle routing in an autonomous vehicle based transportation system
US20170213308A1
Unlock and authentication for autonomous vehicles
US9194168B1