Determining drop-off or pick-up locations for vehicle passengers

JP2024505379A5Active Publication Date: 2024-11-15QUALCOMM INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023541070
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-01-12
Filing Date
2021-12-07
Publication Date
2024-11-15
Estimated Expiration
2041-12-07

AI Technical Summary

Technical Problem

Autonomous vehicles face challenges in determining safe and convenient drop-off or pick-up locations due to obstacles and hazardous conditions, which can impede passengers' ability to enter or exit the vehicle safely and comfortably.

Method used

The system uses processors to detect obstructions or hazardous conditions and determines alternative drop-off or pick-up locations based on passenger seating positions, physical limitations, and passenger input, adjusting the location to ensure safe and convenient entry or exit.

Benefits of technology

Ensures passengers are not obstructed or inconvenienced by obstacles or hazardous conditions, allowing for safer and more convenient loading and unloading by dynamically determining drop-off or pick-up locations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The present disclosure provides systems, methods, and apparatus for controlling operation of a vehicle configured for passenger service. In some implementations, a vehicle controller includes one or more processors communicatively coupled to a memory, the one or more processors configured to determine an expected entry or exit point for a passenger of the vehicle. The one or more processors can be configured to detect whether an obstacle or hazardous condition exists at or near the site. In response to detecting that an obstacle or hazardous condition exists at or near the site, the one or more processors can be configured to determine a drop-off or pickup location associated with the site based at least in part on a location of the expected entry or exit point for a passenger of the vehicle and the detected obstacle or hazardous condition.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This patent application claims priority to U.S. Patent Application No. 17 / 146,725, entitled "DETERMINING DROP-OFF OR PICK-UP LOCATIONS FOR PASSENGERS OF VEHICLES," filed on January 12, 2021, which is assigned to the assignee of this patent application. The disclosures of all prior applications are considered part of, and are incorporated by reference into, this patent application.

[0002]

[0002] The present disclosure relates generally to vehicles configured for passenger service, and more particularly to determining drop-off or pick-up locations for passengers of the vehicle. [Background technology]

[0003]

[0003] Autonomous vehicles (AVs) and semi-autonomous vehicles can operate in a substantially autonomous mode, in which the vehicle navigates an environment with little or no input from a human driver. Autonomous vehicles can also be dispatched to pick up and / or drop off passengers at various drop-off or pick-up locations, which typically include designated parking areas for parking, for picking up passengers, and for dropping off passengers.

[0004]

[0004] When a vehicle, such as an autonomous vehicle, stops or parks at a location for passenger drop-off and / or pickup, obstacles and hazardous conditions at or near the drop-off or pickup location may prevent passengers from being able to enter and / or exit the vehicle. Thus, while a conventional autonomous vehicle may be capable of autonomously driving to a designated passenger drop-off and / or pickup location, it may not be possible to determine, for example, exactly where to park such that nearby obstacles or hazardous conditions do not prevent or otherwise affect passengers' ability to safely and comfortably enter and / or exit the autonomous vehicle. Summary of the Invention

[0005]

[0005] The systems, methods, and devices of the present disclosure can be used by a vehicle configured for passenger service to determine a drop-off and / or pick-up location for a passenger. In various implementations, an apparatus associated with the vehicle includes a memory communicatively coupled to one or more processors. In some implementations, the one or more processors can be configured to determine an expected entry or exit point for a passenger of the vehicle. The one or more processors can be configured to detect whether an obstacle or hazardous condition exists at or near the site. In response to detecting that an obstacle or hazardous condition exists at or near the site, the one or more processors can be configured to determine a drop-off or pick-up location associated with the site based at least in part on a position of the expected entry or exit point for a passenger of the vehicle and the detected obstacle or hazardous condition.

[0006]

[0006] In various implementations, the detected obstacle or hazardous condition may include puddles, ice, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, less than a certain amount of room in front of or behind the vehicle, or any combination thereof.

[0007]

[0007] In some implementations, determining the drop-off or pick-up location can be based on the seating position of the passenger. In some cases, the drop-off or pick-up location can be determined based on whether the expected entry or exit point for the passenger of the vehicle and the detected obstacle or hazardous condition are on the same side of the vehicle. In some aspects, the various alternate drop-off or pick-up locations can be based on map data, coherent light sensing system data (e.g., LIDAR sensor data), images of the surrounding area, videos of the surrounding area, RADAR, passenger input, or any combination thereof. In other aspects, the alternate drop-off or pick-up location can be determined from different alternate drop-off or pick-up locations within a distance from the determined drop-off or pick-up location.

[0008] In some implementations, the determination of the alternate drop-off or pick-up location may be based at least in part on a physical limitation of the passenger, an age of the passenger, the presence of infants or children with the passenger, or any combination thereof. In other implementations, the determination of the alternate drop-off or pick-up location may be based on one or more preferred drop-off or pick-up locations.

[0009] In one implementation, the one or more processors can be configured to receive an indication of a passenger's willingness to ignore the detected obstacle or unsafe condition. The one or more processors can be configured to maintain the determined drop-off or pick-up location in response to receiving the indication of the passenger's willingness to ignore the detected obstacle or unsafe condition.

[0010] In some implementations, the one or more processors may be configured to determine a seating location of the passenger in the vehicle. The one or more processors may be configured to determine one or more alternate drop-off locations based on the seating location of the passenger relative to an expected entry or exit point for the passenger in the vehicle. In some cases, the one or more processors may be configured to determine an alternate drop-off location for the passenger based at least in part on determining that the seating location of the passenger and the expected entry or exit point are on the same side of the vehicle.

[0011]

[0011] In various implementations, a method for controlling one or more operations of a vehicle is disclosed. In some implementations, the method can be performed by an apparatus. In some aspects, the apparatus can be a vehicle controller associated with the vehicle. In other aspects, the apparatus can be a vehicle (or at least a portion of a vehicle). In one implementation, the method includes determining an expected entry or exit point for a passenger of the vehicle. The method includes detecting whether an obstacle or hazardous condition exists at or near the site. The method includes, in response to detecting that an obstacle or hazardous condition exists at or near the site, determining a drop-off or pickup location associated with the site based at least in part on a location of the expected entry or exit point for a passenger of the vehicle and the detected obstacle or hazardous condition.

[0012]

[0012] In various implementations, the detected obstacle or hazardous condition may include puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, less than a certain amount of clearance in front of or behind the vehicle, or any combination thereof.

[0013]

[0013] In some implementations, determining the drop-off or pick-up location can be based on the seating position of the passenger. In some cases, the drop-off or pick-up location can be determined based on whether the expected entry or exit point for the passenger of the vehicle and the detected obstacle or hazardous condition are on the same side of the vehicle. In some aspects, the various alternative drop-off or pick-up locations can be based on map data, coherent optical sensing system data (e.g., LIDAR sensor data), images of the surrounding area, videos of the surrounding area, RADAR, passenger input, or any combination thereof. In other aspects, the alternative drop-off or pick-up location can be determined from a plurality of different alternative drop-off or pick-up locations within a distance from the determined drop-off or pick-up location.

[0014] In some implementations, the determination of the alternate drop-off or boarding location may be based at least in part on the passenger's physical limitations, the passenger's age, the presence of an infant or child with the passenger, or any combination thereof. In other implementations, the determination of the alternate drop-off or boarding location may be based on one or more preferred drop-off or boarding locations.

[0015] In one implementation, the method can also include receiving an indication of the passenger's willingness to ignore the detected obstacle or unsafe condition. The method can also include maintaining the determined drop-off or pick-up location in response to receiving the indication of the passenger's willingness to ignore the detected obstacle or unsafe condition.

[0016]

[0016] In various implementations, the method may also include determining a seating location of the passenger in the vehicle. The method may also include determining one or more alternate drop-off locations based on the seating location of the passenger relative to an expected entry or exit point for the passenger in the vehicle. In some cases, the method may also include determining an alternate drop-off location for the passenger based at least in part on determining that the seating location of the passenger and the expected entry or exit point are on the same side of the vehicle.

[0017]

[0017] In various implementations, a system is disclosed. In some implementations, the system can include means for determining an expected entry or exit point for a passenger of the vehicle. The system can include means for detecting whether an obstacle or hazardous condition exists at or near the site. The system can include means for determining, in response to detecting that an obstacle or hazardous condition exists at or near the site, a location of an expected entry or exit point for a passenger of the vehicle and a drop-off or pickup location associated with the site based at least in part on the detected obstacle or hazardous condition.

[0018]

[0018] In various implementations, the detected obstacle or hazardous condition may include puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, less than a certain amount of clearance in front of or behind the vehicle, or any combination thereof.

[0019] In some implementations, determining the drop-off or pick-up location can be based on the seating position of the passenger. In some cases, the drop-off or pick-up location can be determined based on whether the expected entry or exit point for the passenger of the vehicle and the detected obstacle or hazardous condition are on the same side of the vehicle. In some aspects, the various alternative drop-off or pick-up locations can be based on map data, coherent optical sensing system data (e.g., LIDAR sensor data), images of the surrounding area, videos of the surrounding area, RADAR, passenger input, or any combination thereof. In other aspects, the alternative drop-off or pick-up location can be determined from a plurality of different alternative drop-off or pick-up locations within a distance from the determined drop-off or pick-up location.

[0020] In some implementations, the determination of the alternate drop-off or boarding location may be based at least in part on the passenger's physical limitations, the passenger's age, the presence of an infant or child with the passenger, or any combination thereof. In other implementations, the determination of the alternate drop-off or boarding location may be based on one or more preferred drop-off or boarding locations.

[0021] In one implementation, the system can also include means for receiving an indication of the passenger's willingness to ignore the detected obstacle or unsafe condition. The system can also include means for maintaining the determined drop-off or pick-up location in response to receiving the indication of the passenger's willingness to ignore the detected obstacle or unsafe condition.

[0022]

[0022] In various implementations, the system may also include means for determining a seating location of the passenger in the vehicle. The system may also include means for determining one or more alternate drop-off locations based on the seating location of the passenger relative to an expected entry or exit point for the passenger of the vehicle. In some cases, the system may also include means for determining an alternate drop-off location for the passenger based at least in part on determining that the seating location of the passenger and the expected entry or exit point are on the same side of the vehicle.

[0023]

[0023] In various implementations, a non-transitory computer-readable medium storing instructions for controlling a vehicle is disclosed. In some implementations, execution of the instructions by one or more processors of the device causes the vehicle to perform an operation. In one implementation, the operation can include determining an expected entry or exit point for a passenger of the vehicle. The operation can include detecting whether an obstacle or hazardous condition exists at or near the site. The operation can include, in response to detecting that an obstacle or hazardous condition exists at or near the site, determining a drop-off or pick-up location associated with the site based at least in part on a location of an expected entry or exit point for a passenger of the vehicle and the detected obstacle or hazardous condition. In some aspects, the device can be a vehicle controller associated with the vehicle. In other aspects, the device can be a vehicle (or at least a portion of a vehicle).

[0024]

[0024] In various implementations, the detected obstacle or hazardous condition may include puddles, ice, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, less than a certain amount of clearance in front of or behind the vehicle, or any combination thereof.

[0025]

[0025] In some implementations, determining the drop-off or pick-up location can be based on the seating position of the passenger. In some cases, the drop-off or pick-up location can be determined based on whether the expected entry or exit point for the passenger of the vehicle and the detected obstacle or hazardous condition are on the same side of the vehicle. In some aspects, the various alternative drop-off or pick-up locations can be based on map data, coherent optical sensing system data (e.g., LIDAR sensor data), images of the surrounding area, videos of the surrounding area, RADAR, passenger input, or any combination thereof. In other aspects, the alternative drop-off or pick-up location can be determined from a plurality of different alternative drop-off or pick-up locations within a distance from the determined drop-off or pick-up location.

[0026] In some implementations, the determination of the alternate drop-off or boarding location may be based at least in part on the passenger's physical limitations, the passenger's age, the presence of an infant or child with the passenger, or any combination thereof. In other implementations, the determination of the alternate drop-off or boarding location may be based on one or more preferred drop-off or boarding locations.

[0027] In one implementation, the action can include receiving an indication of the passenger's willingness to ignore the detected obstacle or unsafe condition. The action can include maintaining the determined drop-off or pick-up location in response to receiving the indication of the passenger's willingness to ignore the detected obstacle or unsafe condition.

[0028]

[0028] In various implementations, the operations can include determining a seating location of the passenger in the vehicle. The operations can include determining one or more alternate drop-off locations based on the seating location of the passenger relative to an expected entry or exit point for the passenger in the vehicle. In some cases, the operations can also include determining an alternate drop-off location for the passenger based at least in part on determining that the seating location of the passenger and the expected entry or exit point are on the same side of the vehicle.

[0029]

[0029] Details of one or more implementations of the subject matter described in this disclosure are set forth in the accompanying drawings and the following description. Other features, aspects, and advantages will become apparent from the description, drawings, and claims. Please note that the relative dimensions of the following figures may not be drawn to scale. [Brief description of the drawings]

[0030] [Figure 1]

[0030] Diagram of an exemplary system. [Diagram 2]

[0031] FIG. 2 is a functional block diagram of the example system of FIG. 1. [Diagram 3]

[0032] FIG. 1 is a block diagram of an autonomous vehicle in accordance with certain aspects of the present disclosure. [Figure 4A]

[0033] An illustration showing a vehicle modifying a drop-off or pick-up location in some implementations. [Figure 4B] An illustration showing a vehicle modifying a drop-off or pick-up location in some implementations. [Figure 4C] An illustration showing a vehicle modifying a drop-off or pick-up location in some implementations. [Figure 5A]

[0034] An illustration showing a vehicle modifying a drop-off or pick-up location according to some other implementations. [Figure 5B] An illustration showing a vehicle modifying a drop-off or pick-up location according to some other implementations. [Figure 5C] An illustration showing a vehicle modifying a drop-off or pick-up location according to some other implementations. [Figure 6A]

[0035] 1 is a flowchart illustrating example operations for determining a passenger drop-off or pick-up location according to some implementations. [Figure 6B]

[0036] 11 is a flow chart illustrating example operations for determining a passenger drop-off or pick-up location according to another implementation. [Figure 7A]

[0037] 1 is a flowchart illustrating example operations for determining a passenger drop-off or pick-up location according to some implementations. [Figure 7B]

[0038] 1 is a flowchart illustrating example operations for determining a passenger drop-off or pick-up location according to some implementations. [Figure 8A]

[0039] 1 is a flowchart illustrating example operations for determining an alternate drop-off location according to some implementations. [Figure 8B]

[0040] 11 is a flowchart illustrating example operations for determining one of the alternative drop-off locations according to some implementations. [Figure 9]

[0041] 11 is a flow chart illustrating example operations for determining a passenger drop-off or pick-up location according to another implementation. [Figure 10]

[0042] 6 is a flowchart illustrating example operations for determining a location of an obstacle or hazardous condition, according to some implementations. [Figure 11]

[0043] 1 is a flowchart illustrating example operations for determining one or more alternative drop-off or pick-up locations according to some implementations. [Figure 12]

[0044] 11 is a flowchart illustrating example operations for determining one or more alternative drop-off or pick-up locations according to another implementation. [Figure 13]

[0045] 11 is a flow chart illustrating example operations for determining an alternative drop-off location according to another implementation. [Figure 14]

[0046] 4 is a flowchart illustrating example operations for determining a new passenger pickup location according to some implementations. [Figure 15]

[0047] 11 is a flowchart illustrating example operations for determining one or more alternative drop-off or pick-up locations according to some other implementations. [Figure 16]

[0048] 11 is a flowchart illustrating example operations for determining a passenger drop-off or pick-up location according to some other implementations. [Figure 17]

[0049] 5 is a flowchart illustrating example operations for receiving indications from a passenger, according to some implementations. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0031]

[0050] Like reference numbers and designations in the various drawings indicate like elements.

[0032]

[0051] Aspects of the present disclosure are provided in the following description and associated drawings directed to various examples provided for illustrative purposes. Alternative aspects may be devised without departing from the scope of the present disclosure. Additionally, well-known elements of the present disclosure will not be described in detail or will be omitted so as not to obscure the relevant details of the present disclosure.

[0033]

[0052] Those skilled in the art will appreciate that the information and signals described hereinafter may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referred to throughout the following description may be represented by voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields or particles, or any combination thereof, depending in part on the particular application, in part on the desired design, in part on the corresponding technology, etc.

[0034]

[0053] Further, many aspects are described in terms of sequences of actions to be performed, for example, by elements of a computing device. It will be appreciated that the various actions described herein can be performed by specific circuitry (e.g., an application specific integrated circuit (ASIC)), by program instructions being executed by one or more processors, or by a combination of both. In addition, the sequences of actions described herein can be considered to be fully embodied in any form of non-transitory computer-readable storage medium having stored therein a corresponding set of computer instructions that, when executed, will cause or direct an associated processor of the device to perform the functionality described herein. Thus, various aspects of the present disclosure can be embodied in a number of different forms, all of which are contemplated to be within the scope of the claimed subject matter. In addition, with respect to each of the aspects described herein, the corresponding form of any such aspect may be described herein, for example, as "logic configured to" perform the described actions. Thus, although described herein with respect to autonomous or semi-autonomous vehicles (also known as self-driving cars or "SDC"), aspects of the disclosure may be implemented in other vehicles, such as, but not limited to, cars, trucks, motorcycles, buses, boats, helicopters, robots, unmanned aerial vehicles, recreational vehicles, amusement park vehicles, construction equipment, and golf carts.

[0035]

[0054] Vehicles can be configured to operate in an autonomous or semi-autonomous mode and navigate an environment with little or no input from a driver while in this mode. These autonomous and semi-autonomous vehicles typically include several sensors configured to determine information about the environment in which the vehicle operates. The sensors can include one or more light detection and ranging (LIDAR) devices that can detect objects in the environment (such as other vehicles, pedestrians, traffic lights, obstacles, etc.) and determine the distance between the autonomous vehicle and the objects. Autonomous and semi-autonomous vehicles can also include other types of sensors including, but not limited to, sonar devices, radar devices, cameras, and audio sensing devices. Data from the LIDAR and / or other types of sensors can be used to determine various characteristics and attributes of the detected objects (such as the object's position, size, shape, type, movement, orientation, etc.).

[0036]

[0055] Some autonomous vehicles can be used or configured for passenger and / or cargo services (e.g., delivery services). For example, a user can provide a pickup and / or drop-off location to a passenger ride dispatch service, which can communicate the passenger pickup and drop-off locations to the autonomous vehicle. A user can indicate or specify the drop-off and pick-up locations in a variety of ways, including, but not limited to, for example, by using the current location of the user's client device, by using a recent or saved location associated with the user's profile, or by entering an address or tapping a location on a map presented on the client device. The client device can send the drop-off and / or pick-up locations to the passenger ride dispatch service, which can then arrange for an autonomous vehicle to pick up the passenger and transport the passenger to the specified drop-off location.

[0037]

[0056] However, not all locations may be suitable, safe, or viable as passenger (or cargo) pick-up or drop-off locations. For example, obstacles and hazardous conditions, such as potholes, uneven pavement, construction fences, and other vehicles, may impede the ability of an autonomous vehicle to safely pick up and drop off passengers. According to some aspects of the present disclosure, systems, methods, and devices are disclosed that may enable an autonomous vehicle providing passenger (or cargo) services to selectively modify a scheduled drop-off or pick-up location based on the presence of an obstacle or hazardous condition at or near the scheduled drop-off or pick-up location, one or more conditions of the autonomous vehicle's passengers (and / or cargo), the relative positions of passengers being transported by the autonomous vehicle, or any combination thereof.

[0038]

[0057] Various implementations relate generally to a vehicle determining appropriate pick-up and / or drop-off locations for passengers. Some implementations relate more specifically to determining passenger pick-up and / or drop-off locations that are free of obstacles, dangerous conditions, and other conditions that may cause injury to the respective passengers, may prevent the respective passengers from being able to enter or exit the vehicle, or may otherwise inconvenience the respective passengers. In one exemplary implementation, a device such as, but not limited to, a vehicle controller may be used to assist or control a vehicle configured for passenger service. In some aspects, the device may determine an expected entry or exit point for a passenger of the vehicle. The device may detect whether an obstacle or dangerous condition exists at or near the site. In response to detecting that an obstacle or dangerous condition exists at or near the site, the device may determine a drop-off or pick-up location associated with the site based at least in part on the location of the expected entry or exit point for the passenger of the vehicle and the detected obstacle or dangerous condition.

[0039]

[0058] In some implementations, the device can detect obstacles and hazardous conditions within an area or zone of an identified drop-off or pick-up location. In some cases, the area or zone of an identified drop-off or pick-up location can include the portion of the surrounding environment that is within a particular distance (e.g., between approximately 15 feet and 50 feet, or another range) from the identified drop-off or pick-up location. In other cases, the area or zone of an identified drop-off or pick-up location can include the portion of the surrounding environment that is within a particular distance (e.g., between approximately 15 feet and 50 feet, or another range) from the vehicle while the vehicle is at the identified drop-off or pick-up location.

[0040]

[0059] In various implementations, determining the drop-off or pick-up location may also be based on the seating position of the passenger relative to the expected entry or exit point for the passenger of the vehicle. For example, if a detected obstacle or unsafe condition is on the same side of the vehicle as the expected exit point for each passenger and is likely to block or prevent one or more passengers from entering or exiting the vehicle, the apparatus may determine an alternate drop-off or pick-up location such that the detected obstacle or unsafe condition does not block, impede, or make unsafe the path of each passenger when exiting the vehicle. Conversely, when a detected obstacle or unsafe condition is on a different side of the vehicle than the expected exit point for each passenger, for example, if the detected obstacle or unsafe condition is unlikely to block or prevent the passenger from entering or exiting the vehicle, the vehicle may stop at the original or scheduled drop-off location to drop off each passenger.

[0041]

[0060] As used herein, an alternate drop-off or pick-up location is a location that is different from the originally scheduled drop-off or pick-up location, but is sufficiently close to the originally scheduled drop-off or pick-up location, such that both the originally scheduled drop-off or pick-up location and the alternate drop-off or pick-up location are associated with the same destination. That is, if the vehicle decides to find a viable alternate drop-off or pick-up location (e.g., due to the presence of an obstacle or hazardous condition at the originally scheduled drop-off or pick-up location), the vehicle does not change the passenger's destination. Instead, the vehicle drops off or picks up the passenger within a certain distance (e.g., within a 5-minute walk, within 1-2 blocks, etc.) from the originally scheduled drop-off or pick-up location. The certain distance is generally a relatively short distance (e.g., within a few minutes of walking, within 1-2 blocks, etc.) that the passenger would feel comfortable walking to the destination from the alternate location instead of from the original location (or walking from the destination to the alternate location instead of from the original location).

[0042]

[0061] Of course, what is comfortable may vary among passengers / users, situations, and / or their requirements (e.g., carrying baggage or infants). In some implementations, the specific distance can be configured by the passenger (e.g., in the vehicle, on a mobile device, etc.) or other parties. In some cases, the specific distance can be adjusted (e.g., automatically or in response to user / passenger confirmation) based on various situations. For example, if rain is detected, the specific distance can be shortened (e.g., by half or another amount). Similarly, if the temperature and / or humidity (or other weather conditions) are above or below some threshold, the specific distance can be shortened accordingly. As another example, if the passenger is late (e.g., as determined by a calendar appointment, profile, etc. on the passenger's device), the specific distance can be shortened to save time. As yet another example, if the passenger's daily steps (or other health indicators, such as calories burned) are low, the specific distance can be extended.

[0043]

[0062] In various implementations, the vehicle can detect one or more conditions of the passengers (either current passengers or prospective passengers). The vehicle can, for example, take the passengers' conditions into account and determine the passenger drop-off or pick-up location based on whether the passengers need additional time and / or space to enter or exit the vehicle. In some cases, the condition of each passenger can include, but is not limited to, the physical handicap or limitation of each passenger, the presence of an infant or child with each passenger, the age of the passenger, the presence of a relatively large amount of baggage, cargo, or equipment with each passenger, or any combination thereof. However, any condition or requirement of the passenger that may result in the passenger needing additional time or space to enter or exit the vehicle can be used in determining the drop-off or pick-up location for the passenger.

[0044]

[0063] In some cases, one or more attributes of the scheduled drop-off or pickup location may be considered in determining one or more alternate drop-off or pickup locations, which may include, but are not limited to, at least one of puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions (e.g., fire hydrants, walls, trees, etc.), weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of the identified drop-off or pickup location, less than a certain amount of room in front of or behind the vehicle, or any combination thereof. For example, if the vehicle determines that each passenger needs additional space to exit the vehicle (e.g., because the passenger has multiple suitcases in the trunk and is traveling with an infant), the vehicle may select an alternate drop-off location that provides additional space to the side of the vehicle for dropping off the infant, provides additional space at the rear of the vehicle for dropping off the suitcases, provides additional time associated with caring for the infant, or any combination thereof. Conversely, if the vehicle does not determine that each passenger needs additional time or space, the vehicle may continue to the scheduled drop-off location.

[0045]

[0064] In some cases, the passenger can indicate to the vehicle (e.g., directly or indirectly through an intermediary such as a passenger dispatcher) whether the passenger needs additional time and / or space to enter or exit the vehicle during passenger boarding and disembarking, respectively. In further implementations, the passenger can indicate approximately how much time (e.g., 5 minutes) and / or space (e.g., 10 feet of clearance behind the vehicle) he or she needs. This indication can then be used by the vehicle to modify the drop-off or pick-up location. In some implementations, the passenger can provide details or other information (e.g., traveling with an infant and car seat, traveling with several suitcases, etc.) that may affect his or her additional time and / or space requirements. These details can then be used by the vehicle to modify the drop-off or pick-up location. For example, the vehicle can modify the drop-off or pick-up location to fit the details.

[0046]

[0065] In some implementations, the vehicle may present several alternative drop-off locations on a display screen (e.g., a display screen in the vehicle, etc.) viewable by passengers aboard the vehicle. Each passenger may select one of the alternative drop-off locations presented on the display screen. The vehicle may drive to the alternative drop-off location selected by each passenger and drop off the respective passenger there. In some cases, the alternative drop-off location may be presented on a display screen associated with the vehicle. Additionally or alternatively, the alternative drop-off or alternative boarding locations may be shared with one or more passengers' mobile computing devices, which may present the alternative drop-off or boarding locations on their own displays (e.g., touch-sensitive display screens) for viewing and interaction with the respective passengers. For example, the alternative drop-off or boarding locations may be presented as selectable icons on the touch-sensitive display screens of the passengers' mobile computing devices. A passenger may select a particular alternative drop-off or pick-up location by touching, tapping, or otherwise interacting with a selectable icon that corresponds to the particular alternative drop-off or pick-up location.

[0047]

[0066] Particular implementations of the subject matter described in this disclosure can be implemented to achieve one or more of the following potential advantages: By enabling a vehicle (such as an autonomous vehicle) to determine a drop-off and / or pick-up location based on the presence of an obstacle or dangerous condition at or near a passenger drop-off and / or pick-up location, aspects of the subject matter disclosed herein can ensure that passengers of such vehicles are not impeded or inconvenienced by obstacles or dangerous conditions when entering or exiting the vehicle. Additionally, the ability of a vehicle implementing various technologies disclosed herein to dynamically determine one or more alternative drop-off and / or pick-up locations based on passenger preferences and / or needs can ensure that passengers who require additional time to enter or exit the vehicle, who require additional space to enter or exit the vehicle, and / or who have certain physical attributes or limitations are boarded and disembarked at locations that suit them. In this manner, a vehicle implementing various aspects of the subject matter disclosed herein can board and disembark passengers in a safer and more convenient manner than conventional vehicles.

[0048]

[0067] Several aspects of vehicles, such as autonomous vehicles, providing passenger and / or cargo services are now presented with reference to various apparatus and methods that are described in the detailed description that follows and illustrated in the accompanying drawings by various blocks, components, circuits, processes, algorithms, etc. (collectively referred to as "elements"). These elements may be implemented using electronic hardware, computer software, or any combination thereof. Whether such elements are implemented as hardware or software depends on the particular application and design constraints imposed on the overall system.

[0049]

[0068] As an example, the elements, or any portion of the elements, or any combination of the elements, may be implemented as a "processing system" including one or more processors. Examples of processors include microprocessors, microcontrollers, graphics processing units (GPUs), central processing units (CPUs), application processors, digital signal processors (DSPs), reduced instruction set computing (RISC) processors, systems on chips (SoCs), baseband processors, field programmable gate arrays (FPGAs), programmable logic devices (PLDs), state machines, gated logic, discrete hardware circuits, and other suitable hardware configured to perform various functionality described throughout this disclosure. One or more processors in a processing system may execute software. Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software components, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, and the like, whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0050]

[0069] Thus, in one or more exemplary implementations, the functions described can be implemented in hardware, software, or any combination thereof. If implemented in software, the functions can be stored on a computer-readable medium or encoded as one or more instructions or codes on a computer-readable medium. Computer-readable media includes computer storage media. A storage medium can be any available medium that can be accessed by a computer. By way of example and not limitation, such computer-readable media can include random access memory (RAM), read-only memory (ROM), electrically erasable programmable ROM (EEPROM), optical disk storage, magnetic disk storage, other magnetic storage devices, combinations of the aforementioned types of computer-readable media, or any other medium that can be used to store computer-executable code in the form of instructions or data structures that can be accessed by a computer.

[0051]

[0070] 1 illustrates a pictorial diagram of an example system 100 in which various aspects of the subject matter disclosed herein may be implemented. System 100 includes a vehicle control system 110, one or more client devices 120, vehicles 130A-130C, and a communication network 140. In some implementations, example system 100 may include other numbers of client devices 120 and / or vehicles 130. Additionally or alternatively, example system 100 may include other components, devices, or systems not shown for the sake of brevity.

[0052]

[0071] Vehicle control system 110 may include any number of computing devices, such as, but not limited to, servers, which may be implemented in a single location or distributed across multiple locations. The servers may be of various types, such as, for example, web servers, news servers, file servers, application servers, database servers, proxy servers, or any other server suitable for performing the functions or processes described herein, or any combination thereof. Each server may be a single server or distributed servers across multiple computers or multiple data centers, and may include hardware, software, or embedded logic components, or a combination of two or more such components, for performing the appropriate functionality implemented or supported by the server.

[0053]

[0072] Vehicle control system 110 may be configured to be used to assist vehicles 130A-130C (collectively referred to herein as vehicles 130) operating in an autonomous mode, as well as to provide passenger and / or cargo services to select, identify, or otherwise determine drop-off and / or pick-up locations for passengers. In some implementations, vehicle control system 110 may determine passenger drop-off and / or pick-up locations that are free of obstacles and hazardous conditions. Vehicle control system 110 may also determine passenger drop-off and / or pick-up locations based at least in part on one or more physical attributes of the passenger, physical limitations of the passenger, age of the passenger, presence of an infant or child with the passenger, or any combination thereof. Additionally or alternatively, vehicle control system 110 may also determine passenger drop-off and / or pick-up locations based on whether the passenger needs additional time or space to enter or exit the autonomous vehicle.

[0054]

[0073] In some implementations, vehicle control system 110 may facilitate transportation for one or more passengers 160 in vehicle 130. For example, vehicle control system 110 may receive a service request from a passenger 160 (e.g., via the passenger's client device 120) along with an identifier for the requesting passenger 160. The passenger identifier may identify the passenger 160 to vehicle control system 110, enabling vehicle control system 110 to retrieve, for example, (but not limited to) the passenger's preferences, payment method, preferred pick-up or drop-off locations, or any other suitable information.

[0055]

[0074] Client device 120 may be any suitable computer or computing device capable of communicating with vehicle control system 110, vehicle 130, or other communication devices, nodes, or entities over communication network 140. In some cases, client device 120 may be a desktop computer, laptop computer, personal digital assistant, cellular phone, smartphone, tablet computer, game console, e-book reader, or another suitable communication device. Some client devices 120 may be associated with passengers 160 of vehicles 130, while other client devices 120 may be associated with human drivers 135 of vehicles 130. For example, in some cases, passenger 160 may use client device 120 to request or schedule a passenger service with one of vehicles 130, and may use client device 120 to interact with vehicle 130 during the requested or scheduled passenger service. In other cases, a human driver 135 may use a client device 120 to communicate and interact with one or more passengers 160, as well as with the vehicle control system 110 and the vehicles 130. In some other cases, one or more of the vehicles 130 may include or be associated with one of the client devices 120.

[0056]

[0075] Vehicle 130 may be any suitable type of autonomous or semi-autonomous vehicle that may be used to provide passenger and / or cargo services while in an autonomous mode. Although not shown in FIG. 1 for simplicity, vehicle 130 may include an autonomous vehicle controller, communication circuitry, user interface, and other components typically included in a vehicle capable of operating in an autonomous (or semi-autonomous) driving mode while providing passenger services. In some implementations, a vehicle controller provided in or associated with vehicle 130 may perform some or all of the operations described with reference to vehicle control system 110.

[0057]

[0076] Communications network 140 provides communications links between vehicle control system 110, client device 120, and vehicle 130. Network 140 can be any suitable communications network or networks including, for example, one or more of the Internet, a wide area network (WAN), a metropolitan area network (MAN), a wireless local area network (WLAN), a personal area network (PAN) such as Bluetooth®, a radio access network (RAN) such as a fifth generation (5G) new radio (NR) system, a wired network, a cable network, a satellite network, or other suitable network.

[0058]

[0077] FIG. 2 illustrates a functional block diagram of an example system 200 according to some implementations. System 200 may be an example of system 100 of FIG. 1 and is shown to include vehicle control system 210, client device 220, autonomous vehicle 230, and communication network 140 of FIG. 1. Vehicle control system 210 may be an example of vehicle control system 110 of FIG. 1 and is shown to include one or more processors 212, memory 214, one or more applications 216, and communication circuitry 218. Processor 212 may be or include any number of commercially available microprocessors or central processing units (CPUs) capable of executing scripts or instructions of one or more software programs stored in associated memory. Additionally or alternatively, processor 212 may be or include any number of application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or programmable logic devices (PLDs).

[0059]

[0078] The memory 214 may include a non-transitory computer-readable medium (e.g., one or more non-volatile memory elements, such as EPROM, EEPROM, flash memory, hard drives, etc.) having instructions stored thereon that, when executed by the one or more processors 212, cause the vehicle control system 210 to perform at least some of the operations described with reference to one or more of Figures 6A-6B, 7A-7B, 8A-8B, 9, 10, 11, 12, 13, 14, 15, 16, and 17. In some cases, the memory 214 may store applications 216 that may be executed by the one or more processors 212 to perform certain functions. For example, a vehicle controller application resident in the memory of the vehicle control system 210 may be executed to communicate with and control various operations of the autonomous vehicle 230. In some cases, the vehicle controller application can be used to assist or operate the autonomous vehicle 230 in selecting a drop-off or pick-up location for passengers and / or cargo, in modifying the selected drop-off or pick-up location based on one or more of a detected obstacle or hazardous condition, a physical limitation of a particular passenger, or a passenger needing additional time and / or space to enter or exit the autonomous vehicle, as well as in selecting an alternate drop-off or pick-up location.

[0060]

[0079] Communications circuitry 218 may be used to establish and maintain communications links between vehicle control system 210, client device 220, and autonomous vehicle 230 over communications network 140. Communications circuitry 218 may use any suitable communications protocol, including, for example, a wireless communications protocol specified by one or more amendments to the IEEE 802.11 family of standards, the Bluetooth Interest Group, or other suitable communications technologies, by one or more releases of the 3rd Generation Partnership Project (3GPP®).

[0061]

[0080] The client device 220 may be an example of the client device 120 of FIG. 1 and is shown to include one or more processors 222, a memory 224, a display screen 226, and a communication circuit 228. The processor 222 may be or include any number of commercially available microprocessors or central processing units (CPUs) capable of executing scripts or instructions of one or more software programs stored in associated memory. Additionally or alternatively, the processor 212 may be or include any number of ASICs, FPGAs, or PLDs. The memory 224 may include a non-transitory computer-readable medium (such as one or more non-volatile memory elements such as EPROM, EEPROM, flash memory, hard drives, etc.) that store instructions that, when executed by the one or more processors 222, cause the client device 220 to perform at least some of the operations described herein. The display screen 226 may be any suitable display screen capable of receiving input from a user and presenting output to a user. Communications circuitry 228 may be used to establish and maintain communications links between client device 220, vehicle control system 210, and autonomous vehicle 230 over communications network 140. Communications circuitry 228 may use any suitable communications protocol, including wireless communications protocols specified by one or more amendments to the IEEE 802.11 family of standards, by one or more releases of 3GPP, by the Bluetooth Interest Group, or other suitable communications technologies.

[0062]

[0081] Client device 220 may be used by passengers, by human co-drivers of an autonomous vehicle, or may be provided within an autonomous vehicle. For example, passengers may use client device 120 to request passenger service by an autonomous vehicle, update drop-off or pick-up locations, pay ride fares, and other functions. Human co-drivers may use client device 120 to communicate with one or more passengers, vehicle control system 210, and other autonomous vehicles. Autonomous vehicles may use client device 120 to communicate with passengers, vehicle control system 210, and other autonomous vehicles.

[0063]

[0082] Autonomous vehicle 230 may be an example of vehicle 130 of FIG. 1 and may be any suitable type of vehicle capable of providing passenger services while operating in an autonomous or semi-autonomous mode. Autonomous vehicle 230 may include a vehicle controller 232, communications circuitry 234, and a user interface 236. Vehicle controller 232 may be used to control various operations of autonomous vehicle 300 related to providing passenger services. For example, vehicle controller 232 may control operations related to picking up passengers at designated pick-up locations, dropping off passengers at designated drop-off locations, modifying the designated pick-up or drop-off locations based on detected obstacles or hazardous conditions, passenger physical limitations, an indication that a particular passenger needs additional time or space to enter or exit the autonomous vehicle, among other factors or conditions. Communications circuitry 234 may be used to establish and maintain communications links between vehicle control system 210, client device 220, and autonomous vehicle 230 via communications network 140. User interface 236 may be used to present information to passengers. The user interface 236 may be used to receive user input (such as commands and preferences) from passengers.

[0064]

[0083] 3 illustrates a block diagram of an autonomous vehicle 300 (which may correspond to the autonomous vehicles 130, 230 of FIGS. 1 and 2) according to some implementations. The autonomous vehicle 300 may be any type of vehicle, including but not limited to, a car, truck, van, bus, tram, train, subway, airplane, boat, etc., regardless of how it is powered or driven. In some implementations, the autonomous vehicle 300 may include an autonomous vehicle controller 310, a communication interface 360, a drive system 370, an external sensor 372, a navigation system 374, an internal sensor 376, and a user interface 378. The autonomous vehicle 300 may include other components not shown in the example of FIG. 3.

[0065]

[0084] Vehicle controller 310 may be an example of vehicle controller 232 of FIG. 2 and may be used to determine drop-off or pick-up locations for passengers transported by autonomous vehicle 300. Vehicle controller 310 may be implemented using any analog, digital, or mixed signal processing circuitry to control various operations of autonomous vehicle 300. In some cases, vehicle controller 310 may interface with and / or control operation of drive system 370, external sensors 372, navigation system 374, internal sensors 376, and user interface 378 of autonomous vehicle 300. For example, vehicle controller 310 may be integrated with drive system 370 in a manner that allows vehicle controller 310 to assume control of various driving and steering operations of autonomous vehicle 300 in picking up or dropping off passengers at various pick-up or drop-off locations.

[0066]

[0085] Communications interface 360 ​​may be used to establish and maintain communications links between a vehicle control system (such as vehicle control system 110 of FIG. 1 or vehicle control system 210 of FIG. 2), one or more mobile computing devices (such as client device 120 of FIG. 1 or client device 220 of FIG. 2), and autonomous vehicle 300. Communications interface 360 ​​may use any suitable communications protocol including, for example, wireless communications protocols specified by one or more amendments to the IEEE 802.11 family of standards, the Bluetooth Interest Group, by one or more releases of 3GPP, or other suitable communications technologies.

[0067]

[0086] Drive system 370 may include the powertrain and various associated electrical, mechanical, electromechanical, control, and diagnostic systems of autonomous vehicle 300. In some cases, drive system 370 may include one or more engine systems, motor systems, transmission systems, steering systems, braking systems, and other systems to control driving and parking operations of autonomous vehicle 300.

[0068]

[0087] The external sensors 372 may include any suitable sensors or devices that may be used individually or in conjunction with each other to scan the surrounding scene for objects, environmental features, roads, route features, other vehicles, traffic lights, weather conditions, obstacles, hazardous conditions, and other attributes, characteristics, or properties of the surrounding scene.

[0069]

[0088] The external sensors 372 may include optical cameras, image sensors, video cameras, coherent light sensing systems, RADAR systems, or other suitable devices or sensors that may be used to detect and / or recognize objects in the surrounding environment. In various implementations, the coherent light sensing systems and RADAR systems may be used to detect the presence of objects in the surrounding environment, to determine the distance between those objects and the vehicle 120, to determine the movement of the detected objects relative to the vehicle 120, and to determine other features and attributes of the surrounding environment. In some aspects, the RADAR system may include one or more radio frequency (RF) sensors and one or more millimeter wave (mmW) frequency sensors. In some aspects, the coherent light sensing system may include one or more LIDAR sensors and one or more infrared (IR) sensors. In some implementations, measurements provided by the RF sensors, mmW frequency sensors, SONAR sensors, LIDAR sensors, and / or IR sensors may be used by a neural network to detect and classify objects in the surrounding environment. For example, in some aspects, a neural network may employ deep learning and inference techniques to recognize detected objects (e.g., to recognize that a first detected object is another vehicle, that a second detected object is a stop sign, that a third detected object is a pedestrian, etc.).

[0070]

[0089] In one implementation, a coherent optical sensing system can emit or transmit light or infrared (IR) pulses into an environment and receive light or IR pulses reflected by objects and other surfaces in the environment to determine information about the objects and other surfaces. In some implementations, the distance to a detected object can be determined based on the time between the emission of a light or IR pulse by the coherent optical sensing system and the reception of a corresponding reflected light or IR pulse by the coherent optical sensing system. The size, shape, orientation, texture, and other characteristics of a detected object can be determined based (at least in part) on the amplitude, pulse width, timing information, and other characteristics of many such received light or IR pulses. Information generated from the received light or IR pulses can be used to generate a point cloud that indicates the location, size, shape, movement, orientation, and other characteristics of objects and other surfaces detected in the environment. The measured distance can be combined with the orientation of the emitter to associate a three-dimensional location with each light or IR pulse received by the coherent optical sensing system. Three-dimensional (3D) positions associated with multiple received light or IR pulses can be used to generate a 3D map of points indicating the locations of various objects and features in the environment. The autonomous vehicle 300 can use one or more of these 3D point clouds to navigate the environment (such as along a route between drop-off or pick-up locations) without human input.

[0071]

[0090] In some implementations, a first group of external sensors 372 can be configured to detect and / or recognize obstacles, hazardous conditions, and other passenger obstructions that are relatively close to a particular drop-off or pick-up location (e.g., located within a zone surrounding or associated with the particular drop-off or pick-up location). A second group of external sensors 372 can be configured to scan a relatively far-away area of ​​the scene to detect and / or recognize objects, environmental features, landmarks, buildings, roads, and other attributes of the scene that are relatively far from the particular drop-off or pick-up location (e.g., located outside of a zone surrounding or associated with the particular drop-off or pick-up location). The zones can be of various sizes, shapes, or configurations based, for example, on attributes or characteristics of the particular drop-off or pick-up location, the status of one or more passengers, passenger preferences, and other suitable factors. In this manner, the first group of external sensors 372 can be configured for short-range scanning, while the second group of external sensors 372 can be configured for long-range scanning.

[0072]

[0091] In various implementations, scene mapping information provided by or obtained from a first group of external sensors 372 can be fused, stitched, or otherwise combined with scene mapping information provided by or obtained from a second group of external sensors 372 to generate a synthetic 3D point cloud of the entire scene. In this manner, the synthetic 3D point cloud can indicate the presence of nearby obstacles and hazardous conditions relative to more distant objects, environmental features, landmarks, buildings, roads, and other attributes of the scene. In some cases, the synthetic 3D point cloud can be updated with scene mapping information associated with relatively distant areas of the scene less frequently than with scene mapping information associated with relatively closer areas of the scene. For example, if the positions or orientations of environmental features, objects, and other surfaces relatively far from the autonomous vehicle 300 remain constant (or have minimal change) over a period of time during which a new obstacle or hazardous condition is detected relatively close to a drop-off or pick-up location (or the autonomous vehicle 300), the autonomous vehicle 300 may update the composite 3D point cloud with nearby scene mapping information more frequently than with far-away scene mapping information. In other cases, the composite 3D point cloud may be updated with scene mapping information associated with relatively far-away areas of the scene more frequently than with scene mapping information associated with relatively close areas of the scene. In some other cases, the composite 3D point cloud may be updated with all scene mapping information at the same or similar times.

[0073]

[0092] The navigation system 374 may be provided at any suitable location on or within the autonomous vehicle 300. The navigation system 374 may use map data and sensor data to guide the autonomous vehicle 300 to a destination without colliding with (or otherwise avoiding) other objects. The navigation system 374 may also use map data and sensor data to detect the presence of obstacles and hazardous conditions at or near scheduled drop-off or pick-up locations. In some implementations, the navigation system 374 may access or receive detailed map information (e.g., 3D point clouds, etc.) directly (e.g., without intermediate systems or services) from one or more sources, such as, but not limited to, government agencies, subscription-based services, user-generated map collections, cloud-sourced mapping information, mapping information provided by other devices, etc. In other implementations, the navigation system 374 may access or receive detailed map information (such as a 3D point cloud) from a server (or other intermediate system or service) that may, at least in some cases, aggregate the detailed map information. In some cases, the detailed map information may be provided by a network entity or server (such as the vehicle control system 210 of FIG. 2). In other cases, the detailed map information (or at least a portion thereof) may be provided by one or more other devices over an appropriate wireless channel (such as a V2V or V2X channel of a 5G RAN, a sidelink channel of a 5G RAN, an unlicensed frequency band, a peer-to-peer (P2P) connection, or a dedicated short-range communications (DSRC) channel of a wireless network).Exemplary devices may include, but are not limited to, other vehicles, smartphones, cameras, or AR / VR headsets. In one exemplary implementation, the navigation system 374 may use map data and / or sensor data to supplement detailed map information (e.g., when the detailed map information is incomplete or does not cover the entirety of a particular area of ​​interest).

[0074]

[0093] In various implementations, the detailed map information can be used to determine whether a scheduled drop-off or pick-up location is feasible for a passenger and / or the autonomous vehicle 300. The detailed map information can be used to detect the presence of an obstacle or hazardous condition at a scheduled drop-off or pick-up location. The detailed map information can also be used to identify viable alternative drop-off or pick-up locations for a passenger of the autonomous vehicle 300. In certain implementations, this can be done before the autonomous vehicle 300 travels to the scheduled drop-off or pick-up location or before it otherwise arrives at or near the scheduled drop-off or pick-up location. In this manner, the speed and efficiency with which the autonomous vehicle 300 can select the most convenient drop-off or pick-up location while taking into account various attributes of the drop-off or pick-up location and any conditions that may be associated with the passenger can be significantly greater than conventional techniques that rely on external sensors of the autonomous vehicle to provide such mapping information (where the autonomous vehicle would typically be within scanning range of the drop-off or pick-up location).

[0075]

[0094] In some implementations, the detailed map information can be periodically or continuously (such as in real-time) fused, stitched, or filtered with mapping information provided by or obtained from the external sensor 372. In some cases, one or more portions of the detailed map information can be updated with mapping information available from the external sensor 374. For example, the autonomous vehicle 300 can use the received detailed map information to determine that a particular drop-off location is viable for the passenger prior to the ride. The external sensor 372 can subsequently identify one or more obstacles as the autonomous vehicle 300 approaches the drop-off location. In this example, the detailed map information did not indicate any obstacles at or near the drop-off location, so the mapping information provided by the external sensor 372 is more up-to-date and more accurate. Thus, the autonomous vehicle 300 can use the mapping information provided by the external sensor 372 to determine whether the drop-off location is still viable for the passenger.

[0076]

[0095] In some implementations, the navigation system 374 may include one or more Satellite Positioning System (SPS) receivers capable of receiving and decoding satellite signals associated with various global satellite services, such as the Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), and Galileo, as well as various regional satellite services, such as the Indian Regional Navigation Satellite System (IRNSS). The satellite signals may be used by the autonomous vehicle 300 for general navigation purposes, including, for example, determining a route between a pick-up location and a drop-off location, and then safely operating the autonomous vehicle 300 from the pick-up location to the drop-off location along the determined route. In some cases, the autonomous vehicle 300 may also use the received satellite signals to determine or construct mapping information regarding the pick-up and / or drop-off locations.

[0077]

[0096] In various implementations, the autonomous vehicle 300 can be configured to determine the seating positions of passengers (e.g., specific seat locations, relative to each other, etc.) and / or expected egress points for passengers. In some implementations, the internal sensors 376 can include any suitable sensors or devices (such as, but not limited to, pressure sensors, motion sensors, light sensors, optical sensors, wireless transceivers, etc.) that can be used to determine the seating positions of passengers within the autonomous vehicle 300. The internal sensors 376 can be used to determine the relative positions of current passengers to each other. The internal sensors 376 can be used to determine estimated egress points of passengers from the autonomous vehicle 300 (and / or their relative positions to the estimated egress points). In some cases, pressure sensors provided in or near the seats of the autonomous vehicle 300 can be used to determine whether a particular seat is occupied by a passenger. In other cases, motion sensors distributed throughout the interior of the autonomous vehicle 300 may be used to determine whether a passenger is entering or exiting the autonomous vehicle 300. In some other cases, optical sensors may be used to determine the distance to each passenger in the autonomous vehicle 300.

[0078]

[0097] In some implementations, the internal sensor 376 may include one or more transceivers that are disposed within the autonomous vehicle 300 and configured to exchange wireless signals with mobile computing devices associated with passengers. The exchanged wireless signals may be used to determine the relative positions of the passengers relative to one another, the relative positions of the passengers relative to an expected entry point of the autonomous vehicle 300, and / or the relative positions of the passengers relative to an expected exit point of the autonomous vehicle 300. In some cases, a wireless transmitting device (such as, but not limited to, an access point (AP), a soft AP, a wireless station (STA), a user equipment (UE), or some other suitable wireless communication device) may transmit wireless signals to and receive wireless signals from the passengers' mobile computing devices. In some cases, the wireless transmitting device may be disposed on the dashboard. In some other cases, the wireless transmitting device may be provided in another suitable location on the vehicle 120.

[0079]

[0098] In one example implementation, the wireless transmitting device may use RF sensing and / or ranging technology to determine the distance between the transmitting device and each of the passengers, to determine the relative locations of the passengers, and / or to determine the relative movement of the passengers with respect to one another. RF ranging signals may include, but are not limited to, Wi-Fi® signals, ultra-wideband (UWB) signals, Bluetooth signals, LTE® communications, 5G NR communications, narrowband signals, P2P communications, etc. In some aspects, the RF sensing and / or ranging technology may classify (e.g., recognize or identify) passengers in the vehicle.

[0080]

[0099] The wireless transmitting device may also use information of the transmitted and received wireless signals to determine the distance and / or angle between the wireless transmitting device and each passenger's mobile computing device. The distance and / or angle information may be used to determine the relative location of each passenger's mobile computing device to the wireless transmitting device, and thus the relative location of each passenger's mobile computing device to each other, to an expected entry point of the autonomous vehicle 300, and / or to an expected exit point of the autonomous vehicle 300. The wireless transmitting device may use any suitable positioning technology, including (but not limited to), Assisted GNSS (A-GNSS), Observed Time Difference of Arrival (OTDOA) (e.g., downlink (DL) OTDOA or uplink (UL) OTDOA), Real Time Kinematics (RTK), Precision Point Positioning (PPP), Differential GNSS (DGNSS), Extended Cell ID (E-CID), Angle of Arrival (AOA), Angle of Departure (AOD), and / or other positioning methods for determining the location of a passenger in the autonomous vehicle 300.

[0081]

[0100] User interface 380 may be or may include any suitable device or component through which autonomous vehicle 300 may present questions, options, or other information to a passenger and / or through which a passenger may provide answers or other response information to autonomous vehicle 300. In some cases, user interface 380 may include a tablet computer, a touch-sensitive display, a speaker, a microphone, or the like. For example, in some aspects, autonomous vehicle 300 may indicate the presence of a pothole at the designated drop-off location on a touch-sensitive display. In other aspects, autonomous vehicle 300 may indicate the presence of a pothole on a display screen of the user's device. Autonomous vehicle 300 may ask the passenger if they would like an alternative drop-off location. Optionally, autonomous vehicle 300 may display the location of the alternative drop-off location (and optionally other alternatives from which the user can select). In response, the passenger can use the touch-sensitive display to indicate whether the specified drop-off location is acceptable or whether an alternative drop-off location is preferred. User interface 380 can be provided in any suitable location within the autonomous vehicle, including, for example, embedded within the back of the front seats. In other implementations, the passenger's mobile computing device can provide some or all of the functionality of user interface 378.

[0082]

[0101] The vehicle controller 310 may include a data store 320, one or more processors 330, a memory 340, and a number of system engines 350. The data store 320 may include drop-off / pick-up location data 321, navigation data 322, entry / exit point data 323, obstacle data 324, and user profile data 325. The drop-off / pick-up location data 321 may include drop-off locations for passengers being transported by the autonomous vehicle. The drop-off / pick-up location data 321 may also include pick-up locations for one or more passengers scheduled to be picked up by the autonomous vehicle. In some cases, the drop-off / pick-up location data 321 may also store historical information related to some previous drop-off or pick-up locations.

[0083]

[0102] Navigation data 322 may include route information for rides requested by passengers, road conditions, traffic conditions, weather conditions, construction activity, event conditions (e.g., scheduled times for nearby events), and any other information associated with navigating autonomous vehicle 300 from pick-up locations to drop-off locations for each passenger. In some cases, navigation data 322 may include map data and / or sensor data, such as street view, satellite view, etc. In other cases, navigation data 322 may include the received detailed map information discussed above.

[0084]

[0103] Entry / exit point data 323 may include information indicative of an expected exit point of autonomous vehicle 300 for each passenger currently being transported in autonomous vehicle 300 and may store information indicative of an expected entry point of autonomous vehicle 300 for each passenger scheduled to be picked up by autonomous vehicle 300. In some cases, entry / exit point data 323 may be correlated with information stored in one or both of drop-off / pick-up data 321 and obstacle data 324. In other cases, entry / exit point data 323 may indicate default entry and / or exit points of autonomous vehicle 300 for one or more passengers. For example, when autonomous vehicle 300 approaches a drop-off location, autonomous vehicle 300 may instruct one or more passengers to exit through the right rear door (or another suitable door) of autonomous vehicle 300. In some implementations, the autonomous vehicle 300 may open certain doors of the autonomous vehicle 300 for each passenger to enter or exit the autonomous vehicle 300. In some cases, the autonomous vehicle 300 may lock other doors when approaching a drop-off or pick-up location, for example, to increase passenger safety.

[0085]

[0104] The obstacle data 324 may include information indicative of one or more previously detected attributes, features, or characteristics of some objects, obstacles, and / or hazardous conditions. The obstacle data 324 may also indicate the precise location of a previously detected object, obstacle, or hazardous condition (e.g., within 50 centimeters), either absolutely or relative to one or more stored drop-off or pick-up locations. In some cases, the stored attributes, features, or characteristics of a particular obstacle may be used to assist the autonomous vehicle in detecting or identifying the particular obstacle as it approaches the corresponding drop-off or pick-up location.

[0086]

[0105] The user profile data 325 may include profile information regarding any number of past, current, or prospective passengers of the autonomous vehicle 300. The profile information regarding each passenger may include the passenger's identity (such as name, age, height, etc.) and the passenger's preferences (such as whether the passenger typically travels with an infant or small child, the amount of baggage or cargo typically carried by the passenger, willingness to enter or exit the autonomous vehicle if an obstacle or hazardous condition is detected at or near a selected pickup or drop-off location, etc.). In some cases, some or all of the passenger profile data may be obtained from the vehicle control systems 110 and 200 of FIGS. 1 and 2, respectively. In other cases, at least some of the passenger profile data may be provided by the passenger, such as by accessing profile information from the passenger's client device 120.

[0087]

[0106] In some implementations, the user profile data 325 (or other profile data) can include profile information for one or more shipping services. The profile information for each shipping service can indicate special requirements associated with one or more types of cargo to be transported by the autonomous vehicle 300 for each shipping service. For example, the special requirements can include, but are not limited to, a time-consuming loading or unloading process, a need for specific loading / unloading equipment for the cargo (e.g., dollies, forklifts, cranes, ramps, conveyor belts, etc.), a need for a specific amount of space to load / unload the cargo (such as for lumber, pipes, beams, etc. with lengths greater than a certain value), or a need for specialized loading / unloading areas for the cargo (such as areas with ramps). In one example implementation, the special requirements can indicate a protocol for boarding a package or other delivery item. For example, the protocol may require that the autonomous vehicle 300 wait at or near the pick-up location, or otherwise not occupy a parking space, until it receives confirmation that the package or other delivery item has been dropped off at the pick-up location.

[0088]

[0107] In various implementations, the user profile data 325 (or other profile data) can include profile information for one or more delivery services. The delivery services can include, but are not limited to, food delivery services, prescription drug delivery services, grocery delivery services, and the like. In some implementations, the profile information for each delivery service can indicate special requirements associated with boarding and / or loading items for delivery onto the autonomous vehicle 300. For example, those special requirements can include, but are not limited to, specific areas of a restaurant for parking and waiting for the delivery order to be loaded onto the autonomous vehicle 300, designated lanes in which the autonomous vehicle 300 will wait for the delivery order to be loaded onto the autonomous vehicle 300, and the like. In some cases, the profile information for each delivery service can also indicate special procedures associated with boarding delivery orders at various vendors (such as food orders from Chick-fil-a). For example, the special procedures may include, but are not limited to, a signal or prompt indicating that the food order is not ready for delivery, that the food order has been canceled, that the food order has been loaded onto the autonomous vehicle 300, etc.

[0089]

[0108] In various implementations, the profile information for each delivery service can indicate special requirements and / or procedures associated with dropping off and / or loading delivery orders at a consumer's location. For example, those special requirements can include, but are not limited to, a designated area for the autonomous vehicle 300 to park at the consumer's lot and wait for the consumer to retrieve (or for a passenger to deliver) the delivered items from the autonomous vehicle 300, a period of time for the autonomous vehicle 300 to wait for the consumer to retrieve (or for a passenger to deliver) the delivered items from the autonomous vehicle 300, etc.

[0090]

[0109] Processor 330 may be or include any number of commercially available microprocessors or central processing units (CPUs) capable of executing scripts or instructions of one or more software programs stored in associated memory. Additionally or alternatively, processor 330 may be or include any number of ASICs, GPUs, DSPs, NSPs, DPUs, microcontrollers, hardware accelerators, FPGAs, PLDs, or any combination thereof.

[0091]

[0110] The memory 340 may include a non-transitory computer-readable medium (such as one or more non-volatile memory elements, such as EPROM, EEPROM, flash memory, hard drive, etc.) storing instructions that, when executed by one or more processors 330, cause the vehicle controller 310 to perform any number of the operations described with reference to Figures 6, 7A-7B, 8, 9, 10, 11A-11B, 12, 13A-13C, 14, and 15. The instructions may be any set of instructions to be executed directly (such as machine code) or indirectly (such as script) by the processor 330. For example, the instructions may be stored as computing device code on a computing device readable medium. Thus, the terms "instructions" and "program" may be used interchangeably herein. The instructions may be stored in object code format for direct processing by the processor, or in any other computing device language, including script, or a collection of independent source code modules.

[0092]

[0111] The system engines 350 may include, but are not limited to, a vehicle control engine 352, a navigation engine 354, an object detection engine 356, and a passenger positioning engine 358. The vehicle control engine 352 may assist or operate the autonomous vehicle 300 in determining appropriate drop-off or pick-up locations for the passengers. The vehicle control engine 352 may also assist or operate the autonomous vehicle 300 in determining one or more alternative drop-off or pick-up locations based on the presence of a detected obstacle or hazardous condition at or near the drop-off or pick-up location, the physical limitations of each passenger, the physical attributes of each passenger, the age of each passenger, the presence of an infant or child with each passenger, the amount of baggage or cargo associated with each passenger, or any combination thereof.

[0093]

[0112] The navigation engine 354 can be used to navigate the autonomous vehicle 300 to and from locations specified by the passenger (such as along a route between a passenger pick-up location and a passenger drop-off location). The navigation engine 354 can also be used to select, identify, or determine passenger pick-up and drop-off locations. The navigation engine 354 can be used to modify passenger pick-up or drop-off locations. The navigation engine 354 can also be used to determine alternative passenger pick-up or drop-off locations. In some cases, the navigation engine 354 can identify or select pick-up or drop-off locations where the autonomous vehicle 300 can wait for a passenger, or can stop and wait for the passenger to perform some task and enter the vehicle, or can stop long enough to allow a departing passenger to perform some task and then proceed without the autonomous vehicle. As described in more detail below, various aspects of the subject matter disclosed herein can increase the usefulness, safety, and convenience of autonomous vehicles providing passenger services.

[0094]

[0113] The object detection engine 356 can be used to detect obstacles or hazardous conditions at or near a designated drop-off or pick-up location. In some cases, the object detection engine 356 can employ one or more of the external sensors 376 to detect and determine the location of hazards / obstacles, such as, but not limited to, puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions (e.g., fire hydrants, walls, trees, etc.), weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, or less than a certain amount of room in front of or behind the autonomous vehicle 300.

[0095]

[0114] In some implementations, the profile information for each passenger may indicate or identify which of a plurality of potential obstacles or hazardous conditions the respective passenger considers to be of little or no concern for entering and / or exiting the autonomous vehicle. For example, the plurality of potential obstacles or hazardous conditions may include, but are not limited to, puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, or less than a certain amount of clearance in front of or behind the autonomous vehicle.

[0096]

[0115] In some implementations, if the obstacles or hazardous conditions detected by the autonomous vehicle 300 include only obstacles or hazardous conditions identified as being of little or no concern to the respective passenger, the autonomous vehicle 300 may determine not to modify a particular drop-off or pick-up location for the respective passenger. For example, if the first passenger's profile information indicates that puddles, potholes, uneven pavement, and high curbs are of little or no concern when entering or exiting the autonomous vehicle 300, the autonomous vehicle 300 may not modify a particular drop-off or pick-up location for the first passenger if puddles, potholes, uneven pavement, and / or high curbs are detected within the area of ​​the particular drop-off or pick-up location for the first passenger. In this manner, the first passenger may not be inconvenienced by having to wait for the autonomous vehicle to find an alternate drop-off or pick-up location or by having to walk a longer distance to their destination if there are puddles, potholes, uneven pavement, and / or high curbs near the expected entry or exit point of the autonomous vehicle.

[0097]

[0116] In some cases, the autonomous vehicle 300 may modify a particular drop-off or pick-up location for the first passenger if an obstacle or dangerous condition (such as ice chips or debris) not identified in the first passenger's profile information is detected within the area of ​​the particular drop-off or pick-up location. In this manner, the first passenger may rest assured knowing that the autonomous vehicle 300 will find an alternate drop-off or pick-up location if an obstacle or dangerous condition other than a puddle, pothole, uneven pavement, and / or high curb is detected within the area of ​​the drop-off or pick-up location.

[0098]

[0117] In various implementations, the profile information for the separate passengers may indicate separate potential obstacles or hazardous conditions (or the absence of any) that pose little or no concerns for entering and / or exiting the autonomous vehicle 300. For example, the profile information of the second passenger may indicate that trash and construction fences pose little or no concerns for the second passenger when entering or exiting the autonomous vehicle 300. Based on the profile information of the second passenger, the autonomous vehicle 300 may not modify a particular drop-off or pick-up location for the second passenger if trash and / or construction fences are detected within the area of ​​the particular drop-off or pick-up location. In this manner, the second passenger may not be inconvenienced by having to wait for the autonomous vehicle to find an alternative drop-off or pick-up location or by having to walk a longer distance to their destination if there is trash and / or construction fences near the expected entry or exit point of the autonomous vehicle 300. Conversely, if the autonomous vehicle 300 detects an obstacle or dangerous condition (e.g., ice chips) that is of concern to the second passenger, the autonomous vehicle 300 may modify the drop-off or pick-up location for the second passenger. In this manner, the second passenger may rest assured knowing that the autonomous vehicle 300 will find an alternate drop-off or pick-up location if an obstacle or dangerous condition other than trash or construction fences is detected within the area of ​​the drop-off or pick-up location.

[0099]

[0118] Passenger positioning engine 358 can be used to determine the positions of passengers being carried by autonomous vehicle 300, either absolutely or relative to one another, relative to their respective vehicle exit points, and / or relative to one or more detected obstacles or hazardous conditions. Passenger positioning engine 358 can also determine seating positions of passengers being carried by autonomous vehicle 300. In some cases, passenger positioning engine 358 can be in communication with sensors 372 and 376.

[0100]

[0119] 4A-4C illustrate illustrations 400A-400C, respectively, depicting a vehicle, such as an autonomous vehicle, dropping off and picking up a passenger, according to some implementations. With respect to the exemplary operation discussed with reference to FIGS. 4A-4C, the autonomous vehicle 300 is scheduled to drop off a first passenger aboard the autonomous vehicle 300 at a selected location 410 and pick up a second passenger waiting in a house 420 near the selected location 410. Thus, with respect to the exemplary illustrations 400A-400C of each of FIGS. 4A-4C, the selected location 410 can be referred to as a selected drop-off and pick-up location 410. As shown in FIG. 4A, the autonomous vehicle 300 is traveling along a first street 401 toward the selected drop-off and pick-up location 410. The first street 401 intersects with a second street 402 at an intersection 404 with a traffic light 406. Another vehicle 408 is stopped at traffic light 406 on a second street 402. The selected drop-off location 410 is in front of a house 420, which may be indicated as the destination of the first passenger. That is, when the autonomous vehicle 300 stops at the drop-off location 410, the first passenger is expected to exit the autonomous vehicle 300 and walk along path 422 to the house 420, and the second passenger is expected to walk along path 422 from the house 420 to the pick-up location 410 and then enter the autonomous vehicle 300.

[0101]

[0120] In some implementations, the autonomous vehicle 300 can determine an expected exit point of the autonomous vehicle 300 for the first passenger. The autonomous vehicle 300 can determine an expected entry point of the autonomous vehicle for the second passenger. The autonomous vehicle 300 can also determine the seating location of the first passenger (and the seating locations of other passengers, if present). The autonomous vehicle 300 can determine the relative location of the expected exit point for the first passenger and / or the seating location of the first passenger.

[0102]

[0121] FIG. 4B shows an illustration 400B showing an autonomous vehicle 300 traveling along a street 401 toward a selected drop-off and pick-up location 410. Specifically, when the autonomous vehicle 300 comes within a distance of an area 412 around the selected drop-off and pick-up location 410, the autonomous vehicle 300 detects a trash pile 430 and a construction fence 435 within the area 412. The area 412 can be of any suitable diameter or other dimensions. The area 412 can be of different sizes for different drop-off and pick-up locations. In some cases, the distance can correspond to a scan range (such as a LIDAR sensor scan range) of one or more external sensors 372 of the autonomous vehicle 300. The trash pile 430 and the construction fence 435 are merely exemplary and thus are only two of many possible obstacles and hazardous conditions that can be detected by the autonomous vehicle 300.

[0103]

[0122] The autonomous vehicle 300 can detect the presence of and determine the location of the trash pile 430 and the construction fence 435 using any suitable sensors or devices in conjunction with any suitable object detection mechanism. In some implementations, the autonomous vehicle 300 can scan the surrounding environment for objects or surfaces (e.g., using a LIDAR sensor, an IR sensor, an RF sensor, a mmW frequency sensor, a SONAR, a camera, or any combination thereof). The autonomous vehicle can generate a three-dimensional map of points corresponding to the location of the trash pile 430 and the construction fence 435. The resulting three-dimensional map of points, or “point cloud,” can be used to determine the exact location of the trash pile 430 and the construction fence 435.

[0104]

[0123] 4B example, trash pile 430 is located directly on path 422 between selected drop-off and pickup location 410 and home 420, preventing a first passenger from being able to safely and comfortably exit autonomous vehicle 300 and walk along path 422 to home 420. Trash pile 430 may also prevent a second passenger from safely and comfortably walking along path 422 from home 420 to selected drop-off and pickup location 410.

[0105]

[0124] In some implementations, the autonomous vehicle 300 may determine to maintain the selected drop-off and pickup location 410. In other implementations, the autonomous vehicle 300 may determine to modify the selected drop-off and pickup location 410. In certain implementations, the autonomous vehicle 300 may modify the selected location 410 for dropping off the first passenger based at least in part on an expected vehicle exit point for the first passenger relative to the trash pile 430. The autonomous vehicle may modify the selected location 410 for picking up the second passenger (if determined to be different from the location where the first passenger was dropped off) based at least in part on an expected vehicle entry point for the second passenger relative to the trash pile 430. In some cases, the autonomous vehicle 300 may maintain the selected location 410 for passenger pickup if the expected entry point of the autonomous vehicle 300 and the detected obstacle or hazardous condition are on different sides of the autonomous vehicle 300. The autonomous vehicle 300 may select an alternate pickup location if the expected entry point and the detected obstacle or hazardous condition are on the same side of the autonomous vehicle 300. Similarly, the autonomous vehicle 300 may maintain the selected location 410 for passenger drop-off if the expected exit point of the autonomous vehicle 300 and the detected obstacle or hazardous condition are on different sides of the autonomous vehicle 300. The autonomous vehicle 300 may select an alternate drop-off location if the expected exit point and the detected obstacle or hazardous condition are on the same side of the autonomous vehicle 300. In some cases, the autonomous vehicle 300 may also consider a physical disability or limitation of the first passenger in selecting an alternate drop-off location.

[0106]

[0125] Additionally or alternatively, the autonomous vehicle 300 may consider the seating location of the first passenger (and other passengers, if present) in determining whether to modify or change the selected location 410 as the drop-off location. With respect to the example of FIG. 4B, the first passenger is seated in seating location number 4 and is expected to exit from the right side of the autonomous vehicle 300. The trash pile 430 and construction fence 435 are also on the right side of the autonomous vehicle 300. In response to determining that the expected exit point and the detected obstacle are on the same side of the vehicle, the autonomous vehicle 300 may determine to modify the selected drop-off location and select an alternative drop-off location. Similarly, in response to determining that the expected entry point and the detected obstacle of the second passenger are on the same side of the vehicle, the autonomous vehicle 300 may modify the selected pick-up location and select an alternative pick-up location. When carrying multiple passengers, the autonomous vehicle 300 may select different alternative drop-off locations for the different passengers or may select the same alternative drop-off location for the multiple passengers.

[0107]

[0126] 4C shows an illustration 400C illustrating the autonomous vehicle 300 selecting an alternative drop-off and pick-up location 440. In some implementations, the alternative drop-off and pick-up location 440 can be selected from a plurality of different alternative drop-off or pick-up locations within a distance of the selected drop-off and pick-up location 410. The plurality of different alternative drop-off or pick-up locations can be identified or determined based on one or more of map data, LIDAR sensor data, images of the surrounding area, videos of the surrounding area, RADAR sensor data, or passenger input. In some implementations, the autonomous vehicle 300 can receive LIDAR sensor data, RADAR sensor data, images of the surrounding area, videos of the surrounding area, and other sensor data directly from sensors provided on or within the autonomous vehicle 300. In other implementations, the autonomous vehicle 300 may receive the LIDAR sensor data, RADAR sensor data, images of the surrounding area, video of the surrounding area, and other sensor data directly from other sources, such as, but not limited to, roadside units, other vehicles, user devices, or any combination thereof. In some other implementations, the autonomous vehicle 300 may receive the LIDAR sensor data, RADAR sensor data, images of the surrounding area, video of the surrounding area, and other sensor data from a server (or other intermediate system or service) that may, at least in some cases, aggregate the sensor data. In some cases, the autonomous vehicle may select various alternative drop-off locations based at least in part on the physical limitations of the first passenger or the presence of an infant, car seat, or child traveling with the first passenger. In other implementations, the autonomous vehicle 300 may determine that the selected drop-off and pickup location 410 is not feasible based at least in part on one or more physical attributes of the first passenger, and may identify one or more feasible alternative drop-off locations based at least in part on the one or more physical attributes of the first passenger.

[0108]

[0127] A number of different alternative drop-off locations may be presented to the first passenger on a user interface, such as, for example, a touch-sensitive display. The first passenger may select or indicate a preference for one of the alternative drop-off locations. The autonomous vehicle 300 may decide to maneuver to the alternative drop-off location selected by the first passenger. In some cases, the autonomous vehicle 300 may determine the first passenger's intention to ignore the trash pile 430 or construction fence 435 and maintain the selected drop-off location 410 for the first passenger. The passenger's intention may be stored in a passenger profile or provided by the first passenger in response to detecting the trash pile 430 or construction fence 435. In some other cases, the autonomous vehicle 300 may prompt each passenger to indicate whether one or more potentially dangerous conditions detected by the autonomous vehicle 300 are of concern to the respective passenger upon entering and / or exiting the autonomous vehicle 300.

[0109]

[0128] By enabling the autonomous vehicle 300 to dynamically change passenger drop-off and pick-up locations based on obstacles or unsafe conditions detected near the selected drop-off and pick-up locations 410, the autonomous vehicle 300 can ensure that passengers are not hindered or inconvenienced by obstacles or unsafe conditions when entering or exiting the autonomous vehicle. In this manner, an autonomous vehicle embodying various aspects of the subject matter disclosed herein can board and disembark passengers in a safer and more convenient manner than conventional autonomous vehicles.

[0110]

[0129] 5A-5C show illustrations 500A-500C, respectively, illustrating a vehicle, such as an autonomous vehicle, dropping off and picking up a passenger, according to various implementations. With respect to the example operation discussed with reference to FIGS. 5A-5C, the autonomous vehicle 300 is scheduled to drop off a first passenger aboard the autonomous vehicle 300 at a selected location 510 and pick up a second passenger waiting in a house 520 at the selected location 510. Thus, the selected location 510 can be referred to as a selected drop-off and pick-up location 510. In other examples, the drop-off location may differ from the pick-up location. As shown in FIG. 5A, the autonomous vehicle 300 is traveling along a street 501 toward an intersection 504, and the selected drop-off and pick-up location 510 is in front of a house 520, which may be the destination of the first passenger. That is, when autonomous vehicle 300 stops at drop-off location 510, a first passenger is expected to exit autonomous vehicle 300 and walk along route 522 to home 520, and a second passenger is expected to walk along route 522 from home 520 to pick-up location 510 and then enter autonomous vehicle 300.

[0111]

[0130] FIG. 5A also shows a first vehicle 531, a second vehicle 532, and a third vehicle 533 parked on the right side of the street 501. Specifically, the first vehicle 531 is parked immediately in front of the selected drop-off and pick-up location 510, and the second vehicle 532 is parked immediately behind the selected drop-off and pick-up location 510. The third vehicle 533 is parked a distance away from the second vehicle 532. The first and second vehicles 531 and 532 are each parked sufficiently close to the selected drop-off and pick-up location 510 that the selected drop-off and pick-up location 510 may not be feasible for passengers who require additional space or time to enter or exit the autonomous vehicle 300. In various implementations, when the autonomous vehicle is to arrive at or depart from the determined pick-up and / or drop-off location, the autonomous vehicle can communicate with an edge server or other servers in a communications network (such as, but not limited to, an LTE communications network, a 5G NR communications network, a wireless local area network (WLAN), a metropolitan area network (MAN), a wide area network (WAN), a personal area network (PAN), a mesh network, the Internet, etc.) and receive information indicating the location, capacity, configuration, availability, and various characteristics of other vehicles expected to be at or near the determined pick-up and / or drop-off location. In one example implementation, the autonomous vehicle can coordinate passenger pick-up and / or drop-off with one or more of the other vehicles based on passenger schedules, passenger physical conditions, passenger time and space requirements for entering / exiting the autonomous vehicle, the presence of obstacles or hazardous conditions at or near the passenger drop-off and pick-up site, traffic conditions, weather conditions, or any combination thereof.In some aspects, when an autonomous vehicle is at or near (or approaching) a respective pick-up and / or drop-off location, the autonomous vehicle may communicate with the other vehicles (e.g., via a PC5 link) to request a temporary move into or out of a parking spot held by one of the other vehicles. In response to the request, the other vehicle may adjust its attitude and position, or may temporarily leave its spot to allow the autonomous vehicle to temporarily use the parking spot for passenger drop-off and / or pickup.

[0112]

[0131] In some cases, the autonomous vehicle 300 may identify a physical impairment or limitation of the first passenger. The autonomous vehicle 300 may determine whether the first passenger needs additional time or space to exit the autonomous vehicle 300 based at least in part on the identified physical impairment or limitation and one or more attributes of the selected drop-off and pick-up location 510. The one or more attributes of the selected drop-off and pick-up location 510 may include, but are not limited to, one or more of puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions (e.g., fire hydrants, walls, trees, etc.), weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of the identified drop-off or pick-up location, or less than a certain amount of space in front of or behind the autonomous vehicle 300.

[0113]

[0132] In some implementations, the autonomous vehicle 300 can also determine whether each passenger aboard (or to be aboard) the autonomous vehicle 300 is accompanied by an infant, car seat, or small child, and / or is traveling with a quantity of baggage, cargo, or equipment that requires additional time and / or space to enter or exit the autonomous vehicle. In some aspects, the amount of baggage, cargo, or equipment that is deemed to require additional time and / or space can be based on the total weight of the baggage, cargo, or equipment, the total size or volume of the baggage, cargo, or equipment, physical attributes of the passenger, historical data indicating the time and / or space required by the passenger for one or more previous rides in an autonomous vehicle, or any combination thereof. The autonomous vehicle 300 can determine whether each passenger requires additional time and / or space to load and unload during passenger boarding and passenger disembarking. For example, a passenger traveling with skis, poles, and camping equipment will need more time and more space in front of the autonomous vehicle 300 to load and unload the skis, poles, and camping equipment than other passengers not traveling with any such equipment. As another example, a passenger traveling with an infant in a car seat will need more time and more space to the side of the autonomous vehicle 300 to load and unload the infant and car seat than other passengers not traveling with a child. Thus, in some cases, the autonomous vehicle 300 can take into account the additional time and / or space required by each passenger in determining whether to keep the selected drop-off and pick-up location 510 or determine one or more viable alternative pick-up and drop-off locations.The additional space may correspond to one or more of a first area proximate the front end of the autonomous vehicle 300, a second area proximate the rear end of the autonomous vehicle 300, a third area proximate the passenger side of the autonomous vehicle 300, or a fourth area proximate the driver's side of the autonomous vehicle 300.

[0114]

[0133] In some cases, the autonomous vehicle 300 may also consider one or more attributes of the selected drop-off and pick-up location 510 in determining whether each passenger needs additional time or space to enter the autonomous vehicle 300 at the pick-up location and to exit the autonomous vehicle 300 at the drop-off location. For example, if the autonomous vehicle 300 were to stop or park at the selected drop-off and pick-up location 510, the area proximate to the front, rear, or exit side of the autonomous vehicle 300 would be below a certain value, the autonomous vehicle 300 may determine that each passenger needs more time and / or space than is available at the selected drop-off and pick-up location 510.

[0115]

[0134] FIG. 5B shows an illustration 500B showing an autonomous vehicle 300 traveling along a street 501 toward a selected drop-off and pick-up location 510. When the autonomous vehicle 300 comes within a certain range of the selected drop-off and pick-up location 510, the autonomous vehicle 300 may determine that a first passenger needs more space and / or time to exit the autonomous vehicle 300 than the selected drop-off location 510 allows. The autonomous vehicle 300 may modify the selected drop-off location 510 for the first passenger. Similarly, the autonomous vehicle 300 may determine that a second passenger needs more space and / or time to enter the autonomous vehicle 300 than the selected pick-up location 510 allows. Based on that determination, the autonomous vehicle 300 may modify the selected pick-up location 510 for the second passenger. The autonomous vehicle 300 may select an alternative drop-off or pick-up location 540 in response to determining that the first and second passengers need additional time and / or space.

[0116]

[0135] FIG. 5C shows an illustration 500C illustrating the autonomous vehicle 300 selecting an alternative drop-off and pick-up location 540. The alternative location 540 is approximately halfway between the house 520 and the intersection 504. For the case where the house 520 is a destination for a first passenger, the first passenger may be expected to exit the autonomous vehicle 300 at the alternative location 540 and walk along the path 543 to the house 520. Similarly, for the case where the house 520 is an origin for a second passenger, the second passenger may be expected to walk from the house 520 to the alternative pick-up location 540 along the path 543. In some implementations, the alternative drop-off and pick-up location 540 can be selected from a plurality of different alternative drop-off or pick-up locations within a distance of the selected drop-off and pick-up location 510. The plurality of different alternative drop-off or pick-up locations can be identified or determined based on one or more of, but not limited to, map data, LIDAR sensor data, images of the surrounding area, video of the surrounding area, RADAR, or passenger input. In some cases, the autonomous vehicle 300 may select various alternative drop-off locations based at least in part on the physical limitations of the first passenger or the presence of an infant, car seat, or child traveling with the first passenger. In other implementations, the autonomous vehicle 300 may determine that the selected drop-off and pick-up location 510 is not feasible based at least in part on one or more physical attributes of the first passenger. The autonomous vehicle 300 may identify one or more viable alternative drop-off locations based at least in part on one or more physical attributes of the first passenger.

[0117]

[0136] 5C , the autonomous vehicle 300 may determine that a first distance 541 between the second vehicle 532 and the rear end of the autonomous vehicle 300 provides sufficient space and / or time for a departing passenger to retrieve baggage and other items from the trunk of the autonomous vehicle 300. The autonomous vehicle 300 may also determine that the first distance 541 provides sufficient space and / or time for an incoming passenger to load baggage and other items into the trunk of the autonomous vehicle 300. Similarly, the autonomous vehicle 300 may determine that a second distance 542 between the third vehicle 533 and the front end of the autonomous vehicle 300 provides sufficient space and / or time for a departing passenger to retrieve equipment and items (such as bicycles and skis) that are carried on racks at the front of the autonomous vehicle 300. The autonomous vehicle 300 may also determine that the second distance 542 provides sufficient space and / or time for the boarding passenger to load up equipment and items (such as bikes and skis) that are placed on a rack at the front of the autonomous vehicle 300. In some implementations, the autonomous vehicle 300 may also estimate or otherwise determine the distance between the alternative location 540 and the home 520 along the expected route 543. In some cases, the autonomous vehicle 300 may inform the first passenger of the estimated distance along the route 543 to the home 520. In some other cases, the autonomous vehicle 300 may inform the second passenger of the estimated distance along the route 543 from the home 520 to the alternative pickup location 540.

[0118]

[0137] Some or all of the various alternative drop-off locations may be presented to the first passenger on a user interface, such as a touch-sensitive display. The first passenger may select or indicate a preference for one of the alternative drop-off locations. The autonomous vehicle 300 may drive to the alternative drop-off location selected by the first passenger.

[0119]

[0138] By enabling a vehicle, such as an autonomous vehicle, to dynamically change passenger drop-off and pick-up locations based on physical limitations and / or whether one or more passengers need additional time or space to enter or exit the vehicle, the vehicle can ensure that passengers who need extra time or space are picked up and dropped off at locations that allow the passengers additional space and / or time to enter or exit the vehicle. In this manner, a vehicle embodying various aspects of the subject matter disclosed herein can pick up and drop off passengers in a safer and more convenient manner than conventional vehicles.

[0120]

[0139] In some other implementations, the autonomous vehicle 300 may determine to drop off and / or pick up a passenger in an area that is proximate to the scheduled drop-off or pick-up location but not designated for parking or passenger drop-off or pick-up. For example, if a scheduled drop-off or pick-up location in an urban environment is not available (e.g., because another vehicle is parked at the scheduled drop-off or pick-up location), the autonomous vehicle 300 may determine that temporary double parking provides sufficient time and space for passengers to safely enter and / or exit the autonomous vehicle 300 with minimal impact to traffic, etc., and is also relatively close to the scheduled drop-off or pick-up location (e.g., within a particular distance of the scheduled drop-off or pick-up location). As another example, if a scheduled drop-off or pick-up location in a suburban area is not accessible (e.g., blocked by other vehicles), the autonomous vehicle 300 may determine that parking in an adjacent driveway provides sufficient time and space for passengers to enter and / or exit the autonomous vehicle 300 and is also relatively close to the scheduled drop-off or pick-up location (e.g., within a particular distance of the scheduled drop-off or pick-up location).

[0121]

[0140] FIG. 6A illustrates a flowchart showing example operations 600 for determining a passenger drop-off or pick-up location according to some implementations. The operations 600 can be performed by an apparatus, such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle, such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be a vehicle (or at least a portion of the vehicle). At block 602, the apparatus can determine an expected entry or exit point for a passenger of the vehicle. At block 604, the apparatus can detect whether an obstacle or hazardous condition exists at or near the site. At block 606, in response to detecting that an obstacle or hazardous condition exists at or near the site, the apparatus can determine a drop-off or pick-up location associated with the site based at least in part on the location of the expected entry or exit point for a passenger of the vehicle and the detected obstacle or hazardous condition.

[0122]

[0141] The detected obstacles or hazardous conditions may include puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions (e.g., fire hydrants, walls, trees, etc.), weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, less than a certain amount of room in front of or behind the vehicle, or any combination thereof. In some implementations, the vehicle may use the detection of snow banks or snowdrifts as an indicator of hidden obstacles under the snow. In some aspects, the vehicle may go around or otherwise avoid the detected snow banks or snowdrifts.

[0123]

[0142] In some cases, determining the drop-off or pick-up location may be based on whether the expected entry or exit point for the passengers of the vehicle and the detected obstacle or hazardous condition are on the same side of the vehicle. For example, if the detected obstacle or hazardous condition and the expected vehicle entry or exit point for each passenger of the vehicle are on the same side of the vehicle, the device may determine an alternative drop-off or pick-up location for the respective passenger. The vehicle may drop-off or pick-up the respective passenger at the alternative drop-off or pick-up location. Conversely, if the detected obstacle or hazardous condition and the expected entry or exit point for each passenger of the vehicle are on different sides of the vehicle, the device may maintain the determined drop-off or pick-up location for the respective passenger. The vehicle may drop-off or pick-up the respective passenger at the original drop-off or pick-up location.

[0124]

[0143] The alternative drop-off or pick-up location can be determined from multiple different alternative drop-off or pick-up locations within a distance from the determined drop-off or pick-up location. In some cases, the distance can be any suitable threshold distance that is long enough to ensure that the passenger's path to or from the vehicle is not blocked or unsafe due to a detected obstacle. The distance can also be short enough to avoid or at least reduce inconvenience to the passenger. In one example implementation, the multiple alternative drop-off or pick-up locations can be determined based on map data, LIDAR sensor data, images of the surrounding area, videos of the surrounding area, RADAR, passenger input, or any combination thereof.

[0125]

[0144] In some implementations, determining the alternative drop-off or boarding location may be based at least in part on one or more conditions associated with the passenger. In some cases, determining the alternative drop-off or boarding location may be based at least in part on the passenger's physical disability or limitation (which may be considered the passenger's first condition). For example, if the passenger has difficulty walking or is in a wheelchair, the vehicle may determine an alternative drop-off or boarding location that is closer to the identified drop-off or boarding location, may determine an alternative drop-off or boarding location that provides wheelchair access, and so on. In other cases, determining the alternative drop-off or boarding location may be based at least in part on the presence of an infant or child with the passenger (which may be considered the passenger's second condition). For example, if the passenger is traveling with an infant, the vehicle may determine an alternative drop-off or boarding location that is closer to the identified drop-off or boarding location, may determine an alternative drop-off or boarding location that has a changing station, and so on. In some other cases, determining the alternative drop-off or pick-up location may be based at least in part on whether the passenger is traveling with a relatively large amount of baggage, cargo, or equipment, which may be considered a third state of the passenger. For example, if the passenger is traveling with a relatively large amount of baggage, the vehicle may determine an alternative drop-off or pick-up location that provides more room for the passenger to load or unload the baggage and / or allows additional time for the passenger to load or unload the baggage. In some other cases, determining the alternative drop-off or pick-up location may be based at least in part on the age of the passenger. For example, if the passenger is a child (e.g., under 13 years old), the vehicle may determine an alternative drop-off or pick-up location that provides room for an adult to help the child exit the vehicle.

[0126]

[0145] FIG. 6B illustrates a flowchart illustrating example operations 610 for determining a passenger drop-off or pick-up location according to some implementations. The operations 610 can be performed by an apparatus, such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle, such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operations 610 can be performed after determining the drop-off or pick-up location in block 606 of FIG. 6A. For example, in block 612, the apparatus can maintain the determined drop-off or pick-up location in response to determining that the expected entry or exit point for the passenger and the detected obstacle or hazardous condition are on different sides of the vehicle.

[0127]

[0146] FIG. 7A shows a flowchart illustrating example operations 700 for determining a passenger drop-off or pick-up location, according to some implementations. The operations 700 can be performed by an apparatus, such as, but not limited to, the vehicle controller 310 of FIG. 3, in conjunction with a vehicle, such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operations 700 can be performed after determining a passenger drop-off or pick-up location in block 606 of FIG. 6A. For example, in block 702, the apparatus can determine an alternative drop-off or pick-up location from a plurality of different alternative drop-off or pick-up locations within a distance from the determined drop-off or pick-up location. In this manner, the vehicle can ensure that a detected obstacle or hazardous condition does not block the passenger's path to or from the vehicle, while also ensuring that the alternative drop-off or pick-up location is within a distance from the original drop-off or pick-up location.

[0128]

[0147] FIG. 7B illustrates a flowchart illustrating example operations 710 for determining a passenger drop-off or pick-up location, according to some implementations. The operations 710 can be performed by an apparatus, such as, but not limited to, the vehicle controller 310 of FIG. 3, in conjunction with a vehicle, such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operations 710 can be performed simultaneously with determining the alternative drop-off or pick-up location in block 702 of FIG. 7A. In other implementations, the operations 710 can be performed after determining the alternative drop-off or pick-up location in block 702 of FIG. 7A. For example, in block 712, the apparatus can receive one or more preferred drop-off or pick-up locations from a plurality of different alternative drop-off or pick-up locations. In block 714, the apparatus can determine the alternative drop-off or pick-up location based on the one or more preferred drop-off or pick-up locations.

[0129]

[0148] In some cases, the vehicle may present some of the alternative drop-off or pick-up locations on a touch-sensitive display viewable by the passenger. The passenger may interact with the touch-sensitive display to determine one of the alternative drop-off or pick-up locations. For example, the alternative drop-off or pick-up locations may be presented on the touch-sensitive display as selectable icons. The passenger may select a particular alternative drop-off or pick-up location by touching, tapping, or otherwise interacting with a selectable icon corresponding to the particular alternative drop-off or pick-up location. In some cases, the touch-sensitive display may be a touch-sensitive display screen of a mobile computing device associated with the passenger. In some other cases, the touch-sensitive display may be provided within an interior of the vehicle and configured to be viewable by the passenger being transported by the vehicle. The vehicle may determine the alternative drop-off or pick-up location indicated by the passenger. The vehicle may drive to the selected alternative drop-off or pick-up location identified by the passenger. In some other cases, the vehicle may present some of the alternative drop-off or pick-up locations on a touch-sensitive display of the passenger's user device, and the passenger may interact with the user device to determine one of the alternative drop-off or pick-up locations.

[0130]

[0149] FIG. 8A illustrates a flowchart showing example operations 800 for determining an alternative drop-off location, according to some implementations. The operations 800 can be performed by an apparatus, such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle, such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operations 800 can be performed after determining an alternative drop-off or pickup location in block 606 of FIG. 6A. For example, in block 802, the apparatus can determine one or more alternative drop-off locations based at least in part on one or more physical attributes of the passenger.

[0131]

[0150] FIG. 8B illustrates a flowchart showing example operations 810 for determining one of the alternative drop-off locations according to some implementations. The operations 810 can be performed by an apparatus, such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle, such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operations 810 can be performed after determining one or more alternative drop-off locations in block 802 of FIG. 8A. For example, in block 812, the apparatus can determine one of the alternative drop-off locations from the passenger. In block 814, the apparatus can cause the vehicle to drop off the passenger at the determined alternative drop-off location.

[0132]

[0151] In one example implementation, the alternative drop-off or pickup locations may be presented on a touch-sensitive display as selectable icons. A passenger may select a particular alternative drop-off or pickup location by touching, tapping, or otherwise interacting with the selectable icon that corresponds to the particular alternative drop-off or pickup location. In some cases, the touch-sensitive display may be a touch-sensitive display screen of a mobile computing device associated with the passenger. In some other cases, the touch-sensitive display may be provided within the interior of the vehicle and configured to be viewable by passengers being transported by the vehicle.

[0133]

[0152] FIG. 9 illustrates a flowchart illustrating example operations 900 for determining a passenger drop-off or pick-up location, according to some implementations. The operations 900 can be performed by an apparatus, such as, but not limited to, the vehicle controller 310 of FIG. 3, in conjunction with a vehicle, such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operations 900 can be performed in conjunction with determining one of the alternative drop-off locations in block 812 of FIG. 8B. For example, in block 902, the apparatus can receive an indication of the passenger's willingness to ignore a detected obstacle or dangerous condition. In block 904, the apparatus can maintain the determined drop-off or pick-up location in response to receiving an indication of the passenger's willingness to ignore a detected obstacle or dangerous condition. In some cases, the passenger's willingness to ignore a particular obstacle or dangerous condition can be stored in a passenger profile. In some other cases, a passenger's intent to ignore a particular obstacle or dangerous condition may be received from the passenger.

[0134]

[0153] FIG. 10 illustrates a flowchart showing example operations 1000 for determining a location of an obstacle or hazardous condition according to some implementations. The operations 1000 can be performed by an apparatus such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be a vehicle (or at least a portion of a vehicle). In some implementations, the operations 1000 can be an example of detecting whether an obstacle or hazardous condition exists at or near a scene in block 604 of FIG. 6A. For example, in block 1002, the apparatus can receive one or more sensor measurements indicating the presence of an object in the surrounding environment. In block 1004, the apparatus can generate a three-dimensional map of points corresponding to the location of the detected object. In block 1006, the apparatus can determine a location of the obstacle or hazardous condition in the surrounding area based at least in part on the three-dimensional point map.

[0135]

[0154] FIG. 11 shows a flowchart illustrating an example operation 1100 for determining a passenger drop-off or pick-up location according to some other implementations. The operation 1100 can be performed by an apparatus such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operation 1100 can be performed after determining the drop-off location in block 606 of FIG. 6A. For example, in block 1102, the apparatus can determine a seating position of the passenger in the vehicle. In block 1104, the apparatus can determine one or more alternative drop-off locations based on the seating position of the passenger relative to an expected entry or exit point for the passenger of the vehicle.

[0136]

[0155] FIG. 12 shows a flowchart illustrating example operations 1200 for determining an alternative drop-off location according to some other implementations. The operations 1200 can be performed by an apparatus such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operations 1200 can be performed after determining the drop-off or pick-up location in block 606 of FIG. 6A. For example, in block 1202, the apparatus can determine whether the passenger needs additional time or space to enter or exit the vehicle based at least in part on one or more attributes of the determined drop-off or pick-up location, one or more attributes of the passenger, one or more physical limitations or handicaps of the passenger, or any combination thereof. At block 1204, the device may determine one or more alternative drop-off or pick-up locations in response to determining that the passenger needs additional time or space to enter or exit the vehicle.

[0137]

[0156] FIG. 13 shows a flowchart illustrating example operations 1300 for determining a passenger drop-off or pick-up location according to some other implementations. The operations 1300 can be performed by an apparatus, such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle, such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be a vehicle (or at least a portion of the vehicle). At block 1302, the apparatus can determine a drop-off or pick-up location for a passenger of the vehicle. At block 1304, the apparatus can determine whether the passenger needs additional time or space to enter or exit the vehicle based at least in part on one or more attributes of the determined drop-off or pick-up location, one or more attributes of the passenger, one or more physical limitations or disabilities of the passenger, or any combination thereof. At block 1306, the device may determine one or more alternative drop-off or pick-up locations in response to determining that the passenger needs additional time or space to enter or exit the vehicle.

[0138]

[0157] The one or more attributes of the determined drop-off or pick-up location may include puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions (e.g., fire hydrants, walls, trees, etc.), weather conditions, fire breaks, no parking zones, or closed lanes within the vicinity of the identified drop-off or pick-up location, less than a certain amount of clearance in front of or behind the vehicle, or any combination thereof.

[0139]

[0158] In some implementations, determining that a passenger requires additional time and / or space to enter or exit the vehicle may be based on the number of passengers in the vehicle exceeding a set value. In other implementations, determining that a passenger requires additional time and / or space to enter or exit the vehicle may be based on the presence or expected presence of cargo in the trunk of the vehicle, an equipment rack attached to the vehicle (such as a bike rack, a luggage rack, a ski rack, etc.), the presence or expected presence of an infant or child traveling with the passenger, the presence or expected presence of a child car seat in the vehicle, or any combination thereof.

[0140]

[0159] In some implementations, the vehicle may detect one or more physical limitations or disabilities of the passenger using one or more of sensors 372 and 376. In other implementations, the passenger may inform the vehicle (or vehicle controller) of the passenger's one or more physical limitations or disabilities. In some cases, the passenger may indicate one or more physical limitations or disabilities in the passenger's profile. The vehicle may retrieve the passenger's one or more physical limitations or disabilities by accessing the passenger's profile. In other cases, the passenger may send a notification of one or more physical limitations or disabilities to the vehicle using a mobile computing device.

[0141]

[0160] In various implementations, the additional space can be a first area proximate the rear end of the vehicle, a second area proximate the front end of the vehicle, a third area proximate the passenger side of the vehicle, a fourth area proximate the driver's side of the vehicle, or any combination thereof.

[0142]

[0161] FIG. 14 illustrates a flowchart showing example operations 1400 for determining a passenger drop-off or pick-up location according to some other implementations. The operations 1400 can be performed by an apparatus such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be a vehicle (or at least a portion of the vehicle). At block 1402, the apparatus can determine a passenger drop-off or pick-up location. In some cases, the vehicle may be transporting one or more passengers to the determined location. In such cases, the vehicle can drop off one or more passengers at the determined location. In various implementations, the vehicle can continuously or periodically receive one or more sensor measurements that indicate the presence of an object or a dangerous condition in the surrounding environment. For example, as described with reference to one or more of operations 600, 700, 710, 800, 810, 900, 1000, 1100, 1200, or 1300 in Figures 6, 7A, 7B, 8A, 8B, 9, 10, 11, 12, and 13, respectively, the vehicle may determine an alternative drop-off location if an obstacle or unsafe condition is detected within a particular area of ​​the determined location.

[0143]

[0162] At block 1404, the device may cause the vehicle to park at or near the determined location. In some cases, the vehicle may be able to temporarily park (e.g., for a limited period of time) at the determined location. For example, for the case where the vehicle is dropping off one or more passengers at the determined location, the vehicle may detect an available parking space at the determined location. Of course, the vehicle may also detect an available parking space when not transporting passengers to the determined location. In either scenario, the vehicle may park in an available space at the determined location. In other cases, for example, when there is no available parking space at the determined location (or when an obstacle or dangerous condition is detected at the determined location), the vehicle may park at an alternative location proximate to the determined location (e.g., within a certain distance from the determined location). In some other cases, for example, when there is no available parking space at any alternative location within a certain distance from the determined location, the vehicle may continue to drive around the area of ​​the determined location.

[0144]

[0163] At block 1406, the device may cause the vehicle to wait at or near the determined location for one or more passengers to be picked up. At block 1408, the device may receive one or more sensor measurements indicating the presence of an object or dangerous condition in the surrounding environment. For example, when the vehicle parks at the determined location, the vehicle may monitor a particular area around the determined location for obstacles or dangerous conditions, may receive an indication of the presence of an object or dangerous condition, or any combination thereof. If the device does not detect any obstacles or dangerous conditions at block 1410, the device may continue to monitor the surrounding environment at block 1408.

[0145]

[0164] However, if the device detects the presence of an obstacle or dangerous condition in the surrounding environment at block 1410 (e.g., while the vehicle is waiting to pick up one or more passengers at the determined location or an alternate location), the device may also determine whether the detected obstacle or dangerous condition can be ignored by the respective passenger at block 1412. If the detected obstacle or dangerous condition can be ignored by the respective passenger, the device may continue to determine whether there is a presence of another obstacle or dangerous condition at block 1408. For example, if the device detects a puddle while the vehicle is parked at the alternate location and is to pick up one or more passengers at the determined location, the device may ignore the puddle (e.g., because the puddle will not obstruct the passenger's path).

[0146]

[0165] Conversely, if the detected obstacle or unsafe condition cannot be ignored by the respective passenger at block 1412, then the device determines a new pick-up location at block 1414. For example, if the device detects uneven pavement while the vehicle is parked at the determined location and is to pick up one or more passengers at the determined location, the device cannot ignore the uneven pavement (e.g., because the uneven pavement may obstruct the passenger's path to the vehicle). The determination of the new location, as well as consideration of various passenger attributes, conditions, and / or preferences, may include any number of the operations described above.

[0147]

[0166] Detected obstacles or hazardous conditions may include puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions (e.g., fire hydrants, walls, trees, etc.), weather conditions, fire breaks, no parking zones, closed lanes in the vicinity of an identified drop-off or pick-up location, less than a certain amount of room in front of or behind the vehicle, or any other obstacle or condition that prevents a passenger from being able to enter or exit the vehicle. In some implementations, the selection of an alternate drop-off or pick-up location may be based on an expected entry or exit point for the passenger of the vehicle, the passenger's seated position relative to the expected entry or exit point for the passenger of the vehicle, a physical disability or restriction of the passenger, or any combination thereof.

[0148]

[0167] In some implementations, the device can send a notification of the detected obstacle or hazardous condition to the passenger. The notification can be any suitable notification including, but not limited to, a push notification, a text message, an email, an automated voice call, etc. that can be sent to the passenger's mobile computing device. In some other implementations, the vehicle can navigate to an alternate drop-off or pickup location in response to detecting the presence of an obstacle or hazardous condition.

[0149]

[0168] FIG. 15 shows a flowchart illustrating example operations 1500 for determining a passenger drop-off or pick-up location according to some other implementations. The operations 1500 can be performed by an apparatus such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). At block 1502, the apparatus can determine a drop-off or pick-up location for a passenger of the vehicle. At block 1504, the apparatus can detect the presence of an obstacle or unsafe condition in the area of ​​the drop-off or pick-up location while the vehicle is within a distance from the drop-off or pick-up location. At block 1506, the apparatus can determine an alternative drop-off or pick-up location based on the presence of an obstacle or unsafe condition in the area.

[0150]

[0169] FIG. 16 illustrates a flowchart showing example operations 1600 for determining a passenger drop-off or pick-up location according to some other implementations. The operations 1600 can be performed by an apparatus such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operations 1600 can be performed after determining the drop-off or pick-up location in block 1502 of FIG. 15. For example, in block 1602, the vehicle can transport the passenger to an alternative drop-off or pick-up location.

[0151]

[0170] FIG. 17 illustrates a flowchart illustrating example operations 1700 for determining a passenger drop-off or pick-up location according to some other implementations. The operations 1700 can be performed by an apparatus, such as, but not limited to, the vehicle controller 310 of FIG. 3 in conjunction with a vehicle, such as, but not limited to, the autonomous vehicle 300 of FIG. 3. In some cases, the apparatus can be implemented within the vehicle. In other cases, the apparatus can be external to the vehicle. In some other aspects, the apparatus can be the vehicle (or at least a portion of the vehicle). In some implementations, the operations 1700 can be performed after determining the drop-off or pick-up location at block 1502 of FIG. 15. For example, at block 1702, the apparatus can receive an indication that the drop-off or pick-up location is not feasible or convenient for the passenger. The apparatus can determine an alternative drop-off or pick-up location based at least in part on the received indication.

[0152]

[0171] Example implementations are described in the following numbered clauses. 1. Memory and one or more processors communicatively coupled to the memory; 1. An apparatus comprising: determining expected entry or exit points for passengers of the vehicle; Detecting whether an obstacle or hazardous condition exists at or near the site; In response to detecting the presence of an obstacle or hazardous condition at or near the site, the device is configured to: determine a location of an expected entry or exit point for a vehicle passenger and a drop-off or pickup location associated with the site based at least in part on the detected obstacle or hazardous condition. 2. The device described in clause 1, where the detected obstacle or hazardous condition includes puddles, ice, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, less than a specified amount of clearance in front of or behind the vehicle, or any combination thereof. 3. The apparatus of any of clauses 1-2, wherein determining the drop-off or pick-up location is further based on the seating position of the passenger. 4. The device of any of clauses 1 to 3, wherein determining the drop-off or pick-up location is based on whether the expected entry or exit point for the vehicle passenger and the detected obstacle or hazardous condition are on the same side of the vehicle. 5. The one or more processors further comprise: 5. The apparatus of any of clauses 1 to 4, configured to determine an alternative drop-off or pick-up location from a plurality of different alternative drop-off or pick-up locations within a distance from the determined drop-off or pick-up location. 6. The apparatus of clause 5, wherein the plurality of different alternative drop-off or pick-up locations are based on map data, coherent optical sensing system data, images of the surrounding area, video of the surrounding area, RADAR, passenger input, or any combination thereof. 7. The device described in clause 5, wherein the plurality of different alternative drop-off or pick-up locations is based at least in part on the physical limitations of the passenger, the age of the passenger, the presence of an infant or child accompanying the passenger, or any combination thereof. 8. The one or more processors further: Receiving one or more preferred drop-off or pick-up locations from a plurality of different alternative drop-off or pick-up locations; and determining an alternative drop-off or pick-up location based on the one or more preferred drop-off or pick-up locations. 9. The one or more processors further: The apparatus of any of clauses 1-8, configured to determine one or more alternative drop-off locations based at least in part on one or more physical attributes of the passenger. 10. The one or more processors further comprise: The apparatus of clause 9, configured to obtain one of the alternative drop-off locations from the passenger. 11. The apparatus of any of clauses 1 to 10, further comprising a vehicle controller implemented within the vehicle. 12. The apparatus of any of clauses 1-10, further comprising a vehicle controller implemented on a server or cloud-based vehicle control system. 13. The one or more processors further: receiving an indication of a passenger's intent to ignore the detected obstacle or hazardous condition; and in response to receiving an indication of a passenger's intent to ignore the detected obstacle or hazardous condition, maintaining the determined drop-off or pick-up location. 14. Detecting obstacles or dangerous conditions Receiving one or more sensor measurements indicative of a presence of an object in a surrounding environment; generating a three-dimensional map of points corresponding to locations of detected objects; and determining a location of an obstacle or hazardous condition in the surrounding area based on the three-dimensional point map. 15. The one or more processors further: Determining passenger seating positions in a vehicle; and determining one or more alternative drop-off locations based on seating positions of passengers relative to expected entry or exit points for the passengers of the vehicle. 16. The device described in clause 15, wherein the determination of the alternative drop-off location or locations is based on determining that the passenger's seating position and the expected entry or exit point are on the same side of the vehicle, regardless of the seating positions of one or more other passengers in the vehicle. 17. The one or more processors further: determining whether the passenger requires additional time or space to enter or exit the vehicle based at least in part on one or more attributes of the determined drop-off or pick-up location, one or more attributes of the passenger, one or more physical limitations or disabilities of the passenger, or any combination thereof; and determining one or more alternative drop-off or pick-up locations in response to determining that a passenger needs additional time or space to enter or exit the vehicle. 18. A method for controlling one or more operations of a vehicle, comprising: determining expected entry or exit points for passengers of the vehicle; Detecting whether an obstacle or hazardous condition exists at or near the site; in response to detecting the presence of an obstacle or hazardous condition at or near the site, determining a location of an expected entry or exit point for a passenger of the vehicle and a drop-off or pickup location associated with the site based at least in part on the detected obstacle or hazardous condition. 19. The method described in clause 18, wherein the detected obstacle or hazardous condition includes puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, less than a specified amount of clearance in front of or behind the vehicle, or any combination thereof. 20. The method according to any of clauses 18 to 19, wherein determining the drop-off or pick-up location is based on the seating position of the passenger. 21. A method as described in any of clauses 18 to 20, wherein determining the drop-off or pick-up location is based on whether the expected entry or exit point for the vehicle passenger and the detected obstacle or hazardous condition are on the same side of the vehicle. 22. Receiving one or more preferred drop-off or pick-up locations from a plurality of different alternative drop-off or pick-up locations; and determining an alternate drop-off or pick-up location based on one or more preferred drop-off or pick-up locations; 23. The method of claim 22, further comprising: 23. Determining one or more alternative drop-off locations based at least in part on one or more physical attributes of the passenger. 22. The method according to any one of clauses 18 to 21, further comprising: 24. Determining passenger seating positions in a vehicle; determining one or more alternative drop-off locations based on seating positions of passengers relative to expected entry or exit points for the passengers of the vehicle; 22. The method according to any one of clauses 18 to 21, further comprising: 25. Means for determining expected entry or exit points for vehicle passengers; means for detecting whether an obstacle or hazardous condition exists at or near the site; means for determining, in response to detecting the presence of an obstacle or hazardous condition at or near the site, a drop-off or pick-up location associated with the site based at least in part on the location of an expected entry or exit point for a passenger of the vehicle and the detected obstacle or hazardous condition; A system including: 26. Means for determining one or more alternative drop-off locations based at least in part on one or more physical attributes of the passenger. 26. The system of claim 25, further comprising: 27. Means for determining the seating position of passengers in a vehicle; means for determining one or more alternative drop-off locations based on passenger seating positions relative to expected entry or exit points for the passengers of the vehicle; 27. The system of any one of clauses 25 to 26, further comprising: 28. A non-transitory computer-readable medium storing instructions for controlling a vehicle, the execution of the instructions by one or more processors of a device comprising: determining expected entry or exit points for passengers of the vehicle; Detecting whether an obstacle or hazardous condition exists at or near the site; A non-transitory computer readable medium that, in response to detecting the presence of an obstacle or hazardous condition at or near the site, causes a vehicle to perform operations including determining locations of expected entry or exit points for a passenger of the vehicle and a drop-off or pickup location associated with the site based at least in part on the detected obstacle or hazardous condition. 29. Execution of instructions by one or more processors The non-transitory computer-readable medium of clause 28, causing the vehicle to perform operations further including determining one or more alternative drop-off locations based at least in part on one or more physical attributes of the passenger. 30. Execution of instructions by one or more processors Determining passenger seating positions in a vehicle; 30. The non-transitory computer readable medium of any of clauses 28-29, further comprising causing the vehicle to perform an operation including determining one or more alternative drop-off locations based on seating positions of passengers relative to an expected entry or exit point for the passengers of the vehicle. 31. Memory and one or more processors communicatively coupled to the memory; 1. An apparatus comprising: determining drop-off or pick-up locations for passengers of the vehicle; determining whether the passenger requires additional time or space to enter or exit the vehicle based at least in part on one or more attributes of the determined drop-off or pick-up location, one or more physical attributes of the passenger, one or more physical limitations or disabilities of the passenger, or any combination thereof; and determining one or more alternative drop-off or pick-up locations in response to determining that the passenger needs additional time or space to enter or exit the vehicle. 32. An apparatus as described in clause 31, wherein one or more attributes of the determined drop-off or pick-up location include puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of the identified drop-off or pick-up location, less than a specified amount of clearance in front of or behind the vehicle, or any combination thereof. 33. An apparatus as described in any of clauses 31-32, wherein determining whether a passenger requires additional time or space to enter or exit the vehicle is further based on the presence or expected presence of cargo in the trunk of the vehicle, in an equipment rack attached to the vehicle, the presence or expected presence of an infant or child traveling with the passenger, the presence or expected presence of a child car seat in the vehicle, or any combination thereof. 34. The apparatus of any of clauses 31-33, wherein the space includes a first area adjacent a rear end of the vehicle, a second area adjacent a front end of the vehicle, a third area adjacent a passenger side of the vehicle, a fourth area adjacent a driver side of the vehicle, or any combination thereof. 35. An apparatus as described in any of clauses 31 to 34, wherein the alternative drop-off or boarding location is determined from a plurality of alternative drop-off or boarding locations within a certain distance from the determined drop-off or boarding location. 36. Determining one or more alternative drop-off or pick-up locations is presenting the alternative drop-off or pick-up locations on a display screen viewable by the passenger; receiving from the passenger an indication of one of the offered alternative drop-off or pick-up locations; and determining a drop-off or pick-up location in response to the received indication. 37. The apparatus of any of clauses 31-36, wherein determining that at least one passenger needs additional time or space includes receiving an indication from a mobile computing device associated with the passenger. 38. Memory and one or more processors communicatively coupled to the memory; 1. An apparatus comprising: determining a passenger drop-off or pick-up location for a passenger of the vehicle; parking the vehicle at or near the determined location; waiting at or near the determined location to pick up one or more passengers; receiving a sensor measurement indicative of a presence of an object in a surrounding environment; and determining a new passenger pickup location in response to a presence of an object in the surrounding environment. 39. The device described in clause 38, wherein the detected obstacle or hazardous condition includes puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, less than a specified amount of clearance in front of or behind the vehicle, or any combination thereof. 40. An apparatus as described in any of clauses 38-39, wherein the determination of the alternative drop-off or boarding location is based on an expected entry or exit point for the passenger of the vehicle, a seated position of the passenger relative to the expected entry or exit point for the passenger of the vehicle, a physical disability or limitation of the passenger, or any combination thereof. 41. An apparatus as described in any of clauses 38 to 40, wherein the determination of the alternative drop-off or boarding location is based on whether a passenger requires additional time or space to enter or exit the vehicle. 42. The device described in clause 41, wherein the additional space includes a first area adjacent a rear end of the vehicle, a second area adjacent a front end of the vehicle, a third area adjacent a passenger side of the vehicle, a fourth area adjacent a driver side of the vehicle, or any combination thereof. 43. Memory and one or more processors communicatively coupled to the memory; 1. An apparatus comprising: determining drop-off or pick-up locations for passengers of the vehicle; Detecting the presence of an obstacle or hazardous condition within the area of ​​the drop-off or pick-up location while the vehicle is parked at the drop-off or pick-up location; and determining an alternative drop-off or pick-up location based on the presence of an obstacle or hazardous condition in the area. 44. The device described in clause 43, wherein the detected obstacle or hazardous condition includes puddles, ice chips, potholes, uneven pavement, high curbs, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of an identified drop-off or pick-up location, less than a specified amount of clearance in front of or behind the vehicle, or any combination thereof. 45. An apparatus as described in any of clauses 43-44, wherein the determination of the alternative drop-off or boarding location is based on an expected entry or exit point for the passenger of the vehicle, the passenger's seating position relative to the expected entry or exit point for the passenger of the vehicle, a physical disability or limitation of the passenger, or any combination thereof. 46. ​​An apparatus as described in any of clauses 43 to 45, in which the determination of the alternative drop-off or boarding location is based on whether a passenger requires additional time or space to enter or exit the vehicle. 47. The processor or processors further: 47. The apparatus of any of clauses 43-46, configured to drive to an alternative drop-off or pick-up location. 48. The processor or processors further: The device described in clause 47 configured to receive an indication that the alternative drop-off or pick-up location is not feasible or convenient for the passenger.

[0153]

[0172] As used herein, a phrase referring to "at least one of" a list of items refers to any combination of those items, including single members. As an example, "at least one of a, b, or c" is intended to cover a, b, c, ab, ac, bc, and abc.

[0154]

[0173] The various example logic, logic blocks, modules, circuits, and algorithmic processes described in connection with the implementations disclosed herein may be implemented as electronic hardware, computer software, or a combination of both. Interchangeability between hardware and software has been generally described in terms of functionality and is illustrated in the various example components, blocks, modules, circuits, and processes described above. Whether such functionality is implemented in hardware or software depends on the particular application and design constraints imposed on the overall system.

[0155]

[0174] The hardware and data processing devices used to implement the various example logic, logic blocks, modules, and circuits described in connection with the aspects disclosed herein may be implemented or performed using general purpose single-chip or multi-chip processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or any combination thereof, designed to perform the functions described herein. A general purpose processor may be a microprocessor, or any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices (such as a combination of a DSP and a microprocessor), multiple microprocessors, one or more microprocessors in combination with a DSP core, or any other such configuration. In some implementations, certain processes and methods may be performed by circuitry that is specific to a given function.

[0156]

[0175] In one or more aspects, the functions described may be implemented in hardware, digital electronic circuitry, computer software, firmware, or any combination thereof, including the structures disclosed herein and their structural equivalents. Implementations of the subject matter described herein may also be implemented as one or more computer programs, i.e., one or more modules of computer program instructions, encoded on a computer storage medium for execution by or to control the operation of a data processing apparatus.

[0157]

[0176] If implemented in software, the functions can be stored on or transmitted as one or more instructions or codes on a computer-readable medium. The processes of the methods or algorithms disclosed herein can be implemented in processor-executable software modules that can reside on a computer-readable medium. Computer-readable media includes both computer storage media and communication media, including any medium that can enable a computer program to be transferred from one place to another. A storage medium can be any available medium that can be accessed by a computer. By way of example, and not limitation, such computer-readable media can include RAM, ROM, EEPROM, CD-ROM, or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store desired program code in the form of instructions or data structures and that can be accessed by a computer. Also, any connection can be properly referred to as a computer-readable medium. Disk and disc, as used herein, include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc, where disks typically reproduce data magnetically, while discs reproduce data optically using a laser. Combinations of the above are also intended to be included within the scope of computer readable media.Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and instructions on a machine-readable medium and computer-readable medium, which may be incorporated into a computer program product.

[0158]

[0177] Various modifications to the implementations described in this disclosure may be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other implementations without departing from the spirit or scope of the disclosure. Thus, the claims are not intended to be limited to the implementations shown herein, but should be accorded the widest scope consistent with the disclosure, the principles, and novel features disclosed herein.

Claims

1. Memory, one or more processors communicatively coupled to the memory; an apparatus comprising: determining expected entry or exit points for passengers of the vehicle; Detecting whether an obstacle or hazardous condition exists at or near a scene associated with the expected entry point or the expected exit point for the passenger of the vehicle; in response to detecting the presence of the obstacle or hazardous condition at or near the site, determining a drop-off or pick-up location associated with the site based at least in part on a location of the expected entry or exit point for the passenger of the vehicle and the detected obstacle or hazardous condition; determining a seating position of the passenger in the vehicle; determining an alternate drop-off or pick-up location based on determining that the seating location of the passenger and the anticipated entry or exit point are on the same side of the vehicle regardless of the seating locations of one or more other passengers in the vehicle; The apparatus is configured to:

2. 2. The device of claim 1, wherein the detected obstacle or hazardous condition includes a puddle, ice chips, potholes, uneven pavement, high curb, storm drains, trash, construction fences, other vehicles, obstructions, weather conditions, fire breaks, no parking zones, closed lanes within the vicinity of the identified drop-off or pick-up location, less than a certain amount of clearance in front of or behind the vehicle, or any combination thereof.

3. The apparatus of claim 1 , wherein determining the drop-off or pick-up location is further based on a seating position of the passenger.

4. 2. The apparatus of claim 1, wherein determining the drop-off or pick-up location is based on whether the expected entry or exit point for the passenger of the vehicle and the detected obstacle or hazardous condition are on the same side of the vehicle.

5. The one or more processors further comprise: The apparatus of claim 1 , configured to determine an alternative drop-off or pick-up location from a plurality of different alternative drop-off or pick-up locations within a distance from the determined drop-off or pick-up location.

6. 6. The apparatus of claim 5, wherein the plurality of different alternative drop-off or pick-up locations are based on map data, coherent optical sensing system data, images of the surrounding area, videos of the surrounding area, RADAR, passenger input, or any combination thereof.

7. 6. The apparatus of claim 5, wherein the plurality of different alternative drop-off or pick-up locations are based at least in part on a physical limitation of the passenger, an age of the passenger, the presence of an infant or child accompanying the passenger, or any combination thereof.

8. The one or more processors further comprise: Receiving one or more preferred drop-off or pick-up locations from a plurality of different alternative drop-off or pick-up locations; and determining the alternative drop-off or pick-up location based on the one or more preferred drop-off or pick-up locations.

9. The one or more processors further comprise:

13. The apparatus of claim 1, configured to determine one or more alternative drop-off locations based at least in part on one or more physical attributes of the passenger, and optionally further configured to obtain one of the alternative drop-off locations from the passenger.

10. The apparatus of claim 1 , wherein the apparatus comprises a vehicle controller implemented within the vehicle.

11. The apparatus of claim 1 , wherein the apparatus comprises a vehicle controller implemented on a server or a cloud-based vehicle control system.

12. The one or more processors further comprise: receiving an indication of the passenger's willingness to ignore the detected obstacle or hazardous condition; and in response to receiving the indication of the passenger's intent to ignore the detected obstacle or hazardous condition, maintaining the determined drop-off or pick-up location.

13. detecting the obstacle or hazardous condition, Receiving one or more sensor measurements indicative of a presence of an object in a surrounding environment; generating a three-dimensional map of points corresponding to locations of the detected objects; and determining a location of the obstacle or hazardous condition in the surrounding area based on the three-dimensional point map.

14. The one or more processors further comprise: determining whether the passenger requires additional time or space to enter or exit the vehicle based at least in part on one or more attributes of the determined drop-off or pick-up location, one or more attributes of the passenger, one or more physical limitations or disabilities of the passenger, or any combination thereof; and determining one or more alternative drop-off or pick-up locations in response to determining that the passenger needs additional time or space to enter or exit the vehicle.

15. 1. A method for controlling one or more operations of a vehicle, comprising: determining expected entry or exit points for passengers of said vehicle; Detecting whether an obstacle or hazardous condition exists at or near a scene associated with the expected entry point or the expected exit point for the passenger of the vehicle; in response to detecting the presence of the obstacle or hazardous condition at or near the site, determining a drop-off or pick-up location associated with the site based at least in part on a location of the expected entry or exit point for the passenger of the vehicle and the detected obstacle or hazardous condition; determining a seating position of the passenger in the vehicle; determining an alternate drop-off or pick-up location based on determining that the seating location of the passenger and the anticipated entry or exit point are on the same side of the vehicle regardless of the seating locations of one or more other passengers in the vehicle; A method for providing the above.

16. A non-transitory computer-readable medium storing instructions for controlling a vehicle, the execution of the instructions by one or more processors of a device comprising: determining expected entry or exit points for passengers of said vehicle; Detecting whether an obstacle or hazardous condition exists at or near a scene associated with the expected entry point or the expected exit point for the passenger of the vehicle; in response to detecting the presence of the obstacle or hazardous condition at or near the site, determining a drop-off or pick-up location associated with the site based at least in part on a location of the expected entry or exit point for the passenger of the vehicle and the detected obstacle or hazardous condition; determining a seating position of the passenger in the vehicle; determining an alternate drop-off or pick-up location based on determining that the seating location of the passenger and the anticipated entry or exit point are on the same side of the vehicle regardless of the seating locations of one or more other passengers in the vehicle; 23. A non-transitory computer readable medium for causing the vehicle to perform operations comprising: