Boarding experience enhancement with external services

Abstract

A method for boarding experience enhancement with an external service may include receiving a request for shipping of a passenger to a service provider, and determining route information corresponding to the request. Some described methods also include providing service information associated with a service provider to the passenger, and receiving at least one requested service from the passenger based on the provided service information. Some described methods also include transmitting at least a portion of the route information and the at least one requesting service to the service provider. A system and a computer program product are also provided.

Description

Background Art

[0001] People participate in ride hailing services for providing transportation from a first location to a second location. Merchants are typically located at various locations. Thus, when a potential passenger uses a ride hailing service to request transportation, the potential passenger can request transportation to the locations of various merchants. The passenger arrives at the location of the merchant and can obtain goods or services from the merchant. BRIEF DESCRIPTION OF THE DRAWINGS

[0002] Figure 1 is an example environment of a vehicle that can implement one or more components of an autonomous system;

[0003] Figure 2 is a diagram of one or more systems of a vehicle including an autonomous system;

[0004] Figure 3 is Figure 1 and Figure 2 a diagram of one or more devices and / or components of one or more systems of;

[0005] Figure 4 is a diagram of certain components of an autonomous system;

[0006] Figure 5 is a diagram of an implementation of a process for enhancing a ride experience using an external service;

[0007] Figure 6 is a diagram of an example process for enhancing a ride experience using an external service;

[0008] Figure 7 is a diagram of an example environment in which a ride experience is enhanced using an external service; and

[0009] Figure 8 is a flowchart of a process for enhancing a ride experience using an external service. DETAILED DESCRIPTION

[0010] In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. It will be apparent, however, that the embodiments described in the present disclosure may be practiced without these specific details. In some instances, well-known structures and devices are illustrated in block diagram form to avoid unnecessarily obscuring aspects of the present disclosure.

[0011] In the drawings, for ease of description, a specific arrangement or order of illustrative elements (such as those representing systems, devices, modules, instruction blocks, and / or data elements, etc.) is illustrated. However, those skilled in the art will understand that, unless explicitly described, the specific order or arrangement of the illustrative elements in the drawings is not intended to imply a required processing order or sequence, or a separation of processes. In addition, unless explicitly described, the inclusion of illustrative elements in the drawings is not intended to mean that such elements are required in all embodiments, nor is it intended to mean that the features represented by such elements cannot be included in some embodiments or cannot be combined with other elements in some embodiments.

[0012] Furthermore, in the drawings, connecting elements (such as solid lines, dashed lines, or arrows, etc.) are used to illustrate connections, relationships, or associations between or among two or more other illustrative elements. The absence of any such connecting element is not intended to mean that connections, relationships, or associations cannot exist. In other words, some connections, relationships, or associations between elements are not illustrated in the drawings so as not to obscure the present disclosure. In addition, for ease of illustration, a single connecting element may be used to represent multiple connections, relationships, or associations between elements. For example, if a connecting element represents the communication of a signal, data, or instruction (e.g., "software instruction"), those skilled in the art should understand that such an element may represent one or more signal paths (e.g., a bus) that may be required to affect the communication.

[0013] Although terms such as "first", "second", and / or "third", etc. are used to describe various elements, these elements should not be limited by these terms. The terms "first", "second", and / or "third" are only used to distinguish one element from another. For example, without departing from the scope of the described embodiments, a first contact may be referred to as a second contact, and similarly, a second contact may be referred to as a first contact. Both the first contact and the second contact are contacts, but they are not the same contact.

[0014] The terms used in the specification of the various embodiments described herein are included only for the purpose of describing particular embodiments and are not intended to be limiting. As used in the specification of the various embodiments and the appended claims, the singular forms "a", "an", and "the" are also intended to include the plural forms and may be used interchangeably with "one or more than one" or "at least one", unless the context clearly indicates otherwise. It will also be understood that the term "and / or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items. It will also be understood that when the terms "comprises", "comprising", "includes", and / or "including" are used in this specification, it specifies the presence of the stated features, integers, steps, operations, elements, and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0015] As used herein, the terms "communicate" and "communicating" refer to at least one of receiving, receiving, transmitting, conveying, and / or providing information (or information represented by, for example, data, signals, messages, instructions, and / or commands, etc.). For a unit (e.g., a device, a system, a component of a device or system, and / or a combination thereof, etc.) that is to communicate with another unit, this means that the unit can directly or indirectly receive information from the other unit and / or send (e.g., transmit) information to the other unit. This may refer to a direct or indirect connection that is essentially wired and / or wireless. Additionally, two units can communicate with each other even if the information transmitted between the first unit and the second unit is modified, processed, relayed, and / or routed. For example, even if the first unit receives information passively and does not actively transmit information to the second unit, the first unit can communicate with the second unit. As another example, if at least one intermediate unit (e.g., a third unit located between the first unit and the second unit) processes the information received from the first unit and transmits the processed information to the second unit, the first unit can communicate with the second unit. In some embodiments, a message may refer to a network packet (e.g., a data packet, etc.) that includes data.

[0016] As used herein, depending on the context, the term "if" is optionally interpreted to mean "when", "upon", "in response to determining that", and / or "in response to detecting", etc. Similarly, depending on the context, the phrase "if it has been determined" or "if [stated condition or event] is detected" is optionally interpreted to mean "when determining...", "in response to determining that", or "when [stated condition or event] is detected" and / or "in response to detecting [stated condition or event]", etc. Further, as used herein, the terms "has", "having", or "owns", etc. are intended to be open-ended terms. Additionally, unless otherwise explicitly stated, the phrase "based on" is intended to mean "at least partially based on".

[0017] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various described embodiments. However, it will be apparent to those of ordinary skill in the art that the various described embodiments may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.

[0018] General Overview

[0019] In some aspects and / or embodiments, the systems, methods, and computer program products described herein include and / or implement a vehicle (such as an autonomous vehicle, etc.) that enables the transportation of a passenger from a source location (e.g., a location for picking up the passenger) to a destination (e.g., a drop-off location). A service provider is located at or near the destination. A request for the transportation of the passenger to the service provider is received. Route information corresponding to the request is determined. The route information includes an estimated time of arrival at the service provider. After the passenger requests transportation from the source location to the destination, service information corresponding to the services available at the service provider is presented on a user interface (e.g., a vehicle display, vehicle audio, the user's device, etc.). The passenger interacts with the service provider via the user interface, and the passenger requests a service from the service provider. The service provider initiates the requested service at the destination based on the route information, and the time of service provision is coordinated with the estimated time of arrival at the service provider.

[0020] Implementations of the systems, methods, and computer program products described herein provide advantages for ride experience enhancement using external services, including seamlessly integrating interactions between different service providers into vehicle-based services (e.g., robotaxi services, on-demand mobility services). These technologies improve service delivery by incorporating route information not available to passengers into the timing of service delivery. Additionally, these technologies improve the passenger experience using both vehicle-based services and services at service providers. The vehicle has knowledge of interactions between consumers and different merchants. This enables the vehicle to automatically make reservations, share menus, and notify the passenger's friends without passenger input. The vehicle performs time-based integrated services based on trip conditions. For example, the vehicle sends real-time updates related to the estimated arrival time to a restaurant so that ordered appetizers can be ready when the passenger arrives. Additionally, the vehicle determines alternative services and service providers based on a passenger's request (e.g., the destination merchant has an unsatisfactory wait time for its service) and redirects navigation to an alternative destination. For example, the vehicle ranks services most relevant to the passenger, including paid services, and provides a ranked list to the passenger to select an alternative service. The vehicle enables the passenger to interact with their selected services, including a series of multiple services (e.g., a movie, followed by a restaurant, followed by a haircut).

[0021] Now refer to Figure 1 , to illustrate example environment 100, in which vehicles including autonomous systems and vehicles not including autonomous systems operate. As illustrated, environment 100 includes vehicles 102a - 102n, objects 104a - 104n, routes 106a - 106n, region 108, vehicle-to-infrastructure (V2I) devices 110, network 112, remote autonomous vehicle (AV) system 114, queue management system 116, and V2I system 118. Vehicles 102a - 102n, vehicle-to-infrastructure (V2I) devices 110, network 112, autonomous vehicle (AV) system 114, queue management system 116, and V2I system 118 are interconnected via wired connections, wireless connections, or a combination of wired and wireless connections (e.g., establishing connections for communication, etc.). In some embodiments, objects 104a - 104n are interconnected with at least one of vehicles 102a - 102n, vehicle-to-infrastructure (V2I) devices 110, network 112, autonomous vehicle (AV) system 114, queue management system 116, and V2I system 118 via wired connections, wireless connections, or a combination of wired and wireless connections.

[0022] Vehicles 102a - 102n (individually referred to as vehicle 102 and collectively referred to as vehicles 102) include at least one device configured to transport goods and / or people. In some embodiments, vehicle 102 is configured to communicate with V2I device 110, remote AV system 114, queue management system 116, and / or V2I system 118 via network 112. In some embodiments, vehicle 102 includes a car, a bus, a truck, and / or a train, etc. In some embodiments, vehicle 102 is the same as or similar to vehicle 200 described herein (see Figure 2 ). In some embodiments, vehicles 200 in the set of vehicles 200 are associated with an autonomous queue manager. In some embodiments, as described herein, vehicle 102 travels along corresponding routes 106a - 106n (individually referred to as route 106 and collectively referred to as routes 106). In some embodiments, one or more than one vehicle 102 includes an autonomous system (e.g., an autonomous system that is the same as or similar to autonomous system 202).

[0023] Objects 104a - 104n (individually referred to as object 104 and collectively referred to as objects 104) include, for example, at least one vehicle, at least one pedestrian, at least one cyclist, and / or at least one structure (e.g., a building, a sign, a fire hydrant, etc.), etc. Each object 104 (e.g., located at a fixed location and over a period of time) is stationary or (e.g., having a speed and associated with at least one trajectory) moving. In some embodiments, object 104 is associated with a corresponding location in area 108.

[0024] Routes 106a - 106n (individually referred to as Route 106 and collectively as Routes 106) are each associated with (e.g., define) a series of actions (also referred to as a trajectory) along which an AV can navigate. Each Route 106 begins at an initial state (e.g., a state corresponding to a first spatio - temporal location and / or speed, etc.) and ends at a final goal state (e.g., a state corresponding to a second spatio - temporal location different from the first) or a target zone (e.g., a subspace of acceptable states (e.g., a termination state)). In some embodiments, the first state includes a location where one or more individuals will board the AV, and the second state or zone includes one or more locations where one or more individuals boarding the AV will disembark. In some embodiments, Route 106 includes multiple sequences of acceptable states (e.g., multiple sequences of spatio - temporal locations) that are associated with (e.g., define) multiple trajectories. In an example, Route 106 includes only high - level actions or imprecise state locations, such as a series of connecting roads indicating a direction change at a roadway intersection, etc. Additionally or alternatively, Route 106 can include more precise actions or states, such as, for example, a specific target lane or precise location within a lane area and a target rate at those locations. In an example, Route 106 includes multiple precise state sequences along at least one high - level action with a limited look - ahead horizon to reach an intermediate goal, where the combination of successive iterations of the limited - horizon state sequences cumulatively corresponds to multiple trajectories that together form a high - level route terminating at the final goal state or zone.

[0025] Region 108 includes a physical area (e.g., a geographical area) in which vehicle 102 can navigate. In an example, Region 108 includes at least one state (e.g., a country, a province, an individual state among multiple states included in a country, etc.), at least a part of a state, at least one city, at least a part of a city, etc. In some embodiments, Region 108 includes at least one named arterial road (referred to herein as a “road”), such as a highway, an interstate highway, a parkway, an urban street, etc. Additionally or alternatively, in some examples, Region 108 includes at least one unnamed road, such as a lane, a section of a parking lot, a section of a vacant lot and / or an undeveloped area, a dirt road, etc. In some embodiments, a road includes at least one lane (e.g., a portion of the road through which vehicle 102 can pass). In an example, a road includes at least one lane associated with (e.g., identified based on) at least one lane marking line.

[0026] A vehicle-to-infrastructure (V2I) device 110 (sometimes referred to as a vehicle-to-infrastructure or vehicle-to-everything (V2X) device) includes at least one device configured to communicate with a vehicle 102 and / or a V2I system 118. In some embodiments, the V2I device 110 is configured to communicate with the vehicle 102, a remote AV system 114, a queue management system 116, and / or the V2I system 118 via a network 112. In some embodiments, the V2I device 110 includes a radio frequency identification (RFID) device, a sign, a camera (e.g., a two-dimensional (2D) and / or three-dimensional (3D) camera), lane markings, streetlights, a parking meter, etc. In some embodiments, the V2I device 110 is configured to communicate directly with the vehicle 102. Additionally or alternatively, in some embodiments, the V2I device 110 is configured to communicate with the vehicle 102, the remote AV system 114, and / or the queue management system 116 via the V2I system 118. In some embodiments, the V2I device 110 is configured to communicate with the V2I system 118 via the network 112.

[0027] The network 112 includes one or more wired and / or wireless networks. In an example, the network 112 includes a cellular network (e.g., a Long Term Evolution (LTE) network, a third-generation (3G) network, a fourth-generation (4G) network, a fifth-generation (5G) network, a Code Division Multiple Access (CDMA) network, etc.), a Public Land Mobile Network (PLMN), a Local Area Network (LAN), a Wide Area Network (WAN), a Metropolitan Area Network (MAN), a telephone network (e.g., a Public Switched Telephone Network (PSTN)), a private network, an ad-hoc network, an intranet, the Internet, a fiber-based network, a cloud computing network, etc., and / or a combination of some or all of these networks.

[0028] The remote AV system 114 includes at least one device configured to communicate with the vehicle 102, the V2I device 110, the network 112, the queue management system 116, and / or the V2I system 118 via the network 112. In an example, the remote AV system 114 includes a server, a server group, and / or other similar devices. In some embodiments, the remote AV system 114 is co-located with the queue management system 116. In some embodiments, the remote AV system 114 participates in the installation of some or all of the components of the vehicle (including autonomous systems, autonomous vehicle computing, and / or software implemented by autonomous vehicle computing). In some embodiments, the remote AV system 114 maintains (e.g., updates and / or replaces) these components and / or software during the life of the vehicle.

[0029] The queue management system 116 includes at least one device configured to communicate with the vehicle 102, the V2I device 110, the remote AV system 114, and / or the V2I system 118. In an example, the queue management system 116 includes a server, a server group, and / or other similar devices. In some embodiments, the queue management system 116 is associated with a ridesharing company (e.g., an organization for controlling the operation of multiple vehicles (e.g., vehicles including autonomous systems and / or vehicles not including autonomous systems), etc.).

[0030] In some embodiments, the V2I system 118 includes at least one device configured to communicate with the vehicle 102, the V2I device 110, the remote AV system 114, and / or the queue management system 116 via the network 112. In some examples, the V2I system 118 is configured to communicate with the V2I device 110 via a connection different from the network 112. In some embodiments, the V2I system 118 includes a server, a server group, and / or other similar devices. In some embodiments, the V2I system 118 is associated with a municipality or a private institution (e.g., a private institution for maintaining the V2I device 110, etc.).

[0031] Provide Figure 1 The number and arrangement of the illustrated elements are provided as examples. Compared with Figure 1 the illustrated elements, there may be additional elements, fewer elements, different elements, and / or elements with different arrangements. Additionally or alternatively, at least one element of the environment 100 may perform one or more functions described as being performed by Figure 1 at least one different element. Additionally or alternatively, at least one set of elements of the environment 100 may perform one or more functions described as being performed by at least one different set of elements of the environment 100.

[0032] Now refer to Figure 2 , the vehicle 200 (which may be the same as or similar to Figure 1 the vehicle 102) includes an autonomous system 202, a powertrain control system 204, a steering control system 206, and a braking system 208, or is associated with the autonomous system 202, the powertrain control system 204, the steering control system 206, and the braking system 208. In some embodiments, the vehicle 200 is the same as the vehicle 102 (see Figure 1)Same or similar. In some embodiments, the autonomous system 202 is configured to endow the vehicle 200 with autonomous driving capabilities (e.g., implement at least one of the following driving functions, features, and / or devices that are automatic or based on maneuvering actions, and the at least one driving function, feature, and / or device enables the vehicle 200 to operate partially or fully without human intervention, including but not limited to fully autonomous vehicles (e.g., vehicles that abandon reliance on human intervention, such as level 5 ADS-operated vehicles, etc.), highly autonomous vehicles (e.g., vehicles that abandon reliance on human intervention in certain situations, such as level 4 ADS-operated vehicles, etc.), and / or conditionally autonomous vehicles (e.g., vehicles that abandon reliance on human intervention in limited situations, such as level 3 ADS-operated vehicles, etc.), etc.). In one embodiment, the autonomous system 202 includes the operational or tactical functionality required to operate the vehicle 200 in road traffic and continuously perform part or all of the dynamic driving task (DDT). In another embodiment, the autonomous system 202 includes an advanced driver assistance system (ADAS) that includes driver support features. The autonomous system 202 supports various levels of driving automation ranging from no driving automation (e.g., level 0) to full driving automation (e.g., level 5). For a detailed description of fully autonomous vehicles and highly autonomous vehicles, reference can be made to SAE International Standard J3016: Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems, the entire content of which is incorporated by reference. In some embodiments, the vehicle 200 is associated with an autonomous queue manager and / or a ridesharing company.

[0033] The autonomous system 202 includes a sensor suite that includes one or more devices such as a camera 202a, a LiDAR sensor 202b, a Radar sensor 202c, and a microphone 202d. In some embodiments, the autonomous system 202 may include more or fewer devices and / or different devices (e.g., ultrasonic sensors, inertial sensors, GPS receivers (discussed below), and / or odometer sensors for generating data associated with an indication of the distance traveled by the vehicle 200, etc.). In some embodiments, the autonomous system 202 uses one or more devices included in the autonomous system 202 to generate data associated with the environment 100 described herein. The data generated by one or more devices of the autonomous system 202 can be used by one or more systems described herein to observe the environment (e.g., environment 100) in which the vehicle 200 is located. In some embodiments, the autonomous system 202 includes a communication device 202e, an autonomous vehicle computing 202f, a drive-by-wire (DBW) system 202h, and a safety controller 202g.

[0034] The camera 202a includes at least one device configured to communicate with the communication device 202e, the autonomous vehicle computing 202f, and / or the safety controller 202g via a bus (e.g., a bus 302 that is the same as or similar to Figure 3 the bus). The camera 202a includes at least one camera (e.g., a digital camera using an optical sensor such as a charge-coupled device (CCD), a thermal camera, an infrared (IR) camera, and / or an event camera, etc.) for capturing images including physical objects (e.g., cars, buses, curbs, and / or people, etc.). In some embodiments, the camera 202a generates camera data as an output. In some examples, the camera 202a generates camera data that includes image data associated with the image. In this example, the image data may specify at least one parameter corresponding to the image (e.g., image characteristics such as exposure, brightness, etc., and / or an image timestamp, etc.). In such an example, the image may be in a format (e.g., RAW, JPEG, and / or PNG, etc.). In some embodiments, the camera 202a includes a plurality of independent cameras configured (e.g., positioned) on the vehicle for capturing images for the purpose of stereovision (stereo vision). In some examples, the camera 202a includes generating image data and transmitting the image data to the autonomous vehicle computing 202f and / or a queue management system (e.g., the same as Figure 1A plurality of cameras of the same or similar queue management system as the queue management system 116. In such an example, the autonomous vehicle computing 202f determines the depth to one or more objects in the fields of view of at least two of the plurality of cameras based on image data from at least two cameras. In some embodiments, the camera 202a is configured to capture images of objects within a distance relative to the camera 202a (e.g., up to 100 meters and / or up to 1 kilometer, etc.). Thus, the camera 202a includes features such as sensors and lenses optimized for sensing objects at one or more distances relative to the camera 202a.

[0035] In an embodiment, the camera 202a includes at least one camera configured to capture one or more images associated with one or more traffic lights, street signs, and / or other physical objects that provide visual navigation information. In some embodiments, the camera 202a generates traffic light data associated with one or more images. In some examples, the camera 202a generates TLD (Traffic Light Detection) data associated with one or more images including a format (e.g., RAW, JPEG, and / or PNG, etc.). In some embodiments, the camera 202a that generates TLD data is different from other systems incorporating cameras described herein in that the camera 202a may include one or more cameras with a wide field of view (e.g., a wide-angle lens, a fish-eye lens, and / or a lens with a viewing angle of about 120 degrees or greater, etc.) to generate images related to as many physical objects as possible.

[0036] The Light Detection and Ranging (LiDAR) sensor 202b includes being configured to communicate with the communication device 202e, the autonomous vehicle computing 202f, and / or the safety controller 202g via a bus (e.g., with Figure 3at least one device that communicates via a bus (e.g., a bus identical or similar to bus 302). The LiDAR sensor 202b includes a system configured to emit light from a light emitter (e.g., a laser emitter). The light emitted by the LiDAR sensor 202b includes light outside the visible spectrum (e.g., infrared light, etc.). In some embodiments, during operation, the light emitted by the LiDAR sensor 202b encounters a physical object (e.g., a vehicle) and is reflected back to the LiDAR sensor 202b. In some embodiments, the light emitted by the LiDAR sensor 202b does not penetrate the physical object it encounters. The LiDAR sensor 202b further includes at least one light detector that detects the light after the light emitted from the light emitter encounters a physical object. In some embodiments, at least one data processing system associated with the LiDAR sensor 202b generates an image (e.g., a point cloud and / or a combined point cloud, etc.) representing the objects included in the field of view of the LiDAR sensor 202b. In some examples, at least one data processing system associated with the LiDAR sensor 202b generates an image representing the boundary of the physical object and / or the surface of the physical object (e.g., the topology of the surface), etc. In such examples, the image is used to determine the boundary of the physical object in the field of view of the LiDAR sensor 202b.

[0037] A Radio Detection and Ranging (Radar) sensor 202c includes at least one device configured to communicate with a communication device 202e, an autonomous vehicle computer 202f, and / or a safety controller 202g via a bus (e.g., a bus identical or similar to Figure 3 bus 302). The Radar sensor 202c includes a system configured to emit (pulsed or continuous) radio waves. The radio waves emitted by the Radar sensor 202c include radio waves within a predetermined spectrum. In some embodiments, during operation, the radio waves emitted by the Radar sensor 202c encounter a physical object and are reflected back to the Radar sensor 202c. In some embodiments, the radio waves emitted by the Radar sensor 202c are not reflected by some objects. In some embodiments, at least one data processing system associated with the Radar sensor 202c generates a signal representing the objects included in the field of view of the Radar sensor 202c. For example, at least one data processing system associated with the Radar sensor 202c generates an image representing the boundary of the physical object and / or the surface of the physical object (e.g., the topology of the surface), etc. In some examples, the image is used to determine the boundary of the physical object in the field of view of the Radar sensor 202c.

[0038] The microphone 202d includes at least one device configured to communicate with the communication device 202e, the autonomous vehicle computing 202f, and / or the safety controller 202g via a bus (e.g., a bus the same as or similar to the bus 302 of Figure 3 . The microphone 202d includes one or more than one microphone (e.g., an array microphone and / or an external microphone, etc.) that captures an audio signal and generates data associated with (e.g., representing) the audio signal. In some examples, the microphone 202d includes a transducer device and / or a similar device. In some embodiments, one or more than one system described herein may receive the data generated by the microphone 202d and determine the position (e.g., distance, etc.) of an object relative to the vehicle 200 based on the audio signal associated with the data.

[0039] The communication device 202e includes at least one device configured to communicate with the camera 202a, the LiDAR sensor 202b, the Radar sensor 202c, the microphone 202d, the autonomous vehicle computing 202f, the safety controller 202g, and / or the DBW (drive-by-wire) system 202h. For example, the communication device 202e may include a device the same as or similar to the communication interface 314 of Figure 3 . In some embodiments, the communication device 202e includes a vehicle-to-vehicle (V2V) communication device (e.g., a device for enabling wireless communication of data between vehicles).

[0040] The autonomous vehicle computing 202f includes at least one device configured to communicate with the camera 202a, the LiDAR sensor 202b, the Radar sensor 202c, the microphone 202d, the communication device 202e, the safety controller 202g, and / or the DBW system 202h. In some examples, the autonomous vehicle computing 202f includes devices such as a client device, a mobile device (e.g., a cellular phone and / or a tablet computer, etc.), and / or a server (e.g., a computing device including one or more than one central processing unit and / or a graphics processing unit, etc.). In some embodiments, the autonomous vehicle computing 202f is the same as or similar to the autonomous vehicle computing 400 described herein. Additionally or alternatively, in some embodiments, the autonomous vehicle computing 202f is configured to communicate with an autonomous vehicle system (e.g., an autonomous vehicle system the same as or similar to the remote AV system 114 of Figure 1 , a queue management system (e.g., a queue management system the same as or similar to the queue management system 116 of Figure 1 , a V2I device (e.g., a V2I device the same as or similar to the V2I device 110 of Figure 1 , and / or a V2I system (e.g., a V2I system the same as or similar to the V2I system of Figure 1communicate with the same or similar V2I system 118 of the V2I system).

[0041] The safety controller 202g includes at least one device configured to communicate with the camera 202a, the LiDAR sensor 202b, the Radar sensor 202c, the microphone 202d, the communication device 202e, the autonomous vehicle computing 202f, and / or the DBW system 202h. In some examples, the safety controller 202g includes one or more controllers (such as an electrical controller and / or an electromechanical controller, etc.) configured to generate and / or transmit control signals to operate one or more devices of the vehicle 200 (such as the powertrain control system 204, the steering control system 206, and / or the braking system 208, etc.). In some embodiments, the safety controller 202g is configured to generate control signals that take precedence over (e.g., override) the control signals generated and / or transmitted by the autonomous vehicle computing 202f.

[0042] The DBW system 202h includes at least one device configured to communicate with the communication device 202e and / or the autonomous vehicle computing 202f. In some examples, the DBW system 202h includes one or more controllers (such as an electrical controller and / or an electromechanical controller, etc.) configured to generate and / or transmit control signals to operate one or more devices of the vehicle 200 (such as the powertrain control system 204, the steering control system 206, and / or the braking system 208, etc.). Additionally or alternatively, one or more controllers of the DBW system 202h are configured to generate and / or transmit control signals to operate at least one different device of the vehicle 200 (such as turn signals, headlights, door locks, and / or windshield wipers, etc.).

[0043] The powertrain control system 204 includes at least one device configured to communicate with the DBW system 202h. In some examples, the powertrain control system 204 includes at least one controller and / or actuator, etc. In some embodiments, the powertrain control system 204 receives control signals from the DBW system 202h, and the powertrain control system 204 causes the vehicle 200 to perform longitudinal vehicle movement (such as starting to move forward, stopping moving forward, starting to move backward, stopping moving backward, accelerating in a certain direction, decelerating in a certain direction, etc.), or perform lateral vehicle movement (such as making a left turn and / or making a right turn, etc.). In an example, the powertrain control system 204 increases, keeps the same, or decreases the energy (such as fuel and / or electricity, etc.) provided to the motor of the vehicle, thereby causing at least one wheel of the vehicle 200 to rotate or not rotate.

[0044] The steering control system 206 includes at least one device configured to rotate one or more wheels of the vehicle 200. In some examples, the steering control system 206 includes at least one controller and / or actuator, etc. In some embodiments, the steering control system 206 rotates two front wheels and / or two rear wheels of the vehicle 200 left or right to turn the vehicle 200 left or right. In other words, the steering control system 206 causes the activities required to regulate the y-axis component of the vehicle's movement.

[0045] The braking system 208 includes at least one device configured to actuate one or more brakes to decelerate the vehicle 200 and / or keep it stationary. In some examples, the braking system 208 includes at least one controller and / or actuator configured to close one or more calipers associated with one or more wheels of the vehicle 200 on the corresponding rotors of the vehicle 200. Additionally or alternatively, in some examples, the braking system 208 includes an automatic emergency braking (AEB) system and / or a regenerative braking system, etc.

[0046] In some embodiments, the vehicle 200 includes at least one platform sensor (not explicitly illustrated) for measuring or inferring the nature of the state or condition of the vehicle 200. In some examples, the vehicle 200 includes platform sensors such as a global positioning system (GPS) receiver, an inertial measurement unit (IMU), a wheel speed sensor, a wheel brake pressure sensor, a wheel torque sensor, an engine torque sensor, and / or a steering angle sensor. Although the braking system 208 is illustrated as being proximal to the vehicle 200 within Figure 2 the vehicle 200, the braking system 208 can be located anywhere within the vehicle 200.

[0047] Now refer to Figure 3 , a schematic diagram illustrating the device 300. As illustrated, the device 300 includes a processor 304, a memory 306, a storage component 308, an input interface 310, an output interface 312, a communication interface 314, and a bus 302. In some embodiments, the device 300 corresponds to: at least one device of the vehicle 102 (e.g., at least one device of the system of the vehicle 102); an autonomous vehicle system (e.g., an autonomous vehicle system identical or similar to the Figure 1 remote AV system 114 of Figure 2 or the autonomous vehicle computing 202f of Figure 1 ); a queue management system (e.g., a queue management system identical or similar to the Figure 1 queue management system 116 of Figure 1at least one device of a V2I system 118 that is the same as or similar to the V2I system; and / or one or more than one device of network 112 (e.g., one or more than one device of the system of network 112). In some embodiments, one or more than one device of vehicle 102 (e.g., one or more than one device of the system of vehicle 102), an autonomous vehicle system (e.g., an autonomous vehicle system that is the same as or similar to Figure 1 the remote AV system 114 or Figure 2 an autonomous vehicle computing 202f that is the same as or similar to the autonomous vehicle system), a queue management system (e.g., a queue management system that is the same as or similar to Figure 1 the queue management system 116), one or more than one device of a V2I device (e.g., a V2I device that is the same as or similar to Figure 1 the V2I device 110), a V2I system (e.g., a V2I system that is the same as or similar to Figure 1 the V2I system 118), and / or one or more than one device of network 112 (e.g., one or more than one device of the system of network 112) includes at least one device 300 and / or at least one component of device 300. As Figure 3 shown, device 300 includes a bus 302, a processor 304, a memory 306, a storage component 308, an input interface 310, an output interface 312, and a communication interface 314.

[0048] Bus 302 includes components that permit communication between the components of device 300. In some cases, processor 304 includes a processor (e.g., a central processing unit (CPU), a graphics processing unit (GPU), and / or an accelerated processing unit (APU), etc.), a microphone, a digital signal processor (DSP), and / or any processing component that can be programmed to perform at least one function (e.g., a field programmable gate array (FPGA) and / or an application specific integrated circuit (ASIC), etc.). Memory 306 includes random access memory (RAM), read only memory (ROM), and / or another type of dynamic and / or static storage device that stores data and / or instructions for use by processor 304 (e.g., flash memory, magnetic memory, and / or optical memory, etc.).

[0049] The storage component 308 stores data and / or software related to the operation and use of the device 300. In some examples, the storage component 308 includes a hard disk (e.g., a magnetic disk, an optical disk, a magneto-optical disk, and / or a solid state disk, etc.), a compact disk (CD), a digital versatile disk (DVD), a floppy disk, a cassette tape, a magnetic tape, a CD-ROM, a RAM, a PROM, an EPROM, a FLASH-EPROM, an NV-RAM, and / or another type of computer-readable medium, and corresponding drives.

[0050] The input interface 310 includes components that permit the device 300 to receive information such as via a user input (e.g., a touchscreen display, a keyboard, a keypad, a mouse, a button, a switch, a microphone, and / or a camera, etc.). Additionally or alternatively, in some embodiments, the input interface 310 includes sensors for sensing information (e.g., a global positioning system (GPS) receiver, an accelerometer, a gyroscope, and / or an actuator, etc.). The output interface 312 includes components for providing output information from the device 300 (e.g., a display, a speaker, and / or one or more light emitting diodes (LEDs), etc.).

[0051] In some embodiments, the communication interface 314 includes transceiver-like components that permit the device 300 to communicate with other devices via a wired connection, a wireless connection, or a combination of a wired connection and a wireless connection (e.g., a transceiver and / or separate receiver and transmitter, etc.). In some examples, the communication interface 314 permits the device 300 to receive information from another device and / or provide information to another device. In some examples, the communication interface 314 includes an Ethernet interface, an optical interface, a coaxial interface, an infrared interface, a radio frequency (RF) interface, a universal serial bus (USB) interface, an interface, and / or a cellular network interface, etc.

[0052] In some embodiments, the device 300 performs one or more of the processes described herein. The device 300 performs these processes based on software instructions stored by a computer-readable medium such as the memory 306 and / or the storage component 308, etc., and executed by the processor 304. A computer-readable medium (e.g., a non-transitory computer-readable medium) is defined herein as a non-transitory memory device. A non-transitory memory device includes a storage space located within a single physical storage device or a storage space distributed across multiple physical storage devices.

[0053] In some embodiments, software instructions are read into memory 306 and / or storage component 308 from another computer-readable medium or from another device via communication interface 314. When executed, the software instructions stored in memory 306 and / or storage component 308 cause processor 304 to perform one or more processes described herein. Additionally or alternatively, hardwired circuitry is used in place of or in combination with software instructions to perform one or more processes described herein. Accordingly, unless otherwise expressly stated, embodiments described herein are not limited to any specific combination of hardware circuitry and software.

[0054] Memory 306 and / or storage component 308 includes a data store or at least one data structure (e.g., a database, etc.). Device 300 is capable of receiving information from, storing information in, communicating information to, or searching for information stored in the data store or at least one data structure in memory 306 or storage component 308. In some examples, the information includes network data, input data, output data, or any combination thereof.

[0055] In some embodiments, device 300 is configured to execute software instructions stored in memory 306 and / or the memory of another device (e.g., another device that is the same as or similar to device 300). As used herein, the term "module" refers to at least one instruction stored in memory 306 and / or the memory of another device, which when executed by processor 304 and / or the processor of another device (e.g., another device that is the same as or similar to device 300), causes device 300 (e.g., at least one component of device 300) to perform one or more processes described herein. In some embodiments, the module is implemented in software, firmware, and / or hardware, etc.

[0056] Provided Figure 3 The number and arrangement of the illustrated components are provided as an example. In some embodiments, compared to Figure 3 the illustrated components, device 300 may include additional components, fewer components, different components, or components in a different arrangement. Additionally or alternatively, a set of components of device 300 (e.g., one or more components) may perform one or more functions described as being performed by another component or another set of components of device 300.

[0057] Now refer to Figure 4, an example block diagram of an autonomous vehicle computing 400 (sometimes referred to as an "AV stack") is illustrated. As illustrated, the autonomous vehicle computing 400 includes a perception system 402 (sometimes referred to as a perception module), a planning system 404 (sometimes referred to as a planning module), a localization system 406 (sometimes referred to as a localization module), a control system 408 (sometimes referred to as a control module), and a database 410. In some embodiments, the perception system 402, the planning system 404, the localization system 406, the control system 408, and the database 410 are included in and / or implemented in an automatic navigation system of the vehicle (e.g., the autonomous vehicle computing 202f of the vehicle 200). Additionally or alternatively, in some embodiments, the perception system 402, the planning system 404, the localization system 406, the control system 408, and the database 410 are included in one or more independent systems (e.g., one or more systems identical or similar to the autonomous vehicle computing 400, etc.). In some examples, the perception system 402, the planning system 404, the localization system 406, the control system 408, and the database 410 are included in one or more independent systems located in the vehicle and / or at least one remote system as described herein. In some embodiments, any and / or all of the systems included in the autonomous vehicle computing 400 are implemented in software (e.g., software instructions stored in a memory), computer hardware (e.g., via a microprocessor, a microcontroller, an application-specific integrated circuit (ASIC), and / or a field-programmable gate array (FPGA), etc.), or a combination of computer software and computer hardware. It will also be understood that, in some embodiments, the autonomous vehicle computing 400 is configured to communicate with remote systems (e.g., an autonomous vehicle system identical or similar to the remote AV system 114, a queue management system identical or similar to the queue management system 116, and / or a V2I system identical or similar to the V2I system 118, etc.).

[0058] In some embodiments, the perception system 402 receives data associated with at least one physical object in the environment (e.g., data used by the perception system 402 to detect the at least one physical object), and classifies the at least one physical object. In some examples, the perception system 402 receives image data captured by at least one camera (e.g., camera 202a), the image being associated with one or more physical objects within the field of view of the at least one camera (e.g., representing the one or more physical objects). In such examples, the perception system 402 classifies the at least one physical object based on one or more groupings of physical objects (e.g., bicycles, vehicles, traffic signs, and / or pedestrians, etc.). In some embodiments, based on the classification of the physical objects by the perception system 402, the perception system 402 transmits data associated with the classification of the physical objects to the planning system 404.

[0059] In some embodiments, the planning system 404 receives data associated with a destination and generates data associated with at least one route (e.g., route 106) along which a vehicle (e.g., vehicle 102) can travel toward the destination. In some embodiments, the planning system 404 periodically or continuously receives data from the perception system 402 (e.g., the data associated with the classification of the physical objects described above), and the planning system 404 updates at least one trajectory or generates at least one different trajectory based on the data generated by the perception system 402. In other words, the planning system 404 can perform tasks related to the tactical functions required to operate the vehicle 102 in road traffic. Tactical efforts involve maneuvering the vehicle in traffic during the journey, which includes but is not limited to deciding whether and when to overtake another vehicle, change lanes, or select an appropriate speed, acceleration, deceleration, etc. In some embodiments, the planning system 404 receives data associated with an updated position of the vehicle (e.g., vehicle 102) from the positioning system 406, and the planning system 404 updates at least one trajectory or generates at least one different trajectory based on the data generated by the positioning system 406.

[0060] In some embodiments, the positioning system 406 receives data associated with (e.g., representing) the location of a vehicle (e.g., vehicle 102) in an area. In some examples, the positioning system 406 receives LiDAR data associated with at least one point cloud generated by at least one LiDAR sensor (e.g., LiDAR sensor 202b). In certain examples, the positioning system 406 receives data associated with at least one point cloud from multiple LiDAR sensors, and the positioning system 406 generates a combined point cloud based on the respective point clouds. In these examples, the positioning system 406 compares the at least one point cloud or the combined point cloud with a two-dimensional (2D) and / or three-dimensional (3D) map of the area stored in the database 410. Then, based on the positioning system 406 comparing the at least one point cloud or the combined point cloud with the map, the positioning system 406 determines the position of the vehicle in the area. In some embodiments, the map includes a combined point cloud of the area generated prior to the navigation of the vehicle. In some embodiments, the map includes, but is not limited to, a high-precision map of roadway geometry, a map describing the connection properties of a road network, a map describing the physical properties of roadways (such as traffic speed, traffic flow, the number of vehicle and bicycle traffic lanes, lane width, lane traffic direction or the type and location of lane markings, or a combination thereof, etc.), and a map describing the spatial location of road features (such as crosswalks, traffic signs, or various other types of driving signal lights, etc.). In some embodiments, the map is generated in real time based on the data received by the perception system.

[0061] In another example, the positioning system 406 receives global navigation satellite system (GNSS) data generated by a global positioning system (GPS) receiver. In some examples, the positioning system 406 receives GNSS data associated with the location of a vehicle in an area, and the positioning system 406 determines the latitude and longitude of the vehicle in the area. In such examples, the positioning system 406 determines the position of the vehicle in the area based on the latitude and longitude of the vehicle. In some embodiments, the positioning system 406 generates data associated with the position of the vehicle. In some examples, based on the positioning system 406 determining the position of the vehicle, the positioning system 406 generates data associated with the position of the vehicle. In such examples, the data associated with the position of the vehicle includes data associated with one or more semantic properties corresponding to the position of the vehicle.

[0062] In some embodiments, the control system 408 receives data associated with at least one trajectory from the planning system 404, and the control system 408 controls the operation of the vehicle. In some examples, the control system 408 receives data associated with at least one trajectory from the planning system 404, and the control system 408 controls the operation of the vehicle by generating and transmitting control signals to cause the powertrain control system (e.g., the DBW system 202h and / or the powertrain control system 204, etc.), the steering control system (e.g., the steering control system 206), and / or the braking system (e.g., the braking system 208) to operate. For example, the control system 408 is configured to perform operational functions such as lateral vehicle motion control or longitudinal vehicle motion control. Lateral vehicle motion control causes activities required to regulate the y-axis component of the vehicle motion. Longitudinal vehicle motion control causes activities required to regulate the x-axis component of the vehicle motion. In an example, in the case where the trajectory includes a left turn, the control system 408 transmits a control signal to cause the steering control system 206 to adjust the steering angle of the vehicle 200, thereby causing the vehicle 200 to turn left. Additionally or alternatively, the control system 408 generates and transmits control signals to cause other devices of the vehicle 200 (e.g., headlights, turn signals, door locks, and / or windshield wipers, etc.) to change states.

[0063] In some embodiments, the perception system 402, the planning system 404, the positioning system 406, and / or the control system 408 implement at least one machine learning model (e.g., at least one multi-layer perceptron (MLP), at least one convolutional neural network (CNN), at least one recurrent neural network (RNN), at least one autoencoder, and / or at least one transformer, etc.). In some examples, the perception system 402, the planning system 404, the positioning system 406, and / or the control system 408 implement at least one machine learning model individually or in combination with one or more of the above systems. In some examples, the perception system 402, the planning system 404, the positioning system 406, and / or the control system 408 implement at least one machine learning model as part of a pipeline (e.g., a pipeline for identifying one or more objects located in the environment, etc.).

[0064] The database 410 stores data transmitted to, received from, and / or updated by the perception system 402, the planning system 404, the positioning system 406, and / or the control system 408. In some examples, the database 410 includes a storage component (e.g., associated with Figure 3the same or similar storage components as the storage component 308). In some embodiments, the database 410 stores data associated with 2D and / or 3D maps of at least one area. In some examples, the database 410 stores data associated with 2D and / or 3D maps of a part of a city, multiple parts of multiple cities, multiple cities, counties, states, and / or countries (e.g., nations), etc. In such examples, a vehicle (e.g., a vehicle the same or similar to the vehicle 102 and / or the vehicle 200) can drive along one or more drivable areas (e.g., single-lane roads, multi-lane roads, highways, back roads, and / or off-road paths, etc.), and cause at least one LiDAR sensor (e.g., a LiDAR sensor the same or similar to the LiDAR sensor 202b) to generate data associated with an image representing the objects included in the field of view of the at least one LiDAR sensor.

[0065] In some embodiments, the database 410 can be implemented across multiple devices. In some examples, the database 410 is included in a vehicle (e.g., a vehicle the same or similar to the vehicle 102 and / or the vehicle 200), an autonomous vehicle system (e.g., an autonomous vehicle system the same or similar to the remote AV system 114), a queue management system (e.g., a queue management system the same or similar to Figure 1 the queue management system 116), and / or a V2I system (e.g., a V2I system the same or similar to Figure 1 the V2I system 118), etc.

[0066] Now refer to Figure 5 , a diagram illustrating an implementation 500 of ride experience enhancement using an external service. In some embodiments, the implementation 500 includes a vehicle 502, an autonomous vehicle computing 506, a planning system 504a, and a control system 504b. In some embodiments, the vehicle 502 is the same or similar to Figure 1 the vehicle 102. In some embodiments, the autonomous vehicle computing 506 is the same or similar to Figure 2 the autonomous vehicle computing 202f or Figure 4 the autonomous vehicle computing 400. In some embodiments, the planning system 504a is the same or similar to Figure 4 the planning system 404. In some embodiments, the control system 504b is the same or similar to Figure 4 the control system 408 or Figure 2 the DBW system 202h.

[0067] In Figure 5In the example, the planning system 504a determines a route (514). The route is transmitted to the control system 504b. In some examples, the control system 504b includes one or more controllers (e.g., an electrical controller and / or an electromechanical controller, etc.), and the one or more controllers are configured to generate and / or transmit control signals to operate one or more devices of the vehicle 502. The control system 504b controls the vehicle 502 to move from an initial state to a final target state along the determined route.

[0068] In some embodiments, the autonomous vehicle computing 506 of the vehicle 502 receives a request for transporting a passenger to a service provider 520. For example, the passenger generates a ride request including a first location (e.g., the initial state) and a destination (e.g., the target state). In an example, the autonomous vehicle computing 506 identifies the service provider 520 based on the destination received from the passenger. In such an example, the destination includes the name of the service provider 520, and the destination location is derived from the name of the service provider 520. In an example, the destination received from the passenger is a destination location associated with the service provider 520 (e.g., within a threshold distance of the service provider 520). In some embodiments, the autonomous vehicle computing 506 receives a request for transportation through an on-demand mobility application (e.g., a ride sharing application, a carpooling application, etc.). For example, as described with respect to Figure 7 The passenger downloads the application to a personal device, and the autonomous system receives a request for transportation from the application on the personal device.

[0069] In some embodiments, the autonomous vehicle computing 506 determines route information 524. The route information 524 is transmitted to the service provider 520. In some embodiments, the route information 524 is transmitted to the service provider 520 periodically. The route information 524 includes, for example, information associated with transporting at least one passenger to the service provider. For example, the route information includes Figure 1 Route 106. In some embodiments, a planning system (e.g., Figure 4 The planning system 404) generates the route information. In an example, the autonomous vehicle computing 506 generates the route information based on a request for transporting to the service provider. In an example, the route information includes the current location of the AV, the passenger pick-up location, the route between the current location of the AV and the passenger pick-up location, the destination location (e.g., the location of the service provider), the route to the destination location, or a combination thereof. In some examples, the route information includes the estimated time of arrival of the passenger at the service provider, the actual delay during navigation on the route (e.g., there has been a past delay), the predicted delay (e.g., the expected delay), or a combination thereof.

[0070] In some embodiments, the autonomous vehicle computing 506 receives service information 522 from a service provider 520. In some embodiments, the autonomous vehicle computing 506 transmits a service request 526 to the service provider 520. For example, the service request 526 includes the number of passengers in the vehicle 502. In some examples, the service information 522 includes a restaurant menu, and the service request 526 includes a food order from the menu.

[0071] In some embodiments, the autonomous vehicle computing 506 communicates with the service provider using a communication protocol. In an example, the autonomous vehicle computing 506 obtains the communication protocol from a service database (such as Figure 7 the service database 706, etc.). In an example, the communication protocol is based on an application programming interface (API), such as a third-party API, a service provider API, an AV API shared with the service provider, or a combination thereof. In an example, the service corresponding to the AV API is hosted by the autonomous vehicle computing 506, the remote AV system 114, the queue management system 116, the V2I system 118, or a combination thereof. In some embodiments, the AVAPI service manages the communication between the service provider and the autonomous vehicle computing 506. For example, queue management includes cloud services for managing the communication between the service provider and the AV. In an example, the communication protocol includes a web crawler, a telephone protocol, or a combination thereof. The third-party API or the service provider API includes a stand-alone application, and the autonomous vehicle computing 506 transmits communication (e.g., requests a service, creates a reservation) to the service provider 520 through the API. In some examples, both the autonomous vehicle computing 506 and the service provider 520 can register with a third-party API (e.g., a stand-alone application for reservation, carpooling, payment, or any combination thereof). In some examples, the autonomous vehicle computing 506 can register with the service provider API. In some examples, the service provider 520 can register with the AV API. After registering with the shared API, for example, the autonomous vehicle computing 506 and the service provider 520 communicate through the corresponding shared API. The integration of the third-party API enables the service provider to participate in the ride experience enhancement with minimal setup.

[0072] In some embodiments, the autonomous vehicle computing 506 communicates with the service provider 520 using the service provider's website. For example, the autonomous vehicle computing 506 parses the service provider's website to obtain available services (e.g., menu), contact information, business hours, and an online order form. In some examples, as described in more detail below with respect to Figure 6 the autonomous vehicle computing 506 requests a service through the service provider 520's website.

[0073] In some embodiments, the autonomous vehicle computing 506 automatically communicates with the service provider 520 by telephone. In some embodiments, in response to determining that the service provider 520 cannot receive online communications (e.g., online service requests, online reservations), the autonomous vehicle computing 506 uses a telephone communication protocol. For example, the autonomous vehicle computing 506 begins the protocol by initiating a telephone call to the service provider 520. In such an example, the autonomous vehicle computing 506 determines at least one voice message (e.g., pre-recorded or machine-generated in real time) for requesting a service (e.g., a reservation). The at least one voice message may include standard language and service-specific language. Examples of voice messages are provided below in the context of the communications described with respect to Figures 6 to 8 In some embodiments, the autonomous vehicle computing 506 transmits at least one voice message during the telephone call. In some embodiments, the autonomous vehicle computing 506 uses a call center to request a service. For example, the autonomous vehicle computing 506 provides the destination, estimated arrival time, number of passengers, and requested service to the call center and instructs the call center to request the specified service (e.g., create a reservation, order food).

[0074] Figure 6 FIG. Figures 6 to 8 is an example flowchart of a process 600 for enhancing a ride experience using an external service. In some embodiments, the process 600 is implemented (e.g., fully, partially, etc.) using a planning system that is the same as or similar to the planning system 404 described with reference to Figure 4 or the planning system 504a described with reference to Figure 5 In some embodiments, one or more steps of the process 600 are performed by another device or system or another group of devices and / or systems that are separate from or include the planning system (e.g., fully and / or partially, etc.). For example, one or more steps of the process 600 may be performed by the remote AV system 114, the vehicle 200 (e.g., the autonomous system 202 of the vehicle 200), and / or the AV computing 506 (e.g., one or more systems of the AV computer 506) (e.g., fully and / or partially, etc.). In some embodiments, the steps of the process 600 may be coordinated with each other among any of the above systems.

[0075] In Figure 6In the following, the environment 600 is described with reference to five stages T0 - T4. Although the stages T0 - T4 are described in a sequential order starting from T0 and ending at T4, the stages T0 - T4 can occur in any suitable order. In some examples, one or more of these stages occur substantially simultaneously. In such examples, stage T2 occurs substantially simultaneously with stage T3. In some examples, one or more of these stages trigger subsequent stages. For example, stage T0 triggers stage T1, stage T1 triggers stage T2, and stage T2 triggers T3.

[0076] At T0, an autonomous system (e.g., autonomous system 202) of a vehicle 604 (e.g., Figure 1 autonomous vehicle 102, Figure 2 vehicle 200, Figure 5 vehicle 502) receives a request (610) for transportation to a destination from a passenger 602 to a service provider (e.g., Figure 5 service provider 520). In an example, the service provider is a partner as described with respect to Figure 7 . The service provider is communicatively coupled to at least one vehicle 604. In an example, the service provider is communicatively coupled to one or more vehicles via an on - demand mobility application. Additionally, in an example, the service provider is a restaurant and the autonomous system determines that the passenger wishes to dine at the restaurant. In such an example, the autonomous system provides the passenger with an option to make a reservation at the restaurant. In some embodiments, the autonomous system generates an initial service request (e.g., service request 526) based on the request for transportation, sensor data, or input from the passenger. For example, a service request is transmitted to the service provider, and the service request includes information (such as the number of passengers, etc.) from the request for transportation. In an example, sensors (e.g., Figure 2 camera 202a, LiDAR sensor 202b, Radar sensor 202c, and microphone 202d of Figure 6 ) capture sensor data, and the autonomous system generates a service request from the sensor data. In an example, the autonomous system provides one or more prompts for requesting details (e.g., input) from the passenger to generate a service request. In

[0077] the example of Figure 5The communication protocol used by the autonomous vehicle computing 506 to transmit service requests. In some examples, the autonomous system creates service requests through an API corresponding to the service provider. In some examples, the autonomous system uses an online reservation form on the service provider's website to create service requests. In some embodiments, the autonomous system automatically creates service requests by phone. For example, the autonomous system creates at least one digital voice message including details of the service request. In an example, the at least one voice message includes template language for the type of service request (e.g., “…create a temporary reservation for … party”) and request-based language (e.g., number of passengers: “two”, estimated arrival time: “15 minutes” or “7:00 p.m.”).

[0078] In some embodiments, the autonomous system continuously (e.g., in real time, every second, every 10 seconds, every minute) transmits route information (e.g., Figure 5 route information 524) to the service provider (e.g., the destination location of the service provider). In some embodiments, the route information and service requests are iteratively updated throughout T1 to T4. In some embodiments, the autonomous system transmits route information in response to a request received from the service provider. In some examples, the route information includes an estimated arrival time (e.g., 10 minutes away from the destination, 7:00 p.m.), the current location of the vehicle, route conditions (e.g., passengers will arrive early or late for the reservation), or a combination thereof.

[0079] At T1, the autonomous system determines that the passenger 602 has been picked up by the vehicle 604 (620). The autonomous system uses sensor data to determine that the passenger 602 is inside the passenger compartment of the vehicle 604 (e.g., the passenger 602 has been picked up). In an example, in addition to the passenger 602, one or more additional passengers are picked up. In an example, the autonomous system determines that the passenger 602 and one or more additional passengers have been picked up based on information obtained from the passenger 602 and / or one or more additional passengers.

[0080] In some embodiments, the autonomous system updates the initial service request with the total number of diners. For example, the autonomous system uses the communication protocol corresponding to the service provider to update the service request. In such an example, the passenger updates the number of guests arriving at the restaurant (e.g., reserve a table for 4 people). For example, the passenger 602 and an additional passenger are picked up by the vehicle 604, and the two parties can reach the service provider in different ways. The autonomous system transmits the updated service request (e.g., number of diners, updated estimated arrival time) to the service provider. Based on the updated service request, the service provider updates the reservation with the total number of diners (622).

[0081] At T2, the autonomous system provides information (630) to the passenger regarding goods and / or services available at the destination based on service information received from a service provider (e.g., service information 522 of Figure 5 ). In some examples, the service information is obtained from the service provider and stored for access by the autonomous system before a request for transportation is received from the passenger. In response to the passenger selecting the service provider as the destination, the autonomous system presents the service information to the passenger. For example, the autonomous system provides service information that includes a description of the services offered (e.g., a restaurant menu), a service preview (e.g., a movie preview), a list or collection of items available from the service provider, a list or collection of activities available at the service provider, or any combination thereof. In some embodiments, the autonomous system provides the service information to the passenger on a user interface (e.g., user interface 708 of Figure 7 ).

[0082] In some embodiments, the autonomous system communicatively couples the passenger with the service provider via a real-time two-way voice service. For example, the autonomous system enables the passenger to place a call to the service provider within the user interface (e.g., using the vehicle's audio system, from an on-demand mobility application). In some examples, the autonomous system provides the passenger with the phone number of the service provider so that the passenger can call the service provider from a personal device using third-party phone functionality (e.g., outside of the use of the on-demand mobility application).

[0083] In some embodiments, the autonomous system receives an updated service request from the passenger. For example, the autonomous system provides the service information to the passenger and the passenger requests a service. For example, the autonomous system receives a selection of at least one menu item (e.g., an appetizer or a beverage) on a customized interface provided to the passenger (e.g., via user interface 708 of Figure 7 ). In such an example, the autonomous system generates a service request (632) to the service provider that includes an order for the appetizer and the beverage.

[0084] At T3, the autonomous system transmits an estimated time of arrival (640) to the service provider at the destination. For example, the estimated time of arrival is based on the status of route 106 of Figure 1 . In some embodiments, the autonomous system receives information from the service provider based on the transmitted route information. In an example, the autonomous system receives the amount of time it will take to have the requested service ready for the passenger. In an example, the autonomous system receives an indication of whether the requested service can be ready at / near the estimated time of arrival. If the time to have the service ready exceeds the estimated time of arrival, the autonomous system presents an alternative service (e.g., using service selector 704 of Figure 7 ).

[0085] ​​​​​​​​​​In some embodiments, the autonomous system provides information (642) for a restaurant to start preparing appetizers and beverages. For example, the autonomous system transmits data at T3 (e.g., an initial service request, route information including an estimated arrival time or current location) such that the service (e.g., appetizers and beverages) is ready when the passenger arrives, but not so early as to cause a decline in the integrity of the food. In this way, the time of service provision is coordinated with the estimated arrival time at the service provider.

[0086] At T4, the autonomous system notifies the service provider (e.g., the restaurant) that the passenger has arrived (650). The autonomous system drops off the passenger and continues to the next destination (e.g., reposition the vehicle, pick up a new passenger) (652). In some embodiments, the autonomous system terminates the user interface after arriving at the destination. In some embodiments, the autonomous system sends a notification to the on-demand mobility application that the passenger is no longer in the vehicle. In some embodiments, the autonomous system closes any open channels of the communication protocol with the service provider corresponding to the dropped-off passenger after arriving at the destination.

[0087] Now refer to Figure 7 , an example system 700 that illustrates enhancing the ride experience using external services. In some embodiments, a vehicle 200 that is the same as or similar to Figure 2 is used to implement system 700 (e.g., fully, partially, etc.). In some embodiments, a device 300 that is the same as or similar to Figure 3 is used to implement system 700 (e.g., fully, partially, etc.). In some embodiments, a system that is the same as or similar to the autonomous vehicle computing 400 of Figure 4 or Figure 5 the autonomous vehicle computing 506 of

[0088] is used to implement system 700 (e.g., fully, partially, etc.). In some embodiments, system 700 includes a route planner 702, a service selector 704, a database 706, and a user interface 708. Figure 4 the planning system 404 of Figure 5 or Figure 1 the planning system 504a of

[0089] In some embodiments, the service selector 704 determines at least one service provider for the ride enhancement. For example, the service selector determines the at least one service provider based on a request from a passenger. In such an example, the passenger requests transportation to the service provider. In some embodiments, the passenger requests transportation to a destination location, and the service selector 704 determines the at least one service provider based on the destination location. For example, the service selector 704 accesses the service database 706 to determine the at least one service provider. In such an example, the service selector 704 determines whether the location of the at least one service provider meets a threshold relative to the requested destination location (e.g., whether the location of the at least one service provider is within a threshold distance of the requested destination location).

[0090] In some embodiments, the database 706 is located in the vehicle 102, the remote AV system 114, the queue management system 116, or distributed in a combination thereof. In some embodiments, the database 706 is the same as or similar to the database 410 that is Figure 4 associated with. In some embodiments, the database 706 stores profile and service information associated with service providers, including the services provided by each service provider, information associated with the location of the service provider, or any combination thereof. For example, the information associated with a service provider includes a physical address, a website address, a phone number, working hours, supported communication protocols, preferred communication protocols, service-provider-specific voice prompts (e.g., an automated voice message received by an autonomous system when the service provider is called), or any combination thereof. For example, a service provider uses an automated system to answer phone calls, and the service provider registers information related to the automated system (e.g., an automated voice message, a voice response, a number response) with the autonomous system. In some examples, the service selector 704 transmits a request to the service provider via a phone call in response to a specific voice prompt without the need to communicate with a real employee of the service provider.

[0091] In some embodiments, when a service provider is accessed by a passenger of the autonomous system, the service provider's profile is added to database 706. The service provider profile includes, for example, the type of service provider (e.g., restaurant, cinema, salon, barbershop), the service provider category (e.g., family-friendly, wheelchair accessible), other searchable business attributes, or a combination thereof. In an example, the autonomous system provides the service provider with an option to opt in or out of receiving service requests. In an example, the autonomous system prompts the added service provider to register as a partner service provider. In some embodiments, the partner has the ability to register an integration hook. In some embodiments, partner service providers are distinguished from other service providers that have not registered with the autonomous system. In an example, registering with the autonomous system means that the service provider provides information related to the service, location details, and other information included when providing an external service. Partner service providers provide information associated with the external service, which is stored or packaged (e.g., stored or packaged in Figure 7 database 706) for use by passengers to enable an enhanced ride experience. In some embodiments, partner service providers can develop custom integration hooks to provide specific services (e.g., branded services) and / or options to passengers. In some embodiments, the basic information (e.g., phone number) of non-partner service providers is displayed on a custom interface provided to passengers (e.g., via Figure 7 user interface 708). Basic information refers to information extracted from publicly available sources. In some embodiments, basic information is automatically extracted from publicly available sources and added to a database for storing service provider information. For example, a web crawler is deployed to automatically extract service information associated with the service provider.

[0092] In some embodiments, database 706 stores integration hooks. The hooks enable cross-application communication and integration in response to conditions or events. In such embodiments, the integration hooks are registered by the service provider. In such embodiments, the integration hooks are associated with (e.g., indexed by) the service provider (e.g., partner service provider), location, and service type. In some embodiments, the autonomous system provides a set of lifecycle hooks as a software development kit (SDK) that service providers can integrate to provide services to passengers. For example, directly integrating the service with the ride-sharing experience (e.g., integrating with the vehicle, integrating with the ride-sharing application).

[0093] In some embodiments, integration hooks are used to customize the passenger experience. For example, to register an integration hook, a service provider defines code (e.g., commands) to be executed by the autonomous system when a specific event is triggered. In some embodiments, the integration hook instructs the autonomous system to perform an action within the vehicle as requested by the service. For example, the code is executed to display information on a customized interface provided to the passenger (e.g., via Figure 7 user interface 708). In some embodiments, the autonomous system communicates with multiple service providers to provide services during a single ride to a destination. In such embodiments, the integration hooks for multiple service providers are triggered in response to events defined for the integration hooks.

[0094] In some embodiments, the integration hook instructs the autonomous system to call service provider functions at different stages of the ride. In some examples, the integration hook is triggered based on (e.g., in response to) a passenger action (e.g., a registered integration). In such examples, the passenger actions include a request for transportation, the start of transportation to a service provider, a request for communication with a service provider, a requested service, cancellation of transportation, or a combination thereof. In some examples, the integration hook is triggered based on (e.g., in response to) the vehicle meeting a threshold. In such examples, the integration hook is triggered when the estimated time of arrival at the service provider is less than a threshold (e.g., 10 minutes, 15 minutes). In some examples, the integration hook is triggered when the vehicle is within a threshold distance (e.g., 1 mile, 5 miles) of the service provider.

[0095] In some embodiments, the integration hook includes an estimated time to prepare the service. For example, in response to determining that the remaining duration of the route (e.g., estimated time of arrival minus the current time) meets a threshold (e.g., the estimated time to prepare the requested service is greater than the remaining duration of the route), the autonomous system transmits a service request (e.g., a notification to start preparing the requested service). In some examples, the integration hook includes a request for the autonomous system to notify a restaurant of when to start an appetizer in response to a request from a passenger and the estimated time of arrival meeting a threshold. In such examples, when the estimated time of arrival is less than 10 minutes, the autonomous system notifies the restaurant to start an appetizer that takes 10 minutes to prepare. In some examples, in response to the estimated time of arrival occurring after the start time of a show for which a passenger has purchased tickets, the autonomous system pre-orders snacks. In some examples, in response to a passenger request for transportation to a museum, the autonomous system provides a preview of the exhibits at the museum. In some examples, the autonomous system makes a reservation (e.g., a tour, a demonstration) for a time slot based on the estimated time of arrival (e.g., after the estimated time of arrival). In such examples, the reservation is updated in response to a delay during the transportation.

[0096] In some embodiments, in response to an integration hook trigger, the autonomous system provides service information to the passenger. For example, in response to a request for delivery to a restaurant service provider, a restaurant menu with options for placing an appetizer order (e.g., stored in database 706) is provided to the passenger. In such an example, when the consumer selects an appetizer, the integration hook to the service provider is informed of the user's selection, allowing the integration hook to respond to the request defined by the service provider (e.g., by contacting a third-party server to place an order at the restaurant).

[0097] In some embodiments, the service selector 704 provides service information associated with at least one service provider to the passenger (e.g., Figure 5 service information 522). In an example, the service selector accesses the service database 706 to determine the service information. In some embodiments, the service selector 704 provides the service information to the passenger via the user interface 708. In some embodiments, the user interface 708 is the same as or similar to Figure 3 the input interface 310.

[0098] In some embodiments, the user interface 708 includes at least one vehicle display, a vehicle audio system, a user device, or a combination thereof. For example, the user interface 708 includes the user interface by which the autonomous system provides service information to the passenger at T2 Figure 6 . In an example, an audio message is played to the passenger via the vehicle's sound system or via the speaker of the user device. In some examples, a representation (e.g., text, image, or graphic) of the service information is displayed on a vehicle display (e.g., a dashboard display, a display on the back of a headrest) or on a user device (e.g., within an on-demand mobility application on a smartphone).

[0099] In some embodiments, the autonomous system provides service information parsed from a service provider's website. For example, the autonomous system provides the service provider's website. In some embodiments, the autonomous system uses a custom interface to provide the service information parsed from the website. In an example, the parsed information includes a restaurant menu, and the custom interface includes elements for ordering items from the menu. In some embodiments, the custom interface receives user input indicating the requested service. In such an embodiment, the captured data associated with the user input is sent to the service provider as an updated service request. In some examples, the custom interface includes a confirmation (e.g., checkout) screen that includes the selected service and an estimated price. In such an example, after the user confirms the order, the service request is transmitted to the service provider.

[0100] In some embodiments, the service selector 704 provides recommendations for at least one service. For example, the service selector recommends at least one service from the service information associated with at least one service provider.

[0101] In some embodiments, the service selector 704 provides recommendations for at least one alternative service. For example, when the service at the destination service provider is unsatisfactory (e.g., in response to determining that the service at the destination service provider is unsatisfactory), the service selector determines an alternative service. In some embodiments, in response to receiving a service update from a service provider (e.g., unavailable service, unsatisfactory wait time), the autonomous system provides a recommendation. In some embodiments, the service selector 704 provides recommendations for at least one alternative service from the same service provider. For example, in response to determining that the requested service is unavailable at the destination service provider, the service selector recommends an alternative service. In some embodiments, the service selector 704 provides recommendations to a passenger for at least one alternative service provider. For example, the autonomous system determines that the wait time at the service provider is unsatisfactory. In such an example, when the destination restaurant has a 60-minute wait time, a nearby restaurant with a 15-minute wait time may be recommended. In some embodiments, the alternative services are stored in the service database 706.

[0102] In some embodiments, the service selector 704 provides an alternative service based on (e.g., in response to) receiving an indication that the time to prepare the requested service exceeds the estimated arrival time. In some embodiments, the service selector 704 requests a similar service from the alternative service provider and obtains an indication of when the passenger will be able to obtain the requested service at the alternative service provider. In such an embodiment, the service selector 704 recommends an alternative service that will be available before the estimated arrival time at the alternative service provider.

[0103] In some embodiments, the service selector 704 ranks the services. For example, the service selector (e.g., via the user interface 708) provides a ranked list of the top few (e.g., 1, 3, 10) services most relevant to the passenger. In such an example, the autonomous system ranks the services based on information associated with the service provider (e.g., using weighted metrics) stored in (e.g., the service database 706) and passenger preferences. In some examples, passenger preferences include dietary restrictions, food preferences, activity preferences, maximum acceptable wait time, maximum acceptable travel time or distance, the passenger's travel and activity history, service preferences, or a combination thereof.

[0104] In some embodiments, in response to an integration hook stored in database 706, service selector 704 ranks services. For example, when a passenger requests transportation to a destination location, a type of service, or a combination of these (e.g., seafood on First Street), the integration hook is triggered. In such an example, a list of services (e.g., a ranked list) is provided for the passenger to select from. For example, the list of services is displayed on user interface 708 as a pop-up window during the route. In some examples, the list of services is provided to the passenger as audio.

[0105] In some embodiments, the autonomous system determines a destination service provider from a list of service providers (e.g., a ranked list). For example, the autonomous system receives a destination location (e.g., a street address, latitude and longitude, a pin on a map, a shared location) from the passenger. The autonomous system determines a list of service providers that meet a threshold proximity to the destination location. In some embodiments, the autonomous system ranks the service providers included in the list.

[0106] In some embodiments, database 706 stores promotional content (e.g., paid services, advertisements) from registered partner service providers (i.e., partners). For example, the autonomous system provides an internal marketplace to the partners. The internal marketplace includes competitive case integration hooks for service providers to purchase. For example, the competitive case integration hooks are triggered based on location or service type. In some embodiments, service selector provides a list of services for a location (e.g., along the route, within a threshold distance of the destination) to the passenger based on the internal marketplace. In such an embodiment, the list of services includes a predetermined number of services associated with the location from the partner with the highest bid. In some examples, the autonomous system receives payment before providing the list (e.g., when the partner bids) or after providing the list to the passenger.

[0107] In some embodiments, service selector 704 provides a passenger with a list of at least one service provider and receives a selection of a desired service provider from the user. In some examples, service selector 704 obtains information about at least one service provider from service database 706. In some examples, the at least one service provider may include at least one partner merchant. In some embodiments, a list of at least one service is provided through user interface 708.

[0108] In some embodiments, when the service at the destination service provider is unsatisfactory, the autonomous system provides the passenger with a ranked list of alternative service providers. For example, the autonomous system ranks alternative service providers based on passenger preferences and route information. The autonomous system provides the ranked alternative service providers to the passenger and receives a selection of an alternative service provider from the ranked alternative service providers. In some embodiments, the autonomous system updates the route information to transport the passenger to the alternative service provider (e.g., sets the new service provider as a waypoint, final destination, or a stop among at least one stop).

[0109] In some embodiments, the autonomous system recommends a service chain (e.g., at least two services) to the passenger. For example, when the passenger leaves a first service provider, other services are recommended. In such an example, the recommendation is provided on the user interface 708. In some examples, a service chain is recommended before the passenger arrives at the first service provider. In such an example, when the first service is completed, the autonomous system recommends a second service. In some examples, the autonomous system recommends at least a second service and a third service (e.g., movie -> restaurant -> haircut). In some embodiments, in response to an unsatisfactory waiting time at the service provider, the autonomous system recommends a service chain. For example, the autonomous system recommends another service (e.g., an activity) before dining. In some embodiments, when the service chain is approaching the end, the autonomous system recommends another service.

[0110] In some embodiments, the database 706 stores service providers as a service chain. In some examples, the autonomous system provides a deal to the service providers included in the service chain (e.g., recommends service providers together if a single bid wins). In some examples, the autonomous system provides a deal to the passenger for selecting the service chain. In such an example, the deal (e.g., coupon, discount) can be displayed to the passenger on the user interface 708 along with the list of recommended services.

[0111] Now refer to Figure 8 , a flowchart of a process 800 for enhancing a ride experience by leveraging external services is illustrated. In some embodiments, one or more steps described with respect to the process 800 are performed by the autonomous system 200 (e.g., fully and / or partially, etc.). Additionally or alternatively, in some embodiments, one or more steps described with respect to the process 800 are performed by another device or group of devices separate from or including the autonomous system 200, such as Figure 3 the device 300 of Figure 4 and the AV computing 400 of

[0112] The autonomous system (e.g., Figure 2Autonomous system 202f) receives a request for the transportation of a passenger to a service provider (block 802). For example, the service request includes the name of the service provider or the location of the service provider. In some embodiments, the service provider is a partner with a registered integration. For example, the registered integration is indexed by the service provider location and at least one service type. In such an example, the registered integration is stored in service database 706.

[0113] The autonomous system determines route information corresponding to the request (e.g., Figure 5 route information 524) (block 804). In some embodiments, the route information includes an estimated time of arrival of the passenger at the service provider. For example, the route information includes the current location of the vehicle, the current location of the passenger, the estimated time of arrival, delays, passenger preferences, or any combination thereof.

[0114] The autonomous system provides service information associated with the service provider to the passenger before the estimated arrival of the passenger at the service provider (e.g., Figure 5 service information 522) (block 806). For example, the service information is provided through Figure 7 user interface 708. In some examples, the service information includes a description of the service provided, a preview of the service, a restaurant menu, or a combination thereof. In some examples, the service provider is a cinema, and the service information is at least one preview of the movies being shown at the cinema. In some embodiments, providing the service information to the user includes transmitting the service information to the user device.

[0115] In some embodiments, the autonomous system provides recommended services to the passenger based on user preferences (e.g., service preferences, food allergies). For example, the autonomous system filters through a database (e.g., service database 706) to obtain recommendations based on the location of the service provider and user preferences. In such an example, the recommendations include services provided by the destination service provider and services provided by other partners.

[0116] The autonomous system receives at least one service request from the passenger based on the provided service information (block 808). For example, the at least one service request includes a table reservation, an appetizer order, a movie ticket, or a combination thereof.

[0117] The autonomous system transmits at least a portion of the route information and the at least one service request to the service provider (e.g., Figure 5Service request 526) (box 810). In some embodiments, the autonomous system coordinates the provision time of at least one requested service with the estimated arrival time of the passenger at the service provider (e.g., the entry of different elements of a complex activity or organization into a relationship that will ensure efficiency or harmony). In some embodiments, the route information includes the estimated arrival time. In some embodiments, the provision time includes the time when the service is ready for the passenger to use or consume. For example, the autonomous system automatically coordinates with the destination service provider by making a reservation and providing an update of the route information to the service provider. In this example, the autonomous system coordinates with the restaurant service provider to have the appetizer ready when the passenger arrives, but not too early to cause a decline in the integrity of the food.

[0118] In some embodiments, the autonomous system has knowledge of the interaction between the passenger and different service providers and coordinates all partners related to the passenger in a seamless integration. For example, if the autonomous system receives an unsatisfactory waiting time for a service from the service provider, the autonomous system automatically detects an alternative service and redirects the vehicle to an alternative service provider with that service, makes a reservation with the alternative service provider, shares the menu with the passenger, and notifies the passenger's dining party.

[0119] In some embodiments, the autonomous system transmits at least one requested service via a communication protocol (e.g., the communication protocol used at Figure 6 T0). For example, the autonomous system transmits at least one voice message during a phone call. In such an example, the autonomous system determines at least one voice message (e.g., pre-recorded or machine-generated in real time) for requesting at least one requested service.

[0120] According to some non-limiting embodiments or examples, a method is provided that includes: receiving, using at least one processor, a request for the transportation of a passenger to a service provider; determining, using the at least one processor, route information corresponding to the request, wherein the route information includes the estimated arrival time of the passenger at the service provider; providing, using the at least one processor, service information associated with the service provider to the passenger before the estimated arrival time of the passenger at the service provider; receiving, using the at least one processor, at least one requested service from the passenger based on the provided service information; and transmitting, using the at least one processor, at least a portion of the route information and the at least one requested service to the service provider, wherein the provision time of the at least one requested service is coordinated with the estimated arrival time of the passenger at the service provider.

[0121] According to some non - limiting embodiments or examples, a system is provided, including: at least one processor; and at least one non - transitory storage medium storing instructions that, when executed by the at least one processor, cause the at least one processor to: receive a request for the transportation of a passenger to a service provider; determine route information corresponding to the request, wherein the route information includes an estimated arrival time of the passenger at the service provider; provide service information associated with the service provider to the passenger before the estimated arrival time of the passenger at the service provider; receive at least one requested service from the passenger based on the provided service information; and transmit at least a portion of the route information and the at least one requested service to the service provider, wherein the provision time of the at least one requested service is coordinated with the estimated arrival time of the passenger at the service provider.

[0122] According to some non - limiting embodiments or examples, at least one non - transitory storage medium is provided, storing instructions that, when executed by at least one processor, cause the at least one processor to: receive a request for the transportation of a passenger to a service provider; determine route information corresponding to the request, wherein the route information includes an estimated arrival time of the passenger at the service provider; provide service information associated with the service provider to the passenger before the estimated arrival time of the passenger at the service provider; receive at least one requested service from the passenger based on the provided service information; and transmit at least a portion of the route information and the at least one requested service to the service provider, wherein the provision time of the at least one requested service is coordinated with the estimated arrival time of the passenger at the service provider.

[0123] Further non - limiting aspects or embodiments are set forth in the following numbered clauses:

[0124] Clause 1: A method includes: receiving, by using at least one processor, a request for the transportation of a passenger to a service provider; determining, by using the at least one processor, route information corresponding to the request, wherein the route information includes an estimated arrival time of the passenger at the service provider; providing, by using the at least one processor, service information associated with the service provider to the passenger before the estimated arrival time of the passenger at the service provider; receiving, by using the at least one processor, at least one requested service from the passenger based on the provided service information; and transmitting, by using the at least one processor, at least a portion of the route information and the at least one requested service to the service provider, wherein the provision time of the at least one requested service is coordinated with the estimated arrival time of the passenger at the service provider.

[0125] Clause 2: The method according to Clause 1, wherein transmitting the at least one requested service includes: obtaining a communication protocol corresponding to the service provider; and transmitting the at least one requested service through the communication protocol.

[0126] Clause 3: The method according to Clause 1 or 2, wherein transmitting the at least one requested service includes: initiating a telephone call with the service provider; determining at least one voice message for requesting the at least one requested service; and transmitting the at least one voice message during the telephone call.

[0127] Clause 4: The method according to any one of Clauses 1 to 3, further comprising: receiving a service update from the service provider; and in response to receiving the service update from the service provider, providing a recommendation to the passenger for at least one alternative service provider.

[0128] Clause 5: The method according to Clause 4, wherein providing a recommendation to the passenger for at least one alternative service provider includes: ranking alternative service providers based on passenger preferences and the route information; providing the ranked alternative service providers to the passenger; receiving a selection of an alternative service provider from the ranked alternative service providers; and updating the route information to transport the passenger to the alternative service provider.

[0129] Clause 6: The method according to any one of Clauses 1 to 5, wherein transmitting at least a portion of the route information includes: transmitting a real-time update including the passenger's current location and the passenger's estimated time of arrival.

[0130] Clause 7: The method according to any one of Clauses 1 to 6, wherein receiving a request for transporting the passenger to the service provider includes: receiving a destination location from the passenger; determining a list of service providers that meet a threshold proximity to the destination location; and determining a service provider from the list of service providers.

[0131] Clause 8: The method according to any one of Clauses 1 to 7, wherein the service provider is a restaurant, the service information is the menu of the restaurant, and the at least one requested service is a food order.

[0132] Clause 9: The method according to any one of Clauses 1 to 8, wherein the service provider is a cinema, and the service information is at least one preview of a movie being shown at the cinema.

[0133] Clause 10: A system includes: at least one processor; and at least one non-transitory storage medium that stores instructions which, when executed by the at least one processor, cause the at least one processor to: receive a request for the transportation of a passenger to a service provider; determine route information corresponding to the request, wherein the route information includes an estimated time of arrival of the passenger to the service provider; provide service information associated with the service provider to the passenger before the estimated time of arrival of the passenger to the service provider; receive at least one requested service from the passenger based on the provided service information; and transmit at least a portion of the route information and the at least one requested service to the service provider, wherein the provision time of the at least one requested service is coordinated with the estimated time of arrival of the passenger to the service provider.

[0134] Clause 11: The system according to Clause 10, wherein the instructions that cause the at least one processor to transmit the at least one requested service cause the at least one processor to: obtain a communication protocol corresponding to the service provider; and transmit the at least one requested service through the communication protocol.

[0135] Clause 12: The system according to Clause 10 or 11, wherein the instructions that cause the at least one processor to transmit the at least one requested service cause the at least one processor to: initiate a phone call to the service provider; determine at least one voice message for requesting the at least one requested service; and transmit the at least one voice message during the phone call.

[0136] Clause 13: The system according to any one of Clauses 10 to 12, wherein the instructions further cause the at least one processor to: receive a service update from the service provider; and in response to receiving the service update from the service provider, provide a recommendation for at least one alternative service provider to the passenger.

[0137] Clause 14: The system according to Clause 13, wherein the instructions that cause the at least one processor to provide a recommendation for at least one alternative service provider to the passenger cause the at least one processor to: rank alternative service providers based on passenger preferences and the route information; provide the ranked alternative service providers to the passenger; receive a selection of an alternative service provider from the ranked alternative service providers; and update the route information to transport the passenger to the alternative service provider.

[0138] Clause 15: The system according to any one of Clauses 10 to 14, wherein the instructions that cause the at least one processor to transmit at least a portion of the route information cause the at least one processor to: transmit a real-time update including the current location of the passenger and the estimated arrival time of the passenger.

[0139] Clause 16: The system according to any one of Clauses 10 to 15, wherein the instructions that cause the at least one processor to receive a request for the transportation of the passenger to the service provider cause the at least one processor to: receive a destination location from the passenger; determine a list of service providers that meet a threshold proximity to the destination location; and determine a service provider from the list of service providers.

[0140] Clause 17: The system according to any one of Clauses 10 to 16, wherein the service provider is a restaurant, the service information is the menu of the restaurant, and the at least one requested service is a food order.

[0141] Clause 18: The system according to any one of Clauses 10 to 17, wherein the service provider is a cinema, and the service information is at least one preview of a movie being shown at the cinema.

[0142] Clause 19: At least one non-transitory storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to: receive a request for the transportation of a passenger to a service provider; determine route information corresponding to the request, wherein the route information includes an estimated arrival time of the passenger at the service provider; provide service information associated with the service provider to the passenger before the estimated arrival time of the passenger at the service provider; receive at least one requested service from the passenger based on the provided service information; and transmit at least a portion of the route information and the at least one requested service to the service provider, wherein the provision time of the at least one requested service is coordinated with the estimated arrival time of the passenger at the service provider.

[0143] Clause 20: The at least one non-transitory storage medium according to Clause 19, wherein the instructions that cause the at least one processor to transmit the at least one requested service cause the at least one processor to: obtain a communication protocol corresponding to the service provider; and transmit the at least one requested service through the communication protocol.

[0144] Clause 21: The at least one non-transitory storage medium according to clause 19 or 20, wherein the instructions that cause the at least one processor to transmit the at least one service request cause the at least one processor to: initiate a telephone call with the service provider; determine at least one voice message for requesting the at least one service request; and transmit the at least one voice message during the telephone call.

[0145] Clause 22: The at least one non-transitory storage medium according to any one of clauses 19 to 21, wherein the instructions further cause the at least one processor to: receive a service update from the service provider; and in response to receiving the service update from the service provider, provide a recommendation to the passenger for at least one alternative service provider.

[0146] Clause 23: The at least one non-transitory storage medium according to clause 22, wherein the instructions that cause the at least one processor to provide a recommendation to the passenger for at least one alternative service provider cause the at least one processor to: rank alternative service providers based on passenger preferences and the route information; provide the ranked alternative service providers to the passenger; receive a selection of an alternative service provider from the ranked alternative service providers; and update the route information to transport the passenger to the alternative service provider.

[0147] Clause 24: The at least one non-transitory storage medium according to any one of clauses 19 to 23, wherein the instructions that cause the at least one processor to transmit at least a portion of the route information cause the at least one processor to: transmit a real-time update including the passenger's current location and the passenger's estimated time of arrival.

[0148] Clause 25: The at least one non-transitory storage medium according to any one of clauses 19 to 24, wherein the instructions that cause the at least one processor to receive a request for transporting the passenger to the service provider cause the at least one processor to: receive a destination location from the passenger; determine a list of service providers that meet a threshold proximity to the destination location; and determine the service provider from the list of service providers.

[0149] Clause 26: The at least one non-transitory storage medium according to any one of clauses 19 to 25, wherein the service provider is a restaurant, the service information is the menu of the restaurant, and the at least one service request is a food order.

[0150] Clause 27: At least one non-transitory storage medium according to any one of Clauses 19 to 26, wherein the service provider is a cinema, and the service information is at least one preview of a movie being screened at the cinema.

[0151] In the foregoing description, aspects and embodiments of the present disclosure have been described with reference to numerous specific details, which may vary according to implementation. Accordingly, the specification and drawings are to be regarded as illustrative rather than in a limiting sense. The sole and exclusive indication of the scope of the invention, and what the applicant desires to be the scope of the invention, is the literal and equivalent scope of the claims that issue from this application in the specific form of the issued claims, including any subsequent amendments. Any definitions expressly set forth herein for terms to be included in such claims shall govern the meaning of such terms as used in the claims. Additionally, when the term "further comprises" is used in the foregoing specification or the appended claims, the text following this phrase may be additional steps or entities, or sub-steps / sub-entities of the previously recited steps or entities.

Claims

1. A method, comprising: Receiving, by at least one processor, a request for transporting a passenger to a service provider; Determining, by the at least one processor, route information corresponding to the request, wherein the route information includes an estimated arrival time of the passenger at the service provider; Providing, by the at least one processor, service information associated with the service provider to the passenger before the estimated arrival time of the passenger at the service provider; Receiving, by the at least one processor, at least one service request from the passenger based on the provided service information; and Transmitting, by the at least one processor, at least a portion of the route information and the at least one service request to the service provider, wherein a provision time of the at least one service request is coordinated with the estimated arrival time of the passenger at the service provider.

2. The method according to claim 1, wherein Transmitting the at least one service request includes: Obtaining a communication protocol corresponding to the service provider; and Transmitting the at least one service request through the communication protocol.

3. The method according to claim 1, wherein Transmitting the at least one service request includes: Initiating a phone call to the service provider; Determining at least one voice message for requesting the at least one service request; and Transmitting the at least one voice message during the phone call.

4. The method according to claim 1, the method further comprising: Receiving a service update from the service provider; And In response to receiving the service update from the service provider, providing a recommendation for at least one alternative service provider to the passenger.

5. The method according to claim 4, wherein Providing a recommendation for at least one alternative service provider to the passenger includes: Ranking alternative service providers based on passenger preferences and the route information; Providing the ranked alternative service providers to the passenger; Receiving a selection of an alternative service provider from the ranked alternative service providers; and Updating the route information to transport the passenger to the alternative service provider.

6. The method according to claim 1, wherein, Transmitting at least a portion of the route information includes: transmitting real-time updates including the current location of the passenger and the estimated arrival time of the passenger.

7. The method according to claim 1, wherein, Receiving a request for transporting the passenger to the service provider includes: Receiving a destination location from the passenger; Determining a list of service providers that meet a threshold proximity to the destination location; and Determining a service provider from the list of service providers.

8. The method according to claim 1, wherein The service provider is a restaurant, the service information is a menu of the restaurant, and the at least one service request is a food order.

9. The method according to claim 1, wherein The service provider is a cinema, and the service information is at least one preview of a movie being shown at the cinema.

10. A system, comprising: At least one processor; And At least one non-transitory storage medium storing instructions that, when executed by the at least one processor, cause the at least one processor to: Receive a request for transporting a passenger to a service provider; Determine route information corresponding to the request, wherein the route information includes an estimated arrival time of the passenger at the service provider; Provide service information associated with the service provider to the passenger before the estimated arrival time of the passenger at the service provider; Receive at least one service request from the passenger based on the provided service information; and Transmit at least a portion of the route information and the at least one service request to the service provider, wherein the provision time of the at least one service request is coordinated with the estimated arrival time of the passenger at the service provider.

11. The system according to claim 10, wherein The instruction that causes the at least one processor to transmit the at least one service request causes the at least one processor to: Obtain a communication protocol corresponding to the service provider; and Transmit the at least one service request through the communication protocol.

12. The system according to claim 10, wherein, The instruction further causes the at least one processor to: Receive a service update from the service provider; and In response to receiving the service update from the service provider, provide a recommendation to the passenger for at least one alternative service provider.

13. The system according to claim 12, wherein, The instruction that causes the at least one processor to provide a recommendation to the passenger for at least one alternative service provider causes the at least one processor to: Rank alternative service providers based on passenger preferences and the route information; Provide the ranked alternative service providers to the passenger; Receive a selection of an alternative service provider from the ranked alternative service providers; And Update the route information to transport the passenger to the alternative service provider.

14. The system according to claim 10, wherein, The instruction that causes the at least one processor to transmit at least a portion of the route information causes the at least one processor to: Transmit real-time updates including the current location of the passenger and the estimated arrival time of the passenger.

15. The system according to claim 10, wherein The instruction that causes the at least one processor to receive a request for transporting the passenger to the service provider causes the at least one processor to: Receive a destination location from the passenger; Determine a list of service providers that meet a threshold proximity to the destination location; And Determine a service provider from the list of service providers.

16. At least one non-transitory storage medium that stores instructions that, when executed by at least one processor, cause the at least one processor to: Receive a request for transporting a passenger to a service provider; Determine route information corresponding to the request, where The route information includes the estimated arrival time of the passenger at the service provider; Provide service information associated with the service provider to the passenger before the estimated arrival time of the passenger at the service provider; Receive at least one service request from the passenger based on the provided service information; And Transmit at least a portion of the route information and the at least one service request to the service provider, wherein the provision time of the at least one service request is coordinated with the estimated arrival time of the passenger at the service provider.

17. The at least one non-transitory storage medium according to claim 16, wherein, The instruction that causes the at least one processor to transmit the at least one service request causes the at least one processor to: Obtain a communication protocol corresponding to the service provider; and Transmit the at least one service request through the communication protocol.

18. The at least one non-transitory storage medium according to claim 16, wherein, The instruction also causes the at least one processor to: Receive a service update from the service provider; and In response to receiving the service update from the service provider, provide a recommendation to the passenger for at least one alternative service provider.

19. The at least one non-transitory storage medium according to claim 18, wherein, The instruction that causes the at least one processor to provide a recommendation to the passenger for at least one alternative service provider causes the at least one processor to: Rank alternative service providers based on passenger preferences and the route information; Provide the ranked alternative service providers to the passenger; Receive a selection of an alternative service provider from the ranked alternative service providers; And Update the route information to transport the passenger to the alternative service provider.

20. The at least one non-transitory storage medium according to claim 18, wherein, Transmitting at least a portion of the route information includes: transmitting real-time updates including the passenger's current location and the passenger's estimated time of arrival.

Images