Method and system for automated restaurant experience assistance for vehicle

Abstract

The invention provides a method and system for automated restaurant experience assistance for a vehicle. A method includes detecting, by a vehicle system, at least one passenger in a vehicle using image data of a passenger compartment of the vehicle; and establishing, by the vehicle system, a communication link with the restaurant identified as to be viewed by the at least one passenger. The method further includes transmitting, by the vehicle system, a message to the restaurant via the communication link to schedule a reservation of the restaurant for the at least one passenger based on an arrival time to the restaurant in response to detecting that the at least one passenger has a meal within the restaurant, or in response to detecting that the at least one passenger will get food from the restaurant, issuing a packaging order for the at least one passenger in the restaurant.

Description

Technical Field

[0001] The present disclosure relates to systems and / or methods for assisting with a vehicle restaurant experience. Background Art

[0002] The statements in this section merely provide background information related to the present disclosure and may not constitute prior art.

[0003] Advances in vehicle technology include not only improving the driving experience of users, but also providing an overall entertaining and convenient user experience. More specifically, a vehicle infotainment system may be configured to include additional features that assist passengers (e.g., a driver and / or other individuals in the vehicle) with tasks such as responding to incoming communications and / or identifying nearby attractions and / or venues (restaurants). Summary of the Invention

[0004] The statements in this section merely provide background information related to the present disclosure and may not constitute prior art.

[0005] In one form, the present disclosure relates to a method that includes: using, by a vehicle system, image data of a passenger compartment of a vehicle to detect at least one passenger in the vehicle; and establishing, by the vehicle system, a communication link with a restaurant identified as being patronized by the at least one passenger. The method further includes transmitting, by the vehicle system via the communication link, a message to the restaurant to: schedule a reservation for the at least one passenger at the restaurant based on an arrival time at the restaurant in response to detecting that the at least one passenger is going to dine in the restaurant, or place a takeout order for the at least one passenger at the restaurant in response to detecting that the at least one passenger will pick up food from the restaurant.

[0006] In one form, the present disclosure relates to a vehicle system that includes: one or more processors; and a memory storing instructions that are executable by the one or more processors to cause the one or more processors to: use image data of a passenger compartment of a vehicle to detect at least one passenger in the vehicle; establish a communication link with a restaurant identified as being patronized by the at least one passenger; and transmit a message to the restaurant. The message transmitted to the restaurant is to schedule a reservation for the at least one passenger at the restaurant based on an arrival time at the restaurant in response to detecting that the at least one passenger is going to dine in the restaurant that the vehicle is heading to, or place a takeout order for the at least one passenger at the restaurant in response to detecting that the at least one passenger will pick up food from the restaurant.

[0007] In one form, the present disclosure relates to a vehicle system that includes a telematics control unit that includes a transceiver and is configured to communicate with a restaurant. The vehicle system also includes one or more processors and a memory storing instructions that are executable by the one or more processors to cause the one or more processors to: detect at least one passenger in the vehicle using image data of the passenger compartment of the vehicle; establish a communication link with a restaurant identified as being patronized by the at least one passenger via the TCU; detect whether the at least one passenger is going to dine in the restaurant or pick up food from the restaurant based on at least one of the restaurant type of the restaurant, historical data of the at least one passenger, or an input from the at least one passenger indicating that the at least one passenger is going to dine in the restaurant; and transmit a message to the restaurant. The message transmitted to the restaurant is to schedule a reservation for the at least one passenger at the restaurant based on the estimated time of arrival at the restaurant in response to detecting that the at least one passenger is going to dine in the restaurant that the vehicle is approaching, or to place the takeout order for the at least one passenger at the restaurant in response to detecting that the at least one passenger is going to pick up food from the restaurant when the preparation time of the takeout order received by the restaurant is greater than or equal to the estimated time of arrival of the vehicle. The time of arrival is based on the estimated driving time, estimated parking time, and estimated walking time to the restaurant of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] To better understand the present disclosure, various forms of the present disclosure will now be described by way of example with reference to the accompanying drawings, in which:

[0009] Figure 1 A vehicle having a restaurant assistance module communicating with a restaurant in accordance with the present disclosure is shown;

[0010] Figure 2 is an example block diagram of a vehicle system of a vehicle in accordance with the present disclosure; and Figure 1 and

[0011] Figure 3 is a flowchart of an example restaurant assistance program in accordance with the present disclosure. DETAILED DESCRIPTION

[0012] As needed, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely examples of the present invention that may be implemented in various forms and alternative forms. The drawings are not necessarily to scale; some features may be enlarged or minimized to show details of particular components. Accordingly, the specific structural and functional details disclosed herein are not to be construed as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.

[0013] Conventional experiences (such as going to a restaurant) may require different tasks, such as making a reservation or placing a takeout order when dining in the store. Usually, people may go to the same restaurant and may even have the same order. Sometimes, people may need to wait in line before they can place their order, and if they order in advance, they must schedule the order so that the food is fresh rather than cold. More importantly, especially when it is difficult to estimate the arrival time of the reservation and / or the preparation time of the order, such tasks may become difficult to schedule and manage.

[0014] In one form, the present disclosure relates to a vehicle having a restaurant assistance module for assisting a passenger's restaurant experience. More specifically, in the case where the vehicle communicates with a restaurant and uses a device in the vehicle, the restaurant assistance module is configured to detect whether the passenger is going to dine in the restaurant or take out from the restaurant. If dining in, the restaurant assistance module is configured to schedule a reservation for the passenger at the restaurant based on the arrival time, and if taking out, the restaurant assistance module is configured to place a takeout order for the passenger at the restaurant based on the driving time of the vehicle 100. The restaurant assistance module automates the passenger's conventional tasks to provide an enhanced restaurant experience.

[0015] Reference Figure 1 , the vehicle 100 includes a restaurant assistance module 102, which is configured to automate various tasks related to the restaurant experience. More specifically, the vehicle 100 is configured to communicate with restaurants 104A and 104B (collectively referred to as "restaurant 104") and specifically with the service system 106 of the restaurant 104.

[0016] In one form, the service system 106 of the restaurant 104 is configured to manage the in-store dining and takeout experiences, such as but not limited to managing reservations, placing in-store dining orders, receiving and executing takeout orders, and notifying customers of the status / completion of the order. Additionally, using infrastructure-to-everything (I2X) communication, the service system 106 is configured to communicate with external devices (such as but not limited to the vehicle 100) via a communication link. The service system 106 may include a server (local and / or cloud-based server), one or more computing devices configured to interface with a user (such as a restaurant employee) to access data / functions supported by the server, and / or a communication device (such as a modem, transceiver, and / or one or more controllers configured to execute one or more communication protocols (such as Transmission Control Protocol (TCP), cellular protocol, I2X protocol, etc.)).

[0017] Reference Figure 2, vehicle 100 includes vehicle system 200, and the vehicle system includes navigation system 202, communication system 204, occupant detection system 206, and infotainment system 208. Although specific systems are provided, vehicle system 200 may include other systems, such as but not limited to climate control systems, powertrains, and / or adaptive driving systems. In one form, navigation system 202, communication system 204, occupant detection system 206, and infotainment system 208 communicate with each other via vehicle network 209 (e.g., a controlled access network).

[0018] In one form, communication (Comm.) system 204 is configured to communicate with various external devices / systems, such as but not limited to the service system 106 of restaurant 104, cellular networks, and other vehicles. Communication system 204 may also communicate with devices within vehicle 100 (such as but not limited to portable computing devices (PCDs) (e.g., smartphones and / or tablet computers)) via wireless or wired communication links. Thus, in addition to other components, communication system 204 includes a telematics control unit (TCU) 210 configured to establish communication according to vehicle-to-everything (V2X) protocols, a Bluetooth transceiver for communicating with devices using the Bluetooth protocol, a global navigation satellite system (GNSS) receiver, and / or an ultra-wideband (UWB) transceiver.

[0019] In one form, navigation system 202 is configured to track the location of vehicle 100, define a driving route based on a desired destination, provide directions to the desired destination based on the defined driving route, and / or estimate the travel time of vehicle 100 to the desired destination. In addition to other components, navigation system 202 also includes a GNSS receiver, a map library, and / or navigation algorithms for defining driving routes. In some variants, instead of or in addition to a separate dedicated navigation system 202 installed within vehicle 100, navigation system 202 is supported by a PCD disposed within vehicle 100. Specifically, the PCD is configured to include one or more route guidance software applications that a passenger can use to reach the desired destination. In the case where the PCD communicates with vehicle 100 via communication system 204, various modules / systems can access information related to the guidance software (such as but not limited to infotainment system 208). Thus, the navigation system 202 of vehicle system 200 can be supported and implemented by the PCD.

[0020] The occupant detection system 206 is configured to detect passengers within the vehicle 100 using data from occupant detection sensors such as camera 211 and known image processing techniques. For example, the occupant detection system 206 obtains an image of the passenger compartment of the vehicle 100 and uses known image processing techniques to determine whether a passenger is present in the passenger compartment. In a non-limiting example, the image processing software applications include a face detection algorithm for detecting a passenger and obtaining the passenger's facial characteristics (i.e., facial feature data). The occupant detection system 206 can also track the number of detected passengers and the facial feature data associated with each passenger. In some variations, as an alternative or supplement to the image data, passengers can be identified based on the presence of a PCD paired with the vehicle 100.

[0021] The infotainment system 208 is configured to provide information and access to various auxiliary features such as, but not limited to, the navigation system 202 and / or the restaurant assistance module 102. In one form, the infotainment system 208 includes one or more user interface (UI) devices 212 and an infotainment control (IC) module 214, the infotainment control module being configured to exchange information with the passengers and control selected auxiliary features based on inputs received from the passengers via the UI devices 212. In one form, the UI devices 212 include audio devices (e.g., microphone 212A and / or speaker 212B), a display device 212C (e.g., a head-up display and / or a liquid crystal display with a touch screen), and / or other suitable input devices (e.g., buttons, knobs, etc.).

[0022] The IC module 214 is configured to provide information to the passengers via the UI devices 212, such as, but not limited to, a menu of available auxiliary features that can be accessed and controlled using the UI devices 212. In a non-limiting example, the IC module 214 is configured to have voice-activated controls that use the audio devices to communicate with the passengers and / or display a graphical interface on the display device 212C. Based on the received inputs, the IC module 214 can provide information about the inputs to the corresponding systems of the vehicle 100. For example, and as described herein, the IC module 214 provides advice or information associated with the restaurant assistance module 102 to the passengers via the UI devices 212 and provides information to the restaurant assistance module 102 based on inputs from the passengers.

[0023] In one form, the restaurant assistance module 102 is configured to include a user preference module 220, a restaurant detection module 222, and an experience assistance module 224. The user preference module 220 is configured to generate and store data related to one or more users of the restaurant assistance module 102. The data is stored as user records in a user profile data store 226. Specifically, using the IC module 214, the user preference module 220 is configured to request information from the user using the UI device 212 (e.g., by asking questions via an audio device and / or a display device). In a non-limiting example, the requested information may include a user identifier (e.g., name); image data used by the restaurant assistance module 102 to identify the user when the user is a passenger in the vehicle 100; information about the PCD associated with the passenger (e.g., PCD brand / model, unique alphanumeric identifier); and / or information related to the restaurant 104 (e.g., the name and / or address of a preferred restaurant 104 pre-identified by the user, restaurants 104 visited by the user while in the vehicle 100, and / or preferred cuisine). The user preference module 220 may also save information related to restaurants 104 visited by the passenger based on the desired destination tracked by the navigation system 202. In some forms, the user profile data store 226 storing the user records may be provided in the vehicle 100 or even in a cloud-based server accessible to the vehicle 100.

[0024] The user preference module 220 is further configured to identify a passenger in response to the occupant detection system 206 detecting a passenger. In a non-limiting example, the user preference module 220 obtains facial feature data related to the passenger from the occupant detection system 206 and compares the data with pre-stored facial feature data in the user records of one or more users set in the user profile database 226. If multiple passengers are detected, the user preference module 220 identifies each passenger. If the facial feature data matches one of the pre-stored facial feature data, the user preference module 220 identifies the passenger and retrieves the user record of the identified passenger. If the facial feature data does not match one of the pre-stored facial feature data, no passenger is identified, and the user preference module 220 may use the IC module 214 to present options for the passenger to establish a user record.

[0025] In some applications, the restaurant assistance module 102 may employ a pre-existing user / passenger identification system in the vehicle 100 that stores information related to the user instead of having a dedicated user preference module 220. The pre-existing user identification system may be modified to include information related to the restaurant 104. Such a pre-existing user / passenger identification system may also be provided in a cloud-based server accessible to the vehicle 100.

[0026] In one form, the restaurant detection module 222 is configured to detect whether the vehicle 100 is heading towards a restaurant 104, and if so, detect whether the experience at the restaurant 104 is dining in or takeout. More specifically, the restaurant detection module 222 can use the IC module 214 to present a query to the passenger asking him / her if he / she is going to the restaurant 104. If so, the restaurant detection module 222 requests information related to the restaurant 104, such as but not limited to the name and / or address. In another example, the restaurant detection module 222 is configured to detect that the passenger is going to the restaurant 104 based on the desired destination provided by the passenger to the navigation system 202.

[0027] If the vehicle 100 is heading towards the restaurant 104, the restaurant detection module 222 determines whether the passenger intends to dine in or takeout. In a non-limiting example, the restaurant detection module 222 determines whether the experience at the restaurant 104 is dining in or takeout based on at least one of the following: the type of restaurant of the restaurant 104 (e.g., it can be inferred that a fast food restaurant is a takeout place); the historical data of the passenger (if available in the user record), the historical data indicating the pattern of the passenger (e.g., whether the passenger has historically dined in or taken out at a specific restaurant 104, whether the passenger has a pattern of only dining in or only taking out at any restaurant 104); and / or presenting a query to ask the passenger whether he / she intends to dine in or takeout.

[0028] In some variations, if the restaurant detection module 222 determines that the destination is not the restaurant 104, the restaurant detection module 222 can determine whether the time to the destination is longer than a defined driving duration indicating a long trip that may require one or more stops. For example, if it is more than 3 hours to the desired destination, the restaurant detection module 222 is configured to recommend a restaurant 104 located on the route to the selected destination after the vehicle 100 has been driving without stopping for a predefined time (e.g., 1.5 hours) or a predefined distance. In one form, the recommended restaurant 104 is within a selected distance from the vehicle 100 or within the driving route, and can be selected based on the information related to the restaurant 104 set in the user record (if available). In some variations, once the restaurant detection module 222 determines that the time to the destination is longer than the defined driving duration, the restaurant detection module 222 can present a query to ask the passenger whether he / she would be interested in the recommendation before providing the restaurant recommendation along the route.

[0029] The experience assistance module 224 is configured to assist a passenger with a restaurant experience, whether dining in the restaurant or taking out. More specifically, in one form, if the passenger plans to dine in the restaurant, the experience assistance module 224 is configured to schedule a reservation at the restaurant 104 for the passenger based on the passenger's arrival time. In a non-limiting example, the experience assistance module 224 determines the number of reservations based on the number of passengers in the vehicle 100 and / or a consultation to ask or verify the number of reservation people for the passenger. In some forms, when the communication system 204 communicates with the service system 106 of the restaurant 104 using the V2X protocol, the experience assistance module 224 is configured to notify the restaurant 104 or exchange messages with the restaurant via the communication system 204.

[0030] In one form, the experience assistance module 224 estimates the passenger's arrival time at the restaurant 104 based on the estimated travel time of the vehicle 100 and supplementary data (if available), such as but not limited to the estimated parking time (e.g., the time it takes to park the vehicle 100) and / or the estimated walking time from the vehicle 100 to the restaurant 104. In some variations, the experience assistance module 224 obtains information from the restaurant 104 via the communication system 204 about whether the restaurant 104 has available parking spaces and / or valet parking attendants. In some variations, the desired destination may be a parking structure / parking lot, and the experience assistance module 224 estimates the arrival time based on the estimated travel time to the parking structure / parking lot and the time it takes for the passenger to walk from the parking lot / parking structure to the restaurant 104.

[0031] If the restaurant 104 has a valet parking service, the experience assistance module 224 is further configured to notify the restaurant 104 that the vehicle 100 is approaching the restaurant 104 to notify the valet parking service that the vehicle 100 will arrive. Additionally, when the in-restaurant dining experience is about to end, the passenger can use the PCD associated with the passenger to notify the vehicle 100, and the PCD can communicate with the vehicle 100 using known vehicle service software applications. Then, the experience assistance module 224 can notify the restaurant 104 so that the valet parking attendant can retrieve the vehicle 100. In another variation, the experience assistance module 224 is configured to use the vehicle service software application on the PCD to track the passenger's location, and if the location indicates that the passenger is leaving (e.g., walking from the table to the entrance), the experience assistance module 224 provides a notification to the restaurant 104 to enable the valet parking attendant to retrieve the vehicle 100.

[0032] In some variations, vehicle 100 can have Phone As A Key (PAAK) capabilities, where the vehicle service software application set on the PCD is configured to provide access to vehicle 100. With this feature, the experience assistance module 224 is also configured to provide temporary PAAK access to enable a valet to perform selected functions (e.g., unlock the doors of vehicle 100, start vehicle 100, and drive vehicle 100) until the passenger returns to vehicle 100 and is detected as an authorized owner via, for example, the vehicle service software application.

[0033] The experience assistance module 224 is also configured to assist the passenger when the passenger intends to place a takeout order at restaurant 104. Specifically, the experience assistance module 224 is configured to obtain the takeout order from the passenger and, by communicating with restaurant 104, obtain the preparation time of the takeout order. Then, the experience assistance module 224 uses the information from the navigation system 202 to estimate the travel time of vehicle 100 to restaurant 104, and when the preparation time is greater than or equal to the travel time of vehicle 100, place the takeout order. This can reduce the amount of time the food for the takeout order waits for the passenger.

[0034] In one form, the experience assistance module 224 is configured to obtain the takeout order in various suitable ways. In a non-limiting example, the experience assistance module 224: uses the IC module 214 to present order inquiries by displaying the menu from restaurant 104 and requests to order items using the IC module 214; and / or displays recommended orders based on previous orders associated with the passenger and uses the IC module 214 to request the passenger to approve / modify the recommended orders. The recommended orders can be generated based on historical information set in the user record and / or based on previous orders on the food-related software application on the PCD associated with the passenger.

[0035] When at least two passengers are detected, if one order will take longer than the other orders, the experience assistance module 224 is configured to stagger the takeout orders. More specifically, the experience assistance module 224 obtains the preparation time of each takeout order, estimates the travel time of vehicle 100 to restaurant 104, and places the takeout orders based on the preparation time and travel time of the orders so as to reduce or minimize the time the takeout orders wait for the passengers.

[0036] In some variations, the experience assistance module 224 is also configured to determine whether the restaurant 104 can fulfill a takeout order. Specifically, before sending a takeout order, the experience assistance module 224 consults the restaurant 104 to determine whether it can prepare the food set in the takeout order. If so, when the preparation time is greater than or equal to the driving time of the vehicle 100, the experience assistance module 224 provides an official takeout order. In response to receiving a message from the restaurant 104 that it cannot fulfill at least one item in the takeout order, the experience assistance module 224 is configured to notify the passenger that at least one item in the takeout order is unavailable. Then, the passenger may be able to change his / her order and / or provide a different restaurant 104 from which they want to order.

[0037] Reference Figure 3 , the exemplary restaurant assistance program 300 is executed by the vehicle system 200 having the restaurant assistance module 102. At operation 302, the vehicle system 200 detects a passenger in the vehicle 100 and determines whether the passenger is associated with the user record of the restaurant assistance module 102. In a non-limiting example, using image data of the passenger compartment and known image processing techniques, the vehicle system 200 detects the presence of the passenger. Once detected, the vehicle system 200 compares the facial feature data of the passenger with the pre-stored facial features of the user associated with the restaurant assistance module 102. If the passenger is identified (i.e., the user record is associated with the passenger), the vehicle system 200 obtains the user record from the data storage 226 at operation 306.

[0038] After obtaining the user record or failing to identify the passenger, the vehicle system 200 determines at operation 308 whether the destination is the restaurant 104 based on the desired destination input to the navigation system 202 as detailed above and / or by providing a consultation to the passenger. If the destination is not the restaurant 104, the program 300 ends. If the destination is the restaurant 104, the vehicle system 200 determines at operation 310 whether the restaurant experience is for dining in or takeout, as detailed above.

[0039] If the experience is for dining in, at operation 312, the vehicle system 200 estimates the arrival time of the passenger and schedules a reservation at the restaurant 104 based on the arrival time. That is, the vehicle system 200 communicates with the service system 106 of the restaurant 104 to schedule a reservation at a time close to the arrival of the passenger at the restaurant 104. As detailed above, the driving time of the vehicle 100, the estimated parking time for parking the vehicle 100, and the estimated walking time from the vehicle 100 to the restaurant 104 can be used to determine the arrival time.

[0040] If the experience is takeout, the vehicle system 200 estimates the travel time of the vehicle 100 to the restaurant 104 at operation 314 and as detailed above, obtains a takeout order, and places the takeout order based on the travel time and the preparation time of the takeout order. If multiple orders are being placed, the vehicle system 200 is configured to stagger the takeout to reduce or minimize the time the food waits for the passenger.

[0041] The restaurant assistance program 300 can be configured to perform other operations within the scope of the present disclosure and should not be limited to the examples described herein. For example, after determining that the destination is not the restaurant 104, the vehicle system 200 is configured to recommend the restaurant 104 to the passenger when it detects that the vehicle 100 has traveled a predefined time or distance without stopping. In another example, the vehicle system 200 is configured to notify the valet service at the restaurant 104 to obtain the vehicle 100 when it is determined that the passenger has finished his / her meal.

[0042] Among other improvements / features, the vehicle system 200 with the restaurant assistance module 102 improves the automated systems used by individuals and restaurants for scheduling reservations or even placing food orders. Specifically, the restaurant assistance module 102 is configured to use the occupant detection system 206 to detect and identify the passengers in the vehicle 100 and obtain the user profile record of the passengers (if available). By automatically detecting the passengers and using the information in the associated user profile record, the restaurant assistance module 102 can reduce the time it takes for the passengers and the existing automated systems to schedule reservations or place takeout orders. In some forms, the restaurant assistance module 102 is capable of presenting recommendations to the passengers based on the information in the user profile record, which may include historical data of the restaurants visited and / or the food ordered / preferred by the user / passengers.

[0043] In addition, the restaurant assistance module 102 is configured to use the navigation system 202 to monitor the travel time of the vehicle 100 to the restaurant. This can improve the accuracy of the actual arrival time / travel time for scheduling reservations and / or placing takeout orders, and thus improve the accuracy of the reservation scheduling system to limit waiting times or reservation losses and / or improve the restaurant's takeout order system by preparing the food with a more realistic arrival / retrieval arrangement.

[0044] In some forms, the restaurant assistance module 102 is also configured to provide an automated valet service by detecting when a passenger who is currently a customer of the restaurant leaves and transmitting a message to the restaurant to retrieve the vehicle 100. This can improve the efficiency of the valet service and reduce the waiting time of the passengers.

[0045] While the above describes exemplary embodiments, these embodiments are not intended to describe all possible forms of the invention. Rather, the words used in the specification are descriptive words rather than limiting words, and it is to be understood that various changes may be made without departing from the spirit and scope of the invention. Additionally, the features of the various embodiments may be combined to form further embodiments of the invention.

[0046] Unless expressly indicated otherwise herein, all numerical values indicating mechanical / thermal properties, compositional percentages, dimensions, and / or tolerances or other characteristics should be understood to be modified by the word "about" or "approximately" when describing the scope of the present disclosure. Such modification is desired for various reasons, including industrial practice; material, manufacturing, and assembly tolerances; and testing capabilities.

[0047] In this application, the term "module" may refer to, be part of, or include the following: an application specific integrated circuit (ASIC); digital, analog, or mixed analog / digital discrete circuits; digital, analog, or mixed analog / digital integrated circuits; combinational logic circuits; a field programmable gate array (FPGA); processor circuitry (shared, dedicated, or group) that executes code; memory circuitry (shared, dedicated, or group) that stores code executed by the processor circuitry; other suitable hardware components that provide the described functionality; or some or all of the above combinations, such as in a system on a chip.

[0048] The term memory is a subset of the term computer-readable medium. As used herein, the term computer-readable medium does not cover transitory electrical or electromagnetic signals propagated through a medium, such as on a carrier wave; thus, the term computer-readable medium can be considered tangible and non-transitory. Non-limiting examples of non-transitory tangible computer-readable media are non-volatile memory circuits (such as flash memory circuits, erasable programmable read-only memory circuits, or mask read-only circuits), volatile memory circuits (such as static random access memory circuits or dynamic random access memory circuits), magnetic storage media (such as analog or digital magnetic tape or hard disk drives), and optical storage media (such as CDs, DVDs, or Blu-ray discs).

[0049] The devices and methods described in this application may be implemented, in part or in whole, by a special purpose computer created by configuring a general purpose computer to execute one or more specific functions embodied in a computer program. Functional blocks, flowchart components, and other elements described above serve as software specifications that can be translated into a computer program by routine work of a technician or programmer.

[0050] According to the present invention, a method includes: detecting, by a vehicle system, at least one passenger in a vehicle; establishing, by the vehicle system, a communication link with a restaurant identified as being patronized by the at least one passenger; and transmitting, by the vehicle system via the communication link, a message to the restaurant to: schedule a reservation for the at least one passenger at the restaurant based on an arrival time at the restaurant in response to detecting that the at least one passenger is going to dine in the restaurant, or place a takeout order for the at least one passenger at the restaurant in response to detecting that the at least one passenger will pick up food from the restaurant.

[0051] In one aspect of the present invention, the method includes detecting, by the vehicle system, that the at least one passenger is going to dine in the restaurant based on at least one of a type of the restaurant, historical data of the at least one passenger, or an input from the at least one passenger indicating that the at least one passenger is going to dine in the restaurant.

[0052] In one aspect of the present invention, the method includes estimating, by the vehicle system, the arrival time based on an estimated travel time of the vehicle, an estimated parking time, and an estimated walking time to the restaurant.

[0053] In one aspect of the present invention, to place the takeout order, the method further includes: obtaining, by the vehicle system via the communication link, a preparation time of the takeout order; and estimating, by the vehicle system, a travel time of the vehicle to the restaurant, wherein when the preparation time of the takeout order is greater than or equal to the travel time of the vehicle, transmitting the message to place the takeout order.

[0054] In one aspect of the present invention, when at least two passengers are detected, the method further includes: obtaining, by the vehicle system from the restaurant, a preparation time of the takeout order for each of the at least two passengers; and estimating, by the vehicle system, a travel time of the vehicle to the restaurant, wherein when the preparation time of the corresponding takeout order is greater than or equal to the travel time of the vehicle, transmitting the message to place each takeout order.

[0055] In one aspect of the present invention, the method includes: identifying, by the vehicle system, at least one user among the detected at least one passenger based on one or more user records stored in a data storage area, the characteristics of the at least one passenger including at least one of a portable computing device associated with the passenger, facial features identified from image data, or a combination thereof; and recommending, by the vehicle system, food items for the takeout order based on the user records associated with the identified at least one user.

[0056] In one aspect of the present invention, the method includes the vehicle system providing recommendations for one or more restaurants located within a selected distance from the vehicle when it is detected that the vehicle has traveled a predefined time or a predefined distance without stopping.

[0057] In one aspect of the present invention, the method includes the vehicle system notifying at least one passenger that at least one item of the takeout order is unavailable in response to receiving a message from the restaurant that at least one item of the takeout order cannot be fulfilled.

[0058] In one aspect of the present invention, the method includes the vehicle system notifying the restaurant to request a valet service associated with the restaurant to retrieve the vehicle in response to detecting that a customer of the restaurant is ready to leave, where the customer is the detected passenger.

[0059] According to the present invention, there is provided a vehicle system having: one or more processors; a memory storing instructions executable by the one or more processors to cause the one or more processors to: use image data of a passenger compartment of a vehicle to detect at least one passenger in the vehicle; establish a communication link with a restaurant identified as being patronized by the at least one passenger; and transmit a message to the restaurant to: schedule a reservation for the at least one passenger at the restaurant based on an arrival time at the restaurant in response to detecting that the at least one passenger is going to dine in the restaurant that the vehicle is heading to, or place a takeout order for the at least one passenger at the restaurant in response to detecting that the at least one passenger will pick up food from the restaurant.

[0060] According to an embodiment, the instructions further cause the one or more processors to detect that the at least one passenger is going to dine in the restaurant based on at least one of a restaurant type of the restaurant, historical data of the at least one passenger, or an input from the at least one passenger indicating that the at least one passenger is going to dine in the restaurant.

[0061] According to an embodiment, the instructions further cause the one or more processors to estimate the arrival time based on an estimated travel time of the vehicle, an estimated parking time, and an estimated walking time to the restaurant.

[0062] According to an embodiment, in order to place the takeout order, the instructions further cause the one or more processors to: obtain a preparation time of the takeout order; and estimate a travel time of the vehicle to the restaurant, where when the preparation time of the takeout order is greater than or equal to the travel time of the vehicle, transmit the message to place the takeout order.

[0063] According to an embodiment, when at least two passengers are detected, the instructions further cause the one or more processors to: obtain a preparation time of the takeout order for each of the at least two passengers; and estimate at least one travel time of the vehicle to the restaurant, wherein when the preparation time of the corresponding takeout order is greater than or equal to the travel time of the vehicle, transmit the message to place each takeout order.

[0064] According to an embodiment, the instructions further cause the one or more processors to: identify at least one user among the at least one detected passenger based on one or more user records stored in a data store and based on facial features identified from the image data, and recommend food items for the takeout order based on the user records associated with the at least one identified user.

[0065] According to an embodiment, the instructions further cause the one or more processors to provide recommendations for one or more restaurants located within a selected distance from the vehicle when it is detected that the vehicle has traveled for a predefined time or a predefined distance without stopping.

[0066] According to an embodiment, the instructions further cause the one or more processors to notify the at least one passenger that at least one item is unavailable in response to receiving a message from the restaurant that at least one item of the takeout order cannot be fulfilled.

[0067] According to an embodiment, the instructions further cause the one or more processors to notify the restaurant to request a valet parking service associated with the restaurant to retrieve the vehicle in response to detecting that a customer of the restaurant is about to leave, wherein the customer is the detected passenger.

[0068] According to the present invention, a vehicle system is provided, the vehicle system having: a telematics control unit including a transceiver and configured to communicate with a restaurant; one or more processors; a memory storing instructions executable by the one or more processors to cause the one or more processors to: detect at least one passenger in the vehicle using image data of the passenger compartment of the vehicle; establish a communication link with a restaurant identified as being patronized by the at least one passenger; detect whether the at least one passenger is going to dine in the restaurant or pick up food from the restaurant based on at least one of the restaurant type of the restaurant, historical data of the at least one passenger, or an input from the at least one passenger indicating that the at least one passenger is going to dine in the restaurant; and transmit a message to the restaurant to: arrange a reservation for the at least one passenger at the restaurant based on an arrival time at the restaurant in response to detecting that the at least one passenger is going to dine in the restaurant that the vehicle is driving towards, wherein the arrival time is based on an estimated driving time, an estimated parking time, and an estimated walking time to the restaurant of the vehicle, or place a takeout order for the at least one passenger at the restaurant in response to detecting that the at least one passenger is going to pick up food from the restaurant when a preparation time of the takeout order received by the restaurant is greater than or equal to the estimated driving time of the vehicle.

[0069] According to an embodiment, the instructions further cause the one or more processors to provide recommendations for one or more restaurants located within a selected distance from the vehicle when it is detected that the vehicle has traveled for a predefined time or a predefined distance without stopping.

Claims

1. A method comprising: detecting, by a vehicle system, at least one occupant in the vehicle; establishing, by the vehicle system, a communication link with a restaurant identified as to be visited by the at least one passenger; as well as transmitting, by the vehicle system via the communication link, a message to the restaurant to: arranging a reservation for the at least one passenger at the restaurant based on an arrival time at the restaurant in response to detecting that the at least one passenger is heading to the restaurant for dining, or A take-away order is placed at the restaurant for the at least one passenger in response to detecting that the at least one passenger will pick up food from the restaurant.

2. The method of claim 1 further comprises detecting, by the vehicle system, that the at least one passenger is heading to the restaurant for in-store dining based on at least one of a restaurant type of the restaurant, historical data of the at least one passenger, or input from the at least one passenger indicating that the at least one passenger is going to dine in-store.

3. The method of claim 1 further comprising estimating, by the vehicle system, the arrival time based on an estimated driving time of the vehicle, an estimated parking time, and an estimated walking time to the restaurant.

4. The method of claim 1, wherein in order to place the packaging order, the method further comprises: obtaining, by the vehicle system via the communication link, a preparation time for the packaged order; as well as The vehicle system estimates a travel time of the vehicle to the restaurant, wherein when the preparation time of the package order is greater than or equal to the travel time of the vehicle, the message is transmitted to place the package order.

5. The method of claim 1, wherein when at least two passengers are detected, the method further comprises: obtaining, by the vehicle system from the restaurant, a preparation time for the take-away order for each of the at least two passengers; as well as A travel time of the vehicle to the restaurant is estimated by the vehicle system, wherein the message is transmitted to place each take-away order when the preparation time of the corresponding take-away order is greater than or equal to the travel time of the vehicle.

6. The method of claim 1, further comprising: identifying, by the vehicle system, at least one user among the at least one detected passenger based on one or more user records stored in a data store, characteristics of the at least one passenger including at least one of a portable computing device associated with the passenger, facial features identified from the image data, or a combination thereof; as well as Food items are recommended, by the vehicle system, for the take-away order based on a user record associated with the identified at least one user.

7. The method of claim 1 further comprising providing, by the vehicle system upon detecting that the vehicle has traveled without stopping for a predefined time or a predefined distance, recommendations for one or more restaurants located within a selected distance from the vehicle.

8. The method of claim 1 further comprising notifying the at least one passenger, by the vehicle system, that the at least one item of the take-away order is unavailable in response to receiving a message from the restaurant that the at least one item cannot be fulfilled.

9. The method of claim 1 further comprising notifying, by the vehicle system, the restaurant to request a valet parking service associated with the restaurant to retrieve the vehicle in response to detecting that a patron of the restaurant is preparing to leave, wherein the patron is the detected passenger.

10. A vehicle system comprising: one or more processors; a memory storing instructions executable by the one or more processors to cause the one or more processors to: detecting at least one occupant in the vehicle using image data of a passenger compartment of the vehicle; establishing a communication link with a restaurant identified as to be visited by the at least one passenger; as well as Transmitting a message to the restaurant to: arranging a reservation for the at least one passenger at the restaurant based on an arrival time at the restaurant in response to detecting that the at least one passenger is dining in the restaurant to which the vehicle is traveling, or A take-away order is placed at the restaurant for the at least one passenger in response to detecting that the at least one passenger will pick up food from the restaurant.

11. The vehicle system of claim 10, wherein the instructions further cause the one or more processors to detect that the at least one passenger is heading to the restaurant for in-store dining based on at least one of a restaurant type of the restaurant, historical data of the at least one passenger, or input from the at least one passenger indicating that the at least one passenger is going to dine in-store.

12. The vehicle system of claim 10, wherein the instructions further cause the one or more processors to estimate the arrival time based on an estimated driving time of the vehicle, an estimated parking time, and an estimated walking time to the restaurant.

13. The vehicle system of claim 10, wherein to place the package order, the instructions further cause the one or more processors to: Obtaining the preparation time for the packaging order; and A travel time of the vehicle to the restaurant is estimated, wherein when the preparation time of the package order is greater than or equal to the travel time of the vehicle, the message is transmitted to place the package order.

14. The vehicle system of claim 10, wherein when at least two passengers are detected, the instructions further cause the one or more processors to: obtaining a preparation time for the package order for each of the at least two passengers; and At least one travel time of the vehicle to the restaurant is estimated, wherein the message is transmitted to place each take-away order when the preparation time of the corresponding take-away order is greater than or equal to the travel time of the vehicle.

15. The vehicle system of claim 10, wherein the instructions further cause the one or more processors to provide recommendations for one or more restaurants located within a selected distance from the vehicle upon detecting that the vehicle has traveled without stopping for a predefined time or a predefined distance.

Images