Self-service ordering system and method for automobile intelligent cabin

Abstract

The invention discloses a self-service ordering system and method for an automobile intelligent cabin, and relates to the technical field of intelligent driving. The system comprises an intelligent cockpit domain controller, a vehicle-mounted communication module, a vehicle-mounted information receiving device and an ordering interaction module, the vehicle-mounted information receiving device is used for receiving various information such as voice and images, the vehicle-mounted communication module is used for information transmission, the ordering interaction module is used for information processing and analysis, and the intelligent cockpit domain controller and the vehicle-mounted communication module are integrated. Finally, in cooperation with the control of the intelligent cabin domain controller, the function that the user can complete the ordering operation through voice or gesture instructions in the driving process is achieved. Meanwhile, the system can intelligently recommend nearby restaurants and food and automatically complete the ordering process according to the preference of the user, the historical order and the current position information, the ordering convenience and individuation level are improved, the user operation process is reduced as much as possible, and the driving safety is greatly improved.

Description

Technical Field

[0001] The present invention relates to the field of intelligent driving technology, and in particular to a self-service ordering system and method for an intelligent automobile cockpit. Background Art

[0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art.

[0003] With the rapid development of networking and intelligence of new energy vehicles, the smart cockpit, as an important part of the car, is gradually transforming from the traditional driving space to the "third living space" that integrates driving, entertainment, and life services. In this transformation process, the smart cockpit not only improves the convenience and safety of driving, but also greatly enriches the user's riding experience. In recent years, with the integrated application of vehicle networking, artificial intelligence and Internet of Things technologies, the functions of the smart cockpit have been continuously expanded, providing the possibility for the development of innovative services based on the smart cockpit of the car.

[0004] Traditional car ordering models mostly rely on mobile phone apps or external services, which are inconvenient for users to operate while driving and pose safety risks. However, there is currently no mature car intelligent cockpit-based ordering model function system and its control method on the market, which limits the further application of catering services in the field of intelligent networking of car cockpits.

[0005] In the existing technology, the smart cockpit mainly focuses on driving assistance, infotainment and vehicle control. Although some vehicles have interactive methods such as voice control and gesture recognition, these technologies have not yet been effectively applied to in-car ordering / meal reservation services. In addition, the hardware and software architecture of the smart cockpit has not been fully optimized and cannot support complex ordering processes. For a series of functions such as dish selection, ordering, payment and order tracking, it cannot be automatically jumped intelligently, and users need to select them one by one, which seriously hinders safe driving. Summary of the invention

[0006] In view of the shortcomings of the prior art, the purpose of the present invention is to provide a self-service ordering system and method for a smart cockpit of a car. The system can realize the function of users completing the ordering operation through voice or touch screen instructions during driving. It can also intelligently recommend nearby restaurants and delicacies and automatically complete the ordering process based on the user's preferences, historical orders, location information and parking space availability, thereby improving the convenience and personalization of ordering while reducing the user operation process as much as possible, greatly improving driving safety. In addition, the present invention also optimizes the hardware and software architecture of the smart cockpit to ensure the efficient operation of the ordering process and the stability of the system.

[0007] In order to achieve the above object, the present invention is implemented through the following technical solutions:

[0008] A first aspect of the present invention provides a self-service ordering method for a smart car cabin, comprising the following steps:

[0009] Detecting that the user inputs an ordering instruction, the ordering mode is turned on;

[0010] Obtain user facial information and identify user attributes to automatically log in to the account;

[0011] Identify the user's driving status based on the user's facial information, and jump to the ordering interface if the driving status is normal;

[0012] Obtain vehicle itinerary information and generate a meal ordering interface based on user preferences;

[0013] Identify the user's order instructions, settle the order according to the order instructions, and automatically select the best payment method during the settlement process;

[0014] After receiving the payment instruction confirmed by the user, it will automatically jump to the payment interface and use the default payment method for payment;

[0015] After payment is completed, the order information is generated and the tracking interface is jumped to track the order in real time.

[0016] Furthermore, the user's driving status includes normal driving status, fatigue driving status and drunk driving status. If fatigue driving status or drunk driving status is detected, abnormal reminders and safety prompts will be given through the central control screen and speakers.

[0017] Furthermore, the specific steps of obtaining user facial information and identifying user attributes are as follows:

[0018] Get real-time face images;

[0019] Preprocess the face image, and then use the face image recognition model to perform state recognition and image comparison on the face image;

[0020] Identify whether the current user status is abnormal based on the status recognition result;

[0021] Identify user attributes based on image comparison results and associate the corresponding user account.

[0022] Furthermore, the specific steps of obtaining vehicle travel information and generating a meal ordering interface based on user preferences are as follows:

[0023] According to the preset itinerary of the vehicle, obtain information about restaurants along the way and the availability of parking spaces;

[0024] Obtain user historical order information and classify catering types;

[0025] According to the classification results, the restaurants along the route are sorted according to frequency and parking space availability;

[0026] Generate an ordering interface based on the sorting results.

[0027] Furthermore, the order information includes catering merchant information, payment fees and amounts, estimated arrival time, estimated dining time, dining method, activities and discounts, number of diners, payment method, invoicing type, and user rights.

[0028] Furthermore, after the user logs in to the account of the frequently used restaurant, if it is found that the location of the restaurant to which the last order belongs is within the vehicle itinerary, the user will be asked whether to repeat the last order. If the user confirms, it will automatically jump to the payment interface without the need to place an order.

[0029] Furthermore, after the interface jumps, voice prompts are broadcast through the speaker.

[0030] Furthermore, the user completes the command input by touch screen or voice.

[0031] A second aspect of the present invention provides a self-service ordering system for a smart cockpit of a car, comprising a smart cockpit domain controller, an on-board communication module, an on-board information receiving device and an ordering interaction module.

[0032] The smart cockpit domain controller is used to centrally control each device;

[0033] The vehicle-mounted communication module is used for communication between the inside and outside of the vehicle and between the inside of the vehicle;

[0034] The vehicle-mounted information receiving device is used to obtain the voice, image and instruction information required in the ordering process, and perform voice broadcast or image display;

[0035] The ordering interaction module includes a user interaction interface, an artificial intelligence program, a catering service platform, a payment module and a navigation module. The user interaction interface is used to display an intuitive ordering operation interface. The artificial intelligence program is used to receive and analyze the user's facial information, current location information, historical order information, merchant information and journey information. The catering service platform is used to provide merchant information through the cloud. The payment module is used to complete payment transactions. The navigation module allows users to obtain itinerary information.

[0036] Furthermore, the vehicle-mounted information receiving device includes a camera, a microphone, a speaker and a central control screen in the vehicle. The camera is used to obtain facial information of users in the vehicle in real time, the microphone is used to obtain voice information of users in the vehicle in real time, the speaker is used for voice broadcasting, and the central control screen is used to display images and receive touch screen commands from users.

[0037] One or more of the above technical solutions have the following beneficial effects:

[0038] The present application discloses a self-service ordering system and method for a smart car cockpit. The system integrates technologies such as voice recognition, natural language processing, Internet of Things communication, and intelligent recommendation algorithms, uses an on-board information receiving device to receive various information such as voice and images, and transmits information through an on-board communication module, and uses an ordering interaction module to process and analyze information. Finally, in conjunction with the control of the smart cockpit domain controller, the system enables users to complete ordering operations through voice or touch screen commands during driving. At the same time, the system can also intelligently recommend nearby restaurants and delicacies and automatically complete the ordering process based on user preferences, historical orders, location information, and parking space availability, thereby improving the convenience and personalization of ordering while minimizing the user operation process, greatly improving driving safety. In addition, the present invention also optimizes the hardware and software architecture of the smart cockpit to ensure the efficient operation of the ordering process and the stability of the system.

[0039] The invention aims to solve the shortcomings of the existing smart cockpit in the field of catering services. By integrating innovative technologies, it provides users with a more intelligent, convenient and safe ordering experience, and promotes the smart cockpit to further move towards the "third living space".

[0040] Advantages of additional aspects of the present invention will be given in part in the following description, and in part will become obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings in the specification, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0042] Figure 1 This is a flow chart of the self-service ordering method in Embodiment 1 of the present invention;

[0043] Figure 2 This is a functional block diagram of the self-service ordering system in Embodiment 2 of the present invention. DETAILED DESCRIPTION

[0044] It should be noted that the following detailed descriptions are exemplary and are intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those commonly understood by those skilled in the art to which the present invention belongs.

[0045] It should be noted that in the embodiments of the present invention, when data related to images or voices is involved, when the above embodiments of the present invention are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0046] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present invention. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that when the terms "include" and / or "include" are used in this specification, it indicates the presence of features, steps, operations, devices, components and / or their combinations;

[0047] Embodiment 1:

[0048] The first embodiment of the present invention provides a self-service ordering method for a smart car cabin, which improves the user experience and allows users to achieve smarter and more convenient ordering / subscription services in car use scenarios such as short-distance travel, long-distance travel, and commuting. Figure 1 As shown, the following steps are included:

[0049] S201: The user turns on the ordering mode; it is detected that the user inputs an ordering instruction and the ordering mode is turned on.

[0050] S202: The system identifies user information: obtains user facial information and identifies user attributes, and automatically logs in to the account based on the user's registered account information in the system.

[0051] The specific steps are:

[0052] S2021: Obtain real-time facial images through the camera inside the car.

[0053] S2022: Preprocess the facial image, and then use the facial image recognition model to perform state recognition and image comparison on the facial image.

[0054] In this embodiment, the face recognition algorithm of the existing artificial intelligence program is used. When registering an account, a face image in a normal state is uploaded in advance. The face image recognition model is used to analyze and compare the collected face image with the face image in a normal state through image processing, feature extraction, classification recognition and other technical means.

[0055] S2023: Identify whether the current user status is abnormal according to the status identification result;

[0056] S2024: Identify user attributes based on the image comparison results and associate with corresponding user accounts.

[0057] S203: Check whether the user's state is abnormal: Obtain the user's facial information through the in-car camera, analyze and detect the user's facial features through the artificial intelligence program, and identify the user's driving state. Among them, the user's driving state includes normal driving state, fatigue driving state and drunk driving state. Specifically, it is judged based on factors such as the degree of eye opening and closing, the length of eye closing, heart rate, blood pressure, and arm movement frequency to determine whether it is in an abnormal state. The specific value setting can be customized according to the actual situation.

[0058] S204: If fatigue driving or drunk driving is detected, the self-service ordering system cannot be used, and abnormal reminders and safety prompts are given through the central control screen and speakers.

[0059] S205: Connecting to the catering service platform: If the driving status is normal, the cloud catering service platform is connected in real time through the vehicle communication module.

[0060] S206: Entering the ordering interactive interface: After the cloud catering service platform is successfully connected, the central control screen will jump and display the ordering interface. If the connection is not successful, the central control screen will display an abnormal reminder.

[0061] S207: Order by voice or touch screen: According to the central control screen display interface, the user can order by voice operation through the microphone in the car or by touch screen operation through the central control screen. The specific self-service ordering system can provide users with two ordering methods, the first is the user's self-selection method, and the second is the intelligent recommendation method.

[0062] S208: User selection: The user can input keywords to search by voice or touch screen, and order food according to the search results. Keywords include but are not limited to restaurant name, food type (fruit, drink, noodles, bibimbap, rice noodles, spicy hot pot, etc.), price range, discount activities, etc.

[0063] S209: Intelligent recommendation: The artificial intelligence program intelligently recommends nearby restaurants and food to users for selection based on the user's historical orders, dining preferences, current location information, parking space availability, etc.

[0064] S210: Trip calculation: Obtain vehicle trip information and generate a meal ordering interface based on user preferences.

[0065] In this embodiment, the specific steps of obtaining vehicle travel information and generating a meal ordering interface based on user preferences are as follows:

[0066] Step 1: According to the preset itinerary of the vehicle, obtain the restaurant information along the way and the availability of parking spaces. The preset itinerary of the vehicle includes the vehicle location information, itinerary route, estimated itinerary duration, etc. obtained through the navigation module. The artificial intelligence program uses the navigation module to calculate the user's itinerary based on the above information, and obtains the estimated arrival time for the vehicle communication module to feedback to the selected catering merchants in the cloud catering service platform. Further, the vehicle communication module receives feedback from the catering merchants to obtain the user's estimated dining time in real time.

[0067] It should be noted that the restaurant information along the way is obtained for in-store dining (in-store or take-out). If the take-out ordering method is selected, the restaurant information around the destination is obtained. According to the estimated time to arrive at the destination provided by the navigation module, the restaurant information with the corresponding delivery time is provided. If you need to wait because the restaurant is far away, the meal delivery time is long, or there are few riders around, the corresponding waiting time prompt will be given.

[0068] Step 2: Get the user's historical order information and classify the restaurant types. For example, if the user has ordered ramen 5 times and malatang 3 times in the historical order, ramen-related restaurants will be recommended first.

[0069] Step 3: Sort the restaurants along the way by frequency and parking availability based on the classification results. Specifically, prioritize the types of restaurants with the most orders. For the same type of restaurants, further sort them by restaurant ratings, and filter out those with parking spaces available. In addition, if the user needs other sorting methods, they can customize the settings, such as sorting by distance priority, sorting by discount strength, etc.

[0070] In a specific implementation, the priority of the recommendation factors is set for sorting. In this embodiment, the parking space availability is first set as the highest priority, that is, businesses with vacant parking spaces and waiting time of less than half an hour are screened out. Secondly, the catering type is set as the secondary priority, that is, businesses that have been visited in the past are screened out and sorted from high to low according to the number of historical orders. If there is no merchant with overlapping historical orders on the new route, the merchants with the same catering type in the historical orders are sorted from high to low according to the number of orders. Finally, the score is set to the lowest priority, and the merchants of the same type are sorted from high to low according to the score.

[0071] In a specific implementation, the method for obtaining the parking space availability is:

[0072] According to the destination information, the cloud searches for parking lots within the preset range of the destination, including parking lots of dining merchants, parking lots of surrounding merchants, public parking lots, or other locations where the vehicle can be legally parked.

[0073] For all candidate parking lots after the search, obtain their current smart parking information, such as the current number of available parking spaces, expected waiting time, etc.

[0074] Step 4: Generate an ordering interface based on the sorting results.

[0075] S211: Order confirmation: Identify the user's order instruction, settle the order according to the order instruction, and automatically select the optimal payment method during the settlement process. The optimal payment method selection process is to list all preferential methods and their combinations, and select the method with the greatest preferential strength for settlement.

[0076] S212: Payment transaction: After receiving the payment instruction confirmed by the user, the payment interface is automatically jumped to, and the default payment method is used for payment. In this embodiment, in order to save the number of user operations, after the user confirms the order, the face recognition method is preferred for payment, which further improves the safety during driving.

[0077] S213: Order successfully placed: After payment is completed, order information is generated and the tracking interface is jumped to track the order in real time. The order information includes but is not limited to restaurant merchant information, payment fee and amount, estimated time of arrival, estimated dining time, dining method (in-store or takeaway), activities and discounts, number of diners, payment method, invoice type and user rights.

[0078] In a specific embodiment, when dining in a restaurant, in order to prevent the meal from being served immediately after the order is placed, the vehicle is still on the way after the meal is served, and the meal becomes cold after arriving at the destination, the present embodiment can adopt a reservation mode for serving meals. That is, after the order is successfully placed, the reservation information can be automatically sent to the merchant to remind him not to make it first. Wait until the navigation recognizes that it has entered the parking lot, or is a preset distance from the parking lot (or destination), and then automatically sends the meal information to remind the merchant to prepare the meal. This can greatly improve the dining efficiency and experience. Furthermore, the preset distance for sending the meal information can be customized, or it can be automatically set according to the merchant's feedback on the meal serving time. For example, it takes 10 minutes for the merchant to prepare the meal, and it is estimated that it will take 20 minutes to wait in line for the preparation of the meal by other guests in front. When the navigation shows that there are 30 minutes left to reach the destination, the meal information is automatically sent to remind the merchant to start preparing it.

[0079] In a specific implementation, after each interface jump, a voice announcement is given through a speaker, thereby reducing the time the user spends looking down at the central control screen, allowing the user to concentrate on driving operations and improving driving safety.

[0080] In a specific implementation, the user completes the command input by touch screen or voice.

[0081] In a specific implementation, after the user logs in to an account for a frequently used restaurant, if it is found that the restaurant to which the last order belongs is located within the vehicle's itinerary, the user will be asked whether to repeat the last order. If the user confirms, the user will be automatically directed to the payment interface without the need to place an order, thereby further improving the degree of automation of ordering.

[0082] Embodiment 2:

[0083] Embodiment 2 of the present invention provides a system for the self-service ordering method for a smart cockpit of a car according to embodiment 1, comprising a smart cockpit domain controller, an on-board communication module, an on-board information receiving device, and an ordering interaction module.

[0084] The smart cockpit domain controller is used to perform central control of each device and is responsible for coordinating the information interaction and function realization between modules, including controlling the communication of the on-board communication module, the shooting of the in-vehicle camera, the adjustment of the in-vehicle microphone and speakers, the response of the central control screen, the information interaction of the user interaction interface, the calculation of artificial intelligence programs, the search or storage of the catering service platform, the jump of the payment module, and the real-time navigation of the navigation module.

[0085] The vehicle-mounted communication module is used for communication between the inside and outside of the vehicle and between the insides of the vehicle, including network communication and offline communication.

[0086] The vehicle-mounted information receiving device is used to obtain the voice, image and command information required in the ordering process, and to perform voice broadcast or image display; wherein the vehicle-mounted information receiving device includes a camera, microphone, speaker and central control screen in the vehicle, the camera is used to obtain the facial information of the user in the vehicle in real time, the microphone is used to obtain the voice information of the user in the vehicle in real time, the speaker is used for voice broadcast, and the central control screen is used for image or text display and receiving the user's touch screen commands.

[0087] The ordering interaction module includes a user interaction interface, an artificial intelligence program, a catering service platform, a payment module and a navigation module. The user interaction interface is used to display an intuitive ordering operation interface. The artificial intelligence program is used to receive and analyze the user's facial information, current location information, historical order information, merchant information and journey information. The catering service platform is used to provide merchant information through the cloud. The payment module is used to complete payment transactions through external online banking, Alipay, WeChat and other existing commonly used payment software. The navigation module users obtain itinerary information.

[0088] The steps involved in the above embodiment 2 correspond to those in the method embodiment 1. For the specific implementation method, please refer to the relevant description part of the embodiment 1.

[0089] Those skilled in the art should understand that the modules or steps of the present invention described above can be implemented by a general-purpose computer device, or alternatively, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. The present invention is not limited to any specific combination of hardware and software.

[0090] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A self-service ordering method for a smart car cabin, characterized in that: The following steps are involved: Detecting that the user inputs an ordering instruction, the ordering mode is turned on; Obtain user facial information and identify user attributes to automatically log in to the account; Identify the user's driving status based on the user's facial information, and jump to the ordering interface if the driving status is normal; Obtain vehicle itinerary information and generate a meal ordering interface based on user preferences; Identify the user's order instructions, settle the order according to the order instructions, and automatically select the best payment method during the settlement process; After receiving the payment instruction confirmed by the user, it will automatically jump to the payment interface and use the default payment method for payment; After payment is completed, the order information is generated and the tracking interface is jumped to track the order in real time.

2. The self-service ordering method for a smart car cabin as claimed in claim 1, characterized in that: The user's driving status includes normal driving status, fatigue driving status and drunk driving status. If fatigue driving status or drunk driving status is detected, abnormal reminders and safety prompts will be given through the central control screen and speakers.

3. The self-service ordering method for a smart car cabin according to claim 1, characterized in that: The specific steps to obtain user facial information and identify user attributes are: Get real-time face images; Preprocess the face image, and then use the face image recognition model to perform state recognition and image comparison on the face image; Identify whether the current user status is abnormal based on the status recognition result; Identify user attributes based on image comparison results and associate the corresponding user account.

4. The self-service ordering method for a smart car cabin as claimed in claim 1, characterized in that: The specific steps to obtain vehicle trip information and generate an ordering interface based on user preferences are as follows: According to the preset itinerary of the vehicle, obtain information about restaurants along the way and the availability of parking spaces; Obtain user historical order information and classify catering types; According to the classification results, the restaurants along the route are sorted according to frequency and parking space availability; Generate an ordering interface based on the sorting results.

5. The self-service ordering method for a smart car cabin as claimed in claim 1, characterized in that: Order information includes restaurant merchant information, payment fees and amounts, estimated arrival time, estimated dining time, dining method, activities and discounts, number of diners, payment method, invoicing type and user rights.

6. The self-service ordering method for a smart car cabin as claimed in claim 1, characterized in that: After the user logs in to the account of the frequently used restaurant, if the location of the restaurant to which the last order belongs is found to be within the vehicle's itinerary, the user will be asked whether to repeat the last order. If the user confirms, the user will be automatically redirected to the payment interface without the need to place an order.

7. The self-service ordering method for a smart car cabin as claimed in claim 1, characterized in that: After the interface jumps, voice prompts are broadcast through the speaker.

8. The self-service ordering method for a smart car cabin as claimed in claim 1, characterized in that: The user completes the command input by touch screen or voice.

9. A system for self-service ordering in a smart cockpit of a car, comprising a smart cockpit domain controller, an on-board communication module, an on-board information receiving device and an ordering interaction module, The smart cockpit domain controller is used to centrally control each device; The vehicle-mounted communication module is used for communication between the inside and outside of the vehicle and between the inside of the vehicle; The vehicle-mounted information receiving device is used to obtain the voice, image and instruction information required in the ordering process, and perform voice broadcast or image display; The ordering interaction module includes a user interaction interface, an artificial intelligence program, a catering service platform, a payment module and a navigation module. The user interaction interface is used to display an intuitive ordering operation interface. The artificial intelligence program is used to receive and analyze the user's facial information, current location information, historical order information, merchant information and journey information. The catering service platform is used to provide merchant information through the cloud. The payment module is used to complete payment transactions. The navigation module allows users to obtain itinerary information.

10. The self-service ordering system for a smart car cabin as claimed in claim 9, characterized in that: The vehicle-mounted information receiving device includes a camera, a microphone, a speaker and a central control screen in the vehicle. The camera is used to obtain facial information of users in the vehicle in real time, the microphone is used to obtain voice information of users in the vehicle in real time, the speaker is used for voice broadcasting, and the central control screen is used to display images and receive touch screen commands from users.

Images