Reservation control method and device of vehicle, electronic equipment and vehicle

Abstract

The application provides a vehicle reservation control method and device, electronic equipment and vehicle, applied to the technical field of vehicles. The vehicle reservation control method and device, electronic equipment and vehicle determine whether there is a reservation control requirement through data type judgment when receiving voice input data. When the data type is a first control type, it is determined that there is a reservation control requirement. The starting time of the reservation control is determined according to the reservation time determined according to the voice input data. The vehicle is remotely woken up by calling the reservation application programming interface stored locally to control the vehicle Internet service provider. The control instruction corresponding to the target application programming interface is sent to the vehicle host through the vehicle Internet service provider, the control of the vehicle at the reservation time is realized, the reservation control is realized through the voice, and the user can conveniently perform the reservation control while avoiding safety risks when driving.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicles, in particular to a vehicle reservation control method and device, an electronic device and a vehicle. BACKGROUND

[0002] Reserving vehicle control through the APP of a mobile terminal is a common function, including reserving control of seat heating / ventilation, cabin cleaning, starting air conditioning, steering wheel heating, etc. The user needs to select the control item, time and period to be reserved on the APP, which provides convenience for the user. However, if the user wants to reserve vehicle control while driving, at least one hand of the user will be away from the steering wheel, which is inconvenient and can easily cause safety risks. SUMMARY

[0003] Therefore, the present application aims to provide a vehicle reservation control method and device, an electronic device and a vehicle, which can realize reservation control through voice instructions, provide convenience for the user to reserve control while driving and avoid safety risks.

[0004] To achieve the above purpose, the present application provides a vehicle reservation control method, which comprises the following steps:

[0005] receiving voice input data, determining the data type of the voice input data;

[0006] in response to the data type being a first control type, determining a reservation time according to the voice input data, and determining a target application programming interface corresponding to the voice input data in a preset reservation application programming interface;

[0007] waking up the vehicle through a vehicle networking service provider at the reservation time, and sending a control instruction corresponding to the target application programming interface to a vehicle host through the vehicle networking service provider

[0008] Optionally, the step of waking up the vehicle through a vehicle networking service provider at the reservation time, and sending a control instruction corresponding to the target application programming interface to a vehicle host through the vehicle networking service provider comprises:

[0009] sending the reservation time and the target application programming interface to the vehicle networking service provider at the current time, so that the vehicle networking service provider wakes up the vehicle at the reservation time and sends a control instruction corresponding to the target application programming interface to the vehicle host; or

[0010] sending the target application programming interface to the vehicle Internet service provider at the reservation time, so that the vehicle Internet service provider wakes up a vehicle and sends control instructions corresponding to the target application programming interface to the vehicle host.

[0011] Two instruction issuing modes are provided to realize reservation control, and reservation control is realized through voice instructions, which facilitates users to perform reservation control while driving and avoids causing safety risks.

[0012] Optionally, the reservation control method of the vehicle further comprises:

[0013] in response to the data type being a second control type, determining voice broadcast content and function control instructions according to the voice input data;

[0014] sending the function control instructions to the vehicle host, so that the vehicle host executes a function corresponding to the function control instructions and controls the vehicle host to voice reply according to the voice broadcast content.

[0015] The voice reply content and the specific control mode are determined by analyzing the voice input data, which ensures the use of the original instant voice control and avoids affecting the original voice real-time control function.

[0016] Optionally, before receiving the voice input data sent by the vehicle host, the method further comprises:

[0017] controlling the cloud server to obtain the reservation application programming interface sent by the vehicle Internet service provider; wherein the reservation application programming interface is obtained by the vehicle Internet service provider by abstracting its own reservation control interface;

[0018] controlling the cloud server to determine the calling parameters corresponding to each application programming interface in the reservation application programming interface, to obtain the calling parameter library;

[0019] controlling the AI model to receive the calling parameter library sent by the cloud server and storing the calling parameter library locally.

[0020] By providing the reservation application programming interface of the vehicle Internet service provider to the cloud server, the cloud server has the ability to remotely wake up the vehicle by calling the reservation application programming interface. The cloud server sends the calling parameter library corresponding to the reservation application programming interface to the AI model, so that the AI model has the ability to control the cloud server to call the reservation application programming interface.

[0021] Optionally, the method further comprises:

[0022] convert the voice input data into text data;

[0023] perform keyword matching on the text data according to a preset appointment control keyword set;

[0024] in response to the presence of a matched keyword in the text data, determine that the data type is the first control type;

[0025] in response to the absence of a matched keyword in the text data, determine that the data type is the second control type.

[0026] By classifying the voice input data of the user, the real-time voice interaction function and the appointment control function are distinguished.

[0027] Optionally, the determining, in a preset appointment application programming interface, of a target application programming interface corresponding to the voice input data includes:

[0028] Based on a function call function, a target call parameter for the appointment application programming interface is determined in a preset call parameter library according to the voice input data;

[0029] According to the target call parameter, application programming interface matching is performed in the appointment application programming interface, and a target application programming interface corresponding to the voice input data is obtained.

[0030] By determining the target application programming interface corresponding to the voice input data, the specific content of the user's appointment control is determined, and the appointment sending of the corresponding control instruction is realized by calling the target application programming interface.

[0031] Optionally, the determining, in the call parameter library, of the target call parameter for the appointment application programming interface based on the function call function includes:

[0032] The function declaration is determined by analyzing the voice input data.

[0033] Based on a function call function, a target call parameter for the appointment application programming interface is determined in a preset call parameter library according to the voice input data;

[0034] By determining the target call parameter, the cloud server is informed to mobilize which application programming interface.

[0035] Based on the same inventive concept, the disclosure also provides a vehicle appointment control device, comprising:

[0036] The voice data classification module is configured to receive voice input data, and determine a data type of the voice input data;

[0037] The target interface determination module is configured to, in response to the data type being a first control type, determine a reservation time according to the voice input data, and determine a target application programming interface corresponding to the voice input data in a preset reservation application programming interface.

[0038] The reservation control module is configured to wake up the vehicle through a vehicle networking service provider at the reservation time, and send a control instruction corresponding to the target application programming interface to a vehicle host through the vehicle networking service provider.

[0039] Based on the same inventive concept, the present disclosure further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the method as described above when executing the program.

[0040] Based on the same inventive concept, the present disclosure further provides a vehicle comprising the reservation control device of the vehicle or the electronic device as described above.

[0041] As can be seen from the above, the vehicle reservation control method, device, electronic device and vehicle provided by the present application, when receiving voice input data, determine whether there is a reservation control requirement through the determination of the data type, determine that there is a reservation control requirement when the data type is a first control type, determine the start time of the reservation control according to the reservation time determined by the voice input data, control the vehicle networking service provider to remotely wake up the vehicle by calling the stored reservation application programming interface, and send a control instruction corresponding to the target application programming interface to the vehicle host through the vehicle networking service provider, at the reservation time, the vehicle control is realized by transmitting the reservation control instruction to the vehicle end through the vehicle networking service provider, realizing the reservation control through the voice, facilitating the user to perform the reservation control while driving and avoiding the safety risk. BRIEF DESCRIPTION OF DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the present application or related art, the following will briefly introduce the drawings needed to be used in the embodiments or related art descriptions. Obviously, the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.

[0043] Figure 1 Flow chart of the vehicle reservation control method of the embodiments of the present application;

[0044] Figure 2A flowchart of a control method for second control type voice data according to an embodiment of the present application;

[0045] Figure 3 A flowchart of determining a data type of voice input data according to an embodiment of the present application;

[0046] Figure 4 A flowchart of determining a target application programming interface corresponding to voice input data according to an embodiment of the present application;

[0047] Figure 5 A structural schematic diagram of a reservation control device according to an embodiment of the present application;

[0048] Figure 6 A structural schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0049] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings and in conjunction with specific embodiments.

[0050] It should be noted that, unless otherwise defined, technical terms or scientific terms used in the embodiments of the present application should be understood as their common meanings to those having ordinary skills in the art to which the present application pertains. The terms "first", "second", and similar terms used in the embodiments of the present application do not denote any order, quantity, or importance, but are merely used to distinguish different components. The terms "include", "contain", and similar terms mean that the elements or objects before the terms encompass the elements or objects listed after the terms and their equivalents, and do not exclude other elements or objects. The terms "connect" or "connected" and similar terms do not mean physical or mechanical connections, but can include electrical connections, whether direct or indirect. The terms "upper", "lower", "left", "right", and the like are merely used to represent relative positional relationships, and when the absolute positions of the described objects change, the relative positional relationships can also change accordingly.

[0051] In this document, it should be understood that any number of elements in the drawings are used for illustration only and not limitation, and any naming is merely for differentiation and does not have any limiting meaning.

[0052] Based on the description of the above background technology, there are also the following situations in the related art:

[0053] The process of reservation control in the related art is that the user issues corresponding reservation control instructions, such as reservation control of seat heating, reservation control of cabin cleaning, reservation control of starting air conditioning, and reservation control of steering wheel heating, through an APP in a mobile terminal bound to the vehicle. The user needs to select reservation control items, time, period, and other parameters in advance on the APP.

[0054] Exemplarily, in summer with relatively high temperature, the user needs to start the air conditioner in advance to cool down the vehicle interior before using the vehicle, to ensure a comfortable temperature environment when using the vehicle. For example, if the user's work time is 18:30, the user opens the APP for remotely controlling the vehicle in the mobile terminal at 15:00, selects the air conditioner control in the control item selection interface, selects 18:00 in the time selection interface, and selects to keep on (i.e., not to be turned off, the cycle interval is 0) in the cycle selection interface. The APP will send the user's demand to the Telematics Service Provider (TSP) in the form of a reservation control instruction, the TSP stores the corresponding reservation control instruction locally, at 18:00, the TSP remotely wakes up the vehicle through the TBOX to realize the delivery of the reservation control instruction, so that the vehicle controls the air conditioning system to operate according to the parameters set in the APP, and realizes the reservation cooling control of the vehicle.

[0055] The premise for the vehicle to realize natural language dialogue is that the cloud server (for example, the cockpit cloud) accesses the AI model, which supports the cockpit natural language dialogue and also supports real-time voice control of the vehicle, such as opening / closing the window, opening / closing the back door, etc. However, since the cloud server does not have the ability to wake up the TSP, the cloud server cannot realize voice reservation control. Because the reservation control of the vehicle must be realized by the TSP sending a short message instruction to the TBOX, the user cannot perform reservation control through voice during driving, which causes the user to need to leave at least one hand from the steering wheel to control the APP in the mobile terminal to perform reservation control, which is inconvenient and easy to cause safety risks.

[0056] The vehicle reservation control method, device, electronic equipment and vehicle provided by the application determine whether there is a reservation control demand by judging the data type when the voice input data is received. When the data type is the first control type, it is determined that there is a reservation control demand. The starting time of the reservation control is determined according to the reservation time determined by the voice input data. The local reservation application programming interface is called to control the Telematics Service Provider to remotely wake up the vehicle, and the control instruction corresponding to the target application programming interface is sent to the vehicle host through the Telematics Service Provider, to realize the control of the vehicle at the reservation time, realize the reservation control through voice, and facilitate the user to perform reservation control while avoiding safety risks when driving.

[0057] The vehicle reservation control method provided by the embodiments of the application will be described in detail below with reference to the accompanying drawings.

[0058] In some embodiments, before the reservation control in response to the voice input data of the user, some preparations are also needed in advance to ensure the smooth execution of the reservation control process, and the preparation process before receiving the voice input data includes:

[0059] The control cloud server obtains the reservation application programming interface sent by the vehicle Internet service provider; wherein, the reservation application programming interface is obtained by the vehicle Internet service provider by abstracting its own reservation control interface;

[0060] The control cloud server determines the calling parameters corresponding to each application programming interface in the reservation application programming interface to obtain a calling parameter library;

[0061] The control AI model receives the calling parameter library sent by the cloud server and stores the calling parameter library locally.

[0062] In specific implementation, the reservation control device of the vehicle is equipped with an AI model and a cloud server connected with each other, wherein, the AI model can be directly deployed on the cloud server, or can be deployed on other devices connected with the short server, which is not limited here. The cloud server is connected with the vehicle host and the vehicle Internet service provider, used to receive the voice input data sent by the vehicle end (such as the vehicle host), and forward the voice input data to the AI model, the vehicle Internet service provider abstracts its own application programming interface (Application Programming Interface, API) for reservation control to obtain the reservation application programming interface, and sends the reservation application programming interface to the cloud server, the cloud server sends the calling parameter library corresponding to the reservation application programming interface to the AI model, and the AI model stores the calling parameter library and calls the function when needed. Wherein, the AI model is only used for data analysis and calculation, used to reduce the calculation pressure of the cloud server, and does not have the ability to directly interact with the vehicle, and needs to interact with the vehicle through the cloud server to realize the reservation control and instant control.

[0063] By providing the reservation application programming interface of the vehicle Internet service provider to the cloud server, the cloud server has the ability to remotely wake up the vehicle by calling the reservation application programming interface, and the cloud server sends the calling parameter library corresponding to the reservation application programming interface to the AI model, so that the AI model has the ability to control the cloud server to call the reservation application programming interface.

[0064] In the appointment control, the voice input data of the user is classified by the AI model, and for the voice input data of the first control class with appointment control request, the request parameters for the appointment application programming interface are determined in the calling parameter library according to the appointment control demand in the voice input data according to the function calling function, to inform the cloud server of the target application programming interface to be called. After the cloud server determines the target application programming interface to be called, the vehicle will be woken up by the vehicle networking service provider at the appointment time, and the control instruction corresponding to the target application programming interface will be sent to the vehicle host through the vehicle networking service provider, to realize the appointment control of the vehicle host.

[0065] Among them, at the vehicle end, the device for collecting user voice is the vehicle host (which can also be other voice collection devices, such as mobile terminal devices, etc.), the vehicle host collects user voice data in real time through a microphone or other voice collection device, and obtains corresponding voice input data. The computing power of the vehicle host is limited, so the voice interaction model is generally not deployed in the vehicle host, but the received voice input data is sent to the cloud server, the cloud server realizes efficient voice recognition through the access of the AI model, and the most appropriate reply voice is forwarded to the vehicle host through the cloud server. The vehicle host performs voice broadcast on the reply voice, and then determines to realize intelligent voice interaction.

[0066] If the voice input data is an appointment instruction, the cloud server cannot respond to the corresponding appointment instruction because it does not have the ability to remotely wake up the vehicle. The first step to realize voice appointment control is to enable the cloud server to wake up the vehicle, and TSP is usually used to wake up the vehicle when remotely controlling, so it is necessary to establish a communication connection between the cloud server and the TSP to wake up the vehicle through the TSP. After establishing a connection with the TSP, the cloud server also needs to be configured with the ability to drive the TSP. Since the cloud server accesses the AI model, and the AI model has the function of function calling, the cloud server only needs to have the application programming interface for appointment control.

[0067] The TSP can implement many functions, which are encapsulated as functions, and these functions are application programming interfaces. For example, the operating system B can use the application programming interfaces of the operating system A to use part of the functions of the operating system A or control the operating system A to execute corresponding functions. Therefore, as long as the cloud server has an application programming interface for reservation control, it can control the function. Therefore, as long as the TSP abstracts the application programming interface related to reservation control and provides the abstracted reservation application programming interface to the cloud server, the cloud server can have the ability to wake up the vehicle and control the reservation.

[0068] The reservation application programming interface provided by the TSP is an external application programming interface. When the cloud server receives voice input data, it cannot determine which application programming interface to call. At this time, the AI model is needed to help the cloud server determine the application programming interface corresponding to the voice input data. The AI model needs to determine which application programming interfaces the cloud server has, so the cloud server needs to send the calling parameter library corresponding to the reservation application programming interface to the AI model to determine all the application programming interfaces the cloud server has, so that the AI model has the ability to control the cloud server to call the reservation application programming interface, and thus implement the vehicle reservation control method according to the voice input data.

[0069] In some embodiments, as shown in Figure 1 The vehicle reservation control method includes the following steps.

[0070] Step 101: Receive voice input data and determine the data type of the voice input data.

[0071] In specific implementation, the vehicle host is a device system deployed on the vehicle side, so the vehicle host can collect voice data issued by the user through a microphone or other voice collection device, and transmit the collected voice data to the cloud server as voice input data. The cloud server will forward the voice input data to the AI model for semantic analysis to determine the user's demand, and then perform reservation control according to the user's demand. The voice input data can also be collected by a mobile terminal or other device. For example, if it is identified that the user is inside the vehicle and the vehicle host has been started, the voice input data is collected using the vehicle host. If the user is outside the vehicle or the user is inside the vehicle but the vehicle host has not been started, the voice input data is collected using a mobile terminal such as a mobile phone. The mobile terminal collects voice data issued by the user using the built-in voice collection function, and then sends the collected voice data to the cloud server using the pre-built communication link between the terminal and the cloud server.

[0072] The cloud server transmits the voice data to the AI model for voice analysis after receiving the voice data sent by the vehicle terminal or the mobile terminal. Alternatively, when the AI model is not set in the cloud server, the AI model acquires the voice data by means of the device where the AI model is located.

[0073] After the AI model receives the voice input data sent by the cloud server, the voice input data needs to be parsed first to determine the category of the voice input data. In the embodiments of the present application, the voice input data is divided into a first control category with a reservation control request and a second control category without a reservation control request (for the purpose of distinction, at least two categories are divided, and more detailed category division can be made according to requirements, which is not limited here). Taking the first control category as an example, the second control category is taken as an example for description.

[0074] The reservation control category indicates that the voice input data of the user is used for reservation control, and more attention is paid to accuracy to avoid reservation control errors. The real-time control category indicates that the voice input data of the user is used for real-time voice interaction, and more attention is paid to efficiency to avoid the inability to respond to the voice input of the user in time.

[0075] The purpose of classifying the voice input data is that the cloud server itself has the ability of real-time voice interaction control, and can respond to the voice input data without calling external functions, so the AI model does not need to inform the cloud server how to call the locally stored reservation application programming interface to realize the control of the second control category voice input data. For the voice input data of the first control category, the cloud server needs to realize the response to the voice input data by calling the reservation application programming interface, and the AI model needs to inform the cloud server which external reservation application programming interface to call. Therefore, for different types of voice input data, different parsing processes and control processes need to be performed, so after receiving the voice input data, the data type of the voice input data needs to be determined first to determine the subsequent control mode.

[0076] Step 102: in response to the data type being the first control category, determining the reservation time according to the voice input data, and determining the target application programming interface corresponding to the voice input data in the preset reservation application programming interface.

[0077] In a specific implementation, the appointment time is the time for starting the control corresponding to the voice input data. The target application programming interface is used to start the control function corresponding to the appointment control requirement. The appointment time of the user requirement can be determined by identifying the time-related keywords in the voice input data. Taking the voice input data "turn on the air conditioner at 8:00 tomorrow morning, temperature 25°C" as an example, by analyzing the voice input data, the keywords related to time are extracted, that is, "tomorrow", "morning", and "8:00". Among them, the keyword "tomorrow" is used to determine the time in the natural day dimension of the appointment time. If the current time is 19:00 on October 12, the time parameter of the appointment time in the natural day dimension is October 13, that is, the keyword "tomorrow" is used to determine the specific date of the appointment control. If there is no time keyword in the natural day dimension, the current day is defaulted first, and the time in the natural day dimension is verified according to the time keyword in other dimensions.

[0078] The keyword "morning" is used to determine the specific time in the time period dimension of the appointment time. Since some users may prefer to use the 12-hour system to describe the time (the keywords in the time period dimension correspond to the 12-hour time period of 0:00-12:00 every day, and the keywords correspond to the 12-hour time period of 12:00-24:00), identifying the keywords in the time period dimension can more accurately distinguish the specific time point in the 12-hour system. If the current time is 20:00 on October 12, the time parameter of the appointment time in the time period dimension is 0:00 on October 13-24:00 on October 13, that is, the keyword "morning" is used to determine the specific time period range of the appointment control. If there is no time keyword in the time period dimension, the 24-hour time is defaulted first, and the time in the natural day dimension is verified according to the time keyword in other dimensions.

[0079] The keyword "8:00" is used to determine the specific time in the hour dimension of the appointment time. When there is a keyword in the time period dimension, the range of the keyword "8:00" is limited according to the time period keyword to obtain the time corresponding to 8:00 in the corresponding range (for example, 8:00 in the morning corresponds to 8:00 on the same day, and 8:00 in the afternoon corresponds to 20:00 on the same day). If there is no keyword in the time period dimension, the current time is analyzed. If the current time is 19:00 on October 12, the nearest "8:00" (24 hours as the standard, that is, 8:00 on October 13) after the current time is defaulted as the time in the hour dimension, and the user is asked whether to start the air conditioner at 8:00 on October 13 to ensure accuracy.

[0080] If the current time is 7:00 on October 12, the nearest "8:00" (8:00 on October 12 in 24-hour format) after the current time is taken as the time of the hour dimension by default, and the user is asked whether to start the air conditioner at 8:00 on October 12 to ensure accuracy.

[0081] And the default value of the time period dimension and the default value of the natural day dimension are updated according to the last determined time of the hour dimension, for example, the current day (October 12) is changed to the next day (October 12). If the keyword is 16:00, the corresponding natural day dimension time can be directly updated according to the current time.

[0082] Therefore, when the current time is 19:00 on October 12, after parsing the voice input data to obtain the three keywords "tomorrow", "morning", and "8:00", the appointment time is determined to be 8:00 on October 13.

[0083] The target application programming interface corresponding to the voice data can be determined by semantic recognition. The specific determination process is as follows:

[0084] If the data type is the first control type, it means that there is a reservation requirement, which means that the AI model needs to tell the cloud server which reservation application programming interface to call. At this time, the AI model uses its own function calling function, needs to first parse the voice input data to determine the user's demand, and then determine the control operation that can meet the user's demand according to the user's demand, and determine the target application programming interface that activates the corresponding control operation, and then determine the request parameters corresponding to the target application programming interface in the call parameter library. Each parameter in the call parameter library corresponds to at least one reservation application programming interface, so the user's demand can be determined by parsing the voice input data, and the target application programming interface that can be activated to meet the demand can be determined in reverse according to the user's demand. However, the AI model itself does not have the ability to call the application programming interface, and the request parameters corresponding to the target application programming interface can be sent to the cloud server to tell the cloud server which reservation application programming interface to call, and the reservation time can be sent to the cloud server to tell the cloud server the start time of the reservation control. The reservation control is realized through the voice, which liberates the user's hands and facilitates the user to perform the reservation control while driving and avoids causing safety risks.

[0085] Step 103: Wake up the vehicle through the vehicle networking service provider at the reservation time, and send the control instruction corresponding to the target application programming interface to the vehicle host through the vehicle networking service provider.

[0086] In specific implementation, the delay control effect of the reservation control can be realized in two ways. One is to perform delay control on the cloud server, and the other is to perform delay control on the Internet of Vehicles service provider.

[0087] Step 103 includes:

[0088] Step 1031: sending the reservation time and the target application programming interface to the Internet of Vehicles service provider at the current time, so that the Internet of Vehicles service provider wakes up the vehicle at the reservation time and sends the control instruction corresponding to the target application programming interface to the vehicle host.

[0089] In specific implementation, one way to realize the reservation control effect is that the Internet of Vehicles service provider performs delay control. That is, the cloud server sends the target application programming interface to be called and the reservation time to the Internet of Vehicles service provider at the current time, the Internet of Vehicles service provider stores the target application programming interface and the reservation time locally, and when the actual time reaches the reservation time, the target application programming interface is called to send the control instruction corresponding to the target application programming interface to the vehicle host to implement the corresponding reservation control. This way realizes the reservation control through voice instructions, which is convenient for users to perform reservation control while driving and avoids causing safety risks.

[0090] Step 1032: sending the target application programming interface to the Internet of Vehicles service provider at the reservation time, so that the Internet of Vehicles service provider wakes up the vehicle and sends the control instruction corresponding to the target application programming interface to the vehicle host.

[0091] In specific implementation, another way to realize the reservation control effect is to perform delay control on the cloud server. That is, the cloud server does not send data to the Internet of Vehicles service provider before the reservation time, and at the reservation time, the target application programming interface is called to control the Internet of Vehicles service provider to wake up the vehicle, and the target application programming interface is sent to the Internet of Vehicles service provider, so that the Internet of Vehicles service provider wakes up the vehicle. After waking up the vehicle, the control instruction corresponding to the target application programming interface is sent to the vehicle host to realize the reservation control. This way realizes the reservation control through voice instructions, which is convenient for users to perform reservation control while driving and avoids causing safety risks.

[0092] The data transmission link in the two reservation control processes is: vehicle end / mobile terminal→cloud server→AI model→cloud server→vehicle networking service provider→vehicle end. The reservation control method of the vehicle provided in the embodiments of the present application breaks through the data transmission link between the cloud server and the vehicle networking service provider in an application programming interface manner, so that the cloud server has the ability of reservation control, and the voice interaction capability of the cloud server itself is combined to realize reservation control according to voice input, which facilitates the user to perform reservation control while driving and avoids causing safety risks.

[0093] In summary, the reservation control method of the vehicle provided in the present application determines whether there is a reservation control demand by judging the data type when receiving voice input data. When the data type is the first control type, it is determined that there is a reservation control demand. The starting time of the reservation control is determined according to the reservation time determined according to the voice input data. The reservation application programming interface stored in the AI model of the reservation control device of the vehicle is called to control the vehicle networking service provider to remotely wake up the vehicle. The control instruction corresponding to the target application programming interface is sent to the vehicle host through the vehicle networking service provider, and the reservation control link of vehicle end / mobile terminal→cloud server→AI model→cloud server→vehicle networking service provider→vehicle end is completed. The control of the vehicle at the reservation time is realized. The reservation control through voice is realized. The user can perform reservation control while driving and avoid causing safety risks.

[0094] When the data type is the first control type, the reservation control is performed in the manner described in steps 101 to 103. However, the data type also includes the second control type without reservation control demand. The control process of the second control type voice input data is as follows.

[0095] In some embodiments, as shown in Figure 2 The reservation control method of the vehicle further includes:

[0096] Step 201: In response to the data type being the second control type, determining the voice broadcast content and the function control instruction according to the voice input data.

[0097] In specific implementation, if the data type is the second control type, it indicates that the user needs to have real-time voice interaction with the vehicle and directly control the vehicle through voice at the current time, and the cloud server does not need to call the reservation application programming interface, so it is only necessary to determine the user demand corresponding to the voice input data and respond to the user demand to perform voice broadcast and function execution. Therefore, the AI model only needs to analyze the voice input data to obtain instant control data (including voice broadcast content and function control instructions) to determine the user demand, and send the user demand in the form of instant control data to the cloud server for instant control according to the instant control data, to realize real-time voice interaction and control with the user, ensure the normal use of the original instant voice control function after adding the voice reservation control function, avoid affecting the original voice real-time control function, and improve the comprehensive use experience of the user.

[0098] Step 202: Send the function control instruction to the vehicle host to execute the function corresponding to the function control instruction, and control the vehicle host to reply to the voice according to the voice broadcast content.

[0099] In specific implementation, if the cloud server receives the instant control data sent by the AI model, it indicates that it is a second control type voice instruction, and the instant control data is analyzed to obtain voice broadcast content for voice interaction with the user and function control instructions for responding to the user demand. For the second control type instruction of instant control, the cloud server directly sends the function control instruction to the vehicle host to execute the function corresponding to the function control instruction to realize the voice control demand of the user, and controls the vehicle host to reply to the voice according to the voice broadcast content to realize real-time voice interaction with the user, and reminds the user that the corresponding control has been executed. Ensure the use of the original instant voice control, avoid affecting the original voice real-time control function.

[0100] The data type determines whether to perform reservation control or instant control, so when receiving the voice input data, the data type of the voice input data needs to be determined first. The specific process of determining the data type of the voice input data is as follows.

[0101] In some embodiments, as shown in Figure 3 The data type of the voice input data is determined, including:

[0102] Step 301: Convert the voice input data into text data.

[0103] In specific implementation, text data is easier to analyze than voice data, so the voice input data is first converted into text data to improve the classification efficiency.

[0104] Step 302: keyword matching is performed on the text data according to a preset appointment control keyword set.

[0105] In specific implementation, the remote control keyword set is a full set of keywords corresponding to the appointment control. Keyword matching is performed on the text data using the appointment control keyword set as the full set, so as to determine whether the text data contains the keywords of the appointment control.

[0106] Step 303: in response to the presence of the matched keyword in the text data, the data type is determined as the first control class.

[0107] In specific implementation, if the text data contains the matched keyword, it means that the text data contains the keywords of the appointment control, such as "tomorrow" and "in advance", and the data type is determined as the first control class.

[0108] Step 304: in response to the absence of the matched keyword in the text data, the data type is determined as the second control class.

[0109] In specific implementation, if the text data does not contain the matched keyword, it means that the text data does not contain the keywords of the appointment control, and the data type is determined as the second control class. By classifying the voice input data of the user through the AI model, the real-time voice interaction function and the appointment control function are distinguished, the classification accuracy is improved, and the operation pressure of the cloud server is reduced.

[0110] After determining the data type, for the first control class voice input data with the appointment control requirement, the appointment control of the vehicle needs to be performed according to the voice input data. When the appointment control is performed, the control requirement corresponding to the voice input data needs to be determined, and the target application programming interface that meets the corresponding control requirement is determined. The process of determining the target application programming interface is as follows.

[0111] In some embodiments, as shown in FIG. 4, the target application programming interface corresponding to the voice input data is determined in the preset appointment application programming interface, including: Figure 4

[0112] Step 401: based on the function calling function, the target calling parameter for the appointment application programming interface is determined in the preset calling parameter library according to the voice input data.

[0113] In some embodiments, step 401 includes:

[0114] Step 4011: the function declaration is determined by analyzing the voice input data.

[0115] ​In specific implementation, the function declaration is a description of the demand tool or the demand information, and the reservation time is the expected function execution time of the user. Taking the voice input data "turn on the air conditioner at 8:00 tomorrow morning, and the temperature is 25 DEG C" as an example, by analyzing the voice input data, the keywords related to the time are extracted, and five keywords "tomorrow", "morning", "8:00", "turn on the air conditioner", and "temperature 25 DEG C" are obtained. Among them, the keyword "tomorrow" is used to determine the reservation time, and the keywords "turn on the air conditioner" and "temperature 25 DEG C" are used to determine the function declaration.

[0116] Among them, "air conditioner" in the keyword "turn on the air conditioner" is a description of the required tool, and "turn on" is a description of the action performed by the required tool. The keyword "temperature 25 DEG C" is a description of the effect that needs to be achieved by the required tool. If the part number of the air conditioner is 007, the function declaration can be (007, ON, 25 DEG C), which realizes the description of the user's demand.

[0117] Step 4012: performing parameter retrieval in the calling parameter library according to the function declaration to obtain a target calling parameter; wherein the target calling parameter corresponds to at least one reserved application programming interface.

[0118] In specific implementation, based on the function calling function, according to the function declaration (007, ON, 25 DEG C), it can be determined that the target calling parameter is the first calling parameter corresponding to turning on the air conditioner in the calling parameter library. If the temperature has a corresponding application programming interface, the target calling function also includes a second calling parameter corresponding to 25 DEG C.

[0119] Step 402: performing application programming interface matching in the reserved application programming interface according to the target calling parameter to obtain a target application programming interface corresponding to the voice input data.

[0120] In specific implementation, the target calling parameter includes the first calling parameter corresponding to turning on the air conditioner and the second calling parameter for adjusting the temperature to 25 DEG C. According to the first calling parameter, the application programming interface matching is performed in the reserved application programming interface to obtain the first application programming interface corresponding to the air conditioner turning on function. According to the second calling parameter, the application programming interface matching is performed in the reserved application programming interface to obtain the second application programming interface corresponding to the temperature control function. The first application programming interface and the second application programming interface are integrated to obtain the target application programming interface corresponding to the voice input data. Through the target application programming interface, the vehicle can be awakened, and the air conditioner of the vehicle can be turned on, and the temperature in the vehicle can be adjusted to 25 DEG C. When the reserved function is executed to realize the corresponding function, the voice reservation control is realized, which is convenient for the user to perform reservation control while driving and avoids causing safety risks.

[0121] Based on the same inventive concept, the application also provides a vehicle reservation control device corresponding to any of the above-mentioned embodiment methods.

[0122] Reference Figure 5 The vehicle reservation control device comprises:

[0123] The voice data classification module 10 is configured to receive voice input data and determine the data type of the voice input data.

[0124] The target interface determination module 20 is configured to, in response to the data type being a first control type, determine a reservation time according to the voice input data, and determine a target application programming interface corresponding to the voice input data in a preset reservation application programming interface.

[0125] The reservation control module 30 is configured to wake up the vehicle through a vehicle networking service provider at the reservation time, and send a control instruction corresponding to the target application programming interface to the vehicle host through the vehicle networking service provider.

[0126] For the convenience of description, the above device is described as various modules in function. Of course, in the implementation of the present application, the functions of each module can be implemented in one or more software and / or hardware.

[0127] The device of the above-mentioned embodiment is used to implement the corresponding vehicle reservation control method of any of the above-mentioned embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be described here.

[0128] Based on the same inventive concept, the application also provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle reservation control method of any of the above-mentioned embodiments.

[0129] Figure 6 A more specific hardware structure of an electronic device provided by the present embodiment is shown, which can include a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040 and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030 and the communication interface 1040 are connected to each other through the bus 1050 for communication within the device.

[0130] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits, etc., for executing relevant programs to implement the technical solutions provided by the embodiments of the present specification.

[0131] The memory 1020 can be implemented by a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, etc. The memory 1020 can store an operating system and other application programs, and when the technical solutions provided by the embodiments of the present specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and called and executed by the processor 1010.

[0132] The input / output interface 1030 is configured to connect input / output modules to implement information input and output. The input / output modules can be configured as components in the device (not shown in the figure) or externally connected to the device to provide corresponding functions. The input devices can include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output devices can include a display, a speaker, a vibrator, an indicator light, etc.

[0133] The communication interface 1040 is configured to connect a communication module (not shown in the figure) to implement the communication interaction between the device and other devices. The communication module can realize communication through a wired manner (such as USB, network cable, etc.) or through a wireless manner (such as mobile network, WIFI, Bluetooth, etc.).

[0134] The bus 1050 includes a channel for transmitting information between various components (such as the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040) of the device.

[0135] It should be noted that although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040, and the bus 1050, in the specific implementation process, the device can also include other components necessary for normal operation. In addition, those skilled in the art can understand that the above device can also only include the components necessary to implement the solutions of the embodiments of the present specification, and does not have to include all the components shown in the figure.

[0136] The electronic device of the above embodiment is used to implement the corresponding vehicle reservation control method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0137] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable the computer to execute the vehicle reservation control method described in any of the above embodiments.

[0138] The computer-readable media of this embodiment include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0139] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the vehicle reservation control method described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0140] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present application also provides a vehicle, including the electronic device or vehicle reservation control device of the above-mentioned embodiment, and executing the vehicle reservation control method described in any of the above embodiments through the electronic device or vehicle reservation control device of the above-mentioned embodiment, and having the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0141] It is understandable that before using the technical solutions of each embodiment of the present disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the user's authorization will be obtained.

[0142] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operation of the disclosed technical solution based on the prompt message.

[0143] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0144] It is understandable that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0145] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application is limited to these examples. In line with the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.

[0146] In addition, for simplicity of description and discussion, and in order not to make the embodiment of the application difficult to understand, the known power supply / ground connection with integrated circuit (IC) chip and other components may or may not be shown in the accompanying drawings provided. In addition, the device can be shown in the form of a block diagram to avoid making the embodiment of the application difficult to understand, and this also takes into account the following fact, that is, the details of the embodiment of these block diagram devices are highly dependent on the platform to be implemented in the embodiment of the application (that is, these details should be fully within the scope of understanding of those skilled in the art). When specific details (for example, circuit) are set forth to describe exemplary embodiments of the application, it will be apparent to those skilled in the art that the embodiment of the application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.

[0147] Although the present invention has been described in conjunction with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those skilled in the art based on the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may utilize the embodiments discussed.

[0148] Embodiments of the present application are intended to cover any and all such substitutions, modifications, and variations. Accordingly, any one of the above-described embodiments of the present application can be replaced by any other disclosed embodiments of the present application, and the entirety of any disclosed series can be substituted for any other disclosed series, and the entirety of any disclosed series can be substituted for any other disclosed series, and the entirety of any disclosed series can be substituted for any other disclosed series, and the entirety of any disclosed series can be substituted for any other disclosed series, and the entirety of any disclosed series can be substituted for any other disclosed series, and the entirety of any disclosed series can be substituted for any other disclosed series, and the entirety of any disclosed series can be substituted for any other disclosed series, and the entirety of any disclosed series can

Claims

1. A reservation control method of a vehicle, characterized by, The application comprises: receiving voice input data, determining the data type of the voice input data; in response to the data type being a first control type, determining a reservation time according to the voice input data, and determining a target application programming interface corresponding to the voice input data in a preset reservation application programming interface; wherein, the determination of the target application programming interface corresponding to the voice input data in the preset reservation application programming interface comprises: based on a function call function, determining a target call parameter for the reservation application programming interface in a preset call parameter library according to the voice input data; performing application programming interface matching in the reservation application programming interface according to the target call parameter to obtain the target application programming interface corresponding to the voice input data; wherein, the determination of the target call parameter for the reservation application programming interface in the call parameter library based on the function call function according to the voice input data comprises: determining a function declaration by analyzing the voice input data; based on the function call function, performing parameter retrieval in the call parameter library according to the function declaration to obtain the target call parameter; wherein, the target call parameter corresponds to at least one reservation application programming interface; at the reservation time, waking up the vehicle through the vehicle networking service provider, and sending a control instruction corresponding to the target application programming interface to the vehicle host through the vehicle networking service provider.

2. The reservation control method of a vehicle according to claim 1, characterized by, The waking up of the vehicle through the vehicle networking service provider at the reservation time, and the sending of the control instruction corresponding to the target application programming interface to the vehicle host through the vehicle networking service provider, comprises: at the current time, sending the reservation time and the target application programming interface to the vehicle networking service provider, so that the vehicle networking service provider wakes up the vehicle at the reservation time and sends the control instruction corresponding to the target application programming interface to the vehicle host; or, at the reservation time, sending the target application programming interface to the vehicle networking service provider, so that the vehicle networking service provider wakes up the vehicle and sends the control instruction corresponding to the target application programming interface to the vehicle host.

3. The reservation control method of a vehicle according to claim 1, characterized by, Further comprising: in response to the data type being a second control type, determining voice broadcast content and function control instructions according to the voice input data; sending the function control instructions to the vehicle host, so that the vehicle host executes the function corresponding to the function control instructions and controls the vehicle host to voice reply according to the voice broadcast content.

4. The reservation control method of a vehicle according to claim 1, characterized by Before receiving the voice input data sent by the vehicle host, further comprising: controlling the cloud server to obtain the reservation application programming interface sent by the vehicle networking service provider; wherein, the reservation application programming interface is obtained by the vehicle networking service provider by abstracting its own reservation control interface; controlling the cloud server to determine the call parameters corresponding to each application programming interface in the reservation application programming interface to obtain a call parameter library; The control AI model receives the calling parameter library sent by the cloud server and stores the calling parameter library locally.

5. The reservation control method of a vehicle according to claim 1, characterized by, The data type of the voice input data is determined, including: The voice input data is converted into text data; The text data is matched with a preset reservation control keyword set; In response to the presence of a matched keyword in the text data, the data type is determined as the first control type; In response to the absence of a matched keyword in the text data, the data type is determined as the second control type.

6. A reservation control device of a vehicle characterized by comprising: Comprising: A voice data classification module configured to receive voice input data and determine the data type of the voice input data; A target interface determination module configured to, in response to the data type being the first control type, determine a reservation time according to the voice input data and determine a target application programming interface corresponding to the voice input data in a preset reservation application programming interface; wherein the determination of the target application programming interface corresponding to the voice input data in the preset reservation application programming interface comprises: based on a function calling function, determining a target calling parameter for the reservation application programming interface in a preset calling parameter library according to the voice input data; performing application programming interface matching in the reservation application programming interface according to the target calling parameter to obtain the target application programming interface corresponding to the voice input data; wherein the determination of the target calling parameter for the reservation application programming interface in the calling parameter library according to the voice input data based on the function calling function comprises: determining a function declaration by analyzing the voice input data; based on the function calling function, performing parameter retrieval in the calling parameter library according to the function declaration to obtain the target calling parameter; wherein the target calling parameter corresponds to at least one reservation application programming interface; A reservation control module configured to wake up a vehicle through an Internet of Vehicles service provider at the reservation time and send a control instruction corresponding to the target application programming interface to a vehicle host through the Internet of Vehicles service provider.

7. An electronic device comprising a memory, a processor, and a computer program stored on the memory and running on the processor, characterized in that, The processor executes the program to implement the method of any one of claims 1 to 5.

8. A vehicle characterized by comprising: The reservation control device of the vehicle of claim 6 or the electronic device of claim 7. The processor executes the program to implement the method of any one of claims 1 to 5. The reservation control device of the vehicle of claim 6 or the electronic device of claim 7.

Images