Vehicle-based service processing method and device

By obtaining vehicle operation data and user interaction data, using generative models to identify vehicle scenarios and determine service objects, the problem of insufficient flexibility and comprehensiveness of service processing in the vehicle driving process is solved, and user experience and service are improved Diversity of treatment.

CN119071339APending Publication Date: 2024-12-03ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411112102.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-13
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The existing vehicle-machine system provides high requirements for networking services during vehicle driving, and it is difficult to effectively identify vehicle operating scenarios and user interaction data, resulting in insufficient flexibility and comprehensiveness of service processing and poor user experience.

Method used

By obtaining vehicle operation data and user interaction data, using a generative model to identify scenes and determine service objects, generate service parameters, and call corresponding service objects for processing based on these parameters, improving the flexibility and comprehensiveness of service processing.

Benefits of technology

It improves the response flexibility and comprehensiveness of user interaction data, improves user experience, and realizes diversity and comprehensive calls to different service objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071339A_ABST
    Figure CN119071339A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a vehicle-based service processing method and device, and the method comprises the steps: obtaining vehicle operation data and user interaction data, and transmitting the data to a server, so as to carry out the scene recognition based on the vehicle operation data, determining at least one candidate service object based on a vehicle service scene obtained by scene recognition; receiving service parameters of a target service object, which are returned by the server and are obtained by inputting the object identifier of each candidate service object, the vehicle operation data and the user interaction data into a generative model to carry out target service object determination and service parameter generation, and finally calling the target service object according to a calling mode corresponding to the target service object. And calling the target service object to perform service processing according to the corresponding service parameters.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This document relates to the field of data processing, and more particularly to a vehicle-based service processing method and device. Background Art

[0002] With the continuous development of Internet technology and the continuous improvement of vehicle intelligence, more and more vehicles are equipped with intelligent car systems. The car systems are equipped with operating systems and can be connected to the Internet. Users can use the functions and networking services configured by the car systems through human-computer interaction with the car systems. As more and more vehicles are equipped with car systems, more and more users use the car systems to participate in functions and networking services during vehicle driving, which puts higher requirements on the car systems. Summary of the invention

[0003] One or more embodiments of the present specification provide a vehicle-based service processing method, including: obtaining vehicle operation data and user interaction data and sending them to a server, so as to perform scene recognition based on the vehicle operation data, and determine at least one candidate service object based on the obtained vehicle service scene. Receive the service parameters of the target service object returned by the server. The service parameters are obtained by inputting the object identifier of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate the service parameters. According to the calling method corresponding to the target service object, the target service object is called to perform service processing according to the service parameters.

[0004] One or more embodiments of the present specification provide another vehicle-based service processing method, including: receiving vehicle operation data and user interaction data sent by a vehicle terminal, and performing scene recognition based on the vehicle operation data to obtain a vehicle service scene. Determine at least one candidate service object that matches the vehicle service scene in the set of service objects bound to the vehicle. Input the object identifier of each candidate service object, the vehicle operation data, and the user interaction data into a generative model to determine the target service object and generate service parameters to obtain the service parameters of the target service object. Return the service parameters of the target service object to the vehicle terminal, so that the target service object is called according to the calling method corresponding to the target service object to perform service processing according to the service parameters.

[0005] One or more embodiments of the present specification provide a vehicle-based service processing device, including: a data sending module, configured to obtain vehicle operation data and user interaction data and send them to a server, so as to perform scene recognition based on the vehicle operation data, and determine at least one candidate service object based on the obtained vehicle service scene. A parameter receiving module, configured to receive service parameters of a target service object returned by the server; the service parameters are obtained by inputting the object identifier of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate the service parameters. An object calling module, configured to call the target service object according to the calling method corresponding to the target service object and perform service processing according to the service parameters.

[0006] One or more embodiments of the present specification provide another vehicle-based service processing device, including: a data receiving module, configured to receive vehicle operation data and user interaction data sent by a vehicle terminal, and perform scene recognition based on the vehicle operation data to obtain a vehicle service scene. An object determination module, configured to determine at least one candidate service object that matches the vehicle service scene in a set of service objects bound to the vehicle. A parameter generation module, configured to input the object identifier of each candidate service object, the vehicle operation data, and the user interaction data into a generative model to determine a target service object and generate service parameters to obtain the service parameters of the target service object. A parameter return module, configured to return the service parameters of the target service object to the vehicle terminal, so as to call the target service object according to the calling method corresponding to the target service object and perform service processing according to the service parameters.

[0007] One or more embodiments of the present specification provide a vehicle-based service processing device, comprising: a processor; a memory configured to store computer-executable instructions, wherein the processor executes the computer-executable instructions to achieve: obtaining vehicle operation data and user interaction data and sending them to a server, so as to perform scene recognition based on the vehicle operation data, and determine at least one candidate service object based on the obtained vehicle service scene. Receive service parameters of the target service object returned by the server. The service parameters are obtained by inputting the object identifier of each candidate service object, the vehicle operation data, and the user interaction data into a generative model to determine the target service object and generate the service parameters. According to the calling method corresponding to the target service object, the target service object is called to perform service processing according to the service parameters.

[0008] One or more embodiments of the present specification provide another vehicle-based service processing device, comprising: a processor; a memory configured to store computer-executable instructions, the processor executing the computer-executable instructions to achieve: receiving vehicle operation data and user interaction data sent by a vehicle terminal, and performing scene recognition based on the vehicle operation data to obtain a vehicle service scene. Determine at least one candidate service object that matches the vehicle service scene in the set of service objects bound to the vehicle. Input the object identifier of each candidate service object, the vehicle operation data, and the user interaction data into a generative model to determine the target service object and generate service parameters to obtain the service parameters of the target service object. Return the service parameters of the target service object to the vehicle terminal, so that the target service object is called according to the calling method corresponding to the target service object to perform service processing according to the service parameters.

[0009] One or more embodiments of this specification provide a computer-readable storage medium for storing computer-executable instructions, which implement the following process when executed: obtain vehicle operation data and user interaction data and send them to a server to perform scene recognition based on the vehicle operation data, and determine at least one candidate service object based on the obtained vehicle service scene. Receive service parameters of the target service object returned by the server. The service parameters are obtained by inputting the object identifier of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate service parameters. According to the calling method corresponding to the target service object, call the target service object to perform service processing according to the service parameters.

[0010] One or more embodiments of the present specification provide another computer-readable storage medium for storing computer-executable instructions, which implement the following process when executed: receiving vehicle operation data and user interaction data sent by a vehicle terminal, and performing scene recognition based on the vehicle operation data to obtain a vehicle service scene. Determine at least one candidate service object that matches the vehicle service scene in the set of service objects bound to the vehicle. Input the object identifier of each candidate service object, the vehicle operation data, and the user interaction data into a generative model to determine the target service object and generate service parameters to obtain the service parameters of the target service object. Return the service parameters of the target service object to the vehicle terminal, so that the target service object is called according to the calling method corresponding to the target service object to perform service processing according to the service parameters. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate one or more embodiments of the present specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present specification. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.

[0012] Figure 1 A schematic diagram of an implementation environment of a vehicle-based service processing method provided for one or more embodiments of this specification;

[0013] Figure 2 A process flow chart of a vehicle-based service processing method provided for one or more embodiments of this specification;

[0014] Figure 3 A processing sequence diagram of a vehicle-based service processing method applied to a command processing scenario provided by one or more embodiments of this specification;

[0015] Figure 4 A processing sequence diagram of a vehicle-based service processing method applied to a voice processing scenario provided by one or more embodiments of this specification;

[0016] Figure 5 Another vehicle-based service processing method processing flow chart provided for one or more embodiments of this specification;

[0017] Figure 6 A process flow chart of a vehicle-based service processing method applied to a generative model scenario provided for one or more embodiments of this specification;

[0018] Figure 7 A data processing method processing flow chart provided for one or more embodiments of this specification;

[0019] Figure 8 A schematic diagram of an embodiment of a vehicle-based service processing device provided for one or more embodiments of the present specification;

[0020] Fig. 9 A schematic diagram of another vehicle-based service processing device embodiment provided for one or more embodiments of the present specification;

[0021] Fig.10 A schematic diagram of the structure of a vehicle-based service processing device provided for one or more embodiments of this specification;

[0022] Fig.11 A schematic diagram of the structure of another vehicle-based service processing device provided for one or more embodiments of the present specification. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the technical solutions in one or more embodiments of this specification will be clearly and completely described below in conjunction with the drawings in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of them. Based on one or more embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this document.

[0024] The vehicle-based service processing method provided by one or more embodiments of this specification can be applied to the implementation environment of vehicle-based service processing, such as Figure 1 As shown, the implementation environment includes a server 101 and a vehicle terminal 102. In addition, the implementation environment may also include a user terminal 103;

[0025] The server 101 may be one or more servers, a server cluster consisting of several servers, or a cloud server of a cloud computing platform, and is used to process the vehicle operation data and user interaction data sent by the vehicle terminal 102 to determine the target service object and generate service parameters, or to respond to the vehicle information access instruction sent by the user terminal 103;

[0026] The vehicle terminal 102 includes a vehicle terminal deployed on the vehicle, at least one application is installed on the vehicle terminal 102, and the vehicle terminal can call any application. In addition, the vehicle terminal 102 also establishes a data link with at least one vehicle accessory, and data reading and data writing between the vehicle terminal 102 and each vehicle accessory are realized through the data link;

[0027] The user terminal 103 may be a mobile phone, a personal computer, a tablet computer, an e-book reader, a device for information interaction based on VR (Virtual Reality), an IoT device, a wearable smart device, a laptop computer, a desktop computer, etc. The user terminal 103 may be installed with a vehicle service application corresponding to the server 101, and a vehicle information access instruction may be submitted through the vehicle service application;

[0028] In this implementation environment, the vehicle terminal 102 obtains vehicle operation data and user interaction data and sends them to the server 101. The server 101 performs scene recognition based on the vehicle operation data, and determines at least one candidate service object based on the vehicle service scene obtained by the scene recognition. The object identifier, vehicle operation data and user interaction data of each candidate object are input into the generative model to determine the target service object and generate service parameters, and the target service object and service parameters are returned to the vehicle terminal 102. The vehicle terminal 102 receives the service parameters of the target service object returned by the server 101, and calls the target service object according to the calling method corresponding to the target service object to perform service processing according to the service parameters.

[0029] One or more embodiments of a vehicle-based service processing method provided in this specification are as follows:

[0030] The present embodiment provides a vehicle-based service processing method, in which a vehicle terminal obtains vehicle operation data and user interaction data and sends them to a server, the server performs scene recognition based on the vehicle operation data, and determines at least one candidate service object based on the obtained vehicle service scene, and inputs the object identifier, vehicle operation data and user interaction data of each candidate service object into a generative model to determine a target service object and generate service parameters, obtains a target service object and service parameters in response to the user interaction data and returns them to the vehicle terminal, thereby determining the target service object and generating service parameters with the help of the capabilities of the generative model and the candidate service objects corresponding to the pre-configured vehicle service scene, while ensuring the validity of the determined target service object and the generated service parameters, improving the flexibility and comprehensiveness of responding to the user interaction data, and improving the user's perception; after the vehicle terminal receives the service parameters of the target service object returned by the server, it calls the target service object according to the corresponding calling method of the target service object to perform service processing according to the service parameters, thereby, for different target service objects, corresponding calling methods are used for calling, thereby improving the diversity and comprehensiveness of calling the service object.

[0031] Reference Figure 2 The vehicle-based service processing method provided in this embodiment can be applied to a vehicle terminal, and specifically includes steps S202 to S206.

[0032] Step S202, obtaining vehicle operation data and user interaction data and sending them to a server, so as to perform scene recognition based on the vehicle operation data, and determine at least one candidate service object based on the obtained vehicle service scene.

[0033] The vehicle operation data includes the operation data of the vehicle equipment configured in the vehicle, such as the operation status of the vehicle transmitter, the air conditioning temperature of the vehicle air conditioner, the seat angle and / or massage status of the vehicle seat, and the vehicle position data of the vehicle positioning; in addition, the vehicle operation status may also include the operation status and / or operation data of the application installed on the vehicle terminal; for example, the navigation data when the operation status of the navigation application installed on the vehicle terminal is running, and the music data played when the operation status of the music application is running. It should be noted that the vehicle operation data belongs to the user's privacy to a certain extent, and the user's authorization is required before obtaining the vehicle operation data.

[0034] The user interaction data includes data submitted by the user based on gestures, voice and / or controls for interaction with the vehicle terminal for service processing; in addition, the user interaction data may also be images of the user in the driving position, and analysis of the user's emotions may be performed based on the user images.

[0035] The vehicle service scenario can be determined according to different vehicle states; for example, if the vehicle is in a parked state (that is, the vehicle engine is in a turned-off state), the vehicle service scenario is determined to be a parked scenario; if the vehicle is in a driving state, the vehicle service scenario is determined to be a driving scenario; if the vehicle is in a charging state, the vehicle service scenario is determined to be a charging state. In addition, the vehicle service scenario can also be determined based on the vehicle's driving speed and / or driving position, for example, a highway scenario, a provincial road scenario, etc.; in addition, the vehicle service scenario can also be divided from other dimensions, which are not limited in this embodiment.

[0036] The service objects in this embodiment include vehicle accessories bound to the vehicle that are pre-entered on the vehicle service platform corresponding to the server, or applications installed on the vehicle terminal that are pre-entered on the vehicle service platform; this is equivalent to pre-entering the service object of the vehicle service platform. In the process of object entry, in addition to entering the object identifier, the service function of the service object can also be entered, such as the music search and playback function of the music application, such as the navigation function of the navigation application; in addition, the action point of the service object can also be entered, which can be an application or a data link of a vehicle accessory. Optionally, the service object includes at least one of the following:

[0037] A vehicle accessory that establishes a data link with a vehicle terminal, and an application running on the vehicle terminal;

[0038] Optionally, the vehicle accessories include factory accessories configured on the vehicle when the vehicle leaves the factory and / or third-party accessories that establish a data link with the vehicle terminal based on a data protocol. The third-party accessories can establish a data link with the terminal interface configured based on the data protocol and the vehicle terminal based on the data protocol. Merchants of third-party accessories can search for the data protocol corresponding to the vehicle corresponding to the vehicle terminal through the data protocol set provided by the vehicle service platform, and configure the accessory interface of the third-party accessories based on the data protocol.

[0039] In addition, during the service object configuration process, you can also enter the vehicle service scenarios that match the service objects. For example, the vehicle service scenarios that match the vehicle accessory vehicle air conditioning include: driving scenarios; the vehicle service scenarios that match the vehicle accessory vehicle fragrance include driving scenarios and charging scenarios.

[0040] In specific implementation, the vehicle terminal obtains vehicle operation data and user interaction data and sends them to the server. After receiving the vehicle operation data and user interaction data sent by the vehicle terminal, the server first performs scene recognition based on the vehicle operation data, and determines at least one candidate service object based on the obtained vehicle service scene. In order to improve the effectiveness of scene recognition, in an optional implementation provided in this embodiment, scene recognition can be performed in the following manner:

[0041] Determining the vehicle service scenario according to the operating accessory status and / or charging accessory status carried by the vehicle operating data;

[0042] or,

[0043] Inputting the vehicle operation data into a recognition prompt template for scene recognition to obtain a prompt text for prompting scene recognition;

[0044] The prompt text is input into the generative model for scene recognition to obtain the vehicle service scene.

[0045] Specifically, the corresponding relationship between the vehicle running accessory state and / or the charging accessory state and the vehicle service scene can be pre-configured, and the vehicle service scene can be determined according to the running accessory data and / or the charging accessory state carried by the vehicle running data; for example, if the running accessory (engine) is in the off state, the vehicle service scene is determined to be the parking scene; if the charging accessory is in the working state, the vehicle service scene is determined to be the charging scene; if the running accessory data is in the on state and the charging accessory is in the off state, the vehicle service scene is determined to be the driving state;

[0046] In addition, vehicle service scenarios can also be identified through pre-trained generative models. Specifically, vehicle operation data can be input into a recognition prompt template for scene recognition to obtain prompt text for scene recognition. The prompt text can be input into the generative model for scene recognition to obtain the vehicle service scenario.

[0047] In this embodiment, the user interaction data may be a processing instruction for service processing, such as a navigation instruction, a music playing instruction, or a user interaction voice. In the case of different user interaction data, the method for obtaining the user interaction data and the vehicle operation data is also different.

[0048] In an optional implementation manner provided by this embodiment, taking the processing instruction of a navigation instruction as an example, the vehicle terminal performs the following operations in the process of acquiring vehicle operation data and user interaction data and sending them to the server:

[0049] Obtaining the user's navigation instructions for the target location;

[0050] The vehicle operation data including at least the vehicle position data is acquired according to the navigation instruction, and the navigation instruction and the vehicle operation data are sent to the server.

[0051] Specifically, after the vehicle terminal obtains the user's navigation instruction for the target location, it obtains the vehicle operation data including at least the vehicle location data according to the navigation instruction, and sends the navigation instruction and the vehicle operation data to the server.

[0052] In addition, the processing instruction may also be a vehicle start instruction or a music play instruction, which is not limited in this embodiment.

[0053] In another optional implementation manner provided by this embodiment, the process in which the vehicle terminal obtains the vehicle operation data and the user interaction data and sends them to the server can also be achieved by obtaining the vehicle operation data and the user interaction voice and sending them to the server.

[0054] In addition, step S202 can also be replaced by, if user interaction data is detected, reading the vehicle operation data, and sending the vehicle operation data and the vehicle interaction data to the server, and forming a new implementation method with other processing steps provided in this embodiment.

[0055] Step S204: receiving the service parameters of the target service object returned by the server.

[0056] Optionally, the service parameters are obtained by inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate the service parameters.

[0057] During the specific execution process, after receiving the vehicle operation data and user interaction data sent by the vehicle terminal, the server first performs scene recognition based on the vehicle operation data, and determines at least one candidate service object based on the obtained vehicle service scene. In the process of determining at least one candidate service object based on the obtained vehicle service scene, at least one candidate service object matching the vehicle service scene is determined in the service object set bound to the vehicle; further, the vehicle operation data, user interaction data and the object identifiers of each candidate service object are input into the generative model to determine the target service object and generate service parameters, so as to obtain the target service object and the service parameters of the target service object; it should be noted that in the process of inputting the vehicle operation data, user interaction data and the object identifiers of each candidate service object into the generative model to determine the target service object and generate service parameters, the vehicle operation data, user interaction data and the object identifiers of each candidate service object are first written into the prompt template for prompting the target service object determination and service parameter generation to obtain the prompt text, and then the prompt text is input into the generative model to determine the target service object and generate service parameters.

[0058] When the categories of the above-mentioned user interaction data are different, the process of the generative model determining the target service object and generating service parameters is also different. The following specifically explains the process of the generative model determining the target service object and generating service parameters for processing user interaction data of the instruction category and user interaction data of the voice category.

[0059] (1) Processing instructions

[0060] Taking navigation instructions as an example, if the vehicle operation data and navigation instructions sent by the vehicle terminal are received, the generative model can perform the following operations in the process of determining the target service object and generating service parameters:

[0061] Determine a navigation application from among the candidate service objects according to the navigation instruction;

[0062] Reading service environment data and reading the environment preference data of the user;

[0063] Performing an environment configuration test according to the service environment data and the environment preference data, and determining environment configuration accessories according to the test results;

[0064] Determine the navigation application and the environment configuration accessory as the target service objects;

[0065] The vehicle position data and the target position data included in the navigation instruction are determined as service parameters of the navigation application, and the environmental preference data corresponding to the environmental configuration accessory is determined as the service parameter of the environmental configuration accessory.

[0066] Optionally, the service environment data includes real environment data and vehicle environment data. The real environment data may be in-vehicle temperature data; and the vehicle environment data may be in-vehicle seat data.

[0067] Specifically, first determine the navigation application among the candidate service objects according to the navigation instruction, and on this basis, perform environmental configuration detection on the current service environment data, determine the environmental configuration accessories to be processed according to the detection results, determine the navigation application and the environmental configuration accessories as target service objects, determine the vehicle position data and the target position data contained in the navigation instruction as service parameters of the navigation application, and determine the environmental preference data corresponding to the environmental configuration accessories as service parameters of the environmental configuration accessories.

[0068] For example, when a user submits a navigation instruction for position p1, the generative model first determines the navigation application as the target service object, and determines position p1 and the current position p2 in the vehicle operation data as the service parameters of the navigation application during the process of determining the target service object and generating the service parameters. On this basis, the vehicle temperature and seat data are read in the vehicle operation data to detect whether the vehicle temperature falls within the user's temperature preference range. If so, no processing is performed. If not, the air-conditioning accessories are determined as the target service object, and the middle value in the temperature preference range is determined as the service parameter of the air-conditioning accessories. In addition, it is detected whether the seat data is the user's preferred seat data. If so, no processing is performed. If not, the seat accessories are determined as the target service object, and the preferred seat data is determined as the service parameter of the seat data.

[0069] In the specific implementation process, in addition to registering vehicle accessories and applications based on the vehicle service platform, the user can also register the associated service objects deployed at the associated location (such as home). In the process of obtaining the navigation instruction, in addition to performing environmental configuration detection, the generative model can also perform target location detection in order to improve the management of more user-related service objects, and then recommend configurations for the associated service objects deployed at the associated location. In an optional implementation manner provided by this embodiment, the generative model also performs the following operations:

[0070] detecting whether the target location is an associated location of the user;

[0071] If not, no action is required;

[0072] If yes, calculating the driving time of the user to the target location according to the vehicle driving data sent by the vehicle terminal;

[0073] In the case where it is detected that the driving duration is less than a time threshold, reading an object service preference of an associated service object deployed by the user at the associated location;

[0074] An object service reminder is generated based on the associated service object and the object service preference.

[0075] Optionally, the vehicle driving data includes driving position and / or driving speed.

[0076] Specifically, when the target location carried by the navigation instruction is the user's associated location, the driving time for the user to drive to the target location is calculated based on the driving position and driving speed sent by the vehicle terminal. When the driving time is less than the time threshold, an object service reminder is generated based on the object service preference of the associated service object deployed by the user at the associated location.

[0077] After the generative model generates and outputs the object service reminder, optionally, the server obtains the object service reminder output by the generative model and sends it to the vehicle terminal;

[0078] The vehicle terminal receives the object service reminder and calls the broadcast accessory to broadcast the reminder, and if it is detected that the user submits a reminder confirmation instruction for the object service reminder, sends the reminder confirmation instruction to the server;

[0079] Based on the reminder confirmation instruction, the server calls the associated service object in accordance with the calling method corresponding to the associated service object to perform service processing according to the object service preference.

[0080] The associated service object is configured according to the object service preference, so that the associated service object performs service processing based on the object service preference.

[0081] Continuing with the above example, location p1 is the location defined by the user as home. Therefore, the target location is determined to be the associated location of the user. When it is detected that the time it takes for the user to reach location p1 is less than 10 minutes, the user's preferred temperature for, for example, the home air conditioner is read; an object service reminder such as "You will be home in ten minutes. Do you need to turn on the home air conditioner and adjust it to x degrees?" is generated based on the home air conditioner, driving time and preferred temperature; after the server obtains the object service reminder output by the generative model, it returns the object service reminder to the vehicle terminal and / or the user terminal, and the vehicle terminal and / or the user terminal broadcast the object service reminder through the deployed broadcast accessories. If a reminder confirmation instruction for the object service reminder submitted by the user by triggering a control or submitting a voice confirmation instruction is received, the server is sent a reminder confirmation instruction. Based on the reminder confirmation instruction, the server turns on the home air conditioner and adjusts the temperature of the home air conditioner to the preferred temperature according to the call address corresponding to the home air conditioner, so that the home air conditioner runs based on the preferred temperature.

[0082] (2) User interaction voice

[0083] In response to receiving the vehicle operation data and user interaction voice sent by the vehicle terminal, the vehicle operation data, the user interaction voice and the object identification of each candidate service object are input into the generative model to determine the target service object and generate service parameters. In an optional implementation manner provided by this embodiment, the target service object determination and service parameter generation include:

[0084] Performing intention recognition on the user interaction voice to obtain interaction intention, and performing emotion recognition on the user interaction voice to obtain emotion category;

[0085] Determine a recommended service object from the at least one candidate service object based on the interaction intention and the emotion category and generate a recommended service category for the recommended service object;

[0086] generating a feedback voice according to the user interaction voice, the emotion category, the object identifier of the recommended service object, and the recommended service category;

[0087] The announcement accessory is determined as a target service object, and the feedback voice is determined as a service parameter.

[0088] Specifically, intent recognition is performed on the user interaction voice to obtain the interaction intention, and / or emotion recognition is performed on the user interaction voice to obtain the emotion category, a recommended service object is determined from at least one candidate service object based on the interaction intention and / or the emotion category and a recommended service category of the recommended service object is generated, feedback voice is generated according to the user interaction voice, the emotion category, the object identifier of the recommended service object, and the recommended service category, the broadcast accessory is determined as the target service object, and the feedback voice is determined as a service parameter.

[0089] For example, the user interaction voice is "I am so tired after a day's work", and the generative model detects that the interaction intention of the user interaction voice is communication intention, and the emotion category is negative emotion. Based on the communication intention and negative emotion, music applications and seat accessories are determined as recommended service objects among the candidate service objects. According to the negative emotion, soothing music is determined as the recommended service category of music applications, and massage mode is the recommended service category of seat accessories. According to the user interaction voice, emotion category, object identifier of the recommended service object and recommended service category, a feedback voice similar to "You have worked hard all day. Do you need me to play soothing music for you and turn on the seat massage to relax?" is generated, the broadcast component is determined as the target service object, and the feedback voice is determined as the service parameter.

[0090] It should be noted that the above-mentioned server inputs the object identification, vehicle operation data and user interaction data of each candidate service object into the generative model to determine the target service object and generate service parameters. At least one of the object identification, vehicle operation data and user interaction data may also be input into the generative model to determine the target service object and generate service parameters. Specifically, if the target service object is determined and the service parameters are generated based on at least one of the object identification, vehicle operation data and user interaction data, it is sufficient to obtain the corresponding features without obtaining data that does not participate in the target service object determination and service parameter generation.

[0091] The above specifically describes the process of determining the target service object and generating service parameters by the generative model when the vehicle terminal sends different user interaction data. In this embodiment, in addition to interacting with the vehicle terminal, the server can also interact with the user terminal. In an optional implementation provided by this embodiment, the server also performs the following operations:

[0092] Obtaining a vehicle data access instruction submitted by a user based on a user terminal;

[0093] Based on the terminal identification carried by the vehicle data access instruction, interact with the vehicle terminal to obtain vehicle status data; or,

[0094] Reading time data, writing the time data and the user identifier carried by the vehicle data access instruction into a generation prompt template for status data generation, and obtaining prompt text for prompting status data generation;

[0095] Inputting the prompt text into the generative model to generate state data and obtain vehicle state data;

[0096] The vehicle status data and the vehicle data access instruction are input into the generative model to generate response data, and the response data is obtained and sent to the user terminal.

[0097] Optionally, the response data generation includes:

[0098] Reading the user's historical amount of power to be charged according to the user identifier carried in the vehicle data access instruction;

[0099] Detecting whether the vehicle charging time has arrived according to the vehicle power in the vehicle status data and the historical power to be charged;

[0100] If yes, read at least one preferred charging location of the user; select a target charging location from the at least one preferred charging location according to the location data in the vehicle status data; determine the target charging location and the vehicle status data as the response data;

[0101] If not, the vehicle status data is determined as the response data.

[0102] Specifically, after obtaining the vehicle data access instruction submitted by the user based on the user terminal, the vehicle status data can be obtained by interacting with the vehicle terminal based on the terminal identifier carried in the vehicle data access instruction, or the current time data can be read, and the time data and the user identifier carried in the vehicle data access instruction are written into the generation prompt template for status data generation to obtain the prompt text for prompting status data generation, and the prompt text is input into the generative model to generate status data and obtain the vehicle status data; in addition, after obtaining the vehicle data access instruction, the vehicle status data is first obtained by interacting with the vehicle terminal based on the terminal identifier carried in the vehicle data access instruction. If the obtained vehicle status data is empty, the current time data and the user identifier carried in the vehicle data access instruction are written into the generation prompt template for turntable data generation to obtain the prompt text for prompting status data generation, and the prompt text is input into the generative model to generate status data and obtain the vehicle status data;

[0103] On the basis of obtaining the vehicle status data, the vehicle status data and the vehicle data access instruction are input into the generative model to generate response data, and the response data is obtained and sent to the user terminal; in the process of generating the response data, the generative model determines whether the vehicle meets the charging reminder conditions to determine the vehicle operation data as the response data or the target charging position and the vehicle operation data as the response data; optionally, the target charging position is determined based on the user's preferred charging position and the position data in the vehicle operation data.

[0104] For example, a user submits a request for access to vehicle data based on a vehicle service subroutine running on a payment application on a user terminal. After receiving the vehicle data access request submitted by the user terminal, the server first obtains the vehicle status data, and inputs the vehicle status data and the vehicle data access instruction into the generative model to generate response data. The generative model pre-learns the charging preference of the user. Therefore, after obtaining the vehicle status data and the vehicle data access instruction, the generative model first reads the user's historical charging power according to the user identifier carried by the vehicle data access instruction, and detects whether the vehicle charging time has arrived according to the historical charging power and the vehicle power in the vehicle status data. If so, the target charging position with a distance less than other distances from the user is determined according to the learned user's preferred charging position and the vehicle position in the vehicle status data (which can be vehicle operation data), or determines that the vehicle power can support the arrival of the user's more preferred target charging position, and determines the target charging position and the vehicle status data as a response state. It should be noted that the specific data contained in the vehicle status data can be obtained according to the pre-configured data identifier, which is not limited in this embodiment.

[0105] During specific implementation, the server obtains the service parameters of the target service object and returns them to the vehicle terminal, and the vehicle terminal receives the service parameters of the target service object returned by the server.

[0106] Step S206: In accordance with the calling method corresponding to the target service object, the target service object is called to perform service processing according to the service parameters.

[0107] In this embodiment, each service object enters its action point (data link of the application or vehicle accessory) during the process of registering the service object on the vehicle service platform. Therefore, in this step, according to the action point corresponding to the target service object, the target service object is called to perform service processing according to the service parameters.

[0108] Corresponding to the above user interaction data being a navigation instruction, in an optional implementation manner provided by this embodiment, according to the calling mode corresponding to the target service object, in the process of calling the target service object to perform service processing according to the service parameters, the following operations are performed:

[0109] loading the navigation application according to the program identifier of the navigation application;

[0110] inputting the vehicle position data and the target position data into the navigation application so that the navigation application performs navigation processing with the vehicle position as the starting point and the target position as the end point; and

[0111] Based on the data link with the environment configuration accessory, the environment preference data corresponding to the environment configuration accessory is written into the environment configuration accessory to perform device configuration processing.

[0112] Specifically, when the target service object includes an application, the vehicle terminal loads the corresponding application according to the program identifier of the application and inputs the service parameters into the application; when the target service object includes vehicle accessories, such as environmental configuration accessories, the vehicle terminal writes the service parameters corresponding to the vehicle accessories into the vehicle accessories based on the data link with the vehicle accessories to perform accessory configuration.

[0113] Corresponding to the user interaction data provided above being user interaction voice, in an optional implementation manner provided by this embodiment, in the process of calling the target service object to perform service processing according to the service parameters in accordance with the calling method corresponding to the target service object, feedback voice is sent to the broadcast accessory so that the broadcast accessory performs voice broadcast of the feedback voice. Furthermore, in an optional implementation manner provided by this embodiment, if a confirmation instruction submitted by the user for the feedback voice is received, the object identifier and the recommended service category contained in the feedback voice are read; in accordance with the calling method corresponding to the recommended service object, the recommended service object is called to perform service processing according to the recommended service category.

[0114] In addition, the user interaction data in this embodiment may also be a vehicle start instruction. After receiving the vehicle start instruction and the vehicle operation data, the server inputs the vehicle start instruction, the vehicle operation data and the object identification of each candidate service object into the generative model to determine the target service object and generate service parameters. Optionally, in the process of determining the target service object and generating the service parameters, the following operations are performed:

[0115] Read the user's preferred travel time according to the terminal identification carried in the vehicle start instruction;

[0116] If the start time carried in the vehicle start instruction exceeds the preferred travel time;

[0117] If not, the environment configuration test can be performed to obtain the target service object and service parameters;

[0118] If so, feedback voice generation may also be performed, the announcement component may be determined as a target service object, and the feedback voice may be determined as a service parameter.

[0119] Here, the feedback voice can be "I got off work very late today. You must have worked hard. Do you want me to play soothing music and turn on the seat massage to relax you?"

[0120] In addition, the above process of determining the target service object and generating service parameters after obtaining the vehicle start instruction can also be performed after obtaining the user image, which is not limited in this embodiment.

[0121] It should be noted that the processes of determining the target service objects and generating the service parameters corresponding to the above-mentioned different user interaction data can be combined and replaced according to requirements.

[0122] In summary, the present embodiment provides a vehicle-based service processing method, in which the vehicle terminal obtains vehicle operation data and user interaction data and sends them to a server, the server performs scene recognition based on the vehicle operation data, and determines at least one candidate service object based on the obtained vehicle service scene, and inputs the object identification, vehicle operation data and user interaction data of each candidate service object into a generative model to determine the target service object and generate service parameters, obtains the target service object and service parameters in response to the user interaction data and returns them to the vehicle terminal, thereby, with the help of the capabilities of the generative model and the candidate service objects corresponding to the pre-configured vehicle service scene, the target service object is determined and the service parameters are generated, while ensuring the validity of the determined target service object and the generated service parameters, the flexibility and comprehensiveness of the response to the user interaction data are improved, and the user's perception is improved; after the vehicle terminal receives the service parameters of the target service object returned by the server, it calls the target service object according to the corresponding calling method of the target service object to perform service processing according to the service parameters, thereby, for different target service objects, corresponding calling methods are used for calling, thereby improving the diversity and comprehensiveness of calling the service object.

[0123] The vehicle-based service processing method provided in the present embodiment can be applied to vehicle terminals, and the vehicle-based service processing method provided in the following embodiments can be applied to servers. The vehicle-based service processing method provided in the present embodiment and applicable to vehicle terminals is similar to or corresponds to the relevant contents of the vehicle-based service processing method applicable to servers provided in the following embodiments. Reading this embodiment may refer to the relevant contents of the following embodiments, and reading the following embodiments may also refer to the relevant contents of this embodiment.

[0124] The following takes the application of a vehicle-based service processing method provided by this embodiment in a command processing scenario as an example to further illustrate the vehicle-based service processing method provided by this embodiment. Figure 3 , a vehicle-based service processing method applied to a command processing scenario specifically includes the following steps.

[0125] Step S302, obtaining vehicle operation data and user processing instructions.

[0126] Step S304, sending vehicle operation data and user processing instructions to the server.

[0127] Step S312: receiving the service parameters of the target service object returned by the server.

[0128] Step S314, loading the application in the target service object and inputting the corresponding program service parameters into the application to execute the application.

[0129] Step S316, writing accessory service parameters to the vehicle accessory based on the data link with the vehicle accessory in the target service object to perform accessory configuration.

[0130] The above-mentioned steps S302 to S304 and steps S312 to S316 provided in this embodiment are executed by the vehicle terminal. It should be noted that the above-mentioned steps S302 to S304 and steps S312 to S316 executed by the vehicle terminal and steps S306 to S310 executed by the server in the following embodiment can cooperate with each other during the execution process. Therefore, when reading this embodiment, please refer to the corresponding contents of steps S306 to S310 provided in the following method embodiment, and when reading the following method embodiment, please refer to the corresponding contents of steps S302 to S304 and steps S312 to S316 provided in this embodiment.

[0131] It should be noted that any one of steps S302 to S304 and any combination of steps S312 to S316 can be replaced by any one of steps S202 to S206 or any combination of steps S312 to S316 to form a new implementation method according to the needs of implementation deployment; in addition, according to the needs of actual deployment, any one or any combination of technical features can be selected from steps S302 to S304 and steps S312 to S316 and combined with any one or more technical features provided by steps S202 to S206 to form a new implementation method; or, any one or any combination of technical features from steps S302 to S304 and steps S312 to S316 can be replaced by any one of steps S202 to S206 to form a new implementation method according to the needs of actual deployment, which will not be elaborated here.

[0132] The following uses the application of a vehicle-based service processing method provided by this embodiment in a voice processing scenario as an example to further illustrate the vehicle-based service processing method provided by this embodiment. Figure 4 , a vehicle-based service processing method applied to voice processing scenarios specifically includes the following steps.

[0133] Step S402, obtaining vehicle operation data and user interaction voice.

[0134] Step S404, sending vehicle operation data and user interaction voice to the server.

[0135] Step S414, receiving the broadcast accessories and feedback voice returned by the server.

[0136] Step S416: Send feedback voice to the announcement accessory based on the data link with the announcement accessory, so that the announcement accessory performs voice broadcast of the feedback voice.

[0137] Step S418: If a confirmation instruction from the user for the feedback voice is received, the recommended object identifier and the recommended service category contained in the feedback voice are read.

[0138] Step S420: In accordance with the calling method corresponding to the recommended service object to which the recommended object identifier belongs, the recommended service object is called to perform service processing according to the recommended service category.

[0139] The above-mentioned steps S402 to S404 and steps S414 to S420 provided in this embodiment are executed by the vehicle terminal. It should be noted that the above-mentioned steps S402 to S404 and steps S414 to S420 executed by the vehicle terminal and steps S406 to S412 executed by the server in the following embodiment can cooperate with each other during the execution process. Therefore, when reading this embodiment, please refer to the corresponding contents of steps S406 to S412 provided in the following method embodiment, and when reading the following method embodiment, please refer to the corresponding contents of steps S402 to S404 and steps S414 to S420 provided in this embodiment.

[0140] It should be noted that any one of steps S402 to S404 and any combination of multiple steps from step S414 to step S420 can be replaced by any one of steps S202 to S206 or any combination of multiple steps to form a new implementation method according to the needs of implementation deployment; in addition, according to the needs of actual deployment, any one or multiple technical features can be selected from steps S402 to S404 and steps S414 to S420 and combined with any one or multiple technical features provided by steps S202 to S206 to form a new implementation method; or, any one or multiple technical features from steps S402 to S404 and steps S414 to S420 can be replaced by any one or multiple technical features provided by steps S202 to S206 to form a new implementation method according to the needs of actual deployment, which will not be elaborated here.

[0141] One or more embodiments of another vehicle-based service processing method provided in this specification are as follows:

[0142] Reference Figure 5 The vehicle-based service processing method provided in this embodiment can be applied to a server, and specifically includes steps S502 to S508.

[0143] Step S502, receiving vehicle operation data and user interaction data sent by the vehicle terminal, and performing scene recognition based on the vehicle operation data to obtain a vehicle service scene.

[0144] The vehicle operation data includes the operation data of the vehicle equipment configured in the vehicle, such as the operation status of the vehicle transmitter, the air conditioning temperature of the vehicle air conditioner, the seat angle and / or massage status of the vehicle seat, and the vehicle position data of the vehicle positioning; in addition, the vehicle operation status may also include the operation status and / or operation data of the application installed on the vehicle terminal; for example, the navigation data when the operation status of the navigation application installed on the vehicle terminal is running, and the music data played when the operation status of the music application is running. It should be noted that the vehicle operation data belongs to the user's privacy to a certain extent, and the user's authorization is required before obtaining the vehicle operation data.

[0145] The user interaction data includes data submitted by the user based on gestures, voice and / or controls for interaction with the vehicle terminal for service processing; in addition, the user interaction data may also be images of the user in the driving position, and analysis of the user's emotions may be performed based on the user images.

[0146] The vehicle service scenario can be determined according to different vehicle states; for example, if the vehicle is in a parked state (that is, the vehicle engine is in a turned-off state), the vehicle service scenario is determined to be a parked scenario; if the vehicle is in a driving state, the vehicle service scenario is determined to be a driving scenario; if the vehicle is in a charging state, the vehicle service scenario is determined to be a charging state. In addition, the vehicle service scenario can also be determined based on the vehicle's driving speed and / or driving position, for example, a highway scenario, a provincial road scenario, etc.; in addition, the vehicle service scenario can also be divided from other dimensions, which are not limited in this embodiment.

[0147] The service objects in this embodiment include vehicle accessories bound to the vehicle that are pre-entered on the vehicle service platform corresponding to the server, or applications installed on the vehicle terminal that are pre-entered on the vehicle service platform; this is equivalent to pre-entering the service object of the vehicle service platform. In the process of object entry, in addition to entering the object identifier, the service function of the service object can also be entered, such as the music search and playback function of the music application, such as the navigation function of the navigation application; in addition, the action point of the service object can also be entered, which can be an application or a data link of a vehicle accessory. Optionally, the service object includes at least one of the following:

[0148] A vehicle accessory that establishes a data link with a vehicle terminal, and an application running on the vehicle terminal;

[0149] Optionally, the vehicle accessories include factory accessories configured on the vehicle when the vehicle leaves the factory and / or third-party accessories that establish a data link with the vehicle terminal based on a data protocol. The third-party accessories can establish a data link with the terminal interface configured based on the data protocol and the vehicle terminal based on the data protocol. Merchants of third-party accessories can search for the data protocol corresponding to the vehicle corresponding to the vehicle terminal through the data protocol set provided by the vehicle service platform, and configure the accessory interface of the third-party accessories based on the data protocol.

[0150] In addition, during the service object configuration process, you can also enter the vehicle service scenarios that match the service objects. For example, the vehicle service scenarios that match the vehicle accessory vehicle air conditioning include: driving scenarios; the vehicle service scenarios that match the vehicle accessory vehicle fragrance include driving scenarios and charging scenarios.

[0151] In specific implementation, the vehicle terminal obtains vehicle operation data and user interaction data and sends them to the server. After receiving the vehicle operation data and user interaction data sent by the vehicle terminal, the server first performs scene recognition based on the vehicle operation data, and determines at least one candidate service object based on the obtained vehicle service scene. In order to improve the effectiveness of scene recognition, in an optional implementation provided in this embodiment, scene recognition can be performed in the following manner:

[0152] Determining the vehicle service scenario according to the operating accessory status and / or charging accessory status carried by the vehicle operating data;

[0153] or,

[0154] Inputting the vehicle operation data into a recognition prompt template for scene recognition to obtain a prompt text for prompting scene recognition;

[0155] The prompt text is input into the generative model for scene recognition to obtain the vehicle service scene.

[0156] Specifically, the corresponding relationship between the vehicle running accessory state and / or the charging accessory state and the vehicle service scene can be pre-configured, and the vehicle service scene can be determined according to the running accessory data and / or the charging accessory state carried by the vehicle running data; for example, if the running accessory (engine) is in the off state, the vehicle service scene is determined to be the parking scene; if the charging accessory is in the working state, the vehicle service scene is determined to be the charging scene; if the running accessory data is in the on state and the charging accessory is in the off state, the vehicle service scene is determined to be the driving state;

[0157] In addition, vehicle service scenarios can also be identified through pre-trained generative models. Specifically, vehicle operation data can be input into a recognition prompt template for scene recognition to obtain prompt text for scene recognition. The prompt text can be input into the generative model for scene recognition to obtain the vehicle service scenario.

[0158] In this embodiment, the user interaction data may be a processing instruction for service processing, such as a navigation instruction, a music playing instruction, or a user interaction voice. In the case of different user interaction data, the method for obtaining the user interaction data and the vehicle operation data is also different.

[0159] In an optional implementation manner provided by this embodiment, taking the processing instruction of a navigation instruction as an example, the vehicle terminal performs the following operations in the process of acquiring vehicle operation data and user interaction data and sending them to the server:

[0160] Obtaining the user's navigation instructions for the target location;

[0161] The vehicle operation data including at least the vehicle position data is acquired according to the navigation instruction, and the navigation instruction and the vehicle operation data are sent to the server.

[0162] Specifically, after the vehicle terminal obtains the user's navigation instruction for the target location, it obtains the vehicle operation data including at least the vehicle location data according to the navigation instruction, and sends the navigation instruction and the vehicle operation data to the server.

[0163] In addition, the processing instruction may also be a vehicle start instruction or a music play instruction, which is not limited in this embodiment.

[0164] In another optional implementation manner provided by this embodiment, the process in which the vehicle terminal obtains the vehicle operation data and the user interaction data and sends them to the server can also be achieved by obtaining the vehicle operation data and the user interaction voice and sending them to the server.

[0165] Step S504: determining at least one candidate service object matching the vehicle service scenario in the service object set bound to the vehicle.

[0166] In the above steps, the vehicle service scenario is acquired. In this step, at least one candidate service object matching the vehicle service scenario is determined in the service object set bound to the vehicle.

[0167] Step S506, inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine a target service object and generate service parameters, thereby obtaining the service parameters of the target service object.

[0168] During the specific execution process, after receiving the vehicle operation data and user interaction data sent by the vehicle terminal, the server first performs scene recognition based on the vehicle operation data, and determines at least one candidate service object based on the obtained vehicle service scene. In the process of determining at least one candidate service object based on the obtained vehicle service scene, at least one candidate service object matching the vehicle service scene is determined in the service object set bound to the vehicle; further, the vehicle operation data, user interaction data and the object identifiers of each candidate service object are input into the generative model to determine the target service object and generate service parameters, so as to obtain the target service object and the service parameters of the target service object; it should be noted that in the process of inputting the vehicle operation data, user interaction data and the object identifiers of each candidate service object into the generative model to determine the target service object and generate service parameters, the vehicle operation data, user interaction data and the object identifiers of each candidate service object are first written into the prompt template for prompting the target service object determination and service parameter generation to obtain the prompt text, and then the prompt text is input into the generative model to determine the target service object and generate service parameters.

[0169] When the categories of the above-mentioned user interaction data are different, the process of the generative model determining the target service object and generating service parameters is also different. The following specifically explains the process of the generative model determining the target service object and generating service parameters for the user interaction data of the processing instruction category and the user interaction data of the voice category sent by the vehicle terminal.

[0170] (1) Processing instructions

[0171] Taking navigation instructions as an example, if the vehicle operation data and navigation instructions sent by the vehicle terminal are received, the generative model can perform the following operations in the process of determining the target service object and generating service parameters:

[0172] Determine a navigation application from among the candidate service objects according to the navigation instruction;

[0173] Reading service environment data and reading the environment preference data of the user;

[0174] Performing an environment configuration test according to the service environment data and the environment preference data, and determining environment configuration accessories according to the test results;

[0175] Determine the navigation application and the environment configuration accessory as the target service objects;

[0176] The vehicle position data and the target position data included in the navigation instruction are determined as service parameters of the navigation application, and the environmental preference data corresponding to the environmental configuration accessory is determined as the service parameter of the environmental configuration accessory.

[0177] Optionally, the service environment data includes real environment data and vehicle environment data. The real environment data may be in-vehicle temperature data; and the vehicle environment data may be in-vehicle seat data.

[0178] Specifically, first determine the navigation application among the candidate service objects according to the navigation instruction, and on this basis, perform environmental configuration detection on the current service environment data, determine the environmental configuration accessories to be processed according to the detection results, determine the navigation application and the environmental configuration accessories as target service objects, determine the vehicle position data and the target position data contained in the navigation instruction as service parameters of the navigation application, and determine the environmental preference data corresponding to the environmental configuration accessories as service parameters of the environmental configuration accessories.

[0179] For example, when a user submits a navigation instruction for position p1, the generative model first determines the navigation application as the target service object, and determines position p1 and the current position p2 in the vehicle operation data as the service parameters of the navigation application during the process of determining the target service object and generating the service parameters. On this basis, the vehicle temperature and seat data are read from the vehicle operation data to detect whether the vehicle temperature falls within the user's temperature preference range. If so, no processing is performed. If not, the air-conditioning accessories are determined as the target service object, and the middle value in the temperature preference range is determined as the service parameter of the air-conditioning accessories. It is detected whether the seat data is the user's preferred seat data. If so, no processing is performed. If not, the seat accessories are determined as the target service object, and the preferred seat data are determined as the service parameters of the seat data.

[0180] In the specific implementation process, in addition to registering vehicle accessories and applications based on the vehicle service platform, the user can also register the associated service objects deployed at the associated location (such as home). In the process of obtaining the navigation instruction, in addition to performing environmental configuration detection, the generative model can also perform target location detection in order to improve the management of more user-related service objects, and then recommend configurations for the associated service objects deployed at the associated location. In an optional implementation manner provided by this embodiment, the generative model also performs the following operations:

[0181] detecting whether the target location is an associated location of the user;

[0182] If not, no action is required;

[0183] If yes, calculating the driving time of the user to the target location according to the vehicle driving data sent by the vehicle terminal;

[0184] In the case where it is detected that the driving duration is less than a time threshold, reading an object service preference of an associated service object deployed by the user at the associated location;

[0185] An object service reminder is generated based on the associated service object and the object service preference.

[0186] Optionally, the vehicle driving data includes driving position and / or driving speed.

[0187] Specifically, when the target location carried by the navigation instruction is the user's associated location, the driving time for the user to drive to the target location is calculated based on the driving position and driving speed sent by the vehicle terminal. When the driving time is less than the time threshold, an object service reminder is generated based on the object service preference of the associated service object deployed by the user at the associated location.

[0188] After the generative model generates and outputs the object service reminder, optionally, the server obtains the object service reminder output by the generative model and sends it to the vehicle terminal;

[0189] The vehicle terminal receives the object service reminder and calls the broadcast accessory to broadcast the reminder, and if it is detected that the user submits a reminder confirmation instruction for the object service reminder, sends the reminder confirmation instruction to the server;

[0190] Based on the reminder confirmation instruction, the server calls the associated service object in accordance with the calling method corresponding to the associated service object to perform service processing according to the object service preference.

[0191] The associated service object is configured according to the object service preference, so that the associated service object performs service processing based on the object service preference.

[0192] Continuing with the above example, location p1 is the location defined by the user as home. Therefore, the target location is determined to be the associated location of the user. When it is detected that the time it takes for the user to reach location p1 is less than 10 minutes, the user's preferred temperature for, for example, the home air conditioner is read; an object service reminder such as "You will be home in ten minutes. Do you need to turn on the home air conditioner and adjust it to x degrees?" is generated based on the home air conditioner, driving time and preferred temperature; after the server obtains the object service reminder output by the generative model, it returns the object service reminder to the vehicle terminal and / or the user terminal, and the vehicle terminal and / or the user terminal broadcast the object service reminder through the deployed broadcast accessories. If a reminder confirmation instruction for the object service reminder submitted by the user by triggering a control or submitting a voice confirmation instruction is received, the server is sent a reminder confirmation instruction. Based on the reminder confirmation instruction, the server turns on the home air conditioner and adjusts the temperature of the home air conditioner to the preferred temperature according to the call address corresponding to the home air conditioner, so that the home air conditioner runs based on the preferred temperature.

[0193] (2) User interaction voice

[0194] In response to receiving the vehicle operation data and user interaction voice sent by the vehicle terminal, the vehicle operation data, the user interaction voice and the object identification of each candidate service object are input into the generative model to determine the target service object and generate service parameters. In an optional implementation manner provided by this embodiment, the target service object determination and service parameter generation include:

[0195] Performing intention recognition on the user interaction voice to obtain interaction intention, and performing emotion recognition on the user interaction voice to obtain emotion category;

[0196] Determine a recommended service object from the at least one candidate service object based on the interaction intention and the emotion category and generate a recommended service category for the recommended service object;

[0197] generating a feedback voice according to the user interaction voice, the emotion category, the object identifier of the recommended service object, and the recommended service category;

[0198] The announcement accessory is determined as a target service object, and the feedback voice is determined as a service parameter.

[0199] Specifically, intent recognition is performed on the user interaction voice to obtain the interaction intention, and / or emotion recognition is performed on the user interaction voice to obtain the emotion category, a recommended service object is determined from at least one candidate service object based on the interaction intention and / or the emotion category and a recommended service category of the recommended service object is generated, feedback voice is generated according to the user interaction voice, the emotion category, the object identifier of the recommended service object, and the recommended service category, the broadcast accessory is determined as the target service object, and the feedback voice is determined as a service parameter.

[0200] For example, the user interaction voice is "I am so tired after a day's work", and the generative model detects that the interaction intention of the user interaction voice is communication intention, and the emotion category is negative emotion. Based on the communication intention and negative emotion, music applications and seat accessories are determined as recommended service objects among the candidate service objects. According to the negative emotion, soothing music is determined as the recommended service category of music applications, and massage mode is the recommended service category of seat accessories. According to the user interaction voice, emotion category, object identifier of the recommended service object and recommended service category, a feedback voice similar to "You have worked hard all day. Do you need me to play soothing music for you and turn on the seat massage to relax?" is generated, the broadcast component is determined as the target service object, and the feedback voice is determined as the service parameter.

[0201] It should be noted that the above-mentioned server inputs the object identification, vehicle operation data and user interaction data of each candidate service object into the generative model to determine the target service object and generate service parameters. At least one of the object identification, vehicle operation data and user interaction data may also be input into the generative model to determine the target service object and generate service parameters. Specifically, if the target service object is determined and the service parameters are generated based on at least one of the object identification, vehicle operation data and user interaction data, it is sufficient to obtain the corresponding features without obtaining data that does not participate in the target service object determination and service parameter generation.

[0202] The above specifically describes the process of determining the target service object and generating service parameters by the generative model when the vehicle terminal sends different user interaction data. In this embodiment, in addition to interacting with the vehicle terminal, the server can also interact with the user terminal. In an optional implementation provided by this embodiment, the server also performs the following operations:

[0203] Obtaining a vehicle data access instruction submitted by a user based on a user terminal;

[0204] Based on the terminal identification carried by the vehicle data access instruction, interact with the vehicle terminal to obtain the vehicle operation data; or,

[0205] Reading time data, writing the time data and the user identifier carried by the vehicle data access instruction into a generation prompt template for status data generation, and obtaining prompt text for prompting status data generation;

[0206] Inputting the prompt text into the generative model to generate state data and obtain vehicle state data;

[0207] The vehicle status data and the vehicle data access instruction are input into the generative model to generate response data, and the response data is obtained and sent to the user terminal.

[0208] Optionally, the response data generation includes:

[0209] Reading the user's historical amount of power to be charged according to the user identifier carried in the vehicle data access instruction;

[0210] Detecting whether the vehicle charging time has arrived according to the vehicle power in the vehicle operation data and the historical power to be charged;

[0211] If yes, read at least one preferred charging location of the user; select a target charging location from the at least one preferred charging location according to the location data in the vehicle operation data; determine the target charging location and the vehicle operation data as the response data;

[0212] If not, the vehicle operation data is determined as the response data.

[0213] Specifically, after obtaining the vehicle data access instruction submitted by the user based on the user terminal, the vehicle status data can be obtained by interacting with the vehicle terminal based on the terminal identifier carried in the vehicle data access instruction, or the current time data can be read, and the time data and the user identifier carried in the vehicle data access instruction are written into the generation prompt template for status data generation to obtain the prompt text for prompting status data generation, and the prompt text is input into the generative model to generate status data and obtain the vehicle status data; in addition, after obtaining the vehicle data access instruction, the vehicle status data is first obtained by interacting with the vehicle terminal based on the terminal identifier carried in the vehicle data access instruction. If the obtained vehicle status data is empty, the current time data and the user identifier carried in the vehicle data access instruction are written into the generation prompt template for turntable data generation to obtain the prompt text for prompting status data generation, and the prompt text is input into the generative model to generate status data and obtain the vehicle status data;

[0214] On the basis of obtaining the vehicle status data, the vehicle status data and the vehicle data access instruction are input into the generative model to generate response data, and the response data is obtained and sent to the user terminal; in the process of generating the response data, the generative model determines whether the vehicle meets the charging reminder conditions to determine the vehicle operation data as the response data or the target charging position and the vehicle operation data as the response data; optionally, the target charging position is determined based on the user's preferred charging position and the position data in the vehicle operation data.

[0215] Step S508, returning the service parameters of the target service object to the vehicle terminal, so as to call the target service object to perform service processing according to the service parameters in accordance with the calling method corresponding to the target service object.

[0216] During specific implementation, the server obtains the service parameters of the target service object and returns them to the vehicle terminal, and the vehicle terminal receives the service parameters of the target service object returned by the server.

[0217] In this embodiment, each service object enters its action point (data link of the application or vehicle accessory) during the process of registering the service object on the vehicle service platform. Therefore, in this step, according to the action point corresponding to the target service object, the target service object is called to perform service processing according to the service parameters.

[0218] Corresponding to the above user interaction data being a navigation instruction, in an optional implementation manner provided by this embodiment, according to the calling mode corresponding to the target service object, in the process of calling the target service object to perform service processing according to the service parameters, the following operations are performed:

[0219] loading the navigation application according to the program identifier of the navigation application;

[0220] inputting the vehicle position data and the target position data into the navigation application so that the navigation application performs navigation processing with the vehicle position as the starting point and the target position as the end point; and

[0221] Based on the data link with the environment configuration accessory, the environment preference data corresponding to the environment configuration accessory is written into the environment configuration accessory to perform device configuration processing.

[0222] Specifically, when the target service object includes an application, the vehicle terminal loads the corresponding application according to the program identifier of the application and inputs the service parameters into the application; when the target service object includes vehicle accessories, such as environmental configuration accessories, the vehicle terminal writes the service parameters corresponding to the vehicle accessories into the vehicle accessories based on the data link with the vehicle accessories to perform accessory configuration.

[0223] Corresponding to the user interaction data provided above being user interaction voice, in an optional implementation manner provided by this embodiment, in the process of calling the target service object to perform service processing according to the service parameters in accordance with the calling method corresponding to the target service object, feedback voice is sent to the broadcast accessory so that the broadcast accessory performs voice broadcast of the feedback voice. Furthermore, in an optional implementation manner provided by this embodiment, if a confirmation instruction submitted by the user for the feedback voice is received, the object identifier and the recommended service category contained in the feedback voice are read; in accordance with the calling method corresponding to the recommended service object, the recommended service object is called to perform service processing according to the recommended service category.

[0224] In summary, the present embodiment provides a vehicle-based service processing method, in which the vehicle terminal obtains vehicle operation data and user interaction data and sends them to a server, the server performs scene recognition based on the vehicle operation data, and determines at least one candidate service object based on the obtained vehicle service scene, and inputs the object identification, vehicle operation data and user interaction data of each candidate service object into a generative model to determine the target service object and generate service parameters, obtains the target service object and service parameters in response to the user interaction data and returns them to the vehicle terminal, thereby, with the help of the capabilities of the generative model and the candidate service objects corresponding to the pre-configured vehicle service scene, the target service object is determined and the service parameters are generated, while ensuring the validity of the determined target service object and the generated service parameters, the flexibility and comprehensiveness of the response to the user interaction data are improved, and the user's perception is improved; after the vehicle terminal receives the service parameters of the target service object returned by the server, it calls the target service object according to the corresponding calling method of the target service object to perform service processing according to the service parameters, thereby, for different target service objects, corresponding calling methods are used for calling, thereby improving the diversity and comprehensiveness of calling the service object.

[0225] The following takes the application of a vehicle-based service processing method provided by this embodiment in a command processing scenario as an example to further illustrate the vehicle-based service processing method provided by this embodiment. Figure 3 , a vehicle-based service processing method applied to a command processing scenario specifically includes the following steps.

[0226] Step S306, receiving the vehicle operation data and user processing instructions sent by the vehicle terminal, and determining the vehicle service scenario based on the operation accessory status and charging accessory status carried in the vehicle operation data.

[0227] Step S308: determining at least one candidate service object that matches the vehicle service scenario in the service object set bound to the vehicle.

[0228] Step S310, inputting vehicle operation data, user processing instructions and object identifications of candidate service objects into a generative model to determine a target service object and generate service parameters, obtaining the service parameters of the target service object and returning them to the vehicle terminal.

[0229] It should be noted that any one of steps S306 and S310 or any combination of multiple steps can be replaced by any one of steps S502 to S508 or any combination of multiple steps to form a new implementation method according to the needs of implementation deployment; in addition, according to the needs of actual deployment, any one or multiple technical features can be selected in steps S306 and S310 and combined with any one or multiple technical features provided by steps S502 to S508 to form a new implementation method; or, any one or multiple technical features in steps S306 and S310 can be replaced by any one or multiple technical features provided by steps S502 to S508 to form a new implementation method according to the needs of actual deployment, which will not be repeated here.

[0230] The following uses the application of a vehicle-based service processing method provided by this embodiment in a voice processing scenario as an example to further illustrate the vehicle-based service processing method provided by this embodiment. Figure 4 , a vehicle-based service processing method applied to voice processing scenarios specifically includes the following steps.

[0231] Step S406, receiving the vehicle operation data and user interaction voice sent by the vehicle terminal.

[0232] Step S408, write the vehicle operation data into the first prompt template to obtain a first prompt text, input the first prompt text into the generative model for scene recognition, and obtain the vehicle service scene.

[0233] Step S410: determining at least one candidate service object matching the vehicle service scenario in the service object set bound to the vehicle.

[0234] Step S412, write the user interaction data and the object identifier of each candidate service object into the second prompt template, obtain the second prompt text, input the second prompt text into the generative model for data generation, obtain the broadcast accessories and feedback voice and return them to the vehicle terminal.

[0235] It should be noted that any one of steps S406 and S412 or any combination of multiple steps can be replaced by any one of steps S502 to S508 or any combination of multiple steps to form a new implementation method according to the needs of implementation deployment; in addition, according to the needs of actual deployment, any one or multiple technical features can be selected in steps S406 and S412 and combined with any one or multiple technical features provided by steps S502 to S508 to form a new implementation method; or, any one or multiple technical features in steps S406 and S412 can be replaced by any one or multiple technical features provided by steps S502 to S508 to form a new implementation method according to the needs of actual deployment, which will not be elaborated here.

[0236] The following uses the application of a vehicle-based service processing method provided by this embodiment in a generative model scenario as an example to further illustrate the vehicle-based service processing method provided by this embodiment. Figure 6 ,The vehicle-based service processing method applied to the generative model scenario specifically includes the following steps.

[0237] Step S602: obtaining a vehicle data access instruction submitted by a user based on a user terminal.

[0238] Step S604: Based on the terminal identification carried in the vehicle data access instruction, interact with the vehicle terminal to obtain the vehicle operation data.

[0239] Step S606: if the vehicle operation data obtained through interaction with the vehicle terminal is empty, the current time data and the user identifier carried in the vehicle data access instruction are written into the first prompt template to obtain a first prompt text.

[0240] Step S608: input the first prompt text into the generative model to generate operation data to obtain vehicle operation data.

[0241] Step S610: Write the vehicle operation data and the vehicle data access instruction into the second prompt template to obtain a second prompt text.

[0242] Step S612: input the second prompt text into the generative model to generate response data, obtain the response data and send it to the user terminal.

[0243] In the case where the target charging location is included in the response data, if a navigation instruction to the target charging location submitted by the user based on the user terminal or a vehicle start instruction submitted by the vehicle terminal is detected, the vehicle operation data is acquired through interaction with the vehicle terminal, the navigation processing data of the target charging location and the vehicle operation data are input into the generative model to determine the target service object and generate service parameters, and the target service object and service parameters are acquired and returned to the vehicle terminal;

[0244] The vehicle terminal receives the service parameters of the target service object returned by the server, and calls the target service object for service processing according to the service parameters of the target service object and the calling method corresponding to the target service object;

[0245] When the vehicle is traveling to the target charging position, the vehicle terminal can collect vehicle operation data at preset time intervals and send it to the server. After the server obtains the vehicle operation data sent by the vehicle terminal, the vehicle operation data is input into the generative model to generate the second response data, and the second response data is obtained and returned to the vehicle terminal; wherein, the second response data may be "You have arrived at the target charging position, do you need to turn on the vehicle charging accessories?"; the vehicle terminal receives the second response data and broadcasts it based on the broadcast accessories. If it is detected that the user submits a confirmation instruction for the second response data, the recommended service object is called according to the calling method of the recommended service object in the second response data to perform service processing according to the recommended service category in the second response data; or a confirmation instruction is sent to the server, and the server receives the confirmation instruction, and the recommended service object is called according to the calling method of the recommended service object in the second response data to perform service processing according to the recommended service category in the second response data;

[0246] After detecting the charging order sent by the charging server, the server makes order payment for the charging order.

[0247] It should be noted that in the above embodiment, the process in which the vehicle terminal calls the target service object according to the calling method corresponding to the target service object and performs service processing according to the service parameters can also be executed by the server. The specific execution method is similar to that of the above-mentioned vehicle terminal and will not be repeated here.

[0248] One or more embodiments of a vehicle-based data processing method provided in this specification are as follows:

[0249] The relevant contents of the vehicle-based data processing method provided in this embodiment are similar to the vehicle-based service processing methods provided in one or more of the above embodiments during execution. Reading this embodiment may refer to the relevant contents of the above embodiments, and reading the above embodiments may also refer to the relevant contents of this embodiment.

[0250] Reference Figure 7The vehicle-based data processing method provided in this embodiment can be applied to a server, and specifically includes steps S702 to S710.

[0251] Step S702, obtaining vehicle operation data and user interaction data.

[0252] In the process of data access, in an optional implementation manner provided by this embodiment, obtaining vehicle operation data and user interaction data includes:

[0253] Acquiring a vehicle data access instruction submitted by the user based on a user terminal;

[0254] According to the terminal identification carried in the vehicle data access instruction, interact with the vehicle terminal to obtain the vehicle operation data; or,

[0255] Reading time data, writing the time data and the user identifier carried by the vehicle data access instruction into a generation prompt template for generating operation data, and obtaining a second prompt text for prompting the generation of operation data;

[0256] The second prompt text is input into the generative model to generate operation data to obtain the vehicle operation data.

[0257] In the process of navigation processing, in an optional implementation manner provided by this embodiment, obtaining vehicle operation data and user interaction data also includes:

[0258] Acquiring a vehicle navigation instruction for a destination location submitted by the user based on a user terminal;

[0259] Based on the terminal identification carried by the vehicle navigation instruction, query whether the vehicle terminal is in operation;

[0260] If yes, obtaining vehicle operation data including at least vehicle location data based on the vehicle terminal;

[0261] If not, no action is required.

[0262] Step S704: performing interaction scene recognition based on the vehicle operation data to obtain an interaction scene.

[0263] Step S706: determining a candidate service object that matches the interaction scenario in the service object set bound to the vehicle.

[0264] Optionally, the service object set consists of a vehicle terminal, an application installed on the vehicle terminal, and a vehicle accessory that establishes a data link with the vehicle terminal.

[0265] Step S708: input at least one of the interaction data and the vehicle operation data and the object identifier of the candidate service object into a generative model to generate an interaction response, thereby obtaining interaction response data.

[0266] Corresponding to the above data access process, in an optional implementation manner provided by this embodiment, the interactive response generation includes:

[0267] Reading the user's historical amount of power to be charged according to the user identifier carried in the vehicle data access instruction;

[0268] Detecting whether the vehicle charging time of the user has arrived according to the vehicle power in the vehicle operation data and the historical power to be charged;

[0269] If yes, read at least one preferred charging location of the user; select a target charging location from the at least one preferred charging location according to the location data in the vehicle operation data; output the target charging location as interactive response data, so as to push data to the user terminal based on the interactive response data and the vehicle operation data;

[0270] If not, it is determined that the interactive response data is empty and output, so as to push data to the user terminal based on the vehicle operation data.

[0271] Corresponding to the above navigation processing process, in an optional implementation manner provided by this embodiment, the interactive response generation includes:

[0272] determining a navigation device from among the candidate vehicle devices according to the vehicle navigation instruction;

[0273] Reading current temperature data and / or current seat data, and reading the user's preferred temperature data and preferred seat data according to the user identifier in the vehicle navigation instruction;

[0274] performing temperature detection according to the current temperature data and the preferred temperature data, and performing seat detection according to the current seat data and the preferred seat data;

[0275] A target device is determined in the seat device and the temperature device based on the detection result, and the target device and the corresponding preference data, the navigation device, the vehicle position data and the destination position data are output as the interactive response data.

[0276] After the prompt text is input into the generative model to generate an interactive response and obtain interactive response data, the method further includes:

[0277] Sending the device identification of the target device and the preference data to the vehicle terminal, so that the vehicle terminal performs device configuration of the target device according to the preference data based on the data link with the target device; and

[0278] The navigation entity is called to perform navigation processing according to the vehicle position data and the target position data of the target position, and the navigation data is sent to the vehicle terminal so as to display the navigation data based on the vehicle terminal.

[0279] Optionally, interactive response generation also includes:

[0280] Detecting whether the destination location is an associated location of the user;

[0281] If yes, when it is detected that the driving time of the user to the destination location is less than the time threshold, reading the device usage preference of the user for the service device deployed at the associated location and determining the device to be reminded;

[0282] Generate a device operation reminder for the device to be reminded based on the device usage preference and the driving time.

[0283] Further, optionally, after the step of inputting the prompt text into a generative model to generate an interactive response and obtaining interactive response data is executed, the method further includes:

[0284] Sending the device operation reminder to the vehicle terminal, so as to broadcast the device operation reminder at the vehicle terminal;

[0285] If a confirmation instruction of the user for the reminder broadcast collected by the vehicle terminal is received, the device to be reminded is configured according to the device usage preference.

[0286] In addition, in an optional implementation manner provided by this embodiment, the interaction data includes a voice interaction text corresponding to the user's voice interaction data;

[0287] If the interaction intention is a communication intention, the interaction response is generated, including:

[0288] Performing emotion recognition on the voice interaction text to obtain a user emotion category;

[0289] determining a recommended device and device configuration data among the at least one candidate vehicle device according to the user emotion category;

[0290] Generate and output an interactive response text based on the voice interaction text, the recommended device and the device configuration data.

[0291] One or more embodiments of a vehicle-based service processing device provided in this specification are as follows:

[0292] In the above-mentioned embodiment, a vehicle-based service processing method is provided, and correspondingly, a vehicle-based service processing device is also provided, which will be described below with reference to the accompanying drawings.

[0293] Reference Figure 8 , which shows a schematic diagram of an embodiment of a vehicle-based service processing device provided in this embodiment.

[0294] Since the device embodiment corresponds to the method embodiment, the description is relatively simple, and the relevant parts can refer to the corresponding description of the method embodiment provided above. The device embodiment described below is only illustrative.

[0295] This embodiment provides a vehicle-based service processing device, including:

[0296] The data sending module 802 is configured to obtain vehicle operation data and user interaction data and send them to the server, so as to perform scene recognition based on the vehicle operation data and determine at least one candidate service object based on the obtained vehicle service scene;

[0297] The parameter receiving module 804 is configured to receive the service parameters of the target service object returned by the server; the service parameters are obtained by inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate the service parameters;

[0298] The object calling module 806 is configured to call the target service object to perform service processing according to the service parameters in accordance with the calling mode corresponding to the target service object.

[0299] One or more embodiments of another vehicle-based service processing device provided in this specification are as follows:

[0300] In the above-mentioned embodiment, another vehicle-based service processing method is provided, and correspondingly, a vehicle-based service processing device is also provided, which is described below with reference to the accompanying drawings.

[0301] Reference Fig. 9 , which shows a schematic diagram of an embodiment of a vehicle-based service processing device provided in this embodiment.

[0302] Since the device embodiment corresponds to the method embodiment, the description is relatively simple, and the relevant parts can refer to the corresponding description of the method embodiment provided above. The device embodiment described below is only illustrative.

[0303] This embodiment provides a vehicle-based service processing device, including:

[0304] The data receiving module 902 is configured to receive the vehicle operation data and user interaction data sent by the vehicle terminal, and perform scene recognition based on the vehicle operation data to obtain the vehicle service scene;

[0305] The object determination module 904 is configured to determine at least one candidate service object matching the vehicle service scenario from the service object set bound to the vehicle;

[0306] The parameter generation module 906 is configured to input the object identification of each candidate service object, the vehicle operation data and the user interaction data into the generative model to determine the target service object and generate service parameters, thereby obtaining the service parameters of the target service object;

[0307] The parameter return module 908 is configured to return the service parameters of the target service object to the vehicle terminal, so as to call the target service object to perform service processing according to the service parameters in accordance with the calling method corresponding to the target service object.

[0308] One or more embodiments of a vehicle-based service processing device provided in this specification are as follows:

[0309] Corresponding to the vehicle-based service processing method described above, based on the same technical concept, one or more embodiments of this specification further provide a vehicle-based service processing device, the vehicle-based service processing device is used to execute the vehicle-based service processing method provided above, Fig.10 A schematic diagram of the structure of a vehicle-based service processing device provided for one or more embodiments of the present specification.

[0310] This embodiment provides a vehicle-based service processing device, including:

[0311] like Fig.10As shown, the vehicle-based service processing device may have relatively large differences due to different configurations or performances, and may include one or more processors 1001 and memory 1002, and the memory 1002 may store one or more storage applications or data. Among them, the memory 1002 may be a short-term storage or a persistent storage. The application stored in the memory 1002 may include one or more modules (not shown in the figure), and each module may include a series of computer executable instructions in the vehicle-based service processing device. Furthermore, the processor 1001 may be configured to communicate with the memory 1002 to execute a series of computer executable instructions in the memory 1002 on the vehicle-based service processing device. The vehicle-based service processing device may also include one or more power supplies 1003, one or more wired or wireless network interfaces 1004, one or more input / output interfaces 1005, one or more keyboards 1006, etc.

[0312] In a specific embodiment, the vehicle-based service processing device includes a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may include one or more modules, and each module may include a series of computer-executable instructions for the vehicle-based service processing device, and the one or more programs configured to be executed by one or more processors include computer-executable instructions for performing the following:

[0313] Acquire vehicle operation data and user interaction data and send them to a server, so as to perform scene recognition based on the vehicle operation data, and determine at least one candidate service object based on the obtained vehicle service scene;

[0314] receiving service parameters of the target service object returned by the server; the service parameters are obtained by inputting object identifiers of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate service parameters;

[0315] According to the calling mode corresponding to the target service object, the target service object is called to perform service processing according to the service parameters.

[0316] One or more embodiments of another vehicle-based service processing device provided in this specification are as follows:

[0317] Corresponding to the another vehicle-based service processing method described above, based on the same technical concept, one or more embodiments of this specification also provide another vehicle-based service processing device, which is used to execute the another vehicle-based service processing method provided above. Fig.11A schematic diagram of the structure of a vehicle-based service processing device provided for one or more embodiments of the present specification.

[0318] This embodiment provides a vehicle-based service processing device, including:

[0319] like Fig.11 As shown, the vehicle-based service processing device may have relatively large differences due to different configurations or performances, and may include one or more processors 1101 and memory 1102, and the memory 1102 may store one or more storage applications or data. Among them, the memory 1102 may be a short-term storage or a persistent storage. The application stored in the memory 1102 may include one or more modules (not shown in the figure), and each module may include a series of computer executable instructions in the vehicle-based service processing device. Furthermore, the processor 1101 may be configured to communicate with the memory 1102 to execute a series of computer executable instructions in the memory 1102 on the vehicle-based service processing device. The vehicle-based service processing device may also include one or more power supplies 1103, one or more wired or wireless network interfaces 1104, one or more input / output interfaces 1105, one or more keyboards 1106, etc.

[0320] In a specific embodiment, the vehicle-based service processing device includes a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may include one or more modules, and each module may include a series of computer-executable instructions for the vehicle-based service processing device, and the one or more programs configured to be executed by one or more processors include computer-executable instructions for performing the following:

[0321] Receiving vehicle operation data and user interaction data sent by the vehicle terminal, and performing scene recognition based on the vehicle operation data to obtain a vehicle service scene;

[0322] Determining at least one candidate service object matching the vehicle service scenario from the service object set bound to the vehicle;

[0323] Inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine a target service object and generate service parameters, thereby obtaining the service parameters of the target service object;

[0324] The service parameters of the target service object are returned to the vehicle terminal, so that the target service object is called according to the calling mode corresponding to the target service object to perform service processing according to the service parameters.

[0325] One or more embodiments of a computer-readable storage medium provided in this specification are as follows:

[0326] Corresponding to the vehicle-based service processing method described above, based on the same technical concept, one or more embodiments of this specification also provide a computer-readable storage medium.

[0327] The computer-readable storage medium provided in this embodiment is used to store computer-executable instructions, and the computer-executable instructions implement the following process when executed:

[0328] Acquire vehicle operation data and user interaction data and send them to a server, so as to perform scene recognition based on the vehicle operation data, and determine at least one candidate service object based on the obtained vehicle service scene;

[0329] receiving service parameters of the target service object returned by the server; the service parameters are obtained by inputting object identifiers of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate service parameters;

[0330] According to the calling mode corresponding to the target service object, the target service object is called to perform service processing according to the service parameters.

[0331] It should be noted that the embodiment of the computer-readable storage medium in this specification and the embodiment of a vehicle-based service processing method in this specification are based on the same inventive concept, so the specific implementation of this embodiment can refer to the implementation of the aforementioned corresponding method, and the repeated parts will not be repeated.

[0332] One or more embodiments of another computer-readable storage medium provided in this specification are as follows:

[0333] Corresponding to the other vehicle-based service processing method described above, based on the same technical concept, one or more embodiments of the present specification also provide another computer-readable storage medium.

[0334] The computer-readable storage medium provided in this embodiment is used to store computer-executable instructions, and the computer-executable instructions implement the following process when executed:

[0335] Receiving vehicle operation data and user interaction data sent by the vehicle terminal, and performing scene recognition based on the vehicle operation data to obtain a vehicle service scene;

[0336] Determining at least one candidate service object matching the vehicle service scenario from the service object set bound to the vehicle;

[0337] Inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine a target service object and generate service parameters, thereby obtaining the service parameters of the target service object;

[0338] The service parameters of the target service object are returned to the vehicle terminal, so that the target service object is called according to the calling mode corresponding to the target service object to perform service processing according to the service parameters.

[0339] It should be noted that the embodiment of the computer-readable storage medium in this specification and the embodiment of another vehicle-based service processing method in this specification are based on the same inventive concept, so the specific implementation of this embodiment can refer to the implementation of the aforementioned corresponding method, and the repeated parts will not be repeated.

[0340] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referenced to each other. Each embodiment focuses on the differences from other embodiments. For example, the device embodiment, equipment embodiment and readable storage medium embodiment are similar to the method embodiment, so the description is relatively simple. To read the relevant contents in the device embodiment, equipment embodiment and readable storage medium embodiment, please refer to the partial description of the method embodiment.

[0341] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0342] In the 1930s, improvements to a technology could be clearly distinguished as hardware improvements (for example, improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the method flow). However, with the development of technology, many improvements to the method flow today can be regarded as direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented using a hardware entity module. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the user's programming of the device. Designers can "integrate" a digital system on a PLD by programming it themselves, without having to ask a chip manufacturer to design and produce a dedicated integrated circuit chip. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is similar to the software compiler used when developing and writing programs, and the original code before compilation must also be written in a specific programming language, which is called hardware description language (HDL). There is not only one HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages ​​and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.

[0343] The controller can be implemented in any appropriate manner, for example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (such as software or firmware) that can be executed by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that in addition to implementing the controller in a purely computer-readable program code manner, the controller can be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, this controller can be considered as a hardware component, and the devices included therein for implementing various functions can also be regarded as structures within the hardware component. Or even, the devices for implementing various functions can be regarded as both software modules for implementing the method and structures within the hardware component.

[0344] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by software with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0345] For the convenience of description, the above devices are described in terms of functions and are divided into various units. Of course, when implementing the embodiments of this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0346] It should be understood by those skilled in the art that one or more embodiments of this specification may be provided as methods, systems or computer program software. Therefore, one or more embodiments of this specification may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program software implemented on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0347] This specification is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program software according to the embodiments of this specification. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0348] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0349] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0350] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0351] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0352] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer readable storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0353] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0354] One or more embodiments of the present specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. One or more embodiments of the present specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0355] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0356] The above description is only an embodiment of this document and is not intended to limit this document. For those skilled in the art, this document may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this document should be included in the scope of the claims of this document.

Claims

1. A vehicle-based service processing method, comprising: Acquire vehicle operation data and user interaction data and send them to a server, so as to perform scene recognition based on the vehicle operation data, and determine at least one candidate service object based on the obtained vehicle service scene; Receive the service parameters of the target service object returned by the server; The service parameters are obtained by inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate the service parameters; According to the calling mode corresponding to the target service object, the target service object is called to perform service processing according to the service parameters.

2. The vehicle-based service processing method according to claim 1, wherein the target service object comprises at least one of the following: A vehicle accessory that establishes a data link with a vehicle terminal, and an application running on the vehicle terminal; in, The vehicle accessories include factory accessories configured on the vehicle when the vehicle leaves the factory and / or third-party accessories that establish a data link with the vehicle terminal based on a data protocol.

3. The vehicle-based service processing method according to claim 1, wherein the scene recognition based on the vehicle operation data comprises: Determining the vehicle service scenario according to the operating accessory status and / or charging accessory status carried by the vehicle operating data; or, Inputting the vehicle operation data into a recognition prompt template for scene recognition to obtain a prompt text for prompting scene recognition; The prompt text is input into the generative model for scene recognition to obtain the vehicle service scene.

4. The vehicle-based service processing method according to claim 1, wherein the step of acquiring vehicle operation data and user interaction data and sending the data to the server comprises: Obtaining the user's navigation instructions for the target location; The vehicle operation data including at least the vehicle position data is acquired according to the navigation instruction, and the navigation instruction and the vehicle operation data are sent to the server.

5. The vehicle-based service processing method according to claim 4, wherein the target service object determination and service parameter generation comprises: Determine a navigation application from among the candidate service objects according to the navigation instruction; Reading service environment data and reading the environment preference data of the user; Performing an environment configuration test according to the service environment data and the environment preference data, and determining environment configuration accessories according to the test results; Determine the navigation application and the environment configuration accessory as the target service objects; The vehicle position data and the target position data included in the navigation instruction are determined as service parameters of the navigation application, and the environmental preference data corresponding to the environmental configuration accessory is determined as the service parameter of the environmental configuration accessory.

6. The vehicle-based service processing method according to claim 5, wherein the step of calling the target service object to perform service processing according to the service parameters in accordance with the calling mode corresponding to the target service object comprises: loading the navigation application according to the program identifier of the navigation application; Inputting the vehicle position data and the target position data into the navigation application so that the navigation application performs navigation processing with the vehicle position as the starting point and the target position as the end point; as well as, Based on the data link with the environment configuration accessory, the environment preference data corresponding to the environment configuration accessory is written into the environment configuration accessory to perform device configuration processing.

7. The vehicle-based service processing method according to claim 5, wherein the generative model further performs the following operations: detecting whether the target location is an associated location of the user; If yes, calculating the driving time of the user to the target location according to the vehicle driving data sent by the vehicle terminal; In the case where it is detected that the driving duration is less than a time threshold, reading an object service preference of an associated service object deployed by the user at the associated location; An object service reminder is generated based on the associated service object and the object service preference.

8. The vehicle-based service processing method according to claim 7, wherein the server obtains the object service reminder output by the generative model and sends it to the vehicle terminal; The vehicle terminal receives the object service reminder and calls the broadcast accessory to broadcast the reminder, and if it is detected that the user submits a reminder confirmation instruction for the object service reminder, sends the reminder confirmation instruction to the server; The server, based on the reminder confirmation instruction, calls the associated service object according to the calling method corresponding to the associated service object to perform service processing according to the object service preference; The associated service object is configured according to the object service preference, so that the associated service object performs service processing based on the object service preference.

9. The vehicle-based service processing method according to claim 1, wherein the step of acquiring vehicle operation data and user interaction data and sending the data to the server comprises: The vehicle operation data and the user interaction voice are acquired and sent to the server.

10. The vehicle-based service processing method according to claim 9, wherein the target service object determination and service parameter generation comprises: Performing intention recognition on the user interaction voice to obtain interaction intention, and performing emotion recognition on the user interaction voice to obtain emotion category; Determine a recommended service object from the at least one candidate service object based on the interaction intention and the emotion category and generate a recommended service category for the recommended service object; generating a feedback voice according to the user interaction voice, the emotion category, the object identifier of the recommended service object, and the recommended service category; The announcement accessory is determined as a target service object, and the feedback voice is determined as a service parameter.

11. The vehicle-based service processing method according to claim 10, wherein the step of calling the target service object to perform service processing according to the service parameters in accordance with the calling mode corresponding to the target service object comprises: The feedback voice is sent to the announcement accessory so that the announcement accessory performs voice announcement of the feedback voice.

12. The vehicle-based service processing method according to claim 11, after the step of calling the target service object and performing the service processing according to the service parameters in accordance with the calling mode corresponding to the target service object, further comprising: If a confirmation instruction submitted by the user in response to the feedback voice is received, reading the object identifier and the recommended service category contained in the feedback voice; According to the calling method corresponding to the recommended service object, the recommended service object is called to perform service processing according to the recommended service category.

13. A vehicle-based service processing method, comprising: Receiving vehicle operation data and user interaction data sent by the vehicle terminal, and performing scene recognition based on the vehicle operation data to obtain a vehicle service scene; Determining at least one candidate service object matching the vehicle service scenario from a set of service objects bound to the vehicle; Inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine a target service object and generate service parameters, thereby obtaining the service parameters of the target service object; The service parameters of the target service object are returned to the vehicle terminal, so that the target service object is called according to the calling mode corresponding to the target service object to perform service processing according to the service parameters.

14. The vehicle-based service processing method according to claim 13, further comprising: Obtaining a vehicle data access instruction submitted by a user based on a user terminal; Based on the terminal identification carried by the vehicle data access instruction, interact with the vehicle terminal to obtain vehicle status data; or, Reading time data, writing the time data and the user identifier carried by the vehicle data access instruction into a generation prompt template for status data generation, and obtaining prompt text for prompting status data generation; The prompt text is input into the generative model to generate state data to obtain vehicle state data.

15. The vehicle-based service processing method according to claim 14, further comprising: The vehicle status data and the vehicle data access instruction are input into the generative model to generate response data, and the response data is obtained and sent to the user terminal.

16. The vehicle-based service processing method according to claim 15, wherein the response data generation comprises: Reading the user's historical amount of power to be charged according to the user identifier carried in the vehicle data access instruction; Detecting whether the vehicle charging time has arrived according to the vehicle power in the vehicle status data and the historical power to be charged; If not, the vehicle status data is determined as the response data.

17. The vehicle-based service processing method according to claim 16, if the result of the operation of detecting whether the vehicle charging time has arrived according to the vehicle power in the vehicle operation data and the historical power to be charged is yes, the following operations are performed: reading at least one preferred charging location of the user; Filtering a target charging position from the at least one preferred charging position according to the position data in the vehicle status data; The target charging position and the vehicle status data are determined as the response data.

18. A vehicle-based service processing device, comprising: a data sending module configured to obtain vehicle operation data and user interaction data and send them to a server, so as to perform scene recognition based on the vehicle operation data and determine at least one candidate service object based on the obtained vehicle service scene; A parameter receiving module, configured to receive the service parameters of the target service object returned by the server; The service parameters are obtained by inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate the service parameters; The object calling module is configured to call the target service object to perform service processing according to the service parameters in accordance with the calling mode corresponding to the target service object.

19. A vehicle-based service processing device, comprising: A data receiving module is configured to receive vehicle operation data and user interaction data sent by the vehicle terminal, and perform scene recognition based on the vehicle operation data to obtain a vehicle service scene; An object determination module is configured to determine at least one candidate service object matching the vehicle service scenario from a set of service objects bound to the vehicle; A parameter generation module is configured to input the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine a target service object and generate service parameters, thereby obtaining the service parameters of the target service object; The parameter returning module is configured to return the service parameters of the target service object to the vehicle terminal, so as to call the target service object to perform service processing according to the service parameters in accordance with the calling mode corresponding to the target service object.

20. A vehicle-based service processing device, comprising: processor; and a memory configured to store computer executable instructions, wherein the processor executes the computer executable instructions to implement the following process: Acquire vehicle operation data and user interaction data and send them to a server, so as to perform scene recognition based on the vehicle operation data, and determine at least one candidate service object based on the obtained vehicle service scene; Receive the service parameters of the target service object returned by the server; The service parameters are obtained by inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine the target service object and generate the service parameters; According to the calling mode corresponding to the target service object, the target service object is called to perform service processing according to the service parameters.

21. A vehicle-based service processing device, comprising: processor; and a memory configured to store computer executable instructions, wherein the processor executes the computer executable instructions to implement the following process: Receiving vehicle operation data and user interaction data sent by the vehicle terminal, and performing scene recognition based on the vehicle operation data to obtain a vehicle service scene; Determining at least one candidate service object matching the vehicle service scenario from a set of service objects bound to the vehicle; Inputting the object identification of each candidate service object, the vehicle operation data and the user interaction data into a generative model to determine a target service object and generate service parameters, thereby obtaining the service parameters of the target service object; The service parameters of the target service object are returned to the vehicle terminal, so that the target service object is called according to the calling mode corresponding to the target service object to perform service processing according to the service parameters.

22. A computer-readable storage medium for storing computer-executable instructions, wherein the computer-executable instructions implement the steps of the method according to claim 1 or 13 when executed.