Service recommendation method and device, terminal equipment and storage medium

Abstract

The invention provides a service recommendation method and device, terminal equipment and a storage medium, and is suitable for the technical field of data processing, and the method comprises the steps: obtaining historical cabin service use information, current cabin service use information and vehicle driving state information; performing mapping and enhancement processing on the historical cabin service use information, the current cabin service use information and the vehicle driving state information to generate driving individual behavior information; performing matching calculation on the driving individual behavior information and the driving group type information to obtain matched group type information and matching degree information; and generating service recommendation information according to the driving individual behavior information, the matching group type information, the matching degree information, a preset service recommendation model and preset prompt text information. According to the method, the information entertainment service demand of the driver can be accurately captured, and the accuracy and reliability of personalized service recommendation of the intelligent cockpit are effectively improved.

Description

Technical Field

[0001] The present application belongs to the field of data processing technology, and in particular, relates to a service recommendation method, apparatus, terminal device and storage medium. Background Art

[0002] Smart cars are becoming a new generation of smart terminals after personal computers and smartphones. As the "third space" and the main interface for human-vehicle interaction, the smart cockpit of a car is the field of automotive intelligent technology that is most easily understood, perceived and accepted by users, and will become a key node connecting people, cars and the environment. The interactive functions of the smart cockpit can be divided into three dimensions: driving control, riding comfort and infotainment. The infotainment field aims to provide value-added information services and entertainment, and is an important part of modern cars.

[0003] In the existing technology, smart cockpit infotainment service recommendations are mainly divided into three categories: collaborative filtering-based recommendations, content-based recommendations, and deep learning-based recommendations. Collaborative filtering-based recommendations aim to find similar behavior patterns of users to predict the possibility of future interactions, and are achieved by leveraging historical interaction behaviors between users and items; content-based recommendations achieve personalized recommendations through semantic analysis and feature label matching, which can solve the cold start problem; deep learning-based recommendations parse user behavior temporal features based on Transformer, GNN and other models, and support cross-modal content understanding.

[0004] However, the long-tail content discovery capability of collaborative filtering-based recommendations is limited by data sparsity and bias towards popular content; content-based recommendations run the risk of information narrowing, which may cause users to fall into a fixed content loop; deep learning-based recommendations have poor natural language comprehension capabilities and are mostly designed for a single task, resulting in unsatisfactory service recommendation results in complex situations. Summary of the invention

[0005] In view of this, the embodiments of the present application provide a service recommendation method, apparatus, terminal device and storage medium, aiming to solve the problems existing in the existing smart cockpit service recommendation technology that it cannot adapt to the complex interaction scenarios with multiple concurrent intentions in the cockpit and the service recommendation results are not targeted and accurate enough.

[0006] A first aspect of an embodiment of the present application provides a service recommendation method, including: Obtain historical cockpit service usage information, current cockpit service usage information, and vehicle driving status information; Mapping and enhancing the historical cockpit service usage information, current cockpit service usage information, and vehicle driving status information to generate individual driving behavior information; Perform matching calculation on the individual driving behavior information and the driving group type information to obtain matching group type information and matching degree information; The service recommendation information is generated according to the individual driving behavior information, the matching group type information, the matching degree information, the preset service recommendation model and the preset prompt text information.

[0007] A second aspect of an embodiment of the present application provides a service recommendation device, including: An information acquisition module is used to obtain historical cockpit service usage information, current cockpit service usage information, and vehicle driving status information; A driving individual behavior information generation module is used to map and enhance the historical cockpit service usage information, the current cockpit service usage information and the vehicle driving state information to generate driving individual behavior information; A matching calculation module, used for performing matching calculation on the driving individual behavior information and the driving group type information to obtain matching group type information and matching degree information; The service recommendation information generation module is used to generate service recommendation information according to the driving individual behavior information, matching group type information, matching degree information, a preset service recommendation model and preset prompt text information.

[0008] A third aspect of an embodiment of the present application provides a terminal device, which includes a memory and a processor, wherein the memory stores a computer program that can be executed on the processor, and when the processor executes the computer program, it implements the steps of the service recommendation method described in the first aspect above.

[0009] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium, comprising: a computer program stored therein, wherein when the computer program is executed by a processor, the steps of the service recommendation method described in the first aspect above are implemented.

[0010] Compared with the prior art, the embodiments of the present application have the following beneficial effects: the acquired multi-source information of the smart cockpit is mapped and enhanced, and converted into individual driving behavior information, so as to fully tap the data value, improve the availability and accuracy of the multi-source information, accurately characterize the driver's behavior characteristics, and match and calculate the individual driving behavior information with the driving group type information, so as to compensate for the sparsity of individual data by drawing on the group behavior rules, so that the service recommendation can take into account the needs of different types of drivers, and enhance the comprehensiveness of the recommendation, and then combine the service recommendation model and prompt text information to generate service recommendation content, so as to consider multiple factors to deeply analyze the driver's potential needs, so as to accurately capture the driver's infotainment service needs, and effectively improve the accuracy and reliability of the smart cockpit in making personalized service recommendations in complex scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0012] Figure 1 This is a schematic diagram of the implementation process of the service recommendation method provided in Example 1 of the present application; Figure 2 This is a schematic diagram of the implementation flow of the service recommendation method provided in Example 2 of the present application; Figure 3 This is a schematic diagram of the implementation flow of the service recommendation method provided in Example 3 of the present application; Figure 4 This is a schematic diagram of the implementation flow of the service recommendation method provided in Embodiment 4 of the present application; Figure 5 This is a schematic diagram of the implementation flow of the service recommendation method provided in Embodiment 5 of the present application; Figure 6 This is a schematic diagram of the implementation flow of the service recommendation method provided in Example 6 of the present application; Figure 7 is a schematic diagram of the structure of a service recommendation device provided in an embodiment of the present application; Figure 8 It is a schematic diagram of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0013] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0014] In order to illustrate the technical solution described in this application, a specific embodiment is provided below for illustration.

[0015] Figure 1 The following is a flowchart of the implementation of the service recommendation method provided in the first embodiment of the present application, which is described in detail as follows: Step S101, obtaining historical cockpit service usage information, current cockpit service usage information and vehicle driving status information.

[0016] In this embodiment, the cockpit service usage information may refer to the driver's usage behavior information of the cockpit infotainment service (such as music, radio, navigation, etc.) automatically collected by the smart cockpit. The historical cockpit service usage information may refer to the driver's usage behavior information of the cockpit infotainment service (such as music, radio, navigation, etc.) automatically collected by the smart cockpit during the past driving process; the current cockpit service usage information may refer to the driver's usage behavior information of the cockpit infotainment service (such as music, radio, navigation, etc.) automatically collected by the smart cockpit during the current driving process. The vehicle driving state information may refer to the vehicle's driving speed, power mode, and other information used to characterize the state of the vehicle during driving. Among them, the cockpit service usage information is matched with the vehicle driving state information in real time. It can be understood that the mixed cockpit multi-source information may need to be processed by pre-processing techniques such as rule-based state specification and behavior noise reduction, and then associated according to the time sequence to form time series data, and then the next step of calculation and processing is performed.

[0017] In this embodiment, optionally, the historical cockpit service usage information may include historical communication service usage information and historical entertainment service usage information. The historical communication service usage information may refer to information used to characterize the driver's use of phone calls or navigation during the past driving of the vehicle, and the historical entertainment service usage information may refer to information used to characterize the driver's use of entertainment behaviors such as listening to music, listening to the radio, or watching videos during the past driving of the vehicle. Therefore, the historical entertainment service usage information may specifically include historical music playback information, historical radio playback information, and historical video playback information. The current cockpit service usage information may include current communication service usage information and current entertainment service usage information. The current communication service usage information may refer to information used to characterize the driver's use of phone calls or navigation during the current driving of the vehicle, and the current entertainment service usage information may refer to information used to characterize the driver's use of entertainment behaviors such as listening to music, listening to the radio, or watching videos during the current driving of the vehicle. Therefore, the current entertainment service usage information may specifically include current music playback information, current radio playback information, and current video playback information.

[0018] Step S102 , mapping and enhancing the historical cockpit service usage information, the current cockpit service usage information and the vehicle driving state information to generate individual driving behavior information.

[0019] In this embodiment, the historical cockpit service usage information and the current cockpit service usage information may be mapped to the corresponding vehicle driving state information, and then the information enhancement processing and text generation operation are performed through the preset state behavior conversion function and the feature text representation function, and then according to the information attributes and specific rules, the historical cockpit service usage information, the current cockpit service usage information and the vehicle driving state information are converted into text information in a unified format as the driving individual behavior information, thereby generating a data set for the preset service recommendation model to calculate. Among them, the information attributes may include state attributes, behavior attributes and cross attributes; the specific rules may include special interaction attribute deletion rules and behavior state matching rules. The driving individual behavior information may be information used to characterize the service usage of a specific driver in the smart cockpit.

[0020] In this embodiment, the driving personal behavior information can be expressed as the current moment Driving time information , vehicle driving status information , corresponding to the driver Historical behavior sequence A collection of: ; Driving time information Including the current time , boarding time , idling time : ; Vehicle driving status information Including vehicle operating status , infotainment system status : ; The vehicle running status Including vehicle speed , power mode , driving stage : ; Infotainment System Status Including navigation open state , navigation usage time , map zoom status , phone answering status , music playing status , radio station playing status , video playback status : ; Historical behavior sequence Used to record the specific content of the driver's above 5 historical interactions.

[0021] Step S103, performing matching calculation on the individual driving behavior information and the driving group type information to obtain matching group type information and matching degree information.

[0022] In this embodiment, the driving group behavior information may be information used to characterize the service usage of multiple drivers in the smart cockpit, wherein the driving group may include drivers with different service usage habits, such as some drivers are used to listening to music while driving during the day, some drivers are used to listening to the radio while driving during the day, some drivers are used to making phone calls while driving in the afternoon, and some drivers are used to playing videos while driving in the afternoon. The driving group may also represent drivers with different driving behavior patterns, such as commuter drivers, professional drivers, leisure drivers, and other driving behavior patterns. It may be by calculating the similarity between the driving individual behavior information and the driving group type information, and then filtering the similarity to achieve matching calculation, so that the driving individual is matched in the driving group, and the driving group type to which the current driving individual belongs and the matching degree with the driving group type are obtained, that is, the matching group type information and the matching degree information. Among them, the calculated similarity may be cosine similarity.

[0023] Step S104, generating service recommendation information according to the individual driving behavior information, matching group type information, matching degree information, a preset service recommendation model and preset prompt text information.

[0024] In this embodiment, the preset service recommendation model can be set based on the LLM model. The preset prompt text information can be manually set to specify the range of the service recommendation model output content to avoid the service recommendation model outputting redundant information. It can be that the driving individual behavior information, matching group type information and matching degree information are used as the input data of the service recommendation model, and the prompt text information is set to limit the range of the output data of the service recommendation model, so as to generate service recommendation information for pushing service content to the driver, such as displaying inquiry information to the driver through the display device: "Do you need to turn on the navigation?" "Do you need to play music?" The service recommendation method provided in the embodiment of the present application maps and enhances the acquired multi-source information of the smart cockpit, converts it into individual driving behavior information, fully explores the value of data, improves the availability and accuracy of multi-source information, accurately describes the driver's behavior characteristics, and matches and calculates the individual driving behavior information with the driving group type information, so as to make up for the sparsity of individual data by drawing on the rules of group behavior, so that service recommendations can take into account the needs of different types of drivers and enhance the comprehensiveness of recommendations. Then, the service recommendation model and prompt text information are combined to generate service recommendation content, so as to consider multiple factors and deeply analyze the driver's potential needs, thereby accurately capturing the driver's infotainment service needs and effectively improving the accuracy and reliability of personalized service recommendations of the smart cockpit in complex scenarios.

[0025] Figure 2 The following is a flowchart of the service recommendation method provided in the second embodiment of the present application, which differs from the first embodiment in that: The driving group type information is obtained by the following steps: Step S201, obtaining multiple driver behavior information and historical vehicle driving status information.

[0026] In this embodiment, the driver behavior information and historical vehicle driving status information can be automatically collected by the smart cockpit. The driver behavior information can be information used to characterize the service usage of multiple drivers in the smart cockpit, and can include the current time. Driving time information , vehicle driving status information , corresponding to the driver Historical behavior sequence The historical vehicle driving state information may be information representing the state of the vehicle during past driving, and may include vehicle operation state information and infotainment service usage state information during past driving, that is, it may include vehicle driving speed information, power mode information, driving stage information, navigation start state information, navigation usage time information, map zoom state information, call answering state information, music playing state information, radio playing state information, and video playing state information during the driving process recorded in the history.

[0027] Step S202: clustering the plurality of driver behavior information and historical vehicle driving state information, and calculating behavior occurrence frequency information and vehicle driving state statistical information.

[0028] In this embodiment, the driver behavior information may be clustered based on the K-means algorithm, and then the vehicle driving state information corresponding to the driver behavior information may be extracted from the historical vehicle driving state information, and then the occurrence frequency information of each driver behavior information in the past driving records and the vehicle driving state statistical information may be counted. The occurrence frequency information may be the average frequency.

[0029] Step S203 , extracting and integrating the driver behavior information according to the behavior occurrence frequency information and the vehicle driving state statistical information to obtain a plurality of driving group behavior information.

[0030] In this embodiment, based on the behavior occurrence frequency information and the vehicle driving status statistical information, feature extraction can be performed on the typical group behavior pattern in the driver behavior information, and the extracted features can be integrated into multiple driving behavior information as driving group behavior information.

[0031] Step S204: obtaining driving group type information according to the plurality of driving group behavior information.

[0032] In this embodiment, different driving group behavior information may be marked as behavior information of drivers with different types of service usage, thereby generating driving group type information.

[0033] The service recommendation method provided in the embodiment of the present application clusters multiple driver behavior information and historical vehicle driving status information to effectively mine data patterns, extract key features from massive driver behavior information and historical vehicle driving status information, enhance the availability of multi-source information in the cockpit, extract and integrate the clustered driver behavior information, generate driving group type information for matching with individual driving information, thereby introducing the driving group type as a supplementary reference for individual driving information in subsequent calculations, and providing reliable data support for accurate cockpit service recommendations.

[0034] Figure 3 The following is a flowchart of the implementation of the service recommendation method provided in the third embodiment of the present application, which differs from the first embodiment described above in that: The preset service recommendation model includes a preset residual connection layer, a preset normalization processing layer, and a plurality of preset service information encoding and decoding layers; The step S104 specifically includes: Step S301, generating service recommendation word vector information according to the individual driving behavior information, matching group type information, matching degree information and preset prompt text information.

[0035] In this embodiment, the individual driving behavior information, matching group type information, matching degree information and preset prompt text information may be subjected to text encoding processing through the encoding layer in the LLM model to generate service recommendation word vector information.

[0036] Step S302: Project the service recommendation word vector information according to a preset spatial weight coefficient to obtain a service recommendation projection vector.

[0037] In this embodiment, the preset spatial weight coefficients may be query weight coefficients, key weight coefficients, and value weight coefficients obtained after pre-training the multi-head attention mechanism model. The service recommendation word vector may be obtained by multiplying the multiple spatial weight coefficients with the service recommendation word vectors, and then scaling, aggregating, and linearly projecting the attention weights based on the multi-head attention mechanism to obtain the service recommendation projection vector.

[0038] Attention Weight The calculation method can be expressed as: ; The query vector Represents the multiplication result of the query weight coefficient and the service recommendation word vector, key vector Represents the multiplication result of the key weight coefficient and the service recommendation word vector, and the value vector Represents the multiplication result of the value weight coefficient and the service recommendation word vector, represents the calculation of multi-head attention weights for query vector, key vector and value vector, represents the normalization to probability distribution along the key vector dimension, with scaling factor Used to prevent the dot product value from being too large, causing the gradient to be unstable.

[0039] The linear projection can be expressed as: ; in, Used to represent the projection splicing function based on the multi-head attention mechanism, It is used to indicate that the elements are concatenated, h represents the number of heads in the multi-head attention mechanism, It can be an output projection matrix, it can be preset, or it can be obtained by training a multi-head attention mechanism.

[0040] Step S303: Based on a preset residual connection layer and a preset normalization processing layer, the service recommendation projection vector is calculated to obtain a service recommendation projection variable.

[0041] In this embodiment, the preset residual connection layer may be a residual connection layer in the LLM model architecture, and the preset normalization processing layer may be a normalization processing layer in the LLM model architecture. The service recommendation projection vector is first used as input data of the residual connection layer, and the intermediate variable obtained by the residual connection layer is used as input data of the normalization processing layer, and the result calculated by the normalization processing layer is used as the service recommendation projection variable.

[0042] Step S304: Generate a service recommendation content vector according to the service recommendation projection variable and a plurality of preset service information encoding and decoding layers.

[0043] In this embodiment, the preset service information encoding and decoding layer may be a service information encoding and decoding layer in the LLM model architecture. The service recommendation projection variable may be used as input data of the service information encoding and decoding layer, and the result calculated by the service information encoding and decoding layer may be used as the service recommendation content vector.

[0044] Step S305: Generate service recommendation information according to the service recommendation content vector.

[0045] In this embodiment, the service recommendation content vector may be formatted, and the vector form may be converted into a text form for output to obtain the service recommendation information.

[0046] The service recommendation method provided in the embodiment of the present application comprehensively reflects the service demand characteristics of the driver by integrating multi-dimensional key information, effectively highlights the key features in the multi-source information of the cockpit by transforming the word vector, optimizes the expression of the multi-source information of the cockpit, and is used to enhance the pertinence of the service recommendation. The projection variables are calculated by the residual connection layer and the normalization processing layer to ensure the stable transmission of the multi-source information of the cockpit and the retention of key features during the calculation process, thereby improving the accuracy and reliability of the cockpit service recommendation.

[0047] Figure 4 The flowchart of the service recommendation method provided in the fourth embodiment of the present application is shown, which differs from the third embodiment in that: A preset service information encoding and decoding layer includes a plurality of preset service recommendation gating matrices and a plurality of preset service recommendation expert sub-models; the preset service recommendation gating matrices correspond to the preset service recommendation expert sub-models one by one; The step S304 specifically includes: Step S401, obtaining the initial recommended number of encoding and decoding layers.

[0048] In this embodiment, the recommended calculation encoding and decoding layer may be designed based on the Transformer. The initial recommended calculation encoding and decoding layer number may refer to the number of layers of the currently calculated Transformer.

[0049] Step S402: Count the number of preset service information encoding and decoding layers to obtain encoding and decoding layer number information.

[0050] In this embodiment, the service information encoding and decoding layer can be designed based on Transformer. The number of preset service information encoding and decoding layers can be the number of Transformer layers in the LLM model, and the number of service information encoding and decoding layers can be 32, and the statistically obtained encoding and decoding layer number information is 32.

[0051] Step S403, determining whether the number of initially recommended calculated encoding and decoding layers is less than the encoding and decoding layer quantity information; if not, proceeding to step S404; if yes, proceeding to step S405.

[0052] In this embodiment, it can be understood that in the LLM model, the multi-layer Transformer is calculated layer by layer. When the number of encoding and decoding layers for the initial recommendation calculation is less than the number of encoding and decoding layers, it means that the calculation has not been performed through all Transformer layers, and it is necessary to continue to input the calculation result of the previous Transformer layer into the next Transformer layer for calculation until all Transformer layers are calculated; when the number of encoding and decoding layers for the initial recommendation calculation is equal to the number of encoding and decoding layers, it means that all Transformer layers are calculated, and the service recommendation projection variable can be output as the service recommendation content vector.

[0053] Step S404: taking the service recommendation projection variable as a service recommendation content vector.

[0054] In this embodiment, when the number of encoding and decoding layers of the initial recommendation calculation is equal to the number of encoding and decoding layers, it means that all Transformer layers have been calculated, and the service recommendation projection variable can be output as the service recommendation content vector.

[0055] Step S405 , selecting a plurality of preset service recommendation expert sub-models according to a preset service recommendation gating matrix to obtain a plurality of service recommendation calculation sub-models.

[0056] In this embodiment, the preset service recommendation gating matrix can be manually set or calculated by the LLM model during the training process. The sub-model in the LLM model can be selected and processed based on the LoRA mechanism and the MoE architecture, wherein the MoE architecture includes multiple service recommendation expert sub-models, and the service recommendation expert sub-model in the MoE architecture is screened through the LoRA mechanism, and the screened sub-model is the service recommendation calculation sub-model. Specifically, the weights of each service recommendation expert sub-model can be calculated through the service recommendation gating matrix, and then the two service recommendation expert sub-models with the largest weights are selected as the service recommendation calculation sub-models for subsequent calculations.

[0057] Step S406: Generate a service recommendation content intermediate variable according to the service recommendation projection variable, a plurality of service recommendation calculation sub-models, and a plurality of service recommendation gating matrices.

[0058] In this embodiment, the service recommendation expert sub-model can be in one-to-one correspondence with the service recommendation gating matrix. In the calculation process, the service recommendation projection variable is first calculated with the service recommendation gating matrix corresponding to the service recommendation calculation sub-model, and then the calculation result is used as the input data of the service recommendation calculation sub-model. The result calculated by the service recommendation calculation sub-model is the service recommendation content intermediate variable.

[0059] Step S407, updating the initial recommended number of calculation encoding and decoding layers to obtain the intermediate recommended number of calculation encoding and decoding layers.

[0060] In this embodiment, the current Transformer layer has been calculated, and the current initial recommendation calculation encoding and decoding layer number needs to be incrementally calculated, and the calculation result is used as the intermediate recommendation calculation encoding and decoding layer number, so that the service recommendation content intermediate variable is used as the input variable of the next Transformer layer for calculation.

[0061] Step S408, using the intermediate recommendation calculation encoding and decoding layer number as the initial recommendation calculation encoding and decoding layer number, using the service recommendation content intermediate variable as the service recommendation projection variable, and returning to step S403.

[0062] In this embodiment, the current recommendation calculation coding and decoding layer and the calculation intermediate variables are updated to input the calculation result of the previous recommendation calculation coding and decoding layer into the next recommendation calculation coding and decoding layer for calculation until all the recommendation calculation coding and decoding layers are calculated.

[0063] In this embodiment, it is optional to recommend that the encoding and decoding layer to be calculated is a Transformer layer, and the calculation result of the previous Transformer layer is input into the next Transformer layer for calculation until all Transformer layers are calculated.

[0064] The service recommendation method provided in the embodiment of the present application performs feature extraction on the service recommendation projection variables, comprehensively captures the key features in the multi-source information of the cockpit, improves the accuracy of predicting the driver's potential infotainment intentions, and performs selection processing through multiple preset service recommendation expert sub-models. There is no need to calculate all the service recommendation expert sub-models, thereby reducing the calculation time and computing overhead, so as to effectively improve the efficiency of service recommendations and reduce the cost of service recommendations while ensuring the accuracy of the service recommendation content.

[0065] Figure 5 The flowchart of the service recommendation method provided in the fifth embodiment of the present application is shown. The difference between the fifth embodiment and the fourth embodiment is that the step S405 specifically includes: Step S501, calculating multiple service recommendation sub-model selection weights according to the service recommendation projection vector and a preset service recommendation gating matrix.

[0066] In this embodiment, the service recommendation projection vector may be multiplied by a preset service recommendation gating matrix, and the multiplication result is used as the service recommendation sub-model selection weight.

[0067] Step S502: Arrange the plurality of service recommendation sub-model selection weights in descending order to obtain sub-model selection weight sequence information.

[0068] In this embodiment, the service recommendation sub-model selection weights may be arranged in descending order as elements, and the arranged information may be output as a sequence, namely, sub-model selection weight sequence information.

[0069] Step S503: based on the preset number of service recommendation expert sub-models, the sub-model selection weight sequence information is selected to obtain a plurality of selected sub-model weight information.

[0070] In this embodiment, the number of preset service recommendation expert sub-models may be manually set, and may be 2. The first two elements of the sub-model selection weight sequence information may be selected as the weight information of the selected sub-model.

[0071] Step S504, determining a plurality of service recommendation expert sub-models corresponding to the weight information of the plurality of selected sub-models, and obtaining a plurality of service recommendation calculation sub-models.

[0072] In this embodiment, the service recommendation expert sub-model corresponding to the selected sub-model weight information is used as the selected sub-model, ie, the service recommendation calculation sub-model, for calculating the service recommendation projection vector.

[0073] In this embodiment, optionally, the input features are compressed into a low-dimensional space through a projection vector through the LoRA mechanism, and then the original dimension is restored through an up-projection vector to form a dynamic weight disturbance. The weight of the service recommendation expert sub-model is dynamically allocated based on the real-time input driving individual behavior characteristics and vehicle driving status characteristics through the MoE mechanism.

[0074] The service recommendation method provided in the embodiment of the present application calculates the service recommendation sub-model selection weight to screen the service recommendation expert sub-model, thereby avoiding the large calculation delay and computing overhead caused by calculating all sub-models, improving the efficiency of smart cockpit service recommendation, and reducing the hardware and software costs of smart cockpit service recommendation.

[0075] Figure 6 The flowchart of the service recommendation method provided in the sixth embodiment of the present application is shown, which differs from the fourth embodiment in that: The service recommendation information calculation sub-model includes a plurality of connection weight matrices; The step S406 specifically includes: Step S601, performing low-rank decomposition processing on the connection weight matrix to obtain a low-rank decomposition matrix.

[0076] In this embodiment, the connection weight matrix may be present in each expert sub-model of the Transformer layer. The connection weight matrix may be subjected to low-rank decomposition through the LoRA mechanism, and the matrix obtained after decomposition is used as the low-rank decomposition matrix for subsequent calculations.

[0077] Step S602: Calculate a service recommendation variable decomposition matrix according to the low-rank decomposition matrix and the service recommendation projection variables.

[0078] In this embodiment, the service recommendation variable decomposition matrix may be obtained by multiplying the low-rank decomposition matrix and the service recommendation projection variable.

[0079] Step S603: Generate service recommendation content intermediate variables according to the service recommendation projection variables, the connection weight matrix, the service recommendation variable decomposition matrix and the selected sub-model weight information.

[0080] In this embodiment, the service recommendation projection variable may be multiplied layer by layer through the connection weight matrix, the service recommendation variable decomposition matrix and the selected sub-model weight information, and the calculation result is used as the intermediate variable of the service recommendation content.

[0081] In this embodiment, optionally, the low-rank fine-tuning characteristics of LoRA are deeply combined with the dynamic routing mechanism of MoE. The input features are compressed into a low-dimensional space through the projection vector by the LoRA module. The MoE mechanism dynamically allocates the weights of the service recommendation expert sub-model based on the real-time input features.

[0082] The service recommendation method provided in the embodiment of the present application adds a low-rank update matrix to each layer of the service recommendation model through low-rank matrix decomposition, so as to adjust the parameters of only a few service recommendation expert sub-models in each layer, avoiding adjusting all parameters of all service recommendation expert sub-models, greatly reducing the consumption of computing resources and training time, and dynamically calculating the weight information of the selected sub-model, so as to more flexibly select the service recommendation expert sub-model for calculation, so as to more accurately predict the driver's potential infotainment intention when facing different driving scenarios and driver needs, thereby improving the accuracy and efficiency of service recommendations.

[0083] Corresponding to the method of the above embodiment, Figure 7 A structural block diagram of a service recommendation device provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown. Figure 7 The exemplary service recommendation device may be an execution subject of the service recommendation method provided in the aforementioned first embodiment.

[0084] Reference Figure 7 , the service recommended devices include: The information acquisition module 710 is used to acquire historical cockpit service usage information, current cockpit service usage information and vehicle driving status information; The driving individual behavior information generating module 720 is used to map and enhance the historical cockpit service usage information, the current cockpit service usage information and the vehicle driving state information to generate the driving individual behavior information; A matching calculation module 730 is used to perform matching calculation on the driving individual behavior information and the driving group type information to obtain matching group type information and matching degree information; The service recommendation information generation module 740 is used to generate service recommendation information according to the individual driving behavior information, matching group type information, matching degree information, a preset service recommendation model and preset prompt text information.

[0085] The process of each module in the service recommendation device provided in the embodiment of the present application realizing its own function can be specifically referred to in the above Figure 1 The description of the first embodiment is not repeated here.

[0086] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0087] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0088] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0089] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0090] In addition, in the description of the present specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish descriptions, and cannot be understood as indicating or suggesting relative importance. It should also be understood that although the terms "first", "second", etc. are used to describe various elements in some embodiments of the present application in the text, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, the first table can be named as the second table, and similarly, the second table can be named as the first table without departing from the scope of the various described embodiments. The first table and the second table are both tables, but they are not the same table.

[0091] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0092] The service recommendation method provided in the embodiment of the present application can be applied to terminal devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc. The embodiment of the present application does not impose any restrictions on the specific type of terminal devices.

[0093] For example, the terminal device can be a station (STAION, ST) in a WLAN, a cellular phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a Wireless Local Loop (WLL) station, a Personal Digital Assistant (PDA) device, a handheld device with wireless communication function, a computing device or other processing device connected to a wireless modem, a vehicle-mounted device, a vehicle networking terminal, a computer, a laptop computer, a handheld communication device, a handheld computing device, a satellite wireless device, a wireless modem card, a TV set top box (STB), a customer premises equipment (CPE) and / or other devices for communicating on a wireless system and a next-generation communication system, such as a mobile terminal in a 5G network or a mobile terminal in a future evolved Public Land Mobile Network (PLMN) network, etc.

[0094] As an example but not limitation, when the terminal device is a wearable device, the wearable device can also be a general term for wearable devices that are intelligently designed and developed using wearable technology for daily wear, such as glasses, gloves, watches, clothing and shoes. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothes or accessories. Wearable devices are not just hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction. Broadly speaking, wearable smart devices include those that are fully functional, large in size, and can achieve complete or partial functions without relying on smartphones, such as smart watches or smart glasses, as well as those that only focus on a certain type of application function and need to be used in conjunction with other devices such as smartphones, such as various smart bracelets and smart jewelry for vital sign monitoring.

[0095] Figure 8 Schematic diagram of the structure of a terminal device provided by an embodiment of the present application. Figure 8 As shown, the terminal device 8 of this embodiment includes: at least one processor 80 ( Figure 8 Only one is shown in the figure), a memory 81, in which a computer program 82 that can be run on the processor 80 is stored. When the processor 80 executes the computer program 82, the steps in the above-mentioned service recommendation method embodiments are implemented, such as Figure 1 Alternatively, when the processor 80 executes the computer program 82, the functions of each module / unit in the above-mentioned device embodiments are realized, for example, Figure 7 Functions of modules 710 to 740 are shown.

[0096] The terminal device 8 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The terminal device may include, but is not limited to, a processor 80 and a memory 81. Those skilled in the art will appreciate that Figure 8 It is only an example of the terminal device 8 and does not constitute a limitation of the terminal device 8. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal device may also include an input sending device, a network access device, a bus, etc.

[0097] The processor 80 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0098] In some embodiments, the memory 81 may be an internal storage unit of the terminal device 8, such as a hard disk or memory of the terminal device 8. The memory 81 may also be an external storage device of the terminal device 8, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device 8. Further, the memory 81 may also include both an internal storage unit and an external storage device of the terminal device 8. The memory 81 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program, etc. The memory 81 may also be used to temporarily store data that has been sent or is to be sent.

[0099] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0100] An embodiment of the present application also provides a terminal device, which includes at least one memory, at least one processor, and a computer program stored in the at least one memory and executable on the at least one processor, wherein when the processor executes the computer program, the terminal device implements the steps in any of the above-mentioned method embodiments.

[0101] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0102] An embodiment of the present application provides a computer program product. When the computer program product is run on a terminal device, the terminal device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0103] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device that can carry the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc.

[0104] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0105] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0106] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0107] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A service recommendation method, characterized in that: include: Obtain historical cockpit service usage information, current cockpit service usage information, and vehicle driving status information; Mapping and enhancing the historical cockpit service usage information, current cockpit service usage information, and vehicle driving status information to generate individual driving behavior information; Perform matching calculation on the individual driving behavior information and the driving group type information to obtain matching group type information and matching degree information; The service recommendation information is generated according to the individual driving behavior information, the matching group type information, the matching degree information, the preset service recommendation model and the preset prompt text information.

2. The service recommendation method according to claim 1, characterized in that: The driving group type information is obtained by the following steps: Obtain multiple driver behavior information and historical vehicle driving status information; Clustering the plurality of driver behavior information and historical vehicle driving state information, and calculating behavior occurrence frequency information and vehicle driving state statistical information; Extracting and integrating the driver behavior information according to the behavior occurrence frequency information and the vehicle driving state statistical information to obtain multiple driving group behavior information; According to the plurality of driving group behavior information, driving group type information is obtained.

3. The service recommendation method according to claim 1, characterized in that: The preset service recommendation model includes a preset residual connection layer, a preset normalization processing layer, and a plurality of preset service information encoding and decoding layers; The step of generating service recommendation information according to the driving individual behavior information, matching group type information, matching degree information, a preset service recommendation model and preset prompt text information specifically includes: Generate service recommendation word vector information according to the individual driving behavior information, matching group type information, matching degree information and preset prompt text information; Projecting the service recommendation word vector information according to a preset spatial weight coefficient to obtain a service recommendation projection vector; Based on a preset residual connection layer and a preset normalization processing layer, the service recommendation projection vector is calculated to obtain a service recommendation projection variable; Generate a service recommendation content vector according to the service recommendation projection variable and a plurality of preset service information encoding and decoding layers; Generate service recommendation information according to the service recommendation content vector.

4. The service recommendation method according to claim 3, characterized in that: A preset service information encoding and decoding layer includes a plurality of preset service recommendation gating matrices and a plurality of preset service recommendation expert sub-models; the preset service recommendation gating matrices correspond to the preset service recommendation expert sub-models one by one; The step of generating a service recommendation content vector according to the service recommendation projection variable and a plurality of preset service information encoding and decoding layers specifically includes: Get the initial recommended number of encoding and decoding layers; Counting the number of preset service information encoding and decoding layers to obtain encoding and decoding layer number information; Determine whether the number of initially recommended calculated encoding and decoding layers is less than the encoding and decoding layer number information; If not, taking the service recommendation projection variable as the service recommendation content vector; If so, multiple preset service recommendation expert sub-models are selected according to the preset service recommendation gating matrix to obtain multiple service recommendation calculation sub-models; Generate a service recommendation content intermediate variable according to the service recommendation projection variable, a plurality of service recommendation calculation sub-models, and a plurality of service recommendation gating matrices; Update the initial recommended calculation encoding and decoding layer number to obtain the intermediate recommended calculation encoding and decoding layer number; The intermediate recommendation calculation encoding and decoding layer number is used as the initial recommendation calculation encoding and decoding layer number, the service recommendation content intermediate variable is used as the service recommendation projection variable, and the step of determining whether the initial recommendation calculation encoding and decoding layer number is less than the encoding and decoding layer number information is returned.

5. The service recommendation method according to claim 4, characterized in that: The step of selecting a plurality of preset service recommendation expert sub-models according to a preset service recommendation gating matrix to obtain a plurality of service recommendation calculation sub-models specifically includes: Calculating multiple service recommendation sub-model selection weights according to the service recommendation projection vector and a preset service recommendation gating matrix; Arrange the selection weights of the plurality of service recommendation sub-models in descending order to obtain sub-model selection weight sequence information; Based on the preset number of service recommendation expert sub-models, the sub-model selection weight sequence information is selected to obtain a plurality of selected sub-model weight information; A plurality of service recommendation expert sub-models corresponding to the weight information of the plurality of selected sub-models are determined to obtain a plurality of service recommendation calculation sub-models.

6. The service recommendation method according to claim 4, characterized in that: The service recommendation information calculation sub-model includes a plurality of connection weight matrices; The step of generating the service recommendation content intermediate variable according to the service recommendation projection variable, the plurality of service recommendation information calculation sub-models and the plurality of service recommendation gating matrices specifically includes: Performing low-rank decomposition processing on the connection weight matrix to obtain a low-rank decomposition matrix; Calculating a service recommendation variable decomposition matrix according to the low-rank decomposition matrix and the service recommendation projection variable; The service recommendation content intermediate variable is generated according to the service recommendation projection variable, the connection weight matrix, the service recommendation variable decomposition matrix and the selected sub-model weight information.

7. The service recommendation method according to claim 1, characterized in that: The historical cockpit service usage information includes historical communication service usage information and historical entertainment service usage information; The historical entertainment service usage information includes historical music playback information, historical radio playback information, and historical video playback information; The current cockpit service usage information includes current communication service usage information and current entertainment service usage information; The current entertainment service usage information includes current music playing information, current radio playing information and current video playing information; The vehicle driving state information includes vehicle driving speed information, vehicle power mode information and vehicle driving stage information.

8. A service recommendation device, characterized in that: include: An information acquisition module is used to obtain historical cockpit service usage information, current cockpit service usage information, and vehicle driving status information; A driving individual behavior information generation module is used to map and enhance the historical cockpit service usage information, the current cockpit service usage information and the vehicle driving state information to generate driving individual behavior information; A matching calculation module, used for performing matching calculation on the driving individual behavior information and the driving group type information to obtain matching group type information and matching degree information; The service recommendation information generation module is used to generate service recommendation information according to the driving individual behavior information, matching group type information, matching degree information, a preset service recommendation model and preset prompt text information.

9. A terminal device, characterized in that: The terminal device includes a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images