Customer pushing method and system for vehicle-mounted system
By generating user profiles in the in-vehicle system and pushing multimodal services in real time, the problems of inconvenient operation of the in-vehicle system and insufficient integration of financial services are solved, improving the convenience and safety of driving, and realizing accurate service recommendations and user operation optimization.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- CHINA CITIC BANK CO LTD
- Filing Date
- 2025-12-31
- Publication Date
- 2026-05-01
AI Technical Summary
Existing in-vehicle systems fail to effectively integrate financial services, resulting in inconvenience for users while driving, increasing driving risks, and failing to fully utilize vehicle dynamic data to improve the interactive experience.
By acquiring vehicle-mounted data and user information, big data computing is used to generate user profiles, and related services are pushed in real time based on these profiles. Combined with multimodal interaction methods, including natural language processing, graphics processing, and speech synthesis, the interaction methods are dynamically adjusted to form a closed-loop mechanism of recommendation-feedback-analysis.
It improves the ease of operation and safety during driving, enables accurate financial service recommendations, reduces reliance on touchscreens, and optimizes user operation strategies.
Smart Images

Figure CN121967523A_ABST
Abstract
Description
A customer push method and system for in-vehicle systems Technical Field
[0001] This invention relates to the field of multimodal analysis technology, and in particular to a customer push method and system for vehicle systems. Background Technology
[0002] In recent years, car owners have significantly increased their car usage time, and in-vehicle systems have become a new terminal in the intelligent connected ecosystem. Consumers' driving time, dwell time, and usage frequency have increased significantly, and the in-vehicle ecosystem is showing a trend of openness, sharing, and intelligence. Through technologies such as mobile internet, intelligent AI, and voice recognition, an open intelligent vehicle platform is built to fully connect people, cars, life, and society.
[0003] Existing in-vehicle systems focus on basic connectivity functions and do not integrate financial services or deeply integrate vehicle-to-machine interaction. Users cannot easily access card services while driving, requiring them to switch to their mobile devices, which leads to inconvenience and increases driving risks. Furthermore, they do not adequately utilize vehicle dynamic data (such as location and power consumption) and fail to incorporate multimodal AI to enhance the interactive user experience. Summary of the Invention
[0004] To address the shortcomings of existing technologies, this invention establishes a tool for car owner management, providing precise recommendations for car owner services. It upgrades the human-vehicle interaction mode by combining a multimodal large language model, improving the convenience and safety of interaction during driving. By collecting user service feedback, it forms a closed loop of service data of "recommendation-feedback-analysis", improves user profiles, and forms a refined car owner customer group operation.
[0005] To achieve the above objectives, the technical solution adopted by the present invention includes:
[0006] A customer push method for an in-vehicle system, characterized in that it includes:
[0007] S1. Obtain vehicle system data, including vehicle location, environmental data, power consumption, mileage, and vehicle speed; User login, obtain logged-in user information;
[0008] S2. Transmit the vehicle data and user information to the server and use big data calculations to obtain a user profile;
[0009] S3. Push relevant services in real time based on the user profile;
[0010] S4. Receive user feedback on push-related services and adjust push services based on user feedback data.
[0011] Furthermore, the user login method includes QR code login, which includes:
[0012] Generate a login QR code and associate it with a session ID, then use a polling mechanism to check the status of the session ID;
[0013] The user scans the QR code to confirm login; a success indicator is returned upon successful login.
[0014] After successful login, you will be automatically redirected to the main interface.
[0015] Furthermore, before transmitting the vehicle system data and user information to the server and using big data calculations to obtain a user profile, the process includes:
[0016] The vehicle data and user information are preprocessed to obtain their features.
[0017] Furthermore, the step of transmitting the vehicle system data and user information to the server and using big data calculations to obtain a user profile includes:
[0018] Distributed computing is used to perform parallel computation on preprocessed vehicle data and user information, and user profiles are generated based on the features of vehicle data and user information;
[0019] Store the user profile and retain the API call interface.
[0020] Furthermore, the real-time push of related services based on the user profile includes:
[0021] Receive user profiles and real-time vehicle system data;
[0022] Match push conditions and trigger related service push logic based on predefined rule sets;
[0023] The push method is selected based on real-time vehicle system data, and multimodal push is executed. The multimodal push includes generating push text through natural language processing, generating push images through image processing, and generating push voice through speech synthesis technology.
[0024] Furthermore, receiving user feedback on push-related services and adjusting the push service based on user feedback data includes:
[0025] Collect user feedback data through a multimodal interface;
[0026] User tags are obtained based on the user feedback data;
[0027] Update the user profile based on the user tags;
[0028] Adjust push notification services based on user profiles.
[0029] The present invention also relates to a customer push system for an in-vehicle system, characterized in that it comprises:
[0030] The data acquisition module is used to acquire vehicle system data, including vehicle location, environmental data, power consumption, mileage, and vehicle speed; the user login module acquires the logged-in user information.
[0031] The profile generation module is used to transmit the vehicle system data and user information to the server and use big data calculations to obtain user profiles.
[0032] The service push module is used to push related services in real time based on the user profile;
[0033] The feedback adjustment module is used to receive user feedback on push-related services and adjust the push service based on the user feedback data.
[0034] The present invention also relates to a computer-readable storage medium, characterized in that the storage medium stores a computer program, which, when executed by a processor, implements the above-described method.
[0035] The present invention also relates to an electronic device, characterized in that it includes a processor and a memory;
[0036] The memory is used to store program instructions;
[0037] The processor is used to execute the above-described method by invoking program instructions.
[0038] The present invention also relates to a computer program product, including a computer program and / or instructions, characterized in that the computer program and / or instructions, when executed by a processor, implement the steps of the above-described method.
[0039] The beneficial effects of this invention are as follows:
[0040] This invention utilizes in-vehicle data and user information to generate dynamic user profiles through server-side big data calculations, recommending suitable financial and lifestyle services. It automatically pushes services by acquiring and analyzing in-vehicle data in real time. This invention integrates a multimodal large language model, combining voice and visual interaction to reduce touchscreen reliance. It dynamically adjusts the interaction based on real-time in-vehicle data, improving the safety and convenience of operation while driving. Through a user feedback mechanism, it achieves a closed loop of "recommendation-feedback-analysis," collecting user service feedback, using the feedback data to train models, optimizing recommendation services, and forming a refined customer group operation for car owners. Attached Figure Description
[0041] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below.
[0042] Figure 1 is a schematic flowchart of a customer push method for an in-vehicle system according to the present invention.
[0043] Figure 2 is a schematic diagram of a customer push system for an in-vehicle system according to the present invention;
[0044] Figure 3 is a schematic diagram of the structure of an electronic device according to the present invention. Detailed Implementation
[0045] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. It should be understood that the described embodiments are only some embodiments of this application, not all embodiments, and these embodiments are only used to illustrate this application and not to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.
[0046] As shown in Figure 1, this embodiment of the invention discloses a customer push method for an in-vehicle system, the steps of which include:
[0047] Step S1. Obtain vehicle data, including vehicle location, environmental data, power consumption, mileage, and vehicle speed; User login, obtain logged-in user information.
[0048] In this embodiment, user login can be done via QR code login, which includes:
[0049] Generate a login QR code and associate it with a session ID, then use a polling mechanism to check the status of the session ID;
[0050] The user scans the QR code to confirm login; a success indicator is returned upon successful login.
[0051] After successful login, you will be automatically redirected to the main interface.
[0052] Users install an in-vehicle app to obtain vehicle data, including vehicle location, environmental data, power consumption, mileage, and vehicle speed. Users log in by scanning a QR code using the mobile app, which retrieves their login information. The login interaction is dynamically adjusted based on vehicle status. When the vehicle speed exceeds a threshold, voice confirmation can be enabled to complete the login. A seamless payment protocol can also be enabled based on vehicle location and environmental data to reduce payment interaction steps and improve the convenience and safety of operation while driving.
[0053] Step S2. Transmit the vehicle system data and user information to the server and use big data calculations to obtain a user profile.
[0054] The steps preceding step S2 also include:
[0055] The vehicle data and user information are preprocessed to obtain features of the vehicle data and user information, including discrete features, continuous features and spatiotemporal features.
[0056] The features are then encoded.
[0057] The vehicle data includes vehicle location, environmental data, power consumption, mileage, vehicle speed, etc., and the data format is structured time series. User information includes user ID, card type, historical consumption tags, etc.
[0058] The system acquires real-time vehicle infotainment data, filters out invalid data in real time, cleans and performs feature engineering on the data, and calculates derived features such as energy consumption decay rate and average daily driving distance using a sliding window to obtain vehicle infotainment data features. These features are then correlated with user static information. These features can be categorized into discrete, continuous, and spatiotemporal features. Discrete features (such as user card type) are encoded using One-Hot encoding, continuous features (such as energy consumption value) are standardized using Z-Score, and spatiotemporal features (such as vehicle location) are converted to GeoHash encoding and associated with map POIs (charging station / parking lot information points) to enhance location correlation analysis.
[0059] In this embodiment, the vehicle system data and user information are transmitted to the server, and a user profile is obtained using big data calculations, including:
[0060] Distributed computing is used to perform parallel computation on preprocessed vehicle data and user information, and user profiles are generated based on the features of vehicle data and user information;
[0061] Store the user profile and retain the API call interface.
[0062] In this embodiment, an incremental iterative calculation model is adopted to periodically update the user profile in full. The weights are dynamically fine-tuned through real-time data, and the attention mechanism is used to dynamically allocate feature weights to dynamically generate the user profile. The user profile includes multiple label dimensions (such as high charging demand, high-frequency parking areas, etc.).
[0063] Real-time user profiles can be stored in a Redis cache and exposed via a gRPC interface for easy real-time service push. Charging discount push rules can be triggered when vehicle power consumption is below a preset threshold. Historical user profile data can also be stored in HBase for historical version tracking.
[0064] Traditional in-vehicle systems rely on static data analysis. This invention achieves second-level user profile updates through streaming computing and learning, solving the problem of inaccurate recommendations.
[0065] Step S3. Push related services in real time based on the user profile.
[0066] In this embodiment, real-time push of related services based on the user profile includes:
[0067] Receive user profiles and real-time vehicle system data;
[0068] Match push conditions and trigger related service push logic based on predefined rule sets;
[0069] The push method is selected based on real-time vehicle system data, and multimodal push is executed. The multimodal push includes generating push text through natural language processing, generating push images through image processing, and generating push voice through speech synthesis technology.
[0070] This embodiment monitors vehicle-mounted system data in real time. When a user profile and real-time vehicle-mounted system data are input, the logic for pushing related services is triggered. When the vehicle's power consumption is below a preset threshold, discount optimization benefits for nearby charging stations are automatically pushed based on environmental data; seamless parking services are integrated, navigating to the parking lot based on location data and enabling seamless payment; personalized Q&A consultations are generated using a multimodal large language model, and optimized push notifications are combined with real-time vehicle-mounted system data.
[0071] In this embodiment, the push method can be determined based on the real-time vehicle status. When the real-time vehicle speed is not 0, i.e. in the driving scenario, the preferred channel is voice broadcast to avoid visual interference while driving. When the real-time vehicle speed is 0, a full-screen pop-up can be used for push notification.
[0072] Multimodal technologies are integrated into the generation of push notification content. Natural language processing technology is used to generate push notification content based on user profile tags. For example, if the user profile tag is "frequent parking in business districts," the content would be "X parking spaces remaining in the parking lot of the XX building you frequently visit; enjoy a discount of X by activating contactless payment." Image processing is used to generate push notification images; for example, a parking lot navigation thumbnail is generated by calling the map SDK. Speech synthesis technology is used to generate push notification audio, converting text into voice commands.
[0073] Step S4. Receive user feedback on push-related services and adjust the push service based on user feedback data.
[0074] In this embodiment, receiving user feedback on push-related services and adjusting the push service based on user feedback data includes:
[0075] Collect user feedback data through a multimodal interface;
[0076] User tags are obtained based on the user feedback data;
[0077] Update the user profile based on the user tags;
[0078] Adjust push notification services based on user profiles.
[0079] User feedback is sent to the server, and users can provide feedback via voice-to-text conversion.
[0080] Analyze user feedback data to uncover user tags and update user profile weights accordingly.
[0081] As shown in Figure 2, this embodiment of the invention discloses a customer push system for an in-vehicle system, the structure of which includes:
[0082] The data acquisition module is used to acquire vehicle system data, including vehicle location, environmental data, power consumption, mileage, and vehicle speed; the user login module acquires the logged-in user information.
[0083] The profile generation module is used to transmit the vehicle system data and user information to the server and use big data calculations to obtain user profiles.
[0084] The service push module is used to push related services in real time based on the user profile;
[0085] The feedback adjustment module is used to receive user feedback on push-related services and adjust the push service based on the user feedback data.
[0086] By using this system, the aforementioned computational processing methods can be executed and the corresponding technical effects can be achieved.
[0087] Embodiments of the present invention also provide a computer-readable storage medium capable of implementing all the steps of the methods in the above embodiments, wherein the computer-readable storage medium stores a computer program that, when executed by a processor, implements all the steps of the methods in the above embodiments.
[0088] Embodiments of the present invention also provide an electronic device for performing the above-described method. As an implementation apparatus for the method, its structure is shown in FIG3. The electronic device 300 includes a processor 301 and a memory 303. The processor 301 and the memory 303 are connected, for example, via a bus 302. Optionally, the electronic device 300 may further include a transceiver 304. It should be noted that in practical applications, the transceiver 304 is not limited to one. It is understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the specific structure of the electronic device 300. In other embodiments of this application, the electronic device 300 may include more or fewer components than illustrated, or combine some components, or split some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. Optionally, the electronic device may further include a display screen 305 for displaying images or receiving user operation commands when needed.
[0089] In this embodiment, processor 301 is used to implement the method shown in the above method embodiment. Transceiver 304 may include a receiver and a transmitter. Transceiver 304 is used in this embodiment to enable the electronic device of this embodiment to communicate with other devices during execution.
[0090] Processor 301 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 301 may also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.
[0091] Processor 301 may also include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the electronic device 300. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 301 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 301 is a cache memory. This memory can store instructions or data that processor 301 has just used or is reusing. If processor 301 needs to reuse an instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 301, and thus improves system efficiency.
[0092] The processor 301 can run the methods provided in the embodiments of this application. The processor 301 may include different devices. For example, when integrating a CPU and a GPU, the CPU and GPU can cooperate to execute the methods provided in the embodiments of this application. For example, some algorithms in the method are executed by the CPU, and other algorithms are executed by the GPU to obtain faster processing efficiency.
[0093] Bus 302 may include a pathway for transmitting information between the aforementioned components. Bus 302 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. Bus 302 can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in Figure 3, but this does not indicate that there is only one bus or one type of bus.
[0094] The memory 303 may be ROM (Read Only Memory) or other types of static storage devices capable of storing static information and instructions, RAM (Random Access Memory) or other types of dynamic storage devices capable of storing information and instructions, or EEPROM (Electrically Erasable Programmable Read Only Memory), CD-ROM (Compact Disc Read Only Memory), or high-speed random access memory. It may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), or other optical disc storage, optical disk storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto.
[0095] Optionally, the memory 303 is used to store application code that executes the scheme of this application, and the execution is controlled by the processor 301. The processor 301 is used to execute the application code stored in the memory 303 to implement the method provided in any embodiment of this application.
[0096] The memory 303 can be used to store computer executable program code, which includes instructions. The processor 301 executes various functional applications and data processing of the electronic device 300 by running the instructions stored in the memory 303. The memory 303 may include a program storage area and a data storage area. The program storage area can store the operating system, application code, etc. The data storage area can store data created during the use of the electronic device 300 (such as images and videos captured by a camera application).
[0097] The memory 303 may also store one or more computer programs corresponding to the methods provided in the embodiments of this application. The one or more computer programs are stored in the memory 303 and configured to be executed by the one or more processors 301. The one or more computer programs include instructions that can be used to perform the various steps in the corresponding embodiments described above.
[0098] Of course, the code for the method provided in this application embodiment can also be stored in external memory. In this case, the processor 301 can run the code for the method stored in external memory through the external memory interface, and the processor 301 can control the execution flow.
[0099] The display screen 305 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 300 may include one or N displays 305, where N is a positive integer greater than 1. The display screen 305 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, the display screen 305 can display photos, videos, web pages, or documents.
[0100] The electronic device provided in this application is applicable to any of the above-described methods. Therefore, the beneficial effects it can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0101] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0102] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a system for implementing the functions specified in one or more flowchart illustrations and / or one or more block diagrams.
[0103] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including an instruction system that implements the functions specified in one or more flowcharts and / or one or more block diagrams.
[0104] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, thereby providing steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams. Although preferred embodiments of the invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of the invention.
[0105] The above description is merely a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.
Claims
1. A customer push method for an in-vehicle system, characterized in that, include: S1. Acquire vehicle data, including vehicle location, environmental data, power consumption, mileage, and vehicle speed; User login, retrieve user information; S2. Transmit the vehicle system data and user information to the server and use big data calculations to obtain a user profile; S3. Push relevant services in real time based on the user profile; S4. Receive user feedback on push-related services and adjust push services based on user feedback data.
2. The method as described in claim 1, characterized in that, The user login method includes QR code login, which includes: generating a login QR code and associating it with a session ID, and detecting the status of the session ID through a polling mechanism; the user scans the code to confirm login, and a success indicator is returned upon successful login; after successful login, the user is automatically redirected to the main interface.
3. The method as described in claim 1, characterized in that, Before transmitting the vehicle system data and user information to the server and using big data calculations to obtain a user profile, the process includes: preprocessing the vehicle system data and user information to obtain features of the vehicle system data and user information.
4. The method as described in claim 1, characterized in that, The step of transmitting the vehicle data and user information to the server and using big data computing to obtain a user profile includes: using distributed computing to perform parallel computing on the preprocessed vehicle data and user information, generating a user profile based on the features of the vehicle data and user information; storing the user profile and retaining the calling interface.
5. The method as described in claim 1, characterized in that, The real-time push of related services based on the user profile includes: receiving user profiles and real-time vehicle system data; matching push conditions and triggering related service push logic based on a predefined rule set; selecting a push method according to the real-time vehicle system data and performing multimodal push, wherein the multimodal push includes generating push text through natural language processing, generating push images through image processing, and generating push voice through speech synthesis technology.
6. The method as described in claim 1, characterized in that, The step of receiving user feedback on push-related services and adjusting the push service based on user feedback data includes: collecting user feedback data through a multimodal interface; obtaining user tags based on the user feedback data; updating the user profile based on the user tags; and adjusting the push service based on the user profile.
7. A customer push system for an in-vehicle system, characterized in that, include: The data acquisition module is used to acquire vehicle data, including vehicle location, environmental data, power consumption, mileage, and vehicle speed. User login, retrieve user information; The profile generation module is used to transmit the vehicle system data and user information to the server and use big data calculations to obtain user profiles. The service push module is used to push related services in real time based on the user profile; The feedback adjustment module is used to receive user feedback on push-related services and adjust the push service based on the user feedback data.
8. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the method of any one of claims 1 to 6.
9. An electronic device, characterized in that, It includes a processor and a memory; the memory is used to store program instructions; the processor is used to execute the method of any one of claims 1 to 6 by invoking the program instructions.
10. A computer program product comprising a computer program and / or instructions, characterized in that, When the computer program and / or instructions are executed by a processor, they implement the steps of the method according to any one of claims 1 to 6.