Guided intelligent terminal service system
The guided intelligent terminal service system integrates a guidance assistant and a back-end management platform. By utilizing hardware to perceive user behavior and large-scale model training, it enables intelligent and convenient government services, solving the problems of complexity in user business processing and terminal reliability.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- INSPUR SOFTWARE CO LTD
- Filing Date
- 2026-01-26
- Publication Date
- 2026-06-09
AI Technical Summary
The existing government service terminal system lacks convenient artificial intelligence applications, making it difficult for users, especially vulnerable groups such as the elderly, to handle business. They rely on cumbersome queuing and manual operation, lacking intelligent assistance.
A guided intelligent terminal service system is introduced, integrating a front-end user program module, a guidance assistant, and a back-end management platform. Utilizing hardware such as infrared cameras and facial recognition cameras, it provides personalized business recommendations, automated form filling, and real-time monitoring, and optimizes service processes through large-scale model training.
It greatly facilitates users in handling business, reduces operational complexity, lowers the workload of service personnel, improves terminal reliability and security, and provides intelligent and convenient government services.
Smart Images
Figure CN122173179A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of artificial intelligence technology, specifically a guided intelligent terminal service system. Background Technology
[0002] Currently, artificial intelligence (AI) is at a critical stage of simultaneous technological explosion and deepening application. Breakthroughs continue in the technology system centered on deep learning, with large models (such as GPT-4 and Claude) achieving near-human language understanding and generation capabilities through hundreds of billions of parameters, driving the widespread application of generative AI (AIGC) in text, image, and video creation. AI has gradually transformed from something previously "high and mighty" into a more accessible and routine product for ordinary users. As an auxiliary tool, people naturally hope to use it more easily and conveniently, enabling it to better serve users in more situations. However, currently, in most cases, AI remains inaccessible in government services. Users still rely more on conventional queuing methods or, even on self-service terminals, manually clicking and filling out forms according to page requirements, a relatively cumbersome and complex process. Moreover, for vulnerable groups such as the elderly, the difficulty of handling related business, whether queuing in the hall or operating on cumbersome terminals, is doubled compared to ordinary users.
[0003] How to apply artificial intelligence to government terminal service systems to provide users with more convenient and intelligent services is a technical problem that needs to be solved. Summary of the Invention
[0004] The technical objective of this invention is to address the above-mentioned shortcomings by providing a guided intelligent terminal service system to solve the technical problem of how to apply artificial intelligence to government terminal service systems to provide users with more convenient and intelligent services.
[0005] The present invention provides a guided intelligent terminal service system, comprising a front-end user program module, a guidance assistant, and a back-end management platform. The guidance assistant is integrated into the front-end user program module, which is deployed on a self-service terminal machine. The self-service terminal machine is equipped with terminal hardware devices, including an infrared camera, a face camera, a high-speed document scanner, a microphone, and a recorder. The front-end user program module interacts with users and administrators through a front-end interactive interface and interfaces with terminal hardware devices. It is used to detect the approach of users through infrared cameras and trigger the guidance assistant to provide guidance services. The guidance service provides a welcome service and displays the login interface, function list, and popular items. It is used to receive user identity verification data and perform login verification. It extracts user characteristics based on user identity verification data. It works with the guidance assistant to provide personalized business recommendation services based on user characteristics and popular items. It receives user operation instructions and business processing related data to provide business processing services. It collects the operating status of self-service terminal machines and user business processing data in real time as monitoring data and uploads it to the back-end management platform. It receives updated guidance assistants issued by the back-end management platform for function iteration. The user business processing data includes user identity verification data, user operation instructions, business processing related data, and data related to the interaction between the user and the guidance assistant. The back-end management platform is used to provide fault early warning services based on machine status data, to train the guided assistant based on user business processing data, and to send the updated guided assistant to the front-end user program module. It is also used to receive fault handling results from maintenance personnel and update machine operating status information.
[0006] As a preferred option, when providing guidance services, the guidance assistant will proactively initiate assistance reminders based on the user's status or passively based on user feedback, and display a list of functions and popular items on the front-end interactive interface. The functions in the list include assistance with application, certificate printing, and online form filling.
[0007] As a preferred method, users submit facial image data via a face camera and ID card scan data via a high-speed scanner. Both facial image data and ID card scan data are used as user authentication data. After receiving user authentication data, the front-end user program module performs login verification based on the user authentication data. After successful login verification, it extracts user characteristics based on the authentication data and provides personalized business recommendation services based on user characteristics and popular items. It predicts the business that the user needs to handle through the personalized business recommendation service, generates a business recommendation list, and interacts with the user via voice. In response to the user's operation commands, it jumps to the relevant business handling page through the front-end interactive interface. Among them, the assistant guided by the user during voice interaction has the function of dialect recognition.
[0008] As a preferred method, users submit user operation commands and business processing-related data through the front-end interactive interface. The front-end user program module and the guide assistant work together to perform the following business processing services: The front-end interactive interface pushes out business processing flow guidance, processing instructions and material prompts. The system analyzes user questions using voice analysis and generates answers through screen recognition and item analysis, interacting with users in both text and voice. The system receives user operation instructions, business processing related data, and electronic materials submitted by users through the front-end interactive interface. It also calls a high-speed scanner to take pictures and upload the relevant electronic materials, identifies business processing related data from the electronic materials, fills in the form based on the business processing related data submitted by users, the business processing related data identified from the electronic materials, historical declaration records, and user identity verification data, adds electronic materials, and trims and corrects the newly added electronic materials. Record relevant operations and data during the business processing, and generate an interaction log, which includes user questions and operation records.
[0009] As a preferred option, the backend management platform is used to perform the following operations: It receives machine status data, user business processing data, and training data sent through the front-end user program module, performs multi-dimensional data analysis according to machine management, user analysis, model training, and information statistics, generates various data classification reports, and provides them to administrators for viewing through the back-end management interface. Based on the analysis of machine status data, faults or anomalies are identified and warning information including machine name, location, fault type, and person in charge is generated; Statistical analysis is performed on user business processing data to extract key feature data. The key feature data and training data are then entered into the training database. The key feature data includes high-frequency business, user preferences, and frequently asked questions. Provide a model training interface, which allows administrators to configure training parameters and optimization rules. The guide assistant is trained based on a large model training library, and the trained guide assistant model is then distributed to the front-end user program module. Receive feedback from maintenance personnel regarding fault handling results and update machine operating status information; The database stores various types of data, machine anomaly analysis results, data analysis reports, and training data for the guidance assistant.
[0010] Preferably, the front-end user program module and the terminal hardware device achieve real-time data transmission through a hardware interface protocol.
[0011] As a preferred option, the front-end user program module and the back-end management platform communicate via network communication protocols including HTTP to achieve data reporting and command issuance, supporting batch data transmission and real-time interaction.
[0012] As a preferred approach, key data within and between the front-end user program module, the guide assistant, and the back-end management platform are efficiently interacted through memory sharing and database read / write operations to ensure data consistency and timeliness.
[0013] The guided intelligent terminal service system of the present invention has the following advantages: 1. Intelligent services greatly facilitate users in handling business; 2. Automated filling is convenient and quick, reducing manual operations for users; 3. Guided service assistance makes handling affairs simpler and clearer for users; 4. Reduce the workload of service personnel; relevant policies, materials, and information interpretation can all be answered through self-service Q&A. 5. Real-time reporting of machine data reduces the risk of terminal downtime, minimizes security risks, and enables timely maintenance and handling of abnormal machines. Attached Figure Description
[0014] To more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0015] The invention will be further described below with reference to the accompanying drawings.
[0016] Figure 1 This is a schematic diagram of the guidance service display interface in a guided intelligent terminal service system. Figure 2 A schematic diagram showing the content displayed in the back-end management interface of a guided intelligent terminal service system; Figure 3 This is a structural block diagram of a guided intelligent terminal service system. Figure 4 This is a block diagram illustrating the training principle of a guidance assistant model in a guided intelligent terminal service system. Detailed Implementation
[0017] The present invention will be further described below with reference to the accompanying drawings and specific embodiments, so that those skilled in the art can better understand and implement the present invention. However, the embodiments are not intended to limit the present invention. In the absence of conflict, the embodiments of the present invention and the technical features in the embodiments can be combined with each other.
[0018] This invention provides a guided intelligent terminal service system to address the technical problem of how to apply artificial intelligence to government terminal service systems to provide users with more convenient and intelligent services. Example
[0019] The present invention discloses a guided intelligent terminal service system, comprising a front-end user program module, a guidance assistant, and a back-end management platform. The guidance assistant is integrated into the front-end user program module, which is deployed in a self-service terminal machine. The self-service terminal machine is equipped with terminal hardware devices, including an infrared camera, a face camera, a high-speed document scanner, a microphone, and a recorder.
[0020] The front-end user program module interacts with users and administrators through a front-end interactive interface and interfaces with terminal hardware devices. It uses an infrared camera to detect user approach and trigger a guidance assistant to provide guidance services. This guidance service provides a welcome message and displays the login interface, function list, and popular items. It receives user identity verification data and performs login verification, extracts user characteristics based on user identity verification data, and works with the guidance assistant to provide personalized business recommendations based on user characteristics and popular items. It also receives user operation instructions and business processing-related data to provide business processing services. Furthermore, it collects real-time monitoring data of the self-service terminal's operating status and user business processing data, uploading it to the back-end management platform. Finally, it receives updates from the back-end management platform to iterate the guidance assistant's functionality. User business processing data includes user identity verification data, user operation instructions, business processing-related data, and data related to the user's interaction with the guidance assistant.
[0021] When providing guidance services, the guidance assistant will proactively initiate assistance reminders based on the user's status or passively based on user feedback, and display a list of functions and popular items on the front-end interactive interface. The functions in the list include assistance with application, certificate printing, and online form filling.
[0022] As a specific implementation of the login process, users submit facial image data via a face camera and ID card scan data via a high-speed scanner. Both facial image data and ID card scan data serve as user authentication data. After receiving the user authentication data, the front-end user program module performs login verification based on the user authentication data. After successful login verification, it extracts user features based on the authentication data and provides personalized business recommendation services based on user features and popular items. The personalized business recommendation service predicts the business that the user needs to handle, generates a business recommendation list, and interacts with the user via voice. In response to user operation commands, it redirects users to the relevant business handling page through the front-end interactive interface. The assistant guided by the user during voice interaction has dialect recognition capabilities.
[0023] As a concrete implementation of business processing, users submit user operation instructions and business processing-related data through the front-end interactive interface. The front-end user program module and the guide assistant work together to perform the following business processing services: (1) Push business processing process guidance, processing instructions and material prompts through the front-end interactive interface; (2) The voice analysis function analyzes user questions and generates answers through screen recognition analysis and item analysis, and interacts with users in the form of text and voice. (3) Receive user operation instructions, business processing related data and electronic materials submitted by users through the front-end interactive interface, call the high-speed scanner to take pictures and upload the relevant electronic materials, identify business processing related data from the electronic materials, fill the form based on the business processing related data submitted by users, the business processing related data identified from the electronic materials, as well as historical declaration records and user identity verification data, and add electronic materials, and trim and correct the newly added electronic materials. (4) Record relevant operations and data during the business processing process and generate an interaction log, which includes user questions and operation records.
[0024] The back-end management platform is used to provide fault early warning services based on machine status data, to train the guided assistant based on user business processing data, and to send the updated guided assistant to the front-end user program module. It is also used to receive fault handling results from maintenance personnel and update machine operating status information.
[0025] As a specific implementation of the backend management platform, this module is used to perform the following operations: (1) Receive machine status data, user business processing data and training data sent through the front-end user program module, perform multi-dimensional data analysis according to machine management, user analysis, model training and information statistics, generate various data classification reports, and provide them to managers through the back-end management interface; (2) Analyze machine status data to identify faults or anomalies and generate early warning information including machine name, location, fault type, and person in charge; (3) Perform statistical analysis on user business processing data, extract key feature data, and input the key feature data and training data into the training database. The key feature data includes high-frequency business, user preferences, and hot issues. (4) Provide a model training interface, through which administrators can configure training parameters and optimization rules, train the guide assistant model based on the large model training library, and send the trained guide assistant model to the front-end user program module. (5) Receive feedback from maintenance personnel on fault handling results and update machine operating status information; (6) Store various types of data, machine anomaly analysis results, data analysis reports, and training data for the guidance assistant in the database.
[0026] In this embodiment, the front-end user program module and the terminal hardware device achieve real-time data transmission through a hardware interface protocol. The front-end user program module and the back-end management platform communicate via network protocols including HTTP to report data and issue commands, supporting batch data transmission and real-time interaction. Key data within the front-end user program module, the guidance assistant, and the back-end management platform, as well as between modules, achieves efficient interaction through memory sharing and database read / write operations, ensuring data consistency and timeliness.
[0027] The system disclosed in this embodiment is a complete program deployed on a terminal machine, including a visual front-end user program and a back-end management platform. It involves two roles: the user and the administrator, and an interaction medium: a self-service terminal machine.
[0028] The front-end user program of the guided intelligent terminal service system integrates a guidance assistant trained on a large model. This assistant resides permanently in the user interface foreground and can proactively initiate assistance reminders based on user status or feedback. The homepage includes a list of functions integrated into the system (including but not limited to self-service application, certificate printing, online form filling, etc.) and modules for popular items. The specific homepage interface design is shown in the attached figure. Figure 1 As shown.
[0029] The back-end management platform of the guided intelligent terminal service system allows administrators to report, analyze, and statistically process user data. It also enables deep training and learning of the guidance assistant to improve its knowledge base, providing automated data processing during user-submitted business application information on the terminal. The specific homepage interface design is shown in the attached image. Figure 2 As shown.
[0030] Users refer to individuals who need to use self-service terminals to conduct business. Administrators refer to individuals who can use the back-end management platform of the guided intelligent terminal service system to perform related operations.
[0031] A self-service terminal machine refers to a system terminal equipped with hardware such as infrared cameras, facial recognition cameras, document scanners, microphones, and recorders, and featuring a computer display screen. A complete set of convenient service programs can run on this terminal. This guided intelligent terminal service system can run on such a self-service terminal machine. When users access the system's front-end user program, they can perform services including but not limited to information inquiries, certificate printing, and self-service declarations. The program can also report machine status and information data in real time during operation.
[0032] Appendix: Overall Relationship between Users, Administrators, Self-Service Terminal Machines, and Guided Intelligent Terminal Service Systems Figure 3 As shown.
[0033] The relationship between the guide assistant in the front-end user program of the guided intelligent terminal service system and users, administrators, and the back-end management platform is shown in the appendix. Figure 4 As shown.
[0034] The following scenarios exist between users and self-service terminals: When the terminal detects a user's approach via an infrared camera, a guiding assistant greets them. The user then clicks to operate the self-service terminal, using the front-end program of the guided intelligent terminal service system. They log in by swiping their ID card or using facial recognition. After logging in, the guiding assistant predicts and recommends the services the user needs based on their age, gender, and other information. When the user actively clicks on the guiding assistant, the assistant's voice recognition function is triggered, recognizing some regional dialects. Based on the recognized information, the assistant recommends services or directly redirects the user to a designated service page. During the service process, the guiding assistant proactively guides the user at each step, reminding them of the procedures and required materials. When forms or information are filled out, the guiding assistant can automatically fill them out based on past user application records (if any) and basic identity information. When electronic materials are required for application, the assistant can automatically add the corresponding materials based on past user application records (if any). For additional materials, users can scan them using a high-speed scanner. The assistant can automatically crop and correct the materials and generate a list of electronic materials that meet the requirements for automatic addition to the application. Users can actively trigger the assistant throughout the entire application process. By accurately recognizing users' voice questions, the assistant can answer various questions during the application process, including but not limited to screen recognition and analysis of current page information, analysis of matters, policy analysis, and interpretation of various required materials.
[0035] The following scenarios exist between administrators and the back-end management platform of the guided intelligent terminal service system: Administrators can access the back-end management platform to organize and analyze the data reported by the front-end user program, and organize the relevant data into the large model training library of the guide assistant. Administrators can conduct deeper learning and training of the guide assistant to optimize and improve its collaborative ability in the front-end user program. After reaching certain indicators, the guide assistant can be published to the front-end user program in real time.
[0036] The following scenarios exist between the front-end user program and the back-end management platform of the guided intelligent terminal service system: The front-end user program can report machine information and some user business information during operation, which is then aggregated to the back-end management platform for easy analysis and statistics by management personnel; the back-end management platform can analyze the machine status based on the obtained machine data, issue early warnings for faulty or abnormal machines, and perform timely maintenance and handling; it can also perform statistics on the obtained user data, organize the data into the guidance assistant training library, improve and release the guidance assistant to the front-end user program.
[0037] In practical application scenarios, the guided intelligent terminal service system comprises two parts and one medium: users and administrators, and the self-service terminal machine. Users and administrators are not directly connected; they are linked through a guidance assistant within the system's front-end user program, which is deployed on the self-service terminal machine for user access. Specific implementation scenarios are as follows: (1) The front-end user program of the present invention is deployed on the self-service terminal machine and connected to the machine's face camera, high-speed document camera, infrared camera and other hardware; (2) Users use the front-end user program to handle business through the self-service terminal machine. During the business handling process, the guide assistant in the front-end user program will listen and assist the user in providing intelligent services. At the same time, the front-end user program will report machine data and user data to the background management platform of the present invention during its operation. (3) The administrator accesses the back-end management platform of the present invention, organizes and analyzes the reported machine data, promptly notifies the person in charge of maintenance and handling when encountering faulty machines, organizes and summarizes user data into the large model training library in the guide assistant, strengthens the deep training of the guide assistant, and when the guide assistant is trained to a certain stage, the administrator can publish the guide assistant to the front-end user program of the present invention.
[0038] In this embodiment, the system provides users with more convenient and intelligent services when handling business using self-service terminals. This is achieved through a guided intelligent terminal service system deployed on the terminal. The system provides full-process guidance throughout the process, helping users understand the details and facilitating the process step-by-step. Furthermore, it utilizes automated data processing based on large-scale model applications in business applications, resolving issues such as difficulty operating the machine and the complexity of filling out information, thereby improving user efficiency.
[0039] The above provides a detailed description of the guided intelligent terminal service system provided by the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.
Claims
1. A guided intelligent terminal service system, characterized in that, It includes a front-end user program module, a guide assistant, and a back-end management platform. The guide assistant is integrated into the front-end user program module, which is deployed on the self-service terminal machine. The self-service terminal machine is equipped with terminal hardware devices, including an infrared camera, a face camera, a high-speed document scanner, a microphone, and a recorder. The front-end user program module interacts with users and administrators through a front-end interactive interface and interfaces with terminal hardware devices. It is used to detect the approach of users through infrared cameras and trigger the guidance assistant to provide guidance services. The guidance service provides a welcome service and displays the login interface, function list, and popular items. It is used to receive user identity verification data and perform login verification. It extracts user characteristics based on user identity verification data. It works with the guidance assistant to provide personalized business recommendation services based on user characteristics and popular items. It receives user operation instructions and business processing related data to provide business processing services. It collects the operating status of self-service terminal machines and user business processing data in real time as monitoring data and uploads it to the back-end management platform. It receives updated guidance assistants issued by the back-end management platform for function iteration. The user business processing data includes user identity verification data, user operation instructions, business processing related data, and data related to the interaction between the user and the guidance assistant. The back-end management platform is used to provide fault early warning services based on machine status data, to train the guided assistant based on user business processing data, and to send the updated guided assistant to the front-end user program module. It is also used to receive fault handling results from maintenance personnel and update machine operating status information.
2. The guided intelligent terminal service system according to claim 1, characterized in that, When providing guidance services, the guidance assistant will proactively initiate assistance reminders based on the user's status or passively based on the user's feedback, and display a list of functions and popular items on the front-end interactive interface. The functions in the list include assistance with application, certificate printing, and online form filling.
3. The guided intelligent terminal service system according to claim 1, characterized in that, Users submit facial image data via a face camera and ID card scan data via a high-speed scanner. Both facial image data and ID card scan data are used as user authentication data. After receiving user authentication data, the front-end user program module performs login verification based on the user authentication data. After successful login verification, it extracts user characteristics based on the authentication data and provides personalized business recommendation services based on user characteristics and popular items. It predicts the business that the user needs to handle through the personalized business recommendation service, generates a business recommendation list, and interacts with the user via voice. In response to the user's operation commands, it jumps to the relevant business handling page through the front-end interactive interface. Among them, the assistant guided by the user during voice interaction has the function of dialect recognition.
4. The guided intelligent terminal service system according to claim 1, characterized in that, Users submit user operation commands and business processing related data through the front-end interactive interface. The front-end user program module and the guide assistant work together to perform the following business processing services: The front-end interactive interface pushes out business processing flow guidance, processing instructions and material prompts. The system analyzes user questions using voice analysis and generates answers through screen recognition and item analysis, interacting with users in both text and voice. The system receives user operation instructions, business processing related data, and electronic materials submitted by users through the front-end interactive interface. It also calls a high-speed scanner to take pictures and upload the relevant electronic materials, identifies business processing related data from the electronic materials, fills in the form based on the business processing related data submitted by users, the business processing related data identified from the electronic materials, historical declaration records, and user identity verification data, adds electronic materials, and trims and corrects the newly added electronic materials. Record relevant operations and data during the business processing, and generate an interaction log, which includes user questions and operation records.
5. The guided intelligent terminal service system according to claim 1, characterized in that, The backend management platform is used to perform the following operations: It receives machine status data, user business processing data, and training data sent through the front-end user program module, performs multi-dimensional data analysis according to machine management, user analysis, model training, and information statistics, generates various data classification reports, and provides them to administrators for viewing through the back-end management interface. Based on the analysis of machine status data, faults or anomalies are identified and warning information including machine name, location, fault type, and person in charge is generated; Statistical analysis is performed on user business processing data to extract key feature data. The key feature data and training data are then entered into the training database. The key feature data includes high-frequency business, user preferences, and frequently asked questions. Provide a model training interface, which allows administrators to configure training parameters and optimization rules. The guide assistant is trained based on a large model training library, and the trained guide assistant model is then distributed to the front-end user program module. Receive feedback from maintenance personnel regarding fault handling results and update machine operating status information; The database stores various types of data, machine anomaly analysis results, data analysis reports, and training data for the guidance assistant.
6. The guided intelligent terminal service system according to claim 1, characterized in that, The front-end user program module and the terminal hardware device achieve real-time data transmission through a hardware interface protocol.
7. The guided intelligent terminal service system according to claim 1, characterized in that, The front-end user program module and the back-end management platform communicate via network protocols including HTTP to report data and issue commands, supporting batch data transmission and real-time interaction.
8. The guided intelligent terminal service system according to claim 1, characterized in that, Key data within and between the front-end user application module, the guide assistant, and the back-end management platform are efficiently interacted through memory sharing and database read / write, ensuring data consistency and timeliness.