System and method for realizing online handling of vehicle management office business based on AI assisted verification and original handwriting electronic signature

Abstract

This application provides a system and method for online processing of vehicle management office services based on AI-assisted verification and original handwriting electronic signatures. The system includes: a mobile terminal and a PC terminal; the mobile terminal includes a service selection and processing module for receiving user commands to initiate service processing; an identity authentication and facial recognition module for verifying the user's uploaded identity information; a video call request module for establishing encrypted video calls; an original handwriting electronic signature module for enabling handwritten signatures on electronic application forms; a payment and status update module for updating the service status to "paid" after the user completes online payment; the PC terminal includes a video access module for managing video call access and ensuring call quality and reasonable resource allocation; an AI-assisted verification module for automatically classifying, extracting key information, and verifying consistency of user-submitted materials; and a material writing module for writing electronic materials into the six-in-one system. This application effectively solves the problems of cumbersome and inefficient vehicle management office service processes, insufficient online access, difficulty in guaranteeing the authenticity of materials, and non-closed-loop signing processes in existing technologies.

Description

Technical Field

[0001] This application relates to the field of vehicle management and remote service technology, and more specifically to systems and methods for online processing of vehicle management office business. Background Technology

[0002] In the traditional model of handling motor vehicle and driver's license services at vehicle management offices, the public must personally submit paper materials at the office window, which are then manually entered into the system and reviewed by staff. This process is not only time-consuming but also prone to errors. Although some services have gradually supported online appointments and material submissions in recent years, the core steps of in-person identity verification, material review, and signing remain indispensable. This disconnect between online and offline processing has the following key drawbacks, limiting the efficiency and user experience of vehicle management office services:

[0003] 1. Limitations of offline window processing

[0004] Inefficiency: The public has to go through a lengthy process of making appointments, submitting materials and undergoing review, which may involve multiple trips to the vehicle management office, resulting in high time and economic costs.

[0005] Uneven resource allocation: During peak hours, congestion at service windows leads to heavy workloads for police officers. Rigid resource allocation makes it difficult to meet fluctuating public demand, further exacerbating the queuing phenomenon.

[0006] 2. Shortcomings of online self-service application

[0007] Online review is inefficient: Material review still relies on manual processing and lacks automation and intelligent means, which cannot effectively cope with the large number of materials submitted, resulting in limited overall efficiency.

[0008] Lack of remote interaction capabilities: The existing system cannot provide remote video verification and guidance, which greatly limits the degree of online access for businesses that require face-to-face verification of identity or vehicles.

[0009] 3. Video consultation is limited to business consultation: Although some vehicle management offices provide video consultation services, their function is limited to answering business-related questions and cannot complete actual business processing, thus failing to truly realize the value of remote services.

[0010] 4. Issues with verifying the authenticity of materials: Materials submitted online are prone to problems such as forgery, unclear information, or missing content. The lack of effective remote verification methods means that vehicle management offices still need to rely on offline verification, making it difficult to achieve a closed loop in the online process.

[0011] 5. Lack of legal validity in online signing: Traditional online processes have a break in the final signing stage. The legal validity and identity binding strength of electronic confirmation methods are insufficient, forcing people to sign in person offline, which seriously restricts the possibility of making the entire business process online.

[0012] Therefore, the current vehicle management office service model, whether through offline windows or online self-service applications, suffers from core drawbacks such as low efficiency, unreasonable resource allocation, lack of remote interaction capabilities, difficulty in ensuring the authenticity of materials, and an incomplete signing process. These technological bottlenecks limit the improvement of public service efficiency, reduce public satisfaction with government services, and run counter to the reform direction of "Internet + government services." Summary of the Invention

[0013] To overcome the above shortcomings, this application provides a system and method for online processing of vehicle management office business based on AI-assisted verification and original handwriting electronic signature, realizing seamless online processing of business, improving the efficiency and convenience of vehicle management office business processing, improving the user experience, and meeting the new requirements of efficient, convenient and secure government services.

[0014] The technical solution of this application is as follows:

[0015] This application provides a system for online processing of vehicle management office business based on AI-assisted verification and original handwriting electronic signature, including: mobile terminal and PC terminal.

[0016] The mobile device includes:

[0017] The service selection and loading module automatically loads and displays different service types offered by the vehicle management office. Based on the specific service type and processing instructions selected by the user, it loads the service details page and initiates the processing procedure. Here, "user" refers to the general public.

[0018] The identity authentication and facial recognition module is used to obtain the ID card information uploaded by the user and perform facial recognition to confirm the validity of the user's identity. It instructs the user to fill in the business-specific information, automatically fills in the ID card data previously submitted by the user into the application form through two-way data binding technology, and verifies the clarity, completeness and format of the materials uploaded by the user one by one according to the material list.

[0019] The video call request module is used to establish an encrypted video call with the video access module. After the user initiates a video call request, the task distribution mechanism is automatically triggered to intelligently assign the call request to the appropriate police officer based on the police officer's online status and skill group.

[0020] The original handwriting electronic signature module is used to collect users' signature handwriting using original handwriting electronic signature technology, combine the user's signature information with electronic documents, and generate a legally valid electronic signature document.

[0021] The payment and status update module provides users with an online payment channel. After a user completes an online payment, the module updates the business status to "paid" through an asynchronous callback mechanism between the payment gateway and the business middle platform.

[0022] PC version includes:

[0023] The video access module is used to automatically receive video connection requests, establish video calls, and provide police officers with remote video guidance, material verification, and business confirmation, ensuring call quality and reasonable resource allocation.

[0024] The AI-assisted verification module is used to automatically classify, extract key information, and verify the consistency of materials submitted by users.

[0025] The business processing module is used to bind the business transaction number with the corresponding video task after a video call; in response to the signing instruction, it automatically generates an electronic application form with a signing area and pushes the signing request to the user; it writes the electronic materials into the traffic management integrated application platform (i.e., the six-in-one system), officially accepts the business, and generates the corresponding payment information and pushes it to the mobile terminal.

[0026] The video call request module automatically triggers an AI-assisted verification process after a user initiates a video call request. After the video call ends, it automatically records and saves relevant call information, including the call start time, end time, and call duration, and records and reviews the video call. When the video access module receives a video call request, it intelligently schedules resources and assigns tasks based on the business type and police officer skill group.

[0027] Furthermore, in some embodiments of this application, the video call established between the video connection request module and the video access module uses the WebRTC protocol for point-to-point encrypted communication and is relayed through a TURN / STUN server to ensure the stability and low latency of the video call.

[0028] Furthermore, in some embodiments of this application, after a user initiates a video connection request, the mobile terminal generates a temporary room_id and token, causing the user to enter a waiting queue, and the PC terminal establishes a video connection channel through the joinRoom interface.

[0029] Furthermore, in some embodiments of this application, the AI-assisted verification module uses deep learning models and OCR technology to automatically classify and identify the materials uploaded by the user and extract key field information. It verifies the logical consistency between the data through a rule engine and business logic. The verification results are synchronously recorded in the database. If the verification fails, the process is terminated in advance and the user is prompted to supplement or correct the materials. If the verification passes, the task status is updated and pushed.

[0030] Furthermore, in some embodiments of this application, the business processing module uses a secure transfer or dedicated interface to package the electronic application form and image materials that have passed the front-end review, and transmits them to the intranet through a secure data exchange channel. The intranet server then performs the material writing, writing the image materials as attachments into the business record in the traffic management integrated application platform that is bound to the business serial number.

[0031] Furthermore, in some embodiments of this application, the original handwriting electronic signature uses original handwriting electronic signature technology to collect the user's signature handwriting, synthesize the user's signature information with the electronic document, and generate an electronic signature document with legal effect.

[0032] Furthermore, in some embodiments of this application, an application form configuration module is also included, which is used to receive instructions from management personnel and configure the composite content of the application form according to different business needs, including adding form elements, setting attributes and logical relationships, so as to realize customized management of the application form.

[0033] Furthermore, in some embodiments of this application, the identity authentication and face recognition module uses OCR technology to automatically extract structured data from the ID card and performs preliminary verification of the ID card information by calling the trusted identity authentication platform interface.

[0034] Furthermore, in some embodiments of this application, the business selection and processing module supports regional difference management and canary release, displays information such as business process, required materials, and processing time, and guides users to understand the basic steps and requirements for handling business.

[0035] This application also provides a method for remote video processing and online electronic signing of vehicle management office services, including the following steps:

[0036] Business Selection and Loading: On the mobile device, the business selection and loading module automatically loads and displays different business types of the vehicle management office. Based on the specific business type and processing instructions selected by the user, it loads the business details page and starts the processing procedure.

[0037] Identity authentication and information entry: On the mobile device, the identity authentication and information entry module obtains the ID card information uploaded by the user and performs facial recognition to confirm the validity of the user's identity. Then, it instructs the user to fill in the business-specific information. Through two-way data binding technology, it automatically fills in the ID card data previously submitted by the user into the application form and verifies the clarity, completeness and format of the materials uploaded by the user according to the material list.

[0038] Requesting a video call: On mobile devices, the video call request module automatically triggers a task distribution mechanism after a user initiates a video call request, intelligently assigning the call request to the appropriate police officer based on the officer's online status and skill group;

[0039] Video access call: On the PC, the video access module automatically receives video connection requests, establishes WebRTC video calls, and provides police officers with remote video guidance, material verification, and business confirmation.

[0040] Generating business and signing documents: On the PC, the business processing module binds the business serial number to the current video task, and in response to the signing instruction, automatically generates an electronic application form with a signing area and pushes the signing request to the user; the business serial number is automatically generated by the six-in-one system after the police enter the business information into the traffic management integrated application platform (six-in-one system) on the intranet;

[0041] Electronic signature: On mobile devices, after receiving a signature request, the handwritten electronic signature module uses original handwriting electronic signature technology to collect the user's signature handwriting, combines the user's signature information with the electronic document, and generates a legally valid electronic signature document.

[0042] Business Acceptance: On the PC, the business processing module receives all approved electronic materials packaged together and transmits them to the intranet through a secure data exchange channel. The intranet server then executes the material writing step, adding the image data as an attachment to the business record bound to the business serial number in the six-in-one system, thus formally accepting the business and generating the corresponding payment information, which is then pushed to the mobile device.

[0043] Payment: On the mobile device, after receiving payment information, the payment and status update module calls the payment gateway to provide users with an online payment channel. After the user completes the online payment, the business status is updated to "paid" through the asynchronous callback mechanism between the payment gateway and the business middle platform.

[0044] Business completion: On the PC, after confirming payment, the business processing module updates the business status and pushes a completion notification to the mobile device.

[0045] Furthermore, in some embodiments of this application, after the user initiates a video call request but before the task is assigned to a police officer, the video call request module automatically triggers an AI-assisted verification process: the uploaded materials are automatically classified using a pre-trained visual model, key field information is extracted using OCR technology, and the logical consistency between the data is verified using a rule engine and business logic; the verification results are synchronously recorded in the database, and if the verification fails, the process is terminated in advance and the user is prompted to supplement or correct the materials; if the verification passes, the task status is updated and pushed.

[0046] The system and method for online processing of vehicle management office business based on AI-assisted verification and original handwriting electronic signature proposed in this application represent a revolutionary advancement compared to existing technologies. Its beneficial effects are specifically reflected in the following six aspects:

[0047] 1. Achieve "zero-visit" processing: Citizens can complete vehicle management office business without being present, greatly improving convenience.

[0048] This application completely eliminates the need for citizens to visit the vehicle management office in person by constructing a fully online, closed-loop business processing system. From application, identity verification, document submission, review and verification to final signing and payment, all steps are completed through a mobile app and remote video interaction. In particular, remote video verification technology solves the core obstacle of requiring in-person vehicle and driver verification; online electronic signing technology solves the final bottleneck of requiring in-person signing. No matter where they are, citizens can complete the business that previously took several days and multiple trips in just tens of minutes with just a smartphone, truly realizing "data does the work, citizens don't have to," greatly improving the accessibility and convenience of public services, and representing a profound practice of "Internet + government services."

[0049] 2. Improve police work efficiency: Online pre-screening, video verification, electronic signature and other functions reduce repetitive work for police officers and optimize resource allocation.

[0050] This application significantly improves the work efficiency and value of police officers:

[0051] Reduce repetitive work: The system front end uses OCR technology to automatically identify and fill in information and AI quality control to pre-examine materials, freeing police officers from the tedious role of "data entry clerk".

[0052] Optimized work mode: Police officers no longer need to engage in inefficient, repetitive question-and-answer sessions at noisy windows. Instead, they can process online pre-screening tasks in batches at their workstations via a PC management terminal and seamlessly continue video calls. This mode allows for a more focused work environment and more intelligent task scheduling.

[0053] Leveraging professional expertise: The focus of police officers' work has shifted from simple document receipt and dispatch to professional online verification, judgment, and guidance, allowing them to better utilize their professional capabilities.

[0054] Flexible resource allocation: The online virtual hall breaks the limitations of physical windows, allowing a police officer to handle business from people in different regions, realizing flexible scheduling and efficient utilization of human resources on a larger scale, and effectively smoothing out the peak periods of offline business.

[0055] 3. Authentic and controllable materials: The authenticity of materials is ensured through a triple guarantee of video verification, OCR recognition, and manual review.

[0056] This application establishes a three-tiered, progressive security verification mechanism to comprehensively ensure the authenticity and reliability of the materials:

[0057] The first layer (automatic technical verification): When the public uploads materials, OCR technology is integrated to automatically extract document information and compare it with official data sources. At the same time, an AI image quality control model is used to automatically verify the clarity, completeness and format of the documents, intercepting unqualified materials at the source.

[0058] The second layer (remote video verification): This is the most crucial technological innovation. Police officers use high-definition video calls to request users to display original paper documents, vehicle conditions, or their own appearance in real time, comparing the dynamic video footage with the statically uploaded electronic materials. This step effectively identifies fraudulent activities such as Photoshop forgery and screen capture, solving the problem of verifying the consistency between electronic materials and physical originals.

[0059] The third layer (police professional review): Finally, experienced police officers make the final judgment based on video interaction and their own professional knowledge. This triple-layered security mechanism, working in tandem and complementing each other, forms a security defense line far exceeding the reliability of offline visual review, greatly reducing operational risks.

[0060] 4. The signing process is legal and valid: Electronic signatures have legal effect and support subsequent auditing and traceability.

[0061] This application integrates reliable electronic signature technology to ensure the legal validity and security of the online signing process:

[0062] Legal validity: The entire signing process strictly adheres to the provisions of the "Electronic Signature Law of the People's Republic of China" regarding "reliable electronic signatures." Through real-name authentication (facial recognition), confirmation of signing intent (video evidence storage + active operation), and anti-tampering technology, it ensures that electronic signatures have the same legal validity as handwritten signatures or seals.

[0063] End-to-end evidence storage: From the initiation of the signing request, the identity verification of the signer, the signing process to the final signed document, key evidence such as timestamps, IP addresses, device fingerprints, and video clips are encrypted and solidified throughout the entire operation chain, and the hash values ​​are stored on the blockchain to form an immutable electronic evidence package, perfectly supporting subsequent auditing, tracing, and judicial evidence presentation.

[0064] 5. Strong system compatibility: It can be seamlessly integrated with the existing six-in-one system without affecting the original business processes.

[0065] This application design follows the principle of "not making intrusive modifications to the core production system" and has strong compatibility and feasibility.

[0066] Non-intrusive integration: The police officer's PC management terminal is deployed on the intranet. It performs data query and write operations by calling the existing standard data interfaces (such as WebService / API) of the six-in-one system. No modifications are required to the underlying database or core code of the six-in-one system, ensuring the stability and security of the core system.

[0067] Secure data exchange: Data transfer between the Internet and the intranet is facilitated through an approved security boundary access platform (such as a network gateway). The data format follows established standards and meets the requirements of network security level protection.

[0068] Business process alignment: The online processing process reuses the rules and data elements of offline business to the greatest extent. The core links such as final approval, certificate issuance and archiving are still completed in the six-in-one system, ensuring the standardization and consistency of business.

[0069] 6. Supports cross-regional processing: Breaks geographical restrictions, especially suitable for car owners and drivers in other regions to handle business.

[0070] This application, relying on the ubiquity of the Internet, naturally breaks the geographical jurisdiction restrictions of traditional government services.

[0071] Business accessibility: People can apply for services anytime and anywhere without having to return to the place where their documents were issued or where their vehicles are registered, solving the problem of "difficulty in handling affairs" for people who work or live in different places.

[0072] Nationwide resource allocation: In theory, police officers in one region can handle business applications from people in any region of the country (within the scope permitted by business rules), providing a technical foundation for the overall allocation and balanced service of vehicle management business resources nationwide.

[0073] Improving satisfaction: This move greatly benefits drivers and car owners who are often away from home, solves a major pain point for them, and significantly improves the public's satisfaction and sense of gain with traffic management work. Attached Figure Description

[0074] Figure 1 This is a system architecture diagram for remote video processing and online electronic signing of vehicle management office services;

[0075] Figure 2 This is a complete flowchart of the remote video processing and online electronic signing system for vehicle management office business. Detailed Implementation

[0076] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0077] It should be noted that the terms "comprising" and "having" and any variations thereof in the specification, claims and accompanying drawings of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such process, method, product or device.

[0078] This application aims to construct a comprehensive business processing system for vehicle management offices that integrates mobile (mini-program) and PC platforms. The system includes both a mini-program and a PC client, with functional modules on each platform working collaboratively to provide users with a convenient, efficient, and secure business processing experience. The mini-program focuses on user-friendly operation, allowing users to select services, authenticate identities, connect via video, sign documents online, and make payments anytime, anywhere. The PC client focuses on back-end processing and auxiliary functions, enabling key business processes such as AI-assisted verification, video access management, flexible application form configuration, and accurate input of materials into the six-in-one system.

[0079] The following is a description of some of the technical terms used in this application:

[0080] Video processing: This refers to police officers guiding the public online through remote video calls to complete the vehicle management office's business processing procedures.

[0081] Online identity verification: Using technologies such as ID card collection and facial recognition, the authenticity of people's identities is verified online.

[0082] AI-assisted verification: The materials uploaded by the public through the mini-program are automatically verified for consistency and completeness using AI capabilities;

[0083] The six-in-one system is a unified traffic management application platform responsible for the final processing and data management of core businesses such as motor vehicles and driver's licenses.

[0084] Original handwriting electronic signature: Signature confirmation is completed on electronic application forms through electronic signature technology, and has legal effect.

[0085] Image data: Converting paper materials into electronic images through photography or scanning, and storing them in a structured manner for system recognition and transmission.

[0086] One embodiment of this application is shown below. Figure 1 The system architecture will be described in detail.

[0087] I. Mobile App (Mini Program) Functional Modules

[0088] 1. Business Selection and Loading Module:

[0089] Function: This module displays various vehicle management office services and receives user commands to initiate service processing. It provides users with a clear and intuitive interface categorizing services, allowing them to quickly find and select the services they need. It covers different types of services related to motor vehicles and driver's licenses managed by the vehicle management office, meeting the needs of diverse user groups.

[0090] Detailed process:

[0091] After opening the mini-program, users are taken to the business selection homepage. The page displays different business categories in a simple and clear way with icons and text, such as "Reissue Vehicle License", "Cancel Exam Appointment", and "Driver's License Cancellation Can Be Restored".

[0092] Users can click on the corresponding business category icon to enter the specific business list page under that category. The list details the name and brief description of each business.

[0093] Users can click on the specific service name according to their needs to enter the detailed information page for that service, including the service application process, required materials, processing time, and other information. After confirming that everything is correct, users can click the "Start Processing" button to proceed with the subsequent service application process.

[0094] 2. Identity Authentication and Facial Recognition Module

[0095] Function: Used to verify the identity information uploaded by users. This ensures the authenticity and validity of the user's identity when conducting business, preventing risks such as impersonation and guaranteeing the security and legality of business transactions. It achieves high-precision identity verification through a combination of multiple authentication methods and facial recognition technology.

[0096] Detailed process:

[0097] After the user selects a specific service and clicks "Start Processing", the system automatically redirects to the identity verification page.

[0098] Users first need to upload a picture of their ID card and extract relevant information from it, such as their ID number and name. The system then compares this information with the department's database in real time to initially verify the authenticity of the user's identity information.

[0099] After initial verification, the facial recognition process begins. The system prompts the user to follow on-screen instructions for facial capture, such as adjusting the camera angle and ensuring the face is within the designated area. The captured facial image is then compared and analyzed with the ID photo, using advanced biometric algorithms to determine if it belongs to the same person.

[0100] If facial recognition is successful, the system records the user's identity authentication information and allows the user to proceed to the next business processing stage; if recognition fails, the system prompts the user to try again or choose other identity authentication methods (such as SMS verification code verification).

[0101] 3. Video connection request module

[0102] Function: Used to establish encrypted video calls with the video access module. This allows users to communicate in real-time with staff (police officers) during business transactions, enabling police officers to verify the information of the parties involved, confirm their identity, and confirm business transactions. Users can initiate video connection requests through this module to establish video calls with backend staff, enabling face-to-face communication and improving the efficiency and accuracy of business transactions.

[0103] Detailed process:

[0104] When a user clicks the "Video Connection" button on the page during the business process, the system will pop up a video connection request confirmation window, prompting the user that a video connection is about to be initiated and displaying information such as the estimated waiting time.

[0105] After the user confirms the request, the system sends the request to the backend PC. The police officers on the PC assign available staff to the user based on the current availability of staff and establish a video connection channel.

[0106] Once the staff accepts the video call request, the video call between the user and the staff officially begins. During the video call, the user can ask questions, show relevant materials, etc., and the staff will provide real-time guidance and answers, and verify the identity of the parties involved, based on the user's situation.

[0107] After the video call ends, the user clicks the "End Call" button. The system closes the video connection channel and records relevant information about the video call, such as call duration and content, for later query and statistics.

[0108] 4. Original handwriting electronic signature

[0109] Function: Enables online document signing during business processing, providing users with a convenient electronic operation method, reducing offline processing steps, and improving business processing efficiency.

[0110] Detailed process:

[0111] At specific stages of the business process, the system generates an electronic document, namely the business application form, that requires the user's signature and displays it to the user on the page.

[0112] After carefully reading the document, the user clicks the "Sign" button. The system then pops up a signing confirmation window, reminding the user of the legal effect and precautions of the signing.

[0113] After the user confirms that the signature is correct, the system uses original handwriting electronic signature technology to collect the signature. The system then combines the user's signature information with the electronic document and generates a legally valid electronic signature document.

[0114] 6. Payment and Status Update Module

[0115] Function: Provides users with an online payment channel. After a user completes an online payment, the business status is updated to "paid" through an asynchronous callback mechanism between the payment gateway and the business middleware.

[0116] Detailed process:

[0117] After the user completes the signing, the system automatically redirects to the payment page, displaying detailed information such as the amount due and the payment items.

[0118] Users select a suitable payment method, such as WeChat Pay, and after clicking the corresponding payment button, the system calls the third-party payment interface and redirects them to the payment platform page.

[0119] After a user completes the payment on the payment platform page, the payment platform sends the payment result to the integrated payment system. The system updates the service status based on the payment result. If the payment is successful, the service continues with subsequent processes; if the payment fails, the system prompts the user to pay again or choose another payment method.

[0120] II. Functional Modules on the PC Side

[0121] 1. AI-assisted verification module

[0122] Functions: This module automatically categorizes, extracts key information, and verifies consistency of user-submitted materials; the video access module manages video call access, ensuring call quality and efficient resource allocation. It utilizes artificial intelligence technology to automatically verify user-submitted business processing materials, improving verification efficiency and accuracy, reducing the workload of manual verification by staff, and lowering the rate of human error.

[0123] The detailed process is as follows:

[0124] After receiving materials uploaded by the public through the mini-program, the AI-assisted verification component automatically integrates to intelligently review the uploaded materials, primarily focusing on consistency and completeness. Materials failing the review are rejected, and the public must re-upload them. For materials passing the review, police officers intervene to process the application. Verification includes:

[0125] AI image recognition and comparison: The algorithm compares and identifies four photos uploaded by the public: ID card photo, facial recognition photo, certificate photo, and on-site photo, to analyze whether they are the same person's facial information, so as to ensure the consistency of materials and the identity of the person when handling business.

[0126] Signature handwriting comparison: The algorithm recognizes the user's signature on the application form, identifies the actual signature information, and then compares it with the name of the person who actually handled the business. The signature is only valid if the name matches, thus ensuring the integrity of the application form.

[0127] Content consistency comparison: Content consistency means that the names, ID numbers and other information appearing in the material information and personnel information are completely consistent. For example, the names and ID numbers on the application form, the names and ID numbers on the ID card, the names and ID numbers filled in by the applicant during data entry, etc., are compared and identified between materials.

[0128] After verification, the system generates verification results, listing issues found during the verification process, such as inconsistencies in information, missing materials, and errors in filling out forms, and displays the report to staff. Based on the verification report, staff further process the business order, such as requesting users to supplement materials or modify information.

[0129] 2. Video access module

[0130] Function: This module automatically receives video call requests, establishes video calls, and provides remote video guidance and document verification for police officers. As the core support module for video call functionality between the PC and mini-program platforms, it manages video call access, allocation, and monitoring, ensuring the stability and smoothness of video calls and providing reliable technical support for real-time communication between staff and users.

[0131] The detailed process is as follows:

[0132] When a user on the mini-program initiates a video connection request, the system sends the request information to the video access module on the PC.

[0133] The video access module intelligently assigns available staff to handle the video call request based on factors such as the staff's online status and business type. After assignment, a video call notification message, including basic user information and business type, is sent to the staff member's PC.

[0134] After a staff member accepts a video call request, the video access module establishes a video connection channel between the user and the staff member, and monitors the quality of the video call in real time, such as network latency, image clarity, and audio quality. If a call quality problem is detected, the system automatically attempts to adjust network parameters or take other optimization measures to ensure the smooth progress of the video call.

[0135] During a video call, the video access module records relevant call information, such as start time, end time, and duration, for subsequent statistical analysis. It also allows staff to record video calls for easy review and verification later.

[0136] 3. Business Processing Module

[0137] Function: This module is used to bind the business transaction number to the corresponding video task after a video call; in response to a signing instruction, it automatically generates an electronic application form with a signing area and pushes the signing request to the user; it writes the electronic materials into the six-in-one system, formally accepts the business, and generates corresponding payment information and pushes it to the mobile terminal. This module accurately writes the business processing materials submitted and verified by the user on the mini-program into the six-in-one system (traffic management integrated business processing platform), achieving seamless connection and flow of business data, and ensuring that the business can be processed smoothly in the six-in-one system.

[0138] The detailed process is as follows:

[0139] Once users complete all the preliminary steps of the business process on the mini-program, such as identity verification, document upload, online signing and payment, and all documents are verified to be correct with AI assistance, the system generates a business completion notification message on the PC.

[0140] After the staff confirms the business processing status on the PC, they click the "Write to the Six-in-One System" button. The system automatically extracts all relevant materials and data under the business order, including user basic information, application form content, supporting documents, etc.

[0141] The system organizes and converts the extracted materials and data according to the data format and interface specifications stipulated by the six-in-one system, generating a data package that meets the requirements of the six-in-one system.

[0142] The system calls the interface provided by the six-in-one system to send data packets to the six-in-one system. During data transmission, the system monitors the transmission status in real time to ensure that the data arrives at the six-in-one system accurately.

[0143] After receiving the data packet, the six-in-one system parses and verifies the data. If the data verification is successful, the six-in-one system enters the business data into the system database and sends a success message to this system; if the data verification fails, the six-in-one system returns an error message, and this system, upon receiving the error message, prompts staff to check the data and rewrite it.

[0144] 4. Application Form Configuration Module

[0145] Function: This module allows administrators to flexibly configure the content of business application forms, signature positions, etc., according to different business needs, so as to realize different business customization of application forms and improve the adaptability and flexibility of business processing.

[0146] The detailed process is as follows:

[0147] After logging into the PC system, administrators access the application form configuration management interface. This interface displays all existing business application form templates in a list format.

[0148] Administrators can choose to create a new application form template. The system will pop up an application form creation window. After entering basic information such as the application form name and applicable business type, the administrator will enter the application form design page.

[0149] On the application form design page, administrators can add various form elements, such as text boxes, dropdown lists, radio buttons, and checkboxes, by dragging and dropping components. They can also set attributes such as label name, input prompts, and default values ​​for each element. Furthermore, they can define the logical relationships between form elements, such as the display or hiding conditions for certain elements and the setting of required fields.

[0150] After completing the application form design, the administrator clicks the "Save" button, and the system saves the application form template to the database. Subsequently, when users handle related business, the system automatically uses the corresponding application form template to generate the application form page for the user to fill out.

[0151] If an existing application form template needs to be modified, the administrator can select the corresponding template in the application form configuration management interface, click the "Edit" button to enter the application form design page to make modifications, and then click the "Save" button to update the template information after the modifications are complete.

[0152] See below Figure 2 The process steps for implementing the remote video processing and online electronic signing method for vehicle management office business are described in detail through further embodiments.

[0153] The complete process of this method involves three main components: a mobile app, a police officer's PC management terminal, and a six-in-one system on the intranet. The details of its interaction process are as follows:

[0154] Business Selection and Loading: On the mobile device, the business selection and loading module automatically loads and displays different business types of the vehicle management office. Based on the specific business type and processing instructions selected by the user, it loads the business details page and starts the processing procedure.

[0155] Identity authentication and information entry: On the mobile device, the identity authentication and information entry module obtains the ID card information uploaded by the user and performs facial recognition to confirm the validity of the user's identity. Then, it instructs the user to fill in the business-specific information. Through two-way data binding technology, it automatically fills in the ID card data previously submitted by the user into the application form and verifies the clarity, completeness and format of the materials uploaded by the user according to the material list.

[0156] Requesting a video call: On mobile devices, the video call request module automatically triggers a task distribution mechanism after a user initiates a video call request, intelligently assigning the call request to the appropriate police officer based on the officer's online status and skill group;

[0157] Video access call: On the PC, the video access module automatically receives video connection requests, establishes WebRTC video calls, and provides police officers with remote video guidance, material verification, and business confirmation, etc.

[0158] Generating business and signing documents: On the PC, the material writing module of the six-in-one system binds the business serial number with the current video task. At the same time, in response to the signing instruction, it automatically generates an electronic application form with a signing area and pushes the signing request to the user. The business serial number is automatically generated by the six-in-one system after the police enter the business information in the intranet.

[0159] Electronic signature: On mobile devices, after receiving a signature request, the handwritten electronic signature module uses original handwriting electronic signature technology to collect the user's signature handwriting, combines the user's signature information with the electronic document, and generates a legally valid electronic signature document.

[0160] Business Acceptance: On the PC, the material writing module of the six-in-one system receives all the approved electronic materials, packages them, and transmits them to the intranet through a secure data exchange channel. The intranet server then executes the material writing step, adding the image data as an attachment to the business record in the six-in-one system that is bound to the business serial number, thus formally accepting the business, generating the corresponding payment information, and pushing it to the mobile terminal.

[0161] Payment: On the mobile device, after receiving payment information, the payment and status update module calls the payment gateway to provide users with an online payment channel. After the user completes the online payment, the business status is updated to "paid" through the asynchronous callback mechanism between the payment gateway and the business middle platform.

[0162] Business completion: On the PC, after the materials are entered into the six-in-one system processing module and payment is confirmed, the business status is updated and a completion notification is pushed to the mobile device.

[0163] The following examples further illustrate the specific implementation of this method from the perspective of the user and police officer's operating system:

[0164] Step 1: The customer first selects the service they need to handle.

[0165] Technical Implementation: After logging into the mini-program, the front-end interface dynamically loads a list of available service types (such as driver's license replacement, vehicle registration change, etc.) from the server by calling the (getServiceCategoryList) interface. The service list is configured by the management backend and supports canary releases and regionally differentiated management. After the user clicks to select a service, the service_id and service_name parameters are stored in the local cache as the business context for subsequent processes.

[0166] Step 2: Business Instructions - Inform the public of the materials needed and the operating guidelines.

[0167] Technical Implementation: Based on the selected service_id in the previous step, the frontend calls the getServiceGuide(service_id) interface to retrieve the relevant HTML-formatted instructions, required documents, and operation guide from the business rules engine. The system implements a mandatory reading mechanism (15-second countdown) and requires the user to check the "I have read and agree" checkbox. The backend records the agreement_timestamp in the database to ensure the user is fully informed.

[0168] Step 3: The public takes a photo of their ID card and then performs facial recognition.

[0169] Technical Implementation: ID Card Recognition: The system integrates an Optical Character Recognition (OCR) SDK, utilizing the phone's native camera component. After the user photographs the front and back of their ID card, the SDK automatically performs perspective correction, moiré removal, and edge enhancement on the image, extracting structured data (name, id_number, address, etc.). By calling the Internet+ Trusted Identity Authentication Platform interface, the system performs preliminary verification of the ID card information to determine its validity.

[0170] Face recognition: The liveness detection process is initiated, requiring the user to perform random actions (such as blinking or shaking their head). After capturing the video stream, a fusion model of silent liveness detection and action liveness detection is used to determine if the person is real. Subsequently, the captured facial features are compared 1:1 with the features extracted from the ID card photo using OCR, and a similarity score is calculated. If the score is higher than a preset threshold (e.g., 0.89), the verification passes; otherwise, a verification failure message is displayed, and a retry is allowed.

[0171] Step 4: Enter the information that needs to be combined into the application form.

[0172] Technical Implementation: The system automatically populates the corresponding fields in the electronic application form's JSON template with the identity information extracted by OCR. For business-specific information (such as vehicle license plate number and contact address), a dynamic form is rendered for users to fill in. The front-end uses frameworks such as Vue.js or React to implement two-way data binding, and all data is ultimately aggregated into a structured application_form data object.

[0173] Step 5: Take photos of the materials required for the transaction.

[0174] Technical Implementation: Guide users to upload materials one by one according to the required_docs list. Access the phone's camera or photo album:

[0175] Sharpness detection: Calculate the blur value of the image; if it is too low, the image will be rejected.

[0176] Integrity detection: Use object detection algorithms (such as YOLO) to determine whether key areas (such as official seals and dates) are completely visible in the image.

[0177] Format verification: Checks whether the file is in an allowed format (JPG / PNG / PDF) and whether the size meets the requirements.

[0178] All files that pass the verification are uploaded to the cloud object storage (Alibaba Cloud) and a unique file_id is returned to associate with the current business transaction.

[0179] Step 6: Initiate video call and wait

[0180] Technical Implementation: When a user clicks "Video Processing," the mini-program calls the `(createVideoSession)` API. The backend business platform receives the request and performs the following operations:

[0181] Update the current business status to "Pending video processing".

[0182] Intelligent task allocation is performed based on the type of business and the police officer's skill-based routing, and task notifications (new_task_alert) are pushed to the target police officer's PC management terminal using WebSocket.

[0183] At the same time, a video session room is established, and a temporary room_id and token are generated and returned to the mini-program so that it enters the waiting queue interface.

[0184] Step 7: AI-assisted verification of materials uploaded by the public

[0185] Technical Implementation: After a user initiates a video call request and before the task is assigned to a police officer, the system automatically triggers an AI-assisted verification process: Uploaded materials are automatically categorized using a pre-trained visual model (e.g., identifying whether it is a driver's license or vehicle registration certificate), and key field information is extracted using OCR technology. The system then verifies the logical consistency between the data using a rule engine and business logic (e.g., verifying whether ID card information matches facial recognition results, and whether vehicle information matches the form information). The verification results (pass / fail and specific reasons) are synchronously recorded in the database. If the verification fails, the process is terminated early, and the user is prompted to supplement or correct the materials. If the verification passes, the task status is updated to "awaiting police officer processing" and pushed to the police officer's end, thereby improving overall processing efficiency and accuracy.

[0186] Step 8: Police officers receive task reminders from the public.

[0187] Technical Implementation: The police officer's PC management terminal maintains communication with the business platform through a persistent connection (such as WebSocket). When a new video task is assigned, the server pushes a JSON-formatted message: {type: 'new_task', task_id:'123', user_info: {...}, service_type: 'Driver's License Renewal'}. The management terminal interface notifies the police officer through pop-ups, sound alerts, etc., and adds the task to the officer's "To-Do Task List".

[0188] Step 9: Select the business area to review the materials for pre-approval.

[0189] Technical Implementation: When a police officer clicks on a task item, the management interface calls the `getTaskDetail(task_id)` API. The backend retrieves all relevant information for the task (user identity information, electronic application form data, and a list of uploaded document URLs) from the database and object storage. The management interface displays this information in tabs, allowing police officers to browse the electronic materials and application forms one by one for preliminary formal review (whether the materials are complete and whether the format meets the requirements) and form a preliminary judgment.

[0190] Step 10: Initiate a video call

[0191] Technical Implementation: When a police officer clicks the "Video Connection" button, the management terminal joins the video room created in step 6 using the `joinRoom(room_id, token)` command. The mini-program receives the `peer_joined` event via WebSocket, automatically answers the call, and establishes a connection. This application uses the WebRTC protocol to establish peer-to-peer encrypted video calls, with the media stream relayed through a TURN / STUN server to penetrate complex network environments and ensure low latency and high reliability of audio and video.

[0192] Step 11: Video Instruction Service

[0193] Technical implementation: During video calls, police officers can guide users through real-time voice instructions and video annotation tools.

[0194] Document verification: Police officers can ask users to point the camera at physical documents (such as driver's licenses or vehicle VIN codes) and compare the real-time video footage with the previously uploaded electronic documents to verify their authenticity.

[0195] Business confirmation: The police officer verbally confirms the key information in the application form with the user.

[0196] Video evidence storage: The entire video stream (including audio and video data) is recorded after being encoded with H.264, stored in secure cloud storage, and linked to business records as evidence for future audits or dispute resolution.

[0197] Step 12: Enter the serial number generated by the six-in-one system.

[0198] Technical Implementation: After confirming the transaction is correct, the police officer manually logs into the integrated intranet system and enters the transaction information, just like handling it offline. The integrated system generates a unique transaction serial number (e.g., 220101-1234567890). The officer manually enters or copies this serial number into a designated input box on the PC management terminal. The management terminal binds this official_serial_number to the current video task, signifying that the transaction has been officially accepted in the core system.

[0199] Step 13: Initiate application form signing

[0200] Technical Implementation: Police officers click "Initiate Signing" on the PC management terminal. The system calls the (createSignTask) interface of the electronic signature service, sending the final electronic application form (PDF format) and the specified signing area information to the signature service. The signature service generates a unique sign_task_id and returns a signing link or QR code. The mini-program receives the signing request in real time via a WebSocket channel, and a prompt appears on the interface, guiding the user to the signing page.

[0201] Step 14: Write the image data into the six-in-one system

[0202] Technical Implementation: This is a crucial step in establishing a connection between the internet and the intranet. Police officers click "Transfer of Image Data" on their PC management terminal. The management terminal packages all final electronic materials for this service (application form, identity certificate, other supporting documents) into a ZIP archive and transmits it to the designated receiving server on the intranet via the secure data exchange channel specified by the intranet boundary security platform (such as a network gateway). After parsing the data packet, the intranet server calls the standard data interface provided by the six-in-one system to add the image data as an attachment to the service record corresponding to the serial number in step 11, thus completing the processing of the service on the six-in-one platform.

[0203] Step 15: Collect the payment QR code of the six-in-one system and push it to the mini-program on the user's end.

[0204] Technical Implementation: After a transaction is processed in the integrated system, the system generates corresponding payment information. Police officers click "Generate Payment QR Code" in the integrated system. The system then calls the interface of the fiscal non-tax revenue system to generate a QR code image containing information such as the payment amount, fee item, and transaction number. The police officer scans the QR code using the "scan" tool provided on the PC management terminal. The management terminal parses the QR code information and, through the pushPaymentInfo() interface of the business platform, encrypts the payment amount, item description, and payment link from the fiscal system before pushing it to the mini-program via WebSocket.

[0205] Step 16: Hang up the video call

[0206] Technical Implementation: The core business process is complete; both police officers and users can click "End Video." The mini-program and management terminals respectively call the `leaveRoom()` interface to notify the WebRTC server to release the media stream resources for this call. The video session officially ends, but the business status changes to "Pending Payment," and the business logic is not yet finished.

[0207] Step 17: Citizens make payments through the pending services.

[0208] Technical Implementation: After receiving payment information, the mini-program displays it in the "To-Do List". When the user clicks to pay, the front end redirects to an encrypted payment intermediary page, calling the interface of the payment gateway (such as UnionPay, Alipay, or WeChat Pay). After the user completes the payment, the payment gateway notifies the business middleware of "payment_success" via an asynchronous callback. The business middleware updates the payment status in the database to "paid" and records the payment_id and payment_time.

[0209] Step 18: After payment, the police officer will provide feedback on the completion status of the six-in-one service.

[0210] Technical Implementation: After receiving a payment success callback, the business platform pushes a message via WebSocket to the police officer's PC management terminal: {type: 'payment_success', task_id: '123'}. The police officer checks the payment confirmation in the integrated system and then completes the final "completion" operation in the integrated system. The integrated system updates the business status to "completion". Subsequently, the police officer clicks "completion feedback" on the PC management terminal, and the system calls the updateTaskStatus(task_id, 'completed') interface to synchronize the final status back to the business platform. The business platform then pushes a completion notification to the mini-program terminal, informing the user that the business has been successfully processed and providing a download link for the electronic voucher. Thus, the entire business process forms a complete closed loop.

[0211] As seen from the above method of handling vehicle management services by combining remote video verification and electronic signature, this method enables remote vehicle and driver verification through video calls and completes legal confirmation through electronic signatures, forming a complete online processing loop. AI facial recognition and handwriting recognition algorithms are used to intelligently assist in the verification of materials uploaded by the public, ensuring the completeness and consistency of the materials. Through material imaging and the automatic writing mechanism of the six-in-one system, the electronic materials uploaded by the public are automatically structured and written into the internal six-in-one system through a standard interface, reducing manual data entry. Through a multi-terminal collaborative task scheduling and status synchronization mechanism, the task status of the public, police officers, and the six-in-one system is synchronized in real time, ensuring smooth processes and data consistency. Through automatic identity and material verification based on OCR and facial recognition, automatic identity recognition and material pre-screening are achieved at the public's end, improving review efficiency and accuracy.

Claims

1. A system for online processing of vehicle management office services based on AI-assisted verification and original handwriting electronic signature, characterized in that, include: Mobile and PC platforms; The mobile device includes: The business selection and loading module automatically loads and displays different business types of the vehicle management office. Based on the specific business type and processing instructions selected by the user, it loads the business details page and starts the processing procedure. The identity authentication and facial recognition module is used to obtain the ID card information uploaded by the user and perform facial recognition to confirm the validity of the user's identity. It instructs the user to fill in the business information, automatically fills in the ID card data submitted by the user into the application form through two-way data binding technology, and verifies the clarity, completeness and format of the materials uploaded by the user one by one according to the material list. The video connection request module is used to establish encrypted video calls with the video access module. After the user initiates a video connection request, the task distribution mechanism is automatically triggered to intelligently assign the connection request to the appropriate police officer based on the police officer's online status and skill group. The original handwriting electronic signature module is used to collect users' signature handwriting using original handwriting electronic signature technology, combine the user's signature information with electronic documents, and generate a legally valid electronic signature document. The payment and status update module provides users with an online payment channel. After a user completes an online payment, the business status is updated to "paid" through an asynchronous callback mechanism between the payment gateway and the business middle platform. The PC terminal includes: The video access module is used to automatically receive video connection requests, establish video calls, and provide police officers with remote video guidance, material verification, and business confirmation, ensuring call quality and reasonable resource allocation. The AI-assisted verification module is used to automatically classify, extract key information and verify consistency of user-submitted materials; The business processing module is used to bind the business transaction number with the corresponding video task after a video call; in response to the signing instruction, it automatically generates an electronic application form with a signing area and pushes the signing request to the user; it writes the electronic materials into the traffic management integrated application platform, formally accepts the business, and generates the corresponding payment information and pushes it to the mobile terminal. The video call request module automatically triggers an AI-assisted verification process after a user initiates a video call request, and automatically records and saves call-related information, including call start time, end time, and call duration, after the video call ends, and performs video call recording and verification; the video access module intelligently schedules resources and assigns tasks according to the business type and police officer skill group when it receives a video call request.

2. The system according to claim 1, characterized in that, The video call established between the video connection request module and the video access module uses the WebRTC protocol for point-to-point encrypted communication and is relayed through a TURN / STUN server to ensure the stability and low latency of the video call.

3. The system according to claim 1, characterized in that, After a user initiates a video connection request, the mobile terminal generates a temporary room_id and token, causing the user to enter a waiting queue. The PC terminal then establishes a video connection channel through the joinRoom interface.

4. The system according to claim 1, characterized in that, The AI-assisted verification module uses deep learning models and OCR technology to automatically classify and identify the materials uploaded by users and extract key field information. It verifies the logical consistency between the data through a rule engine and business logic. The verification results are synchronously recorded in the database. If the verification fails, the process is terminated in advance and the user is prompted to supplement or correct the materials. If the verification passes, the task status is updated and pushed.

5. The system according to claim 1, characterized in that, The business processing module uses a secure transfer or dedicated interface to package the electronic application form and image materials that have passed the front-end review, and transmit them to the intranet through a secure data exchange channel. The intranet server then performs the material writing, and the image data is used as a business record in the business processing module that is bound to the business serial number.

6. The system according to claim 1, characterized in that, It also includes an application form configuration module, which receives instructions from management personnel and configures the composite content of the application form according to different business needs, including adding form elements, setting attributes and logical relationships, so as to realize customized management of application forms.

7. The system according to claim 1, characterized in that, The identity authentication and facial recognition module uses OCR technology to automatically extract structured data from ID cards and performs preliminary verification of ID card information by calling the trusted identity authentication platform interface.

8. The system according to claim 1, characterized in that, The mobile device is a mini-program.

9. A method for online processing of vehicle management office services based on AI-assisted verification and original handwriting electronic signature, characterized in that, Includes the following steps: Business Selection and Loading: On the mobile device, the business selection and loading module automatically loads and displays different business types of the vehicle management office. Based on the specific business type and processing instructions selected by the user, it loads the business details page and starts the processing procedure. Identity authentication and information entry: On the mobile device, the identity authentication and information entry module obtains the ID card information uploaded by the user and performs facial recognition to confirm the validity of the user's identity. Then, it instructs the user to fill in the business information. Through two-way data binding technology, it automatically fills in the ID card data previously submitted by the user into the application form and verifies the clarity, completeness and format of the materials uploaded by the user according to the material list. Requesting a video call: On mobile devices, the video call request module automatically triggers a task distribution mechanism after a user initiates a video call request, intelligently assigning the call request to the appropriate police officer based on the officer's online status and skill group; Video access call: On the PC, the video access module automatically receives video connection requests, establishes WebRTC video calls, and provides police officers with remote video guidance, material verification, and business confirmation. Generating business and signing documents: On the PC, the material writing module of the six-in-one system binds the business serial number with the current video task. At the same time, in response to the signing instruction, it automatically generates an electronic application form with a signing area and pushes the signing request to the user. The business serial number is automatically generated after the police enter the business information into the traffic management integrated application platform on the intranet. Electronic signature: On mobile devices, after receiving a signature request, the handwritten electronic signature module uses original handwriting electronic signature technology to collect the user's signature handwriting, combines the user's signature information with the electronic document, and generates a legally valid electronic signature document. Business Acceptance: On the PC, the business processing module receives all approved electronic materials packaged together and transmits them to the intranet through a secure data exchange channel. The intranet server then executes the material writing step, adding the image data as an attachment to the business record in the traffic management integrated application platform that is bound to the business serial number, thus formally accepting the business and generating the corresponding payment information, which is then pushed to the mobile device. Payment: On the mobile device, after receiving payment information, the payment and status update module calls the payment gateway to provide the user with an online payment channel. After the user completes the online payment, the business status is updated to "paid" through the asynchronous callback mechanism between the payment gateway and the business middle platform. Business completion: On the PC, after confirming payment, the business processing module updates the business status and pushes a completion notification to the mobile device.

10. The method for remote video processing and online electronic signing of vehicle management office services according to claim 1, characterized in that, After a user initiates a video call request but before the task is assigned to a police officer, the video call request module automatically triggers an AI-assisted verification process: it automatically categorizes the uploaded materials using a pre-trained visual model, extracts key field information using OCR technology, and then verifies the logical consistency between the data using a rule engine and business logic; the verification results are synchronously recorded in the database. If the verification fails, the process is terminated in advance and the user is prompted to supplement or correct the materials. If the verification passes, the task status is updated and pushed.

Images