An intelligent examination data processing system and method based on permission integration and asynchronous statistics

Abstract

The application discloses an intelligent examination data processing system and method based on permission integration and asynchronous statistics, and relates to the field of computer software.The system comprises a teacher terminal, a student terminal and a server end;the server end realizes atomicity verification of commercial permission through a permission control subsystem;the whole process safety is guaranteed through a dynamic token chain;high-concurrent requests and data processing are decoupled through a message queue and an asynchronous processing engine;real-time dynamic statistics of question granularity are realized through atomic operation of an in-memory database and streaming calculation.The application solves the problems of poor safety, low high-concurrent performance, lagging analysis feedback and difficulty in reliable integration of commercial logic of the existing online examination system, and realizes safe, efficient, real-time and commercial intelligent examination data processing.

Description

Technical Field

[0001] This invention relates to the fields of computer software and online education technology, specifically to an intelligent examination data processing system and method that integrates commercial license control, utilizes asynchronous message processing and real-time streaming statistics to achieve high security, high concurrency, and real-time feedback. Background Technology

[0002] With the development of educational informatization, online examination systems are becoming increasingly popular. However, existing systems suffer from the following technical deficiencies in their architectural design that urgently need to be addressed: 1. Weak security and anti-cheating mechanisms: Most systems use simple passwords or fixed keys, and the process of storing and transmitting answers lacks strong verification, making them easy to be cracked or stolen during the exam, posing a significant security risk of data leakage. 2. Performance bottlenecks and poor scalability: The system uses a synchronous request-response model for answer grading and statistics. When a large number of students submit answers simultaneously, the server faces instantaneous high concurrency pressure, leading to response delays, service lag, and even crashes, resulting in poor system stability and user experience. 3. Lagging and crude data analysis capabilities: Statistical results are usually generated in batches after the exam is completely over, which cannot provide real-time feedback; and the analysis dimensions are mostly limited to the total score or average score, lacking dynamic and detailed insights into the answers to each question, making it difficult for teachers to adjust their teaching strategies in a timely manner. 4. Disconnect between business model and technical architecture: Paid features are often treated as independent front-end modules with low coupling to the core examination process. When supporting flexible strategies such as "pay-per-use" and "all-inclusive memberships," there is a lack of technical means to perform atomicity and consistency verification of user permission status under high concurrency, which can easily lead to vulnerabilities in business logic such as overselling and permission bypassing. While existing technical solutions mention online examinations, they do not address the issues of deep integration of security, performance, and real-time analysis in the aforementioned commercial high-concurrency scenarios. Summary of the Invention

[0003] (a) Technical problems to be solved This invention aims to solve the technical problems of existing online examination systems, such as low data security, weak high-concurrency processing capabilities, delayed analysis and feedback, and the disconnect between commercial licensing control and core business logic. It provides an intelligent data processing system and method that can ensure examination security, support massive concurrency, achieve real-time dynamic analysis at the question level, and reliably integrate complex payment strategies. (II) Technical Solution: To achieve the above-mentioned objectives, the present invention adopts the following overall technical concept: designing a multi-layered dynamic token chain to control the security of the entire process; using a message queue asynchronous decoupling architecture to separate request response and data processing; utilizing in-memory computing and streaming aggregation to achieve real-time statistics; and constructing an independent permission control subsystem to transform business rules into atomically executable technical instructions, thereby deeply integrating security, performance, analysis, and business logic into an organic whole. In a first aspect, the present invention provides an intelligent examination data processing method based on permissioned integration and asynchronous statistics, applied to a server cluster, characterized by comprising the following steps: S1: Exam Creation and Security Initialization Steps. In response to the teacher's terminal's creation request, the permission control subsystem verifies the account's creation permission status. Upon successful verification, the token management unit generates a time-limited exam creation token (ECT). Subsequently, the key and token management unit generates a globally unique exam key (EK) and a one-time standard answer storage token (AST). The EK is issued to the teacher's terminal, and the AST is associated with an encrypted temporary storage area. Technical Means: Permission status query, HMAC-SHA256-based token generation, and encrypted temporary storage area creation. Technical Problems Solved: Resolves security vulnerabilities such as unclear permissions during exam creation, easily guessed fixed keys, and exposed standard answer storage points. Technical Effects Achieved: Implements mandatory permission verification in the exam creation process, laying a secure foundation for subsequent processes through dynamic and unpredictable tokens and keys. S2: Controlled Submission and Destruction of Standard Answers. After the exam, the teacher submits encrypted standard answers using an AST (Abstract Syntax Tree). The secure answer storage unit verifies the validity of the AST, decrypts the answer, stores it in the corresponding temporary storage area, and then immediately destroys the AST in memory and the database. Technical Means: One-time token verification, associated data authentication encryption (AES-256-GCM), and immediate token destruction. Technical Problems Solved: This addresses the risks of interception, tampering, or unauthorized access to standard answers during transmission and storage, as well as the potential for secondary leakage due to long-term answer storage. Technical Benefits: This ensures that standard answers are submitted only within a specified time window, through a single authorized channel, and are completely erased after use, greatly enhancing answer confidentiality. S3: Atomic verification step for student participation and permission. The student terminal initiates a participation request using the EK. The real-time authentication engine of the permission control subsystem verifies the permission policy configured for this exam (e.g., single-payment). If it is a paid mode, the billing trigger interface is called to link with the payment gateway, and after the payment callback is successful, the permission usage count for this exam is atomically updated using database optimistic locking or Redis atomic operations, and a student permission record is generated. Subsequently, the token management unit generates a signed answer submission token (ASTu-JWT) for this student. Technical means: Permission policy database query, payment gateway callback processing, database optimistic locking (UPDATE ... SET used_quota = used_quota + 1WHERE version = ?) or Redis INCR atomic command, JWT token issuance. Technical problems solved: Solves the data consistency problem that may be caused by license overselling (i.e., the number sold exceeds the inventory) due to high-concurrency payment requests in commercial scenarios, as well as the permission bypass risk caused by the separation of permission verification and business execution. Technical benefits achieved: It enabled a strong binding between commercial licensing and exam participation, as well as precise control under high concurrency, ensuring the absolute accuracy of billing data and the fairness of transactions. S4: Asynchronous Reception and Reliable Buffering of Answers. Student terminals submit answer data carrying ASTu. After the server API gateway verifies the basic validity of the ASTu, it immediately returns a "submission successful" response and simultaneously publishes a task message containing complete answer data and the ASTu to a message queue (such as RabbitMQ / Kafka). Technical Means: JWT fast verification, asynchronous publishing via message queue. Technical Problem Solved: Resolves the problem of massive instantaneous answer submissions causing server overload in synchronous processing mode, leading to request timeouts or service unavailability. Technical Benefits: Decouples the immediate response of user interaction from the heavy backend data processing, ensuring a smooth frontend experience, and ensures no data loss through the message queue's persistence mechanism. S5: Distributed Asynchronous Processing and Streaming Statistics Steps. The asynchronous processing engine cluster acts as a consumer, sequentially retrieving tasks from the message queue. First, the token verification module performs a complete check on the ASTu (including signature, validity period, and matching degree with the exam). Next, the answer comparison module retrieves the standard answer from the corresponding temporary storage area for grading. Then, the core streaming statistics module performs atomic incremental counting operations (such as HINCRBYstat:exam:q1 total 1 and HINCRBY stat:exam:q1 correct 1) for each question using Redis's hash data structure. Individual results are stored in the database. Technical means: Distributed consumer cluster, message queue consumption, JWT deep validation, atomic incremental operations based on in-memory database (Redis). Technical problems solved: Solves the problems of delayed result updates and inability to reflect the progress of answering questions in real time under the traditional batch statistics mode, as well as the performance bottleneck brought by centralized statistics. Technical benefits achieved: Millisecond-level updates of question-level statistical results were achieved, enabling teachers to perceive the answers to each question in real time; the distributed processing architecture allows the system to handle any increase in data volume through horizontal scaling. S6: Real-time Push and Persistence Steps for Statistical Results. The real-time push unit listens for statistical data update events. When the streaming statistics module updates the count of a question, a publish event is triggered. The push unit obtains the latest statistical snapshot (such as accuracy rate) and pushes it to the online teacher's terminal in real time via WebSocket connection. Simultaneously, individual grading results are pushed to the corresponding student's terminal. In addition, a periodic data persistence service synchronizes the statistical results in memory to a relational database for historical querying. Technical means: Publish-subscribe (Pub / Sub) mode, WebSocket full-duplex communication, scheduled tasks (CronJob). Technical problems solved: Solved the problem of teachers needing to manually refresh the page to obtain updated data, and the reliability issue of easily lost in-memory data. Technical effects achieved: Provided teachers with a "live-stream" dynamic learning dashboard, achieving real-time teaching feedback; through dual storage in memory and database, it balanced real-time performance and data persistence. Secondly, the present invention provides a system for implementing the above method, characterized in that it includes: a teacher terminal, a student terminal, and a server; the server further includes: a permission control subsystem for managing payment strategies, performing real-time authentication and atomic billing operations; an examination management subsystem for generating and verifying dynamic token chains, managing the examination lifecycle, and securely storing answers; an asynchronous data processing subsystem, including message queue middleware, an asynchronous processing engine cluster, and a streaming statistics module, for asynchronously and reliably completing answer grading and real-time statistics; and a real-time communication subsystem for pushing real-time results to teacher and student terminals based on the WebSocket protocol. (III) Beneficial Effects Compared with existing technologies, the technical solution provided by this invention has the following significant advantages: It establishes an end-to-end secure trust chain: through the generation, verification, and destruction mechanism of multi-layered dynamic tokens (ECT, AST, ASU), security control is deeply embedded in every business link from exam creation to result announcement, fundamentally eliminating the risks of unauthorized access, answer leakage, and data tampering, and constructing a security system far exceeding traditional password verification. It achieves extreme elastic scalability and high availability: by introducing message queues, high-concurrency user requests are transformed into data streams that can be consumed asynchronously and smoothly. The data processing engine can dynamically scale based on load, completely solving the performance bottleneck of synchronous processing architectures, enabling the system to easily handle online exams with tens of thousands or even hundreds of thousands of users simultaneously. It provides unprecedented real-time refined analysis capabilities: utilizing the atomic operations and streaming computing concepts of in-memory databases, it achieves millisecond-level updates of question-dimensional statistical indicators. Teachers are no longer "post-exam reviewers" of exam results, but "on-site commanders" who can observe the changes in the accuracy rate of each question in real time, greatly improving the efficiency and quality of teaching interaction. A deep and reliable integration of business model and technical architecture has been achieved: an innovative independent "license control subsystem" has been designed to transform business rules (single-use / monthly subscription) into technical instructions that can be executed atomically by the system. Through optimistic locking, distributed atomic counters, and other technical means, the absolute accuracy and consistency of license revocation in high-concurrency transaction scenarios are ensured, solving the core technical challenges of "overselling" and "loss of funds" in the commercialization of online services, and enabling flexible business strategies to operate reliably in complex technical environments. Attached Figure Description

[0004] Figure 1 System architecture diagram (components and data flow); Figure 2 Overall flowchart (cross-role sequence); Figure 3 Flowchart of atomic update of license; Figure 4 Asynchronous processing and statistics flowchart; Figure 5 Real-time push sequence diagram.

Claims

1. A method for intelligent examination data processing based on permissioned integration and asynchronous statistics, characterized in that, include: Security initialization phase: In response to the teacher's creation request, after verifying its permission status, an examination key (EK) and a one-time standard answer token (AST) are generated. Permission verification phase: In response to the participation request initiated by the student with EK, the permission is verified according to the preset permission policy, and the permission count is atomically updated in the paid scenario to generate the answer submission token (ASTu). Asynchronous processing phase: Receive answers submitted by students carrying ASTu, verify them, and publish them to the message queue; the asynchronous processing engine consumes the queue messages, completes the answer comparison, and incrementally updates the statistical information at the question granularity through atomic operations in the in-memory database; Real-time push phase: Monitor for updates to statistical information and push the updated statistical information to the teacher's end in real time.

2. The method according to claim 1, characterized in that, The atomic update of the license count is implemented using database optimistic locking or distributed cache atomic instructions to ensure that the number of licenses consumed does not exceed the total number of licenses under high concurrency.

3. The method according to claim 1, characterized in that, The incremental update of the statistical information at the question granularity through atomic operations in the in-memory database is specifically achieved by using the Redis HINCRBY command to atomically increment the "total number of answers" and "number of correct answers" fields in the hash structure with the exam and question numbers as keys.

4. The method according to claim 1, characterized in that, The method further includes: the asynchronous processing engine sending the grading result of each question as an event to the stream processing system; the stream processing system aggregating the events according to a time window and synchronizing the aggregation results to persistent storage to ensure the final consistency and fault tolerance of the statistical results.

5. The method according to claim 1, characterized in that, The one-time standard answer token (AST) is destroyed immediately after the corresponding standard answer is successfully stored.

6. A system for implementing the method as described in any one of claims 1-5, characterized in that, include: Teacher terminal, student terminal; The server side includes: The license control subsystem is used to manage license policies and perform atomic license verification. The token management unit is used to generate and verify the examination key (EK), the standard answer token (AST), and the answer submission token (ASTu). A message queue is used to buffer student-submitted answer data. An asynchronous processing engine cluster is used to consume data from the message queue and perform answer comparison and statistical calculations. The real-time push unit is used to push statistical results to the teacher's terminal.

7. The system according to claim 6, characterized in that, The license control subsystem includes a real-time authentication engine and a billing trigger interface. The billing trigger interface interfaces with an external payment gateway and triggers the atomic license update by calling back after successful payment.

8. The system according to claim 6, characterized in that, The system also includes a first-class processing statistics module, which consumes the batch event stream output by the asynchronous processing engine, performs window aggregation calculations, and outputs the results to the in-memory database and the persistent database.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method as described in any one of claims 1 to 5.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1 to 5.

Images