Notarization method and system based on RTC video double recording and electronic data storage

Abstract

The invention relates to the technical field of online notarization services, and discloses a notarization method and system based on RTC video double recording and electronic data storage, and the method comprises the steps: a notarist end creates a remote video room through a TRTC SDK, and generates a unique room identifier; the notarist end uploads a to-be-notarized file and inputs party information, and the system generates a dynamic two-dimensional code; a party side scans the two-dimensional code, joins in a TRTC room, and submits identity card information for public security face database comparison; a cloud recording subsystem is started, a recording robot serves as an independent user to join in a TRTC room, a recording task is called through a RESTful application program interface, and a video stream is recorded in real time and stored in a third-party cloud storage in a TS container format; the notarist and the party browse files in real time in the TRTC room and carry out dialogue communication; and the party completes electronic signature through the online signature subsystem. The method is used for supporting multi-party video calls between notarists and parties, and carrying out online notarization service inquiry and online data evidence storage.

Description

Technical Field

[0001] The present invention relates to the technical field of online notarization services, and in particular to a notarization method and system based on RTC video dual recording and electronic data evidence storage. Background Art

[0002] Currently, the traditional notarization process requires parties to visit a notary office, which presents numerous inconveniences, such as time and space constraints, hindering efficiency. Furthermore, online notarization services also present challenges, such as difficulties ensuring information security. Therefore, it is crucial to employ advanced technologies to improve the methods and quality of online notarization. Summary of the Invention

[0003] In view of the above existing problems, the present invention is proposed.

[0004] Therefore, the present invention provides a notarization method based on RTC video dual recording and electronic data storage, which can solve the time and space limitations of traditional offline notarization and ensure the legality, security and effectiveness of remote notarization through technical means.

[0005] To solve the above technical problems, the present invention provides the following technical solutions, which are notarization methods based on RTC video dual recording and electronic data storage, including: the notary creates a remote video room through the TRTC SDK and generates a unique room identifier; the notary uploads the document to be notarized and enters the party information, and the system generates a dynamic QR code; the party scans the QR code to join the TRTC room and submits the ID card information for comparison with the public security face database; the cloud recording subsystem is started, and the recording robot joins the TRTC room as an independent user, calls the recording task through the RESTful application program interface, records the video stream in real time and stores it in the TS container format to a third-party cloud storage; the notary and the party browse files and communicate in real time in the TRTC room; the party completes the electronic signature through the online signing subsystem.

[0006] As a preferred solution of the notarization method based on RTC video dual recording and electronic data storage described in the present invention, the interface parameters for the TRTCSDK to create a remote video room include room type T1, transmission protocol T2 and encryption mode T3.

[0007] As a preferred solution of the notarization method based on RTC video dual recording and electronic data storage described in the present invention, the party information includes name and mobile phone number, and a dynamic QR code that can be associated with a room identifier is generated based on the information.

[0008] As an optimal solution of the notarization method based on RTC video dual recording and electronic data storage described in the present invention, the comparison of the public security face database needs to verify the consistency between the identity card information submitted by the party and the biometric parameters {K1, K2, ..., Kn}.

[0009] As a preferred solution of the notarization method based on RTC video dual recording and electronic data storage described in the present invention, the recording robot supports single-stream recording mode or mixed-stream recording mode, and the recording file is encapsulated in the HLS protocol and stored in real-time segments as a TS container file.

[0010] As a preferred solution of the notarization method based on RTC video dual recording and electronic data storage described in the present invention, wherein: calling the recording task through the RESTful application program interface includes:

[0011] The notary triggers the cloud recording creation interface and submits the room number and storage bucket address;

[0012] After the system returns task_id, it automatically polls and calls the recording status query interface;

[0013] When a new user is detected, the recording task update interface is called to update the subscription stream;

[0014] At the end of the session, call the recording task stop interface to close the task;

[0015] After recording stops, a callback event is triggered to push the media playlist file path.

[0016] As a preferred solution of the notarization method based on RTC video dual recording and electronic data storage described in the present invention, when the recording task update interface is executed, the encoding parameters and screen segmentation strategy of the mixed stream layout are dynamically adjusted according to the number of real-time call streams.

[0017] The present invention provides a notarization system based on RTC video dual recording and electronic data evidence storage.

[0018] As a preferred solution of the notarization system based on RTC video dual recording and electronic data storage described in the present invention, it includes: a remote video interaction module, an identity verification module, a cloud recording module, an electronic signature management module, and a blockchain evidence storage module;

[0019] The remote video interaction module creates an encrypted video room based on the TRTC SDK, dynamically generates a time-sensitive QR code, enables multi-party real-time audio and video calls and file sharing, and supports dynamic adjustment of the canvas layout;

[0020] The identity verification module calls the Ministry of Public Security interface to perform liveness detection, compares ID card information with biometric parameters in real time, and authorizes entry into the video room after verification;

[0021] The cloud recording module joins the TRTC room as a robot, controls single-stream / mixed-stream recording through the RESTful interface, generates TS encrypted files in segments and uploads them to cloud storage synchronously;

[0022] The electronic signature management module provides a two-field form entry, loads a PDF contract and locates the signature area, and generates an electronic signature bound to a digital certificate and a timestamp;

[0023] The blockchain evidence storage module adopts asymmetric encryption technology to distribute the data of video segment files on the chain and solidify the evidence through smart contracts.

[0024] The present invention provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of a notarization method based on RTC video dual recording and electronic data storage are implemented.

[0025] The present invention provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of a notarization method based on RTC video dual recording and electronic data storage are implemented.

[0026] The beneficial effects of the present invention are as follows: compared with traditional notarization services, which require notaries to go to the site to handle business, they often spend a lot of invalid time on the way or in the process of handling business. At the same time, there are also situations such as short time cycle of notaries and insufficient number of notaries, which make it impossible to handle business. Now, the newly added remote video notarization can greatly reduce the business time of notarization and improve efficiency; it is safer and more effective. The system uses the public security face authority database for identity recognition, making user operations safer and more reliable. The entire process of user operations is retained, and all user operations will be recorded as evidence. At the same time, it supports the entire process of screen recording and video recording, real-time video recording and screenshots, synchronous evidence storage, and face comparison. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0028] Figure 1 A flowchart of a notarization method based on RTC video dual recording and electronic data storage is provided for one embodiment of the present invention.

[0029] Figure 2 A schematic diagram of a page illustrating a notarization method based on RTC video dual recording and electronic data storage provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0030] To make the above-mentioned objects, features, and advantages of the present invention more clearly understood, the following detailed description of the specific embodiments of the present invention is given in conjunction with the accompanying drawings. It is obvious that the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in this field without creative work should fall within the scope of protection of the present invention.

[0031] Example 1, with reference to Figure 1-Figure 2 This is the first embodiment of the present invention, which provides a notarization method based on RTC video dual recording and electronic data storage. It consists of three core components: the notary schedules an appointment with the client and conducts a video interview for confirmation; the applicant completes the application online and signs it online for confirmation; and the notary reviews the document and analyzes and processes it to complete the notarization. This process helps users achieve online notarization services across time and space. Furthermore, it utilizes advanced blockchain electronic data storage technology to ensure the authenticity and validity of data during the notarization process.

[0032] Video communication technology provides a crucial foundation for the smooth operation of online notarization services. The remote video call subsystem utilizes appropriate video transmission and encoding technologies to ensure real-time and secure data transmission over the network. This ensures the smooth and efficient processing of the entire business process, ensuring the same effectiveness as in-person notarization.

[0033] The user online signing subsystem is a peripheral implementation solution attached to the remote video notarization system. Considering that remote notarization documents often require customers to sign documents online, it enables users to sign relevant documents quickly and conveniently.

[0034] Throughout the signing process, all user actions require proof, which is retained. This is crucial to ensuring non-repudiation. Furthermore, ensuring that information is not tampered with by unauthorized users during data transmission within the subsystem is crucial. This is why the team agreed to implement asymmetric encryption technology in the system.

[0035] S1: The notary creates a remote video room through the TRTC SDK and generates a unique room identifier.

[0036] S2: The notary uploads the document to be notarized and enters the information of the parties involved. The system then generates a dynamic QR code.

[0037] S3: The party scans the QR code to join the TRTC room and submits ID card information for comparison with the public security facial database.

[0038] S4: Start the cloud recording subsystem. The recording robot joins the TRTC room as an independent user, calls the recording task through the RESTful application program interface, records the video stream in real time, and stores it in the TS container format to the third-party cloud storage.

[0039] S5: The notary and the parties browse documents and communicate in real time in the TRTC room.

[0040] S6: The parties complete the electronic signature through the online signing subsystem.

[0041] Furthermore, UserA, as the anchor user, first creates an interface T(k) = {T1, T2, T3} through the TRTC SDK. The TRTC remote cloud server receives the room request created by userA and creates an isolated space.

[0042] Room type parameter T1: defines the room as a dedicated session type for notarization services;

[0043] Transmission protocol parameter T2: specifies the video stream transmission channel encrypted by the SRTP protocol;

[0044] Encryption mode parameter T3: Enable AES-256 end-to-end encryption;

[0045] After creation is completed, the TRTC remote cloud server allocates isolated storage space for the room and returns the room identifier to the notary's operation interface in real time.

[0046] After USERA creates a room, USERA can add a file list online and add contract files locally. At the same time, it is also necessary to add customer information online by adding customer name + mobile phone number to add participants;

[0047] The notary uploads the contract file in PDF format to the room's storage space; adds parties through the name / mobile number dual-field verification interface; the system automatically binds the party's information with the room logo and generates an encrypted dynamic QR code; the QR code automatically expires 10 minutes after the appointment time and needs to be regenerated.

[0048] The system generates a unique dynamic QR code for the room and invites customers to the room. Users can join the room by scanning the code;

[0049] The customer scans the code to join the room and enters the ID card information for public security facial verification; after the party scans the code, the user will be redirected to the identity verification page; the system calls the Ministry of Public Security interface to send a liveness detection instruction; the party completes the blinking / shaking head action as prompted; the submitted ID card number is compared with the biometric parameters in real time; after the verification is passed, the user will automatically jump to the TRTC room video interface.

[0050] In a feasible embodiment, a user entering a room can be realized through multimodal biometric cross-verification. Specifically, after the party scans the code, the system prompts to read a random number string (such as "3582"); the voiceprint feature is simultaneously collected to generate voiceprint parameters {W1, W2, ..., Wn};

[0051] Perform multi-feature fusion decision-making, input facial parameters {K1, K2, ..., Kn} and voiceprint parameters {Wn} into the pre-trained model, and the model outputs a comprehensive confidence score (range 0-1.0). When the score is ≥0.85, it is judged as verification passed, otherwise it triggers manual review.

[0052] In a feasible embodiment, users can also enter the room through cross-platform authorization verification. Specifically, after the party scans the code, they will jump to the "Government Cloud" authorization page and obtain real-name information through the national unified identity authentication platform; after the party confirms the authorization, the government platform generates a digital signature receipt, and the system automatically authorizes entry into the room after verifying the validity of the signature.

[0053] The entire video process is shared and stored in the background; the TRTC cloud recording system is a plug-in recording service for live streams and call streams that join the TRTC room. The recording user joins the TRTC room as a separate robot user to pull the real-time stream. Customers can achieve recording through simple operations (calling RESTFULAPI). Currently, single-stream recording and combined-image (mixed stream) recording modes are supported. Customers receive and manage recording files by providing a third-party cloud storage account (HLS protocol format, using TS container as the carrier to minimize the loss of recording files in abnormal situations such as power outages and network disconnections).

[0054] The TRTC cloud recording service exposes four RESTFUL APIs, making it easy to start, query, update, and stop recordings. Customers only need an HTTP server for integration, testing, and deployment. The RESTFUL APIs provide a complete minimal set of functionality for a single recording. Customers who wish to monitor the status of additional recording tasks can subscribe to related callback events.

[0055] You can enter the room for recording by calling the CreateCloudRecording method and setting the room number. A successful request will return the corresponding recording task_id, which is the unique identifier of the entire recording cycle and will be used as a request parameter for calling subsequent methods.

[0056] The DescribeCloudRecording method can be used to view the recording status. In the returned HTTP response, you can obtain the recorded m3u8 index name and upload status.

[0057] The ModifyCloudRecording method updates recording tasks, such as the concatenated layout and subscription streams. Dynamic adjustments are also made. For ≤ 2 participants, a 1:1 canvas split layout is used; for ≥ 3 participants, a nine-square adaptive layout is enabled. When file sharing is detected, the shared image is automatically zoomed in to 70% of the area; and when network bandwidth is < 2 Mbps, the concatenated stream resolution is reduced to 720p.

[0058] The DeleteCloudRecording method stops the recording task. The status of the recording task upload can be obtained through the callback. When there is no user flow in the room and the maximum waiting time has expired, the background recording task will automatically exit.

[0059] In a feasible embodiment, updating the recording task can be achieved through focus tracking based on behavior recognition, specifically, real-time analysis of the video stream, detection of "gesture pointing to the file area" and "voice high-frequency word trigger" (such as "Clause X"); intelligent focus recording, automatic zooming in the speaker's screen to 50% area, synchronously highlighting the associated file paragraphs (through OCR recognition and positioning), and generating a focus mark timestamp and storing it in the M3U8 index.

[0060] In another feasible embodiment, the updating recording task can also be achieved through layered coding adaptive transmission, specifically, streaming media hierarchical processing, breaking down the video stream into: face layer (1080P), background layer (720P), file layer (4K vector); dynamically allocating bandwidth, when the network bandwidth is less than 2Mbps, giving priority to the face layer + file layer; after the bandwidth is restored, the background layer data is automatically retransmitted.

[0061] Notaries and clients can browse documents online and communicate in real time.

[0062] Example 2 is the second embodiment of the present invention, which is different from the previous embodiment in that:

[0063] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0064] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0065] More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic devices), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disc read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering, or processing in another suitable manner as necessary, and then stored in a computer memory.

[0066] It should be understood that various parts of the present application can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, a plurality of steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, and as in another embodiment, it can be implemented using any or a combination of the following technologies, which are well known in the art: discrete logic circuitry having logic gates for implementing logic functions on data signals, application specific integrated circuits having appropriate combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

[0067] Embodiment 3, as an embodiment of the present application, provides a notarization system based on RTC video dual recording and electronic data evidence storage, including a remote video interaction module, an identity verification module, a cloud recording module, an electronic seal management module, and a blockchain evidence storage module.

[0068] The remote video interaction module creates an encrypted video room based on the TRTC SDK, dynamically generates a time-limited two-dimensional code, realizes multi-party real-time audio and video calls and file sharing, and supports dynamic adjustment of canvas layout.

[0069] The identity verification module calls the interface of the Ministry of Public Security to perform live detection, compares the ID information and biometric parameters in real time, and authorizes access to the video room after verification.

[0070] The cloud recording module joins the TRTC room as a robot, controls single / mixed stream recording through the RESTful interface, generates TS encrypted files in segments and synchronously uploads them to the cloud storage.

[0071] The electronic seal management module provides a double-field form entry, loads a PDF contract and locates the signature area, generates an electronic signature bound with a digital certificate and a timestamp.

[0072] The blockchain evidence storage module uses asymmetric encryption technology to distribute the data of the video segment file on the chain, and solidifies the evidence through a smart contract.

[0073] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not limiting. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application can be modified or replaced by equivalents without departing from the spirit and scope of the present application, and they should be covered in the scope of the claims of the present application.

Claims

1. A notarization method based on RTC video dual recording and electronic data storage, characterized by: include, The notary creates a remote video room through the TRTC SDK and generates a unique room identifier; The notary uploads the document to be notarized and enters the party's information, and the system generates a dynamic QR code; The party scans the QR code to join the TRTC room and submits their ID card information for comparison with the public security facial database; Start the cloud recording subsystem. The recording robot joins the TRTC room as an independent user, calls the recording task through the RESTful application program interface, records the video stream in real time, and stores it in the TS container format to a third-party cloud storage. Notaries and parties can browse documents and communicate in real time in the TRTC room; The parties complete the electronic signature through the online signing subsystem.

2. The notarization method based on RTC video dual recording and electronic data evidence storage as claimed in claim 1, characterized in that: The interface parameters for the TRTCSDK to create a remote video room include room type T1, transmission protocol T2 and encryption mode T3.

3. The notarization method based on RTC video dual recording and electronic data evidence storage as claimed in claim 2, characterized in that: The party information includes name and mobile phone number, and a dynamic QR code that can be associated with the room identification is generated based on the information.

4. The notarization method based on RTC video dual recording and electronic data storage as claimed in claim 3, characterized in that: The public security face database comparison needs to verify the consistency between the ID card information submitted by the party and the biometric parameters {K1, K2, ..., Kn}.

5. The notarization method based on RTC video dual recording and electronic data evidence storage as claimed in claim 4, characterized in that: The recording robot supports single-stream recording mode or mixed-stream recording mode. The recording files are encapsulated in HLS protocol and stored in real-time segments as TS container files.

6. The notarization method based on RTC video dual recording and electronic data evidence storage as claimed in claim 5, characterized in that: The recording task called through the RESTful application program interface includes: The notary triggers the cloud recording creation interface and submits the room number and storage bucket address; After the system returns task_id, it automatically polls and calls the recording status query interface; When a new user is detected, the recording task update interface is called to update the subscription stream; At the end of the session, call the recording task stop interface to close the task; After recording stops, a callback event is triggered to push the media playlist file path.

7. The notarization method based on RTC video dual recording and electronic data storage as claimed in claim 6, characterized in that: When the recording task update interface is executed, the encoding parameters and screen segmentation strategy of the mixed stream layout are dynamically adjusted according to the number of real-time call streams.

8. A notarization system based on RTC video dual recording and electronic data storage, applying the notarization method based on RTC video dual recording and electronic data storage as claimed in any one of claims 1 to 7, characterized in that: include: Remote video interaction module, identity verification module, cloud recording module, electronic signature management module, and blockchain evidence storage module; The remote video interaction module creates an encrypted video room based on the TRTC SDK, dynamically generates a time-sensitive QR code, enables multi-party real-time audio and video calls and file sharing, and supports dynamic adjustment of the canvas layout; The identity verification module calls the Ministry of Public Security interface to perform liveness detection, compares ID card information with biometric parameters in real time, and authorizes entry into the video room after verification; The cloud recording module joins the TRTC room as a robot, controls single-stream / mixed-stream recording through the RESTful interface, generates TS encrypted files in segments and uploads them to cloud storage synchronously; The electronic signature management module provides a two-field form entry, loads a PDF contract and locates the signature area, and generates an electronic signature bound to a digital certificate and a timestamp; The blockchain evidence storage module adopts asymmetric encryption technology to distribute the data of video segment files on the chain and solidify the evidence through smart contracts.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the notarization method based on RTC video dual recording and electronic data storage described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the notarization method based on RTC video dual recording and electronic data storage according to any one of claims 1 to 7 are implemented.

Images