Remote dynamic physical signature system and method with high reliability

Abstract

The application provides a remote dynamic physical signature system with high reliability, which comprises a signature information acquisition device, a signature information encryption transmission platform and a remote signature reproduction device. The signature information acquisition device is used for collecting handwriting data and signature synchronous video information of a signer, generating a signature video file and a signature handwriting biological feature file, and encrypting the signature video file, the signature handwriting biological feature file, a signature confirmation file, a signature terminal IP address and time stamp information using an identity of the signer to form an electronic record. The signature information encryption transmission platform is used for encrypting and transmitting the electronic record generated by the signature information acquisition device. The remote signature reproduction device is used for decrypting the electronic record, performing identity authentication on the signer according to the decrypted data, performing handwriting comparison after the identity authentication, and converting the decrypted signature handwriting biological feature file into signature device control information to physically reproduce the remote signature of the signer after the handwriting comparison.

Description

Technical Field

[0001] This invention relates to the field of information processing technology, and more particularly to a method and system for remote dynamic physical signatures with high reliability. Background Technology

[0002] Handwritten signatures retain unique value in today's business and legal environment, particularly in corporate management and document signing. Traditional handwritten signatures not only verify document authenticity but also offer immutability and uniqueness unmatched by electronic signatures. Even with advancements in electronic signature technology, public-key cryptography still presents security vulnerabilities, which are intolerable for high-value documents such as company decision-making documents and national treasures. Handwritten signatures are more than just a formality; they embody the signer's identity and intent. They have deep legal roots, especially in legal documents requiring multi-party verification, where their irreplaceable nature remains.

[0003] While electronic signatures offer efficiency, they also present technical security vulnerabilities. For example, the MD5 algorithm problem and the challenges posed by quantum computing mean that the core technology of electronic signatures may be vulnerable to being cracked in the future. Currently, electronic signatures are widely used in banking and remote signing scenarios, but if the public key certificate or U-Key is lost, there is still a possibility of forgery or misuse. Corporate regulations generally emphasize the importance of handwritten signatures, especially in scenarios such as board documents and shareholder resolutions. Although the "Electronic Signature Law of the People's Republic of China" provides legal support, current regulations on the verification and risk management of electronic signatures are not perfect, relying on dynamic handwritten signatures to verify the signer's identity and intent. Currently, even with methods such as video surveillance, the process of verifying handwritten signatures is still inefficient and resource-intensive, increasing the burden on companies and individuals.

[0004] Therefore, a new solution is needed. Summary of the Invention

[0005] The purpose of this invention is to provide a highly reliable remote dynamic physical signature system and method.

[0006] According to one aspect of the present invention, a highly reliable remote dynamic physical signature system is provided, comprising:

[0007] A signature information collection device is used to collect the full handwriting data of the signer and the synchronous video recording information of the signature, generate a signature video file and a signature biometric file, and use the signer's identity to encrypt the signature video file, the signature biometric file, the signature confirmation file, and the signature terminal IP address and timestamp information to form an electronic record.

[0008] An encrypted transmission platform is used to encrypt and transmit the electronic transcript generated by the signature information collection device; and

[0009] The remote signature reproduction device is used to decrypt the electronic record and authenticate the signer's identity based on the decrypted data. After the identity authentication is passed, the handwriting is compared. After the handwriting comparison is passed, the decrypted signature biometric file is converted into signature device control information to physically reproduce the signer's remote signature.

[0010] In the highly reliable remote dynamic physical signature system provided by this invention, the signature information acquisition device includes:

[0011] The signature acquisition module is used to acquire the full handwriting data of the signer and generate the signature biometric file based on the full handwriting data. The full handwriting data includes dynamic biometric features and signature feature information at the time of signing.

[0012] The signature identity entry module is used to enter the identity identifier of the signer, synchronously collect the signature synchronous video recording information, and generate the signature video file based on the signature synchronous video recording information. The signature synchronous video recording information includes the facial features of the signer and the trajectory of the pen tip movement.

[0013] The information encryption module is used to encrypt the signed video file, the signed handwriting biometric file, the signed confirmation file, and the IP address and timestamp information of the signing terminal using the identity identifier of the signer, and calculate the signature value to form the electronic record.

[0014] An information caching module is used to cache the electronic records.

[0015] In the highly reliable remote dynamic physical signature system provided by this invention, the signature acquisition module includes:

[0016] A pressure-sensitive electronic pen is used to collect the dynamic biometric features, including the pen stroke angle and pen stroke pressure during signing.

[0017] A handwriting touchscreen is used to input the signature content of the pressure-sensitive electronic pen and the signature feature information, which includes the pen stroke trajectory, pen stroke thickness, and signature time.

[0018] In the highly reliable remote dynamic physical signature system provided by the present invention, the encrypted transmission platform encrypts and transmits the electronic transcript through a key negotiation protocol based on the SM2 algorithm and a block encryption mechanism based on the SM4-CTR mode.

[0019] In the highly reliable remote dynamic physical signature system provided by this invention, the remote signature reproduction device includes:

[0020] An authentication gateway is used to establish an encrypted channel with the signature information collection device, and to authenticate the received electronic record based on the pre-stored biometric information of the legitimate signer. After successful authentication, the electronic record is decrypted and transmitted to the signature server.

[0021] The signature server is used to authenticate the signer's identity based on the signature video file in the decrypted electronic record. After successful authentication, the signature biometric file in the decrypted electronic record and the signature video file are compared. After successful comparison, the signature biometric file in the decrypted electronic record is converted into signature device control information.

[0022] A signature device for physically reproducing the remote signature of the signer under the control of the signature device control information.

[0023] In the highly reliable remote dynamic physical signature system provided by this invention, the signature server includes:

[0024] The evidence management module is used to retain decrypted electronic records as signature evidence for evidence management.

[0025] The identity verification module is used to verify the identity of the signer based on the signed video file in the decrypted electronic transcript and the pre-stored legitimate signer data information;

[0026] The signature recognition module is used to compare the biometric file of the signature handwriting and the signature video file in the decrypted electronic record with the signature sample reserved by the signer;

[0027] The control instruction generation module is used to restore the biometric file of the signature in the decrypted electronic record into control information for the signature device, the control information of the signature device including pen angle, pen pressure, pen trajectory and pen thickness.

[0028] In the highly reliable remote dynamic physical signature system provided by the present invention, the signature recognition module is used to fuse the facial feature vector of the signer in the signature video file and the pen stroke trajectory in the signature handwriting biometric file to form a feature vector, and compare the feature vector with the signature sample reserved by the signer.

[0029] In the highly reliable remote dynamic physical signature system provided by the present invention, the signature device includes a robotic arm, a drive module, a control module, a sensing module, and an execution module. The control module controls the drive module to drive the robotic arm to drive the execution module to perform signature according to the signature device control information, and makes real-time adjustments according to the motion state of the robotic arm and external environment information fed back by the sensing module.

[0030] According to another aspect of the present invention, a highly reliable remote dynamic physical signature method is also provided, implemented by the highly reliable remote dynamic physical signature system described above, comprising the following steps:

[0031] Collect the signer's full handwriting data and synchronized video recording information to generate a signature video file and a signature handwriting biometric file;

[0032] The signature video file, the signature biometric file, the signature confirmation file, and the signature terminal IP address and timestamp information are encrypted using the signer's identity to form an electronic record.

[0033] The electronic transcript generated by the signature information collection device is encrypted and transmitted; and

[0034] The electronic record is decrypted, and the signer's identity is authenticated based on the decrypted data. After the identity authentication is passed, handwriting comparison is performed. After the handwriting comparison is passed, the decrypted signature biometric file is converted into signature device control information to physically reproduce the signer's remote signature.

[0035] According to another aspect of the present invention, a computer-readable storage medium is also provided, wherein a computer program is stored therein, and when the computer program is executed by a processor, it implements the highly reliable remote dynamic physical signature method described above.

[0036] The highly reliable remote dynamic physical signature method and system of the present invention have the following beneficial effects: The highly reliable remote dynamic physical signature system provided by the present invention can realize the physical reproduction of remotely signed documents and achieve full information protection of the signing process. Due to the recording of the signing scene, the storage of dynamic evolution data of the signer's handwriting, and the encryption of transmission, it has the characteristic of being tamper-proof, thus ensuring security and reliability. Furthermore, it has low verification cost and high efficiency, and avoids the two types of errors that may occur during the verification of static handwritten signatures. Attached Figure Description

[0037] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort:

[0038] Figure 1 The diagram shown is a schematic of a highly reliable remote dynamic physical signature system according to an embodiment of the present invention.

[0039] Figure 2 yes Figure 1 The schematic diagram of the signature information collection device shown is shown below.

[0040] Figure 3 yes Figure 1 The schematic diagram of the remote signature reproduction device is shown. Detailed Implementation

[0041] To facilitate understanding of the present invention, a more complete description will be given below with reference to the accompanying drawings. Typical embodiments of the invention are shown in the drawings. However, the invention can be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.

[0042] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

[0043] Figure 1 The diagram shown is a schematic of a highly reliable remote dynamic physical signature system according to an embodiment of the present invention. Figure 1As shown, the highly reliable remote dynamic physical signature system provided by this invention includes a signature information acquisition device 100, an encrypted transmission platform 200, and a remote signature reproduction device 300. The signature information acquisition device 100 acquires the signer's full handwriting data and synchronized signature video recording information, generating a signature video file and a signature biometric file. It then encrypts the signature video file, the signature biometric file, the signature confirmation document, and the signature terminal's IP address and timestamp information using the signer's identity identifier, forming an electronic record. The encrypted transmission platform 200 transmits the electronic record generated by the signature information acquisition device in encrypted form. The remote signature reproduction device 300 decrypts the electronic record and authenticates the signer based on the decrypted data. After successful authentication, it performs handwriting comparison. Following successful handwriting comparison, it converts the decrypted signature biometric file into signature device control information to physically reproduce the signer's remote signature. In this invention, the combination of video recording and signature biometric file not only ensures the authenticity of the signature but also effectively prevents signature tampering. The entire digital record of the signing process is highly traceable, and any attempt to tamper with the signature will be detected immediately. The system ensures signature security through a dual verification process of "identity authentication" and "handwriting comparison." Identity authentication guarantees that the signatory is indeed the authorized party, while handwriting comparison ensures the uniqueness and uncopyability of the signature. Compared to traditional signature verification methods (such as manual signature verification and manual comparison), this system's verification process is not only highly efficient but also significantly reduces the probability of human error. Furthermore, the system supports remote operation, eliminating the need for face-to-face signing and saving considerable time and costs.

[0044] Specifically, in one embodiment of the present invention, the signature information acquisition device is responsible for acquiring key data of the signing process. It is not merely a simple handwriting input tool, but a comprehensive system for acquiring multiple biometric features. The signature information acquisition device can accurately record the signer's handwriting, capturing every stroke, pen pressure, and pen speed. In this way, not only can the appearance of the signature be reproduced, but the signer's personalized writing pattern can also be obtained. This is crucial for subsequent identity verification and handwriting comparison. The signer's writing habits (such as pressure, speed, stroke order, etc.) can become a unique biometric feature. To further ensure the authenticity and validity of the signing process, the device also simultaneously records a video of the signing process. This video recording is not only used for subsequent verification but also provides evidence to prevent the use of digital technology to forge signatures, ensuring that there is no tampering or fraudulent operation during the signing process. Simultaneously, the device converts all acquired signature data into electronic records, including the signature video file, handwriting biometric file, signature confirmation document, and the IP address and timestamp information of the signing terminal. These data have immutable properties, ensuring that every detail of the signing process is completely recorded.

[0045] like Figure 2 As shown, the signature information acquisition device 100 includes: a signature acquisition module 110, used to acquire the full handwriting data of the signer and generate the signature biometric file based on the full handwriting data; a signature identity entry module 120, used to enter the identity identifier of the signer, synchronously acquire the signature synchronous video recording information and generate the signature video file based on the signature synchronous video recording information; an information encryption module 130, used to encrypt the signature video file, the signature biometric file, the signature confirmation document, and the signature terminal IP address and timestamp information using the identity identifier of the signer through the national cryptographic SM9 identifier encryption method and calculate the signature value to form the electronic record; and an information caching module 140, used to cache the electronic record.

[0046] Specifically, the signature acquisition module 110 is used to acquire full-handwriting data, which includes dynamic biometric features and signature feature information at the time of signing. Therefore, the signature acquisition module includes a pressure-sensitive electronic pen for acquiring the dynamic biometric features and a handwriting touchscreen for inputting the signature content and signature feature information from the pressure-sensitive electronic pen. The dynamic biometric features include the pen stroke angle and pressure at the time of signing, and the signature feature information includes the pen stroke trajectory, stroke thickness, and signature time. In this embodiment, the pressure-sensitive electronic pen is used to acquire dynamic biometric features including pressure and tilt angle, with a pressure sampling frequency of not less than 200Hz; the handwriting touchscreen is responsible for inputting the signature content and signature feature information from the electronic pen, including handwriting data and signature time.

[0047] In this embodiment, the discretized handwritten full-hand data is defined as:

[0048] Data of Hand-Wri ={Tilt-angle(t);

[0049] (x1,y1,p1)t , (x2,y2,p2)t ,…,(xn(t),yn(t),pn(t))t}, 0≤t≤T

[0050] Wherein, the tilt angle (Tilt-angle) is the angle between the writing tool and the handwriting sensor plane; T is the total writing time; n(t) is the number of sensing units (similar to the number of pixels on a display screen) within the contact area between the writing tool (pen or finger) and the handwriting sensor at time t; (xj, yj, pj), t 1≤j≤n(t) are the position coordinates and pressure value of the j-th contact sensing unit at time t. That is, at time t, the contact surface is composed of n(t) sensing units. The value of n(t) is determined by the resolution (or accuracy) of the sensor and the "thickness" of the writing tool. For example, when writing with a pen, a thicker pen tip will have a larger n(t) value than a thinner pen tip. In actual data acquisition, time t is also discrete.

[0051] Specifically, the signature identity entry module 120 is used to enter the real identity of the signer. By synchronously collecting the signer's facial features and pen tip movement trajectory, it ensures that the entire signing process is not counterfeited. By entering the signer's basic information, it ensures that the content of the signer's signature is consistent with the entered information.

[0052] Specifically, the information encryption module 130 is used to encrypt the collected handwritten full handwriting data (including feature information such as stroke trajectory, stroke thickness, stroke angle, stroke weight, and writing time matching), the video data of the signing process, and the identity data of the signer using the signer's public key, calculate the signature value, store it in the signature file, form an encrypted electronic record, and transmit it to the information cache module for encrypted storage.

[0053] Specifically, in one embodiment of the present invention, the encrypted transmission platform 200 is used to ensure the security of signature information during network transmission and prevent data from being tampered with or leaked. All data from the signature information collection device (signature videos, handwriting feature files, confirmation documents, etc.) are encrypted and then transmitted to the remote signature reproduction device via a secure network.

[0054] Specifically, the encrypted transmission platform uses a key negotiation protocol based on the SM2 algorithm and a block encryption mechanism based on the SM4-CTR mode to encrypt the electronic transcript during transmission, ensuring that the data cannot be cracked even if intercepted. The key negotiation protocol based on the SM2 algorithm is a cryptographic protocol based on the Elliptic Curve Discrete Logarithm Problem (ECDLP), designed to enable secure negotiation and sharing of session keys between the signature information collection device and the signature reproduction device at the signer's end. The protocol flow is as follows: First, both parties A and B possess long-term SM2 public-private key pairs (d_A, P_A) and (d_B, P_B), where d is the private key and P = d·G (G is the base point of the SM2 elliptic curve). During negotiation, both parties generate temporary public-private key pairs (k_A, K_A = k_A·G) and (k_B, K_B = k_B·G), and exchange temporary public keys K_A and K_B. Subsequently, A calculates the shared secret s_A = k_A·K_B + d_A·P_B, and B calculates s_B = k_B·K_A + d_B·P_A. Based on the bilinear property of elliptic curves, s_A = s_B = (k_A + d_A)·(k_B + d_B)·G, ensuring that both parties obtain the same shared secret. Finally, through SM3... The hash function digests the shared secret and related information (such as identity identifiers and timestamps) to generate the final session key. This protocol complies with domestic cryptographic standards such as GM / T 0003.2, possesses resistance to man-in-the-middle attacks, and achieves forward security and key freshness through the combination of temporary and long-term keys, providing a secure key foundation for communication. The SM4-CTR mode is used to convert the block cipher into a stream cipher. A keystream is generated using a counter, and then the keystream is XORed with the plaintext to obtain the ciphertext.

[0055] Specifically, in one embodiment of the present invention, the remote signature reproduction device 300 is responsible for ensuring the authenticity and credibility of the remote signature and reproducing the signature through a physical device. Upon receiving the encrypted data, the reproduction device first decrypts it to recover information such as the signature video and handwriting feature file. The key and algorithm used in the decryption process are guaranteed by a preset protocol. The decrypted data undergoes identity verification. The reproduction device confirms the signer's identity by comparing the signature video and the biometric file of the signature handwriting. By comparing the signature handwriting, the reproduction device further confirms the accuracy and consistency of the signature. Handwriting comparison technology can be based on various biometric algorithms, such as dynamic handwriting analysis and speed change analysis, to ensure that the signature style during remote reproduction is consistent with the real-world signature. After successful identity authentication and handwriting comparison, the system converts the signature handwriting biometric file into signature device control information and reproduces the signature through a remote device. Therefore, as... Figure 3As shown, the remote signature reproduction device includes: an authentication gateway 310, used to establish an encrypted channel with the signature information acquisition device, and to authenticate the received electronic record based on the pre-stored biometric information of the legitimate signer's signature. After successful authentication, the gateway decrypts the electronic record and transmits the decrypted electronic record to the signature server; a signature server 320, used to authenticate the signer's identity based on the signature video file in the decrypted electronic record, and after successful authentication, to compare the signature biometric file in the decrypted electronic record with the signature video file. After successful comparison, the signature biometric file in the decrypted electronic record is converted into signature device control information; and a signature device 330, used to physically reproduce the signer's remote signature under the control of the signature device control information.

[0056] Furthermore, in one embodiment of the present invention, the signature server 320 includes an evidence storage management module 3201, an identity verification module 3202, a signature recognition module 3203, and a control instruction generation module 3204. The evidence management module 3201 is used to retain the decrypted electronic record as evidence for signature management, providing effective evidence archiving and management for electronic data in the digital signature process, thereby ensuring the authenticity and verifiability of the signature; the identity verification module 3202 is used to verify the identity of the signer based on the signature video file in the decrypted electronic record and the pre-stored legal data information of the signer, confirming whether the signer's identity is legitimate, and ensuring that the person signing the electronic document is an authorized and legitimate signer; the signature recognition module 3203 is used to compare the signature handwriting biometric file and the signature video file in the decrypted electronic record with the signature sample reserved by the signer, and can determine whether the signature is a valid signature; the control instruction generation module 3204 is used to restore the signature handwriting biometric file in the decrypted electronic record into control information for the signature device, thereby realizing precise operation of the signature device, and the signature device control information includes pen angle, pen pressure, pen trajectory and pen thickness.

[0057] Furthermore, in one embodiment of the present invention, the signature recognition module fuses the facial feature vector of the signer in the signature video file and the pen stroke trajectory in the signature handwriting biometric file to form a feature vector, and compares the feature vector with the signature sample reserved by the signer. The signature recognition module first analyzes the decrypted signature video file to extract the signer's facial features and form the feature vector. Facial recognition technology, by capturing the unique biometric features of the signer's face, can effectively prevent identity theft or forgery. In addition to facial features, the signature recognition module also needs to analyze the signer's handwriting. Handwriting itself is also a biometric feature, which can include the trajectory of the signature, the pressure of the pen stroke, the angle, etc. This data is converted into digital signals (such as a handwriting trajectory file) for processing. The signature recognition module confirms the accuracy of the signature by comparing the facial feature vector and the biometric features of the handwriting (such as the pen stroke trajectory) with the signature sample reserved by the signer. This method of fusing multiple biometric features greatly improves the accuracy and reliability of signature verification.

[0058] Furthermore, in one embodiment of the present invention, the signature device 330 includes a robotic arm 3301, a drive module 3302, a control module 3303, a sensing module 3304, and an execution module 3305. The control module controls the drive module to drive the robotic arm to move the execution module to sign according to the signature device control information, and at the same time makes real-time adjustments according to the motion state of the robotic arm and the external environment information fed back by the sensing module.

[0059] Specifically, the robotic arm 3301 includes multiple joints and links, similar to the skeletal structure of a human arm, such as the shoulder joint, elbow joint, and wrist joint. Through the combined movement of different joints, the robotic arm can move flexibly in three-dimensional space, reach the designated position, and complete the signature action.

[0060] Specifically, the drive module 3302 provides power for the movement of the robotic arm, and the motor drive gives it advantages such as high precision, fast response, and ease of control. The motor is connected to the joint through a reducer, which can precisely control the rotation angle and speed of the joint, thereby achieving fine signing movements.

[0061] Specifically, the sensor module is used to sense the motion state of the robotic arm and external environmental information, mainly including position sensors and force sensors. The position sensor can monitor the angle and position information of the joints in real time and feed it back to the control module for precise position control; the force sensor is installed at the execution module or joint to sense the pressure and force changes during signing, enabling it to mimic the force exerted by a human when signing, thus ensuring the quality and authenticity of the signature.

[0062] Specifically, the control module is the "brain" of the smart arm, responsible for coordinating the work of various parts and achieving precise control of the robotic arm. The control module typically consists of two parts: hardware and software. The hardware mainly comprises a microprocessor, drivers, and interface circuits, while the software includes motion control algorithms. By inputting the restored control information from the signature server, the control module can control the drive module to move the robotic arm according to the acquired signature trajectory and force requirements. Simultaneously, it makes real-time adjustments based on sensor feedback to ensure the accuracy and stability of the signing action.

[0063] Specifically, the execution module, installed at the end of the robotic arm, directly performs the signature task. It's a pen clip-like device that can hold various types of pens for signing. During signature reproduction, it selects a pen of the same material based on the pen type identified by the signature recognition module. The execution module can adjust according to different pen types and signature requirements to ensure proper contact and angle between the pen and paper, achieving a smooth and natural signature effect.

[0064] Furthermore, the movement of the robotic arm is controlled using a fuzzy PID control algorithm. This mainly includes: A) Fuzzification stage: Mapping the actual error (e) and error change rate (de) to the fuzzy domain through quantization factors, and calculating the membership degree of each linguistic variable; B) Rule reasoning: Determining the fuzzy set of parameter adjustment amounts using the Max-Min synthesis method based on a preset 7x7 fuzzy rule table; C) Defuzzification: Converting the fuzzy output into precise adjustments using the centroid method; D) Parameter adaptation: Dynamically adjusting the PID parameters in each control cycle to ensure they remain within a safe range; E) PID control: Calculating the control output based on the real-time adjusted PID parameters to drive the robotic arm to track the target trajectory. In practical applications, adjustments need to be made according to the robotic arm's dynamic characteristics. Key configurable modules include: fuzzy rule table (designed according to the robotic arm's dynamic characteristics); quantization factor and scaling factor (affecting control sensitivity and stability); membership function form (triangular / Gaussian, etc.); and defuzzification methods (centroid method / maximum membership method, etc.).

[0065] According to another aspect of the present invention, a highly reliable remote dynamic physical signature method is also provided, implemented by the highly reliable remote dynamic physical signature system described above, comprising the following steps:

[0066] S1. Collect the signer's full handwriting data and synchronous video recording information of the signature, and generate a signature video file and a signature handwriting biometric file;

[0067] Specifically, in one embodiment of the present invention, firstly, a signature reservation is initiated, the signer's verification information is entered, and the verification server is notified. The signer's identity is verified online through facial recognition or other means. If the identity verification is successful, the corresponding signature file is sent and the user is prompted to sign; otherwise, the user continues to wait for verification and does not proceed with the signature operation. After successful verification, the signer uses a signature information collection device to perform a remote signature operation. The signature information collection device uses a pressure-sensitive electronic pen and a handwriting touchscreen to collect the signer's full handwriting data (including feature information such as pen stroke trajectory, pen stroke thickness, pen stroke angle, pen stroke pressure, and writing time matching), and obtains synchronous video recording information of the signer's signature through a binocular camera.

[0068] S2. Encrypt the signed video file, the signed handwriting biometric file, the signed confirmation file, and the IP address and timestamp information of the signing terminal using the identity of the signer to form an electronic record;

[0069] Specifically, in one embodiment of the present invention, the signature confirmation document, signature video file, signature handwriting biometric file, and information such as the signature terminal IP address and timestamp generated in step S1 are encrypted using the signer's ID number as an identifier, and the signature value is calculated by using the national cryptographic SM9 identifier encryption technology and stored in the signature file to form an electronic record.

[0070] S3. Encrypt and transmit the electronic record generated by the signature information collection device; and

[0071] S4. Decrypt the electronic record and authenticate the signer's identity based on the decrypted data. After successful authentication, perform handwriting comparison. After successful handwriting comparison, convert the decrypted biometric signature file into signature device control information to physically reproduce the signer's remote signature.

[0072] Specifically, in one embodiment of the present invention, the remote signature reproduction device 300 decrypts and authenticates the received encrypted message fusion information. If the signer passes the verification, it proceeds to handwriting comparison verification; otherwise, it returns to the previous step for verification. The signature recognition module extracts the signer's full handwriting data (including strokes, handwriting, stroke order, pressure, matching time, etc. obtained from the signing terminal) and compares it with the signature sample reserved by the signer. If the comparison is correct, it proceeds to the next step for local intranet reproduction of the signature; otherwise, it returns to the previous step for verification. On the intranet, the remote signature feature data information that has passed signature verification is converted into control information for an intelligent robotic arm, which then physically reproduces the signer's remote signature on the intranet.

[0073] This invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, can perform the following steps;

[0074] The system collects the signer's full handwriting data and synchronized video recording information to generate a signature video file and a signature biometric file. It then uses the signer's identity identifier to encrypt the signature video file, the signature biometric file, the signature confirmation document, and the IP address and timestamp information of the signing device to form an electronic record. The electronic record generated by the signature information collection device is then transmitted in encrypted form. The electronic record is decrypted, and the signer's identity is authenticated based on the decrypted data. After successful authentication, handwriting comparison is performed. Following successful handwriting comparison, the decrypted signature biometric file is converted into signature device control information to physically reproduce the signer's remote signature.

[0075] The computer-readable storage medium may include: USB flash drive, portable hard drive, read-only memory (ROM) > random access memory (RAM), magnetic disk or optical disk, and other media that can store program code.

[0076] Numerous specific details are set forth in the specification provided herein. However, it will be understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this specification.

[0077] Similarly, it should be understood that, in order to streamline this disclosure and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof. However, this method of disclosure should not be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as reflected in the claims, inventive aspects lie in fewer than all features of a single foregoing disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into that detailed description, wherein each claim itself is a separate embodiment of the invention.

[0078] Those skilled in the art will understand that modules in the device of the embodiments can be adaptively changed and placed in one or more devices different from that embodiment. Modules, units, or components in the embodiments can be combined into a single module, unit, or component, and further, they can be divided into multiple sub-modules, sub-units, or sub-components. Except where at least some of such features and / or processes or units are mutually exclusive, any combination can be used to combine all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all processes or units of any method or device so disclosed. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) may be replaced by an alternative feature that serves the same, equivalent, or similar purpose.

[0079] Furthermore, those skilled in the art will understand that although some embodiments herein include certain features included in other embodiments but not others, combinations of features from different embodiments are intended to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments can be used in any combination.

[0080] The various component embodiments of the present invention can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that microprocessors or digital signal processors (DSPs) can be used in practice to implement some or all of the functions of some or all of the components according to the embodiments of the present invention. The present invention can also be implemented as a device or apparatus program (e.g., a computer program and computer program product) for performing part or all of the methods described herein. Such programs implementing the present invention can be stored on a computer-readable medium, or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

[0081] It should be noted that the above embodiments are illustrative of the invention and not restrictive, and that those skilled in the art can devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names.

Claims

1. A remote dynamic physical signature system with high reliability, characterized by, include: A signature information collection device is used to collect the full handwriting data of the signer and the synchronous video recording information of the signature, generate a signature video file and a signature biometric file, and use the signer's identity to encrypt the signature video file, the signature biometric file, the signature confirmation file, and the signature terminal IP address and timestamp information to form an electronic record. An encrypted transmission platform is used to encrypt and transmit the electronic transcript generated by the signature information collection device. as well as The remote signature reproduction device is used to decrypt the electronic record and authenticate the signer's identity based on the decrypted data. After the identity authentication is passed, the handwriting is compared. After the handwriting comparison is passed, the decrypted signature biometric file is converted into signature device control information to physically reproduce the signer's remote signature. The remote signature reproduction device includes: An authentication gateway is used to establish an encrypted channel with the signature information collection device, and to authenticate the received electronic record based on the pre-stored biometric information of the legitimate signer. After successful authentication, the electronic record is decrypted and transmitted to the signature server. The signature server is used to authenticate the signer's identity based on the signature video file in the decrypted electronic record. After successful authentication, the signature biometric file in the decrypted electronic record and the signature video file are compared. After successful comparison, the signature biometric file in the decrypted electronic record is converted into signature device control information. A signing device is used to physically reproduce the remote signature of the signer under the control of the signing device control information; The signature device includes a robotic arm, a drive module, a control module, a sensing module, and an execution module. The control module controls the drive module to drive the robotic arm to move the execution module to sign according to the signature device control information. At the same time, it makes real-time adjustments based on the motion state of the robotic arm and external environment information fed back by the sensing module.

2. The highly reliable remote dynamic physical signature system according to claim 1, characterized in that, The signature information collection device includes: The signature acquisition module is used to acquire the full handwriting data of the signer and generate the signature biometric file based on the full handwriting data. The full handwriting data includes dynamic biometric features and signature feature information at the time of signing. The signature identity entry module is used to enter the identity identifier of the signer, synchronously collect the signature synchronous video recording information, and generate the signature video file based on the signature synchronous video recording information. The signature synchronous video recording information includes the facial features of the signer and the trajectory of the pen tip movement. The information encryption module is used to encrypt the signed video file, the signed handwriting biometric file, the signed confirmation file, and the IP address and timestamp information of the signing terminal using the identity identifier of the signer, and calculate the signature value to form the electronic record. An information caching module is used to cache the electronic records.

3. The highly reliable remote dynamic physical signature system according to claim 2, characterized in that, The signature acquisition module includes: A pressure-sensitive electronic pen is used to collect the dynamic biometric features, including the pen stroke angle and pen stroke pressure during signing. A handwriting touchscreen is used to input the signature content of the pressure-sensitive electronic pen and the signature feature information, which includes the pen stroke trajectory, pen stroke thickness, and signature time.

4. The highly reliable remote dynamic physical signature system according to claim 1, characterized in that, The encrypted transmission platform encrypts and transmits the electronic transcripts using a key negotiation protocol based on the SM2 algorithm and a block encryption mechanism based on the SM4-CTR mode.

5. The highly reliable remote dynamic physical signature system according to claim 1, characterized in that, The signature server includes: The evidence management module is used to retain decrypted electronic records as signature evidence for evidence management. The identity verification module is used to verify the identity of the signer based on the signed video file in the decrypted electronic transcript and the pre-stored legitimate signer data information; The signature recognition module is used to compare the biometric file of the signature handwriting and the signature video file in the decrypted electronic record with the signature sample reserved by the signer; The control instruction generation module is used to restore the biometric file of the signature in the decrypted electronic record into control information for the signature device, the control information of the signature device including pen angle, pen pressure, pen trajectory and pen thickness.

6. The highly reliable remote dynamic physical signature system according to claim 5, characterized in that, The signature recognition module is used to fuse the facial feature vector of the signer in the signature video file and the pen stroke trajectory in the signature handwriting biometric file to form a feature vector, and compare the feature vector with the signature sample reserved by the signer.

7. A highly reliable remote dynamic physical signature method, implemented using any one of claims 1-6, characterized in that, Includes the following steps: Collect the signer's full handwriting data and synchronized video recording information to generate a signature video file and a signature handwriting biometric file; The signature video file, the signature biometric file, the signature confirmation file, and the signature terminal IP address and timestamp information are encrypted using the signer's identity to form an electronic record. The electronic transcript generated by the signature information collection device is encrypted and transmitted. as well as The electronic record is decrypted, and the signer's identity is authenticated based on the decrypted data. After successful authentication, handwriting comparison is performed. After successful handwriting comparison, the decrypted biometric signature file is converted into signature device control information to physically reproduce the signer's remote signature, resulting in a local signature confirmation file that is consistent with the remote signature confirmation file.

8. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by the processor, it implements the highly reliable remote dynamic physical signature method as described in claim 7.

Images