Transaction data processing method, device and electronic equipment

Abstract

The present application provides a transaction data processing method, device, and electronic device, relating to the field of data processing technology, and solving the technical problem of low accuracy in data processing of transaction data. The method comprises: controlling a camera to obtain a payment code image of an electronic payment code on an electronic payment device and a real-time image of the surrounding environment of the electronic payment code based on a payment code scanning operation; identifying the device identifier of the electronic payment device in the real-time image based on information of a payment collector determined by facial recognition in the real-time image to obtain payment collector information, and performing environmental recognition on the surrounding environment of the electronic payment code in the real-time image to obtain consumption environment information; determining the payment collector information, payment terminal information, consumption environment information, payment device information, and the real-time image as first consumption evidence data corresponding to the current consumption of the payment code scanning operation, so as to verify the consumption situation of the current consumption through the first consumption evidence data.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a transaction data processing method, device, and electronic device. Background Art

[0002] Currently, in the transaction data management method of the human resources system, in most cases there is no unified management of transaction data. For example, employees often have canteens and other consumption places at their workplaces. The existing human resources system manages the transaction data of employees' consumption at these consumption places manually. For example, the creation, verification, update and deletion of transaction data all need to be completed manually by human resources department staff. This transaction data processing method is prone to errors and takes a long time, resulting in low accuracy of the existing transaction data processing. Summary of the Invention

[0003] The object of the present invention is to provide a transaction data processing method, device and electronic device to solve the technical problem of low accuracy in data processing of transaction data.

[0004] In a first aspect, the present application provides a transaction data processing method, which is applied to a terminal device, wherein an electronic payment device is provided within a preset distance around the terminal device, and the terminal device is provided with a camera; the method comprises:

[0005] In response to a payment code scanning operation performed on the terminal device, the camera is controlled according to the payment code scanning operation to obtain a payment code image of the electronic payment code on the electronic payment receiving device and a real-time image of the environment surrounding the electronic payment code; wherein the real-time image includes an image of the electronic payment receiving device and an image of a payment recipient corresponding to the electronic payment receiving device;

[0006] Processing payment based on the payment code image, and performing QR code recognition on the payment code image to obtain information of the payment receiving end corresponding to the payment code image;

[0007] Based on the information of the payment recipient determined by face recognition in the real-time image, a device identifier of the electronic payment device in the real-time image is identified to obtain payment device information, and an environment surrounding the electronic payment code in the real-time image is identified to obtain consumption environment information;

[0008] The information of the payment person, the information of the payment terminal, the consumption environment information, the payment device information and the real-time image are determined as the first consumption retained evidence data corresponding to the payment code scanning operation for this consumption, so as to verify the consumption situation of the current consumption through the first consumption retained evidence data.

[0009] In one possible implementation, the real-time image is in the form of a video, and a first video corresponding to the real-time image includes data of a consumption communication process between the cashier and the consumer corresponding to the terminal device; the method further includes:

[0010] Perform image analysis and voice analysis based on the consumption communication process data to obtain the consumption content, consumption amount and consumer corresponding to the current consumption;

[0011] The AI ​​system analyzes and determines the consumption type of the consumption based on the content of the consumption, the amount of consumption, and the consumer; wherein the consumption type includes any one or more of public consumption, private consumption, and external consumption;

[0012] The consumption type, the consumption content, the consumption amount and the consumer are added to the first consumption retained evidence data to obtain the second consumption retained evidence data, so as to perform a second verification on the consumption situation of the current consumption through the second consumption retained evidence data containing the consumption type, the consumption content, the consumption amount and the consumer.

[0013] In one possible implementation, the terminal device is further provided with a positioning device and a timing device; and the method further includes:

[0014] In response to a payment code scanning operation performed on the terminal device, the timer device obtains the time of the current consumption, and the positioning device obtains the location of the current consumption;

[0015] Determining the consumption location information corresponding to the current consumption based on the consumption location information and the consumption environment information;

[0016] The consumption time information, the consumption place information and the consumption location information are added to the second consumption retained evidence data to obtain the third consumption retained evidence data, so as to verify the consumption situation of the current consumption three times through the third consumption retained evidence data containing the consumption time information, the consumption place information and the consumption location information.

[0017] In one possible implementation, each consumption type corresponds to a respective consumption account, and the consumption account includes any one or more of a personal recharge account, an enterprise recharge account, and a reimbursement account; and the method further includes:

[0018] Determining the identity of the payer corresponding to the current consumption according to the terminal device;

[0019] Determining the consumer identities of all the consumers through face recognition based on the real-time image;

[0020] The target consumption account corresponding to the current consumption is analyzed and determined by the AI ​​system based on the consumption type, the consumption location information, the identity of the payer and the identity of the consumer.

[0021] In one possible implementation, the method further includes:

[0022] According to the information of the cashier and the information of the consumption venue, query the duty data of the cashier in the consumption venue corresponding to the consumption venue information;

[0023] The duty time in the duty data is compared with the consumption time information. If the duty time includes the consumption time corresponding to the consumption time information, it is determined that the consumption time information verification is passed, so as to perform four verifications on the consumption situation of the current consumption according to the duty time.

[0024] In one possible implementation, the method further includes:

[0025] In response to a successful connection between the target client and the wireless network device in the consumption scene corresponding to the consumption scene information, performing a security check and an authority check on the target client to obtain a check result;

[0026] If the detection result is passed, it is determined that the target client has the control authority of the monitoring device in the consumption scene;

[0027] controlling at least one of the monitoring devices in the consumption scene based on the control authority, and controlling the monitoring device to track the location of the target client through the positioning device, NFC device and / or wireless device provided on the target client;

[0028] According to the position of the target client, the camera of the monitoring device is controlled to face the consumption position corresponding to the target client, and the video data of the consumption communication process data is obtained through the monitoring device.

[0029] In a possible implementation, after obtaining the video data of the consumer communication process data through the monitoring device, the method further includes:

[0030] Recalling all second video data related to the current consumption in the video data of the consumption communication process data, and bundling the second video data with the third consumption retained evidence data;

[0031] The second video data and the third consumption retention evidence data after bundling processing are determined as historical consumption retention data, and the historical consumption retention data is stored in a designated consumption system.

[0032] In a second aspect, a transaction data processing device is provided, which is applied to a terminal device, wherein an electronic payment device is provided within a preset distance around the terminal device, and the terminal device is provided with a camera; the device comprises:

[0033] a control module, configured to respond to a payment code scanning operation performed on the terminal device and control the camera to acquire a payment code image of the electronic payment code on the electronic payment receiving device and a real-time image of the environment surrounding the electronic payment code in accordance with the payment code scanning operation; wherein the real-time image includes an image of the electronic payment receiving device and an image of a payment recipient corresponding to the electronic payment receiving device;

[0034] an identification module, configured to process payment based on the payment code image and perform QR code recognition on the payment code image to obtain information on the payment receiving end corresponding to the payment code image;

[0035] a determination module configured to identify the payment recipient's information determined by face recognition in the real-time image, identify the device identifier of the electronic payment device in the real-time image to obtain payment device information, and identify the surrounding environment of the electronic payment code in the real-time image to obtain consumption environment information;

[0036] The verification module is used to determine the information of the payment person, the information of the payment terminal, the consumption environment information, the payment device information and the real-time image as the first consumption retained evidence data corresponding to the current consumption of the scanning payment code operation, and verify the consumption situation of the current consumption through the first consumption retained evidence data.

[0037] In a third aspect, the present application provides an electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the computer program, the method described in the first aspect is implemented.

[0038] In a fourth aspect, the present application further provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to execute the method described in the first aspect above.

[0039] The present application brings the following beneficial effects: the present application provides a transaction data processing method, apparatus, and electronic device, which can respond to a payment code scanning operation performed on the terminal device, and control the camera to obtain a payment code image of the electronic payment code on the electronic payment device and a real-time image of the surrounding environment of the electronic payment code according to the payment code scanning operation; wherein the real-time image includes images of the electronic payment device and the payment person corresponding to the electronic payment device; payment processing is performed based on the payment code image, and the payment code image is subjected to QR code recognition to obtain information of the payment terminal corresponding to the payment code image; based on information of the payment person determined by face recognition in the real-time image, the device identifier of the electronic payment device in the real-time image is identified to obtain payment device information, and the surrounding environment of the electronic payment code in the real-time image is subjected to environmental recognition to obtain consumption environment information; the payment person information, the payment terminal information, the consumption environment information, the payment device information, and the real-time image are determined as first consumption retained evidence data corresponding to the current consumption of the payment code scanning operation, so as to verify the consumption of the current consumption through the first consumption retained evidence data. In this solution, when the terminal device performs a payment code scanning operation, the camera can be controlled according to the payment code scanning operation to not only obtain the payment code image of the electronic payment code on the electronic payment device, but also obtain the real-time image of the surrounding environment of the electronic payment code, so that the information of the payment person can be determined by face recognition based on the real-time image. Moreover, the payment device information can be obtained by identifying the device identifier of the electronic payment device in the real-time image. Furthermore, the consumption environment information can be obtained by performing environmental recognition on the surrounding environment of the electronic payment code in the real-time image, so that the consumption evidence data corresponding to the current consumption of the payment code scanning operation can include the information of these payment persons, the information of the payment terminal, the consumption environment information, the payment device information and the real-time image, so that the consumption situation of the current consumption can be more accurately verified through the more accurate and comprehensive consumption evidence data, thereby improving the accuracy of the transaction data verification results and solving the technical problem of low data processing accuracy of transaction data.

[0040] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the specific implementation methods or the description of the prior art. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0042] Figure 1 A flowchart of a transaction data processing method provided in an embodiment of the present application;

[0043] Figure 2 Another flowchart of the transaction data processing method provided in an embodiment of the present application;

[0044] Figure 3 A schematic diagram of the structure of a transaction data processing device provided in an embodiment of the present application;

[0045] Figure 4 A schematic structural diagram of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0046] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0047] The terms "including," "having," and any variations thereof, as used in the embodiments of this application, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or units is not limited to the listed steps or units but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to the process, method, product, or apparatus.

[0048] Currently, employees often have cafeterias and other consumption venues at their workplaces. Existing human resources systems rely on manual management of employee transaction data from these venues. For example, the creation, verification, update, and deletion of transaction data require manual processing by HR staff. This error-prone and time-consuming process results in low accuracy. Furthermore, account information may be scattered across various databases or files, without a unified management system. This lack of a unified management platform can lead to fragmented and inconsistent data. Furthermore, paper records of transaction data are prone to loss or tampering, lacking effective security measures.

[0049] Based on this, the embodiments of the present application provide a transaction data processing method, device, and electronic device, by which the technical problem of low accuracy in data processing of transaction data can be solved.

[0050] The embodiments of the present invention are further described below with reference to the accompanying drawings.

[0051] Figure 1 A flowchart of a transaction data processing method provided by an embodiment of the present application. The method can be applied to a terminal device, wherein an electronic payment device is provided within a preset distance around the terminal device, and a camera is provided on the terminal device. Figure 1 As shown, the method includes:

[0052] Step S110 , in response to the payment code scanning operation on the terminal device, the camera is controlled according to the payment code scanning operation to obtain a payment code image of the electronic payment code on the electronic payment device and a real-time image of the surrounding environment of the electronic payment code.

[0053] The real-time image includes an image of the electronic payment device and the payment person corresponding to the electronic payment device.

[0054] Regarding the process of consumption corresponding to the scanning payment code operation, for example, an employee consumer or a company account consumer completes the transaction at a consumption location through a consumption machine or mobile payment method. During the consumption process, when the client scans the QR code corresponding to the payment object on the electronic payment device, the client activates several cameras installed on it, such as a wide-angle lens installed on the client, so that while scanning the QR code, the client can also obtain a real-time image of the environment around the QR code by taking a photo, such as a photo. This real-time image includes images of the electronic payment device and the payment person.

[0055] As a possible implementation method, the application on the front end is responsible for interacting with the user, displaying the interface and sending requests. The service backend processes the application logic from the front end and calls the relevant hardware interface or API. For the camera set on the terminal device, it communicates with the operating system or directly with the hardware through the software interface to capture images. The captured image is processed by the image processing module, such as recognizing QR codes, etc. In this step, first, the user triggers the scan payment code function. For example, a button or shortcut is provided in the application of the terminal device (such as a smartphone) to allow the user to start the scan payment code function. Then, the camera is automatically started. After the application detects the user's request to scan the payment code, it sends an instruction to the operating system to activate the camera. If necessary, the application may also request access to the camera. After that, the image is captured. After the camera is turned on, it starts to continuously shoot the video stream or capture static pictures periodically. For real-time image needs, keep the video stream open; if only photos at a specific moment are needed, snap them at the right time.

[0056] To capture real-time images, ensure the camera is correctly configured and can consistently capture clear images of the payment code. This can be achieved by using the camera of a mobile device or a dedicated scanning device to capture the payment code.

[0057] For example, computer vision technology is used to process images captured by the camera to locate and decode the QR code on the screen and analyze the image background information. This may involve edge detection, color segmentation, and other technologies to better understand the entire consumption scenario. Depending on business needs, further image processing may be required, such as cropping the payment code area and saving it as a separate file. If the payment code information is successfully read, this data is returned to the user interface to display the results. If the payment code is not correctly recognized, a corresponding prompt message can be displayed, and a suggestion to adjust the angle and try again can be given.

[0058] React Native or Flutter can be used for the front-end of terminal devices to rapidly develop mobile apps across multiple platforms. Node.js, Python Flask / Django, and other frameworks can be used for the back-end, suitable for building lightweight web services. OpenCV, a powerful open-source computer vision library supporting multiple programming languages, can be used for image processing. ZXing ("Zebra Crossing"), a barcode image processing library supporting various barcode and QR code types, can be used for QR code decoding.

[0059] In an alternative implementation, Python can be used with the OpenCV library to implement basic QR code scanning. It would open the default camera, continuously read the video stream, and attempt to decode any visible QR codes. When a QR code is found, the location is marked on the screen and the decoded data is printed.

[0060] Step S120 , performing payment processing based on the payment code image, and performing QR code recognition on the payment code image to obtain information of the payment receiving end corresponding to the payment code image.

[0061] In practical applications, the collected transaction data can include the amount spent, the time spent, the account type, and so on. During the QR code recognition process, existing QR code decoding libraries (such as ZXing and ZBar) are used to parse the QR code data in the image. First, the captured image is converted into a format suitable for processing (usually a grayscale image). Then, a QR code decoding algorithm is used to locate the QR code region in the image. Finally, the data in this region is decoded to obtain a string containing the payee's account information, the amount, and other details.

[0062] To extract and verify transaction data, first, extract the content—that is, extract the payee's account ID, payment amount, and other necessary information from the decoded string. Security checks are then performed to ensure the read data conforms to the expected format and has not been tampered with. For example, data integrity can be verified using a checksum or other security mechanism. A payment request is then initiated. A payment request is constructed based on the extracted information. This request should include, but is not limited to, the following parameters: payee identifier, transfer amount, transaction description, and client unique identifier. The request is then sent to the bank or third-party payment platform's server interface via a network API. The server then waits for a response, returning a confirmation message indicating whether the transaction was successful. If it fails, the error reason should be provided for the user's reference. Finally, feedback is provided, clearly indicating the user's transaction result, whether successful or unsuccessful. If the transaction is successful, transaction details and an electronic receipt can be displayed. If it fails, the user should be informed of the specific issue and recommended solutions. For example, the pyzbar library can be used in a Python environment for QR code recognition.

[0063] Step S130 , based on the information of the payee determined by face recognition in the real-time image, the device identifier of the electronic payment device in the real-time image is identified to obtain the payment device information, and the surrounding environment of the electronic payment code in the real-time image is identified to obtain the consumption environment information.

[0064] The payee may be a payee whose information is determined by face recognition based on real-time images.

[0065] For example, the facial recognition process utilizes existing facial recognition libraries (such as OpenCV, Dlib, and FaceNet) for face detection and recognition. The process may include: first, face detection to identify all facial regions in the real-time image; then, feature extraction to extract the key features of each face; then, feature matching to compare the extracted features with a known facial database to determine the identity of the payee; for security considerations, ensuring the accuracy and robustness of the facial recognition system and implementing necessary privacy protection measures; and finally, device identification recognition, utilizing OCR (Optical Character Recognition) technology to identify text within the image.

[0066] For device identification, the process of identifying device logos typically involves image preprocessing, such as grayscale conversion and binarization, to improve recognition. Next, text location is performed to locate the text area containing the device logo within the image. Finally, text recognition is performed, using an optical character recognition (OCR) tool (such as Tesseract) to identify the device logo. For example, training a specific OCR model can improve the recognition rate of device logos in a specific format.

[0067] For the environmental recognition process of the surrounding environment, deep learning models (such as convolutional neural networks (CNNs)) are typically used for image classification. First, dataset preparation is performed, i.e., collecting and labeling image data from different consumer environments. Next, model training is performed, i.e., using the labeled dataset to train an environmental classification model. Finally, environmental recognition is performed, i.e., real-time images are fed into the trained model, which outputs the corresponding consumer environment category. Example scenarios include restaurants, supermarkets, and convenience stores.

[0068] Through the above steps, processes such as face recognition, device identification recognition and environment recognition based on real-time images can be realized. The application of these processes can greatly improve the security of the payment process and user experience.

[0069] In step S140, the information of the payment person, the information of the payment terminal, the consumption environment information, the payment device information and the real-time image are determined as the first consumption retained evidence data corresponding to the current consumption of the scanning payment code operation, so as to verify the consumption situation of the current consumption through the first consumption retained evidence data.

[0070] As a possible implementation, the real-time image is used as consumption evidence data. Consumption evidence data can include payment device information, payment personnel information, consumption process data, and consumption environment data. These consumption evidence data are used to verify the consumption situation.

[0071] For the information of the cashier, it may include the name, work number, photo, etc. of the cashier. The photo can be obtained from the real-time image through facial recognition technology. For the information of the payment terminal, it may include the merchant name, merchant ID, merchant address, etc., which can be obtained from the electronic payment device or the background system. For the consumption environment information, it may include the consumption place (such as restaurant, supermarket), time, geographic location, etc., which can be obtained from the real-time image through the environment recognition model, or the geographic location can be obtained through GPS positioning. For the payment device information, it may include the device model, device ID, device location, etc., and the device identification can be identified from the real-time image through OCR technology. For the real-time image, the image containing the cashier, payment device, and consumption environment can be captured from the real-time image by the camera.

[0072] Regarding transaction data storage, the above information can be stored in a structured manner, using a database (such as MySQL, MongoDB) or a file system (such as a JSON file). Regarding data verification, in order to verify the current consumption, the following steps can be taken: First, perform a data integrity check, such as verifying that all key fields are correctly filled in through field validation, and verifying the consistency of the logical relationships between various fields through data consistency, such as whether the photo of the cashier matches the facial recognition result.

[0073] Then perform image analysis. In the face recognition process, face recognition can be performed again to confirm the identity of the cashier. In terms of environmental recognition, the environmental recognition model can be run again to confirm the consumption environment. For device recognition, OCR recognition can be performed again to confirm the payment device information.

[0074] For cross-system verification, you can compare the collected data with the merchant's back-end system records to ensure the consistency of transaction information. You can also compare the data with the payment platform's transaction records to ensure consistency in information such as payment amount and time.

[0075] For storage and backup, you can use a database to store structured data for easy query and management. You can also implement logging to record the process and results of each verification for subsequent audits. You can also perform regular backups, that is, regularly back up the database to prevent data loss. For security and privacy, the above data can be stored in encrypted form, such as sensitive information (such as photos and personal identity information). You can also implement access control and set strict permission controls to ensure that only authorized personnel can access this data. For compliance, you need to ensure that the entire process complies with relevant laws and regulations and protect user privacy.

[0076] Through the above steps, the consumption information of the payment code scanning operation can be effectively collected, stored and verified to ensure the security and reliability of the transaction.

[0077] In an embodiment of the present application, when the terminal device performs a payment code scanning operation, the camera can be controlled according to the payment code scanning operation to not only obtain the payment code image of the electronic payment code on the electronic payment device, but also obtain a real-time image of the surrounding environment of the electronic payment code, so that the information of the payment person can be determined by face recognition based on the real-time image, and the payment device information can be obtained by identifying the device identifier of the electronic payment device in the real-time image. Furthermore, the consumption environment information can be obtained by performing environmental recognition on the surrounding environment of the electronic payment code in the real-time image, so that the The consumption evidence data corresponding to the scanning payment code operation can include the information of these payment personnel, the information of the payment terminal, the consumption environment information, the payment device information and the real-time image, so that the consumption situation of the current consumption can be more accurately verified through more accurate and comprehensive consumption evidence data, thereby improving the accuracy of the transaction data verification results, solving the technical problem of low accuracy in data processing of transaction data, and ensuring that all transaction records are accurate, so that when the transaction data verifies consumption anomalies, such as transaction failures, deduction errors, etc., they can be checked and processed in a timely manner. Through the above transaction data processing process, the accurate recording of consumption transactions is ensured, while providing employee consumers with clear consumption records and a convenient consumption experience.

[0078] The above steps are described in detail below.

[0079] In some embodiments, the real-time image is in the form of a video, and the first video corresponding to the real-time image contains data on the consumer communication process between the cashier and the consumer corresponding to the terminal device; the method may further include the following steps:

[0080] Based on the consumer communication process data, image and voice analysis are performed to obtain the consumption content, consumption amount, and consumer corresponding to the current consumption. Based on the consumption content, consumption amount, and consumer, the AI ​​system analyzes and determines the consumption type of the current consumption. The consumption type can include any one or more of the following: public consumption, private consumption, and external consumption.

[0081] The consumption type, consumption content, consumption quantity and consumer are added to the first consumption retained evidence data to obtain the second consumption retained evidence data, so as to perform a second verification of the consumption situation of the current consumption through the second consumption retained evidence data containing the consumption type, consumption content, consumption quantity and consumer.

[0082] As a possible implementation, the real-time image can be in the form of a video, with the first video corresponding to the real-time image containing data on the consumer's communication process between the consumer and the cashier. Based on this communication data, the AI ​​system can analyze the video to determine consumption details, including the content, amount, consumer, and whether the consumption was for business or personal use. This data can also serve as retained consumption evidence, allowing for secondary verification of the consumption details through more complete and comprehensive retained consumption evidence.

[0083] Consumption processes include business, personal, and external consumption. Upon receiving transaction data, the company's top-up system automatically calculates the amount to be deducted based on the account type and consumption location. For personal accounts, the system deducts the amount from the personal account balance. For company accounts, the system deducts the amount from the corresponding company consumption account. If an employee uses a company top-up account, the system deducts the amount from the company top-up account and records the transaction details.

[0084] In the embodiment of the present application, by including more complete and comprehensive consumption evidence data including consumption type, consumption content, consumption quantity and consumer data, a more accurate secondary verification of the current consumption situation can be performed.

[0085] In some embodiments, the terminal device is further provided with a positioning device and a timing device; the method may further include the following steps:

[0086] In response to a payment code scan operation on a terminal device, the time information of the current consumption is obtained through a timing device, and the location information of the current consumption is obtained through a positioning device; and the consumption location information corresponding to the current consumption is determined based on the consumption location information and the consumption environment information;

[0087] The consumption time information, consumption place information and consumption location information are added to the second consumption retained evidence data to obtain the third consumption retained evidence data, so as to verify the consumption situation of the current consumption three times through the third consumption retained evidence data containing the consumption time information, consumption place information and consumption location information.

[0088] During the consumption process, the client also uses the location data obtained through the positioning device installed on the client, and the time data obtained through the timing device installed on the client. These consumption location data and consumption time data are also used as consumption evidence data. Therefore, consumption evidence data also includes consumption time data, consumption location data, and consumption occasion data.

[0089] By providing more comprehensive and complete consumption evidence including information on consumption time, consumption location and consumption location, the data can provide a more accurate three-way verification of the current consumption situation, further improving the accuracy of transaction data.

[0090] In some embodiments, each consumption type corresponds to a respective consumption account, and the consumption account includes any one or more of a personal recharge account, an enterprise recharge account, and a reimbursement account; the method may further include the following steps:

[0091] Determine the identity of the payee corresponding to the current consumption based on the terminal device; determine the consumer identity of all consumers through face recognition based on real-time images; and use the AI ​​system to analyze and determine the target consumption account corresponding to the current consumption based on the consumption type, consumption location information, payee identity, and consumer identity.

[0092] Regarding the process of determining the consumer identities of all consumers through face recognition based on real-time images, for example, the personnel data related to the current consumption is determined based on the face recognition results of the people around the first client.

[0093] As an optional implementation method, the consumption type of the current consumption is determined to be public consumption, private consumption or external consumption based on multiple verification results of the current consumption. Different consumption types correspond to different consumption accounts, that is, public consumption, private consumption, external consumption and other consumption types each correspond to a different consumption account. Consumption accounts include personal recharge accounts, unit recharge accounts, reimbursement accounts and other accounts.

[0094] The above-mentioned target consumption accounts may include personal accounts, company consumption accounts, and company recharge accounts, etc. Among them, for personal accounts, for example, several company sub-accounts and one personal account are set up in the account. The balance inquired by the employee during the period of employment is the total amount of each account. When the employee submits to resign, the second-level administrator of the employee's company shall submit the freezing process, and the remaining amount shall be consumed before leaving. If there is still a company balance when the account is terminated, it shall be returned to the public recharge account of the recharge company. For company consumption accounts, for example, each company has a fixed account for settlement of business activities, which only accepts recharges. When the company is terminated, the balance can be returned to the recharge company (company bank), and cannot be returned to the company recharge account. For company recharge accounts, for example, it is only used to store accounts frozen and returned by the company, and the balance can be used to recharge employee accounts, but not for external personnel accounts and company public consumption accounts.

[0095] In the embodiment of the present application, the consumption type, consumption location information, identity of the payer and identity of the consumer are used to analyze and determine the target consumption account corresponding to the current consumption through the AI ​​system, thereby improving the accuracy of determining the target consumption account and avoiding the occurrence of errors in the deduction account due to the wrong consumption account being determined.

[0096] In some embodiments, the method may further include the following steps: querying the duty data of the cashier in the consumption venue corresponding to the consumption venue information based on the cashier information and the consumption venue information;

[0097] The duty time in the duty data is compared with the consumption time information. If the duty time contains the consumption time corresponding to the consumption time information, it is determined that the consumption time information verification is passed, so that the consumption situation of the current consumption is verified four times according to the duty time.

[0098] As an example, for the cashier information described above, the cashier's duty data for the consumption venue can also be queried based on the consumption venue data, and the consumption time data can be verified based on the time information in the duty data. The cashier's duty time for the consumption venue is compared with the consumption time. If the duty time includes the consumption time, the time data for the consumption is determined to have been verified.

[0099] In an embodiment of the present application, by comparing the duty time in the duty data with the consumption time information, the verification of the consumption time information can be more accurate, making the four verification data of the consumption situation of the current consumption based on the duty time more accurate, further improving the accuracy of the transaction data.

[0100] In some embodiments, as Figure 2 As shown, the method may further include the following steps:

[0101] Step a), in response to a successful connection between the target client and the wireless network device in the consumption venue corresponding to the consumption venue information, performing a security check and an authority check on the target client to obtain a test result;

[0102] Step b), if the detection result is passed, it is determined that the target client has the control authority of the monitoring device in the consumption scene;

[0103] Step c) controlling at least one monitoring device in the consumption scene based on the control authority, and controlling the monitoring device to track the location of the target client through a positioning device, an NFC device and / or a wireless device provided on the target client;

[0104] Step d) controls the camera of the monitoring device to face the consumption position corresponding to the target client according to the position of the target client, and obtains the video data of the consumption communication process data through the monitoring device.

[0105] For example, when the first client in the consumption scene is successfully connected to the corresponding wireless device of the consumption scene, the first client is subjected to security check and permission check. If both checks pass, the first client can control at least one monitoring device in the consumption scene, and control the monitoring device to track the position of the first client through the positioning device, NFC data or wireless positioning data of the first client, and control the camera of the monitoring device to face the consumption position corresponding to the first client at the time of consumption, and obtain video data of the consumption process at the time through the monitoring device.

[0106] In an embodiment of the present application, a connection is successfully established between the target client and the wireless network device in the consumption scene corresponding to the consumption location information. The positioning device, NFC device and / or wireless device set on the target client with control authority is used to control the monitoring device to track the location of the target client. The camera of the monitoring device can be controlled to point toward the consumption location corresponding to the current consumption of the target client, and the video data of the consumption communication process data is obtained through the monitoring device, so that the acquisition process of the video data of the consumption communication process is more efficient and no longer restricted by the scene. Moreover, the control has authority to ensure data security.

[0107] In some embodiments, after the step of acquiring the video data of the consumer communication process data through the monitoring device, the method may further include the following steps:

[0108] Call all the second video data related to the current consumption in the video data of the consumption communication process data, and bundle the second video data with the third consumption retention evidence data; determine the bundled second video data and the third consumption retention evidence data as historical consumption retention data, and store the historical consumption retention data in the designated consumption system.

[0109] As an optional implementation method, the client obtains the consumption site monitoring data of the consumption occasion, and calls the second video data related to the consumption process in the consumption site monitoring data, and bundles and stores the second video data with the corresponding consumption evidence data of the consumption process.

[0110] In an embodiment of the present application, all video data related to the current consumption in the video data of the consumption communication process data are called and the video data and the consumption evidence data are bundled and stored in a designated consumption system, so that the consumption evidence data and video data in the consumption system are easier to query, avoiding confusion of transaction data in the consumption system.

[0111] Figure 3A schematic diagram of the structure of a transaction data processing device is provided. The device can be applied to a terminal device, wherein an electronic payment device is provided within a preset distance around the terminal device, and a camera is provided on the terminal device. Figure 3 As shown, the transaction data processing device 300 includes:

[0112] The control module 301 is configured to respond to a payment code scanning operation performed on the terminal device and control the camera to capture a payment code image of the electronic payment code on the electronic payment device and a real-time image of the environment surrounding the electronic payment code, in accordance with the payment code scanning operation; wherein the real-time image includes an image of the electronic payment device and an image of a payment recipient corresponding to the electronic payment device;

[0113] The recognition module 302 is used to process payment based on the payment code image and perform QR code recognition on the payment code image to obtain information about the payment receiving terminal corresponding to the payment code image;

[0114] The determination module 303 is configured to identify the device identifier of the electronic payment device in the real-time image based on the information of the payment recipient determined by facial recognition in the real-time image to obtain payment device information, and to identify the surrounding environment of the electronic payment code in the real-time image to obtain consumption environment information;

[0115] The verification module 304 is used to determine the information of the payment person, the information of the payment terminal, the consumption environment information, the payment device information and the real-time image as the first consumption retained evidence data corresponding to the current consumption of the scanning payment code operation, and verify the consumption situation of the current consumption through the first consumption retained evidence data.

[0116] The transaction data processing device provided in the embodiment of the present application has the same technical features as the transaction data processing method provided in the above embodiment, so it can also solve the same technical problems and achieve the same technical effects.

[0117] An electronic device provided in an embodiment of the present application is Figure 4 As shown, the electronic device 400 includes a processor 402 and a memory 401 , wherein the memory stores a computer program that can be run on the processor, and the processor implements the steps of the method provided in the above embodiment when executing the computer program.

[0118] See also Figure 4 The electronic device further includes: a bus 403 and a communication interface 404, a processor 402, a communication interface 404 and a memory 401 connected via the bus 403; the processor 402 is used to execute executable modules stored in the memory 401, such as computer programs.

[0119] Memory 401 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage. Communication between the system network element and at least one other network element is achieved through at least one communication interface 404 (which may be wired or wireless), and may use the Internet, a wide area network, a local area network, a metropolitan area network, etc.

[0120] The bus 403 may be an ISA bus, a PCI bus, or an EISA bus. The bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, Figure 4 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0121] Among them, the memory 401 is used to store programs, and the processor 402 executes the program after receiving the execution instruction. The method executed by the device defined by the process disclosed in any embodiment of the present application can be applied to the processor 402 or implemented by the processor 402.

[0122] The processor 402 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by an integrated logic circuit of hardware in the processor 402 or by instructions in the form of software. The above-mentioned processor 402 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in memory 401, and processor 402 reads the information in memory 401 and, in conjunction with its hardware, completes the steps of the above method.

[0123] Corresponding to the above-mentioned transaction data processing method, an embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by the processor, the computer-executable instructions prompt the processor to execute the steps of the above-mentioned transaction data processing method.

[0124] The transaction data processing device provided in the embodiments of the present application can be specific hardware on the device or software or firmware installed on the device. The implementation principle and technical effects of the device provided in the embodiments of the present application are the same as those of the aforementioned method embodiments. For the sake of brief description, any part not mentioned in the device embodiment can be referred to the corresponding content in the aforementioned method embodiments. Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can all refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0125] In the embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interface, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0126] For another example, the flowcharts and block diagrams in the accompanying drawings show the possible architectures, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0127] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0128] In addition, each functional unit in the embodiments provided in the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0129] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the transaction data processing method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and other media that can store program codes.

[0130] It should be noted that similar numbers and letters represent similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. In addition, the terms "first", "second", "third", etc. are only used to distinguish the description and are not to be understood as indicating or implying relative importance.

[0131] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The scope of protection of the present application is not limited thereto. Although the present application has been described in detail with reference to the above-mentioned embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-mentioned embodiments within the technical scope disclosed in the present application, or perform equivalent replacements for some of the technical features thereof. However, these modifications, changes, or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application. They should all be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A transaction data processing method, characterized in that: Applied to a terminal device, wherein an electronic payment device is provided within a preset distance around the terminal device, and the terminal device is provided with a camera; the method comprises: In response to a payment code scanning operation performed on the terminal device, the camera is controlled according to the payment code scanning operation to obtain a payment code image of the electronic payment code on the electronic payment receiving device and a real-time image of the environment surrounding the electronic payment code; wherein the real-time image includes an image of the electronic payment receiving device and an image of a payment recipient corresponding to the electronic payment receiving device; Processing payment based on the payment code image, and performing QR code recognition on the payment code image to obtain information of the payment receiving end corresponding to the payment code image; Based on the information of the payment recipient determined by face recognition in the real-time image, a device identifier of the electronic payment device in the real-time image is identified to obtain payment device information, and an environment surrounding the electronic payment code in the real-time image is identified to obtain consumption environment information; Determining the information of the payment collector, the information of the payment terminal, the consumption environment information, the payment device information, and the real-time image as first consumption evidence data corresponding to the current consumption of the payment code scanning operation, so as to verify the consumption of the current consumption through the first consumption evidence data; The first video corresponding to the real-time image contains the consumption communication process data between the cashier and the consumer corresponding to the terminal device; image analysis and voice analysis are performed based on the consumption communication process data to obtain the consumption content, consumption amount and consumer corresponding to the current consumption; the AI ​​system analyzes and determines the consumption type of the current consumption based on the consumption content, consumption amount and consumer; the consumption situation of the current consumption is verified for the second time through the second consumption retained evidence data containing the consumption type, consumption content, consumption amount and consumer; the amount to be deducted is automatically calculated based on the account type and consumption location corresponding to the public consumption type, private consumption type and external consumption type in the consumption type.

2. The method according to claim 1, characterized in that The real-time image is in the form of a video, and the first video corresponding to the real-time image contains consumption communication process data between the cashier and the consumer corresponding to the terminal device; the method further includes: Perform image analysis and voice analysis based on the consumption communication process data to obtain the consumption content, consumption amount and consumer corresponding to the current consumption; The AI ​​system analyzes and determines the consumption type of the consumption based on the content of the consumption, the amount of consumption, and the consumer; wherein the consumption type includes any one or more of public consumption, private consumption, and external consumption; The consumption type, the consumption content, the consumption amount and the consumer are added to the first consumption retained evidence data to obtain the second consumption retained evidence data, so as to perform a second verification on the consumption situation of the current consumption through the second consumption retained evidence data containing the consumption type, the consumption content, the consumption amount and the consumer.

3. The method according to claim 2, characterized in that The terminal device is further provided with a positioning device and a timing device; the method further comprises: In response to a payment code scanning operation performed on the terminal device, the timer device obtains the time of the current consumption, and the positioning device obtains the location of the current consumption; Determining the consumption location information corresponding to the current consumption based on the consumption location information and the consumption environment information; The consumption time information, the consumption place information and the consumption location information are added to the second consumption retained evidence data to obtain the third consumption retained evidence data, so as to verify the consumption situation of the current consumption three times through the third consumption retained evidence data containing the consumption time information, the consumption place information and the consumption location information.

4. The method according to claim 3, characterized in that Each consumption type corresponds to a respective consumption account, and the consumption account includes any one or more of a personal recharge account, a unit recharge account, and a reimbursement account; the method further includes: Determining the identity of the payer corresponding to the current consumption according to the terminal device; Determining the consumer identities of all the consumers through face recognition based on the real-time image; The target consumption account corresponding to the current consumption is analyzed and determined by the AI ​​system based on the consumption type, the consumption location information, the identity of the payer and the identity of the consumer.

5. The method according to claim 3, characterized in that The method further comprises: According to the information of the cashier and the information of the consumption venue, query the duty data of the cashier in the consumption venue corresponding to the consumption venue information; The duty time in the duty data is compared with the consumption time information. If the duty time includes the consumption time corresponding to the consumption time information, it is determined that the consumption time information verification is passed, so as to perform four verifications on the consumption situation of the current consumption according to the duty time.

6. The method according to claim 3, characterized in that The method further comprises: In response to a successful connection between the target client and the wireless network device in the consumption scene corresponding to the consumption scene information, performing a security check and an authority check on the target client to obtain a check result; If the detection result is passed, it is determined that the target client has the control authority of the monitoring device in the consumption scene; controlling at least one of the monitoring devices in the consumption scene based on the control authority, and controlling the monitoring device to track the location of the target client through the positioning device, NFC device and / or wireless device provided on the target client; According to the position of the target client, the camera of the monitoring device is controlled to face the consumption position corresponding to the target client, and the video data of the consumption communication process data is obtained through the monitoring device.

7. The method according to claim 6, characterized in that After obtaining the video data of the consumer communication process data through the monitoring device, the method further includes: Recalling all second video data related to the current consumption in the video data of the consumption communication process data, and bundling the second video data with the third consumption retained evidence data; The second video data and the third consumption retention evidence data after bundling processing are determined as historical consumption retention data, and the historical consumption retention data is stored in a designated consumption system.

8. A transaction data processing device, characterized in that: Applied to a terminal device, wherein an electronic payment device is provided within a preset distance around the terminal device, and the terminal device is provided with a camera; including: a control module, configured to respond to a payment code scanning operation performed on the terminal device and control the camera to acquire a payment code image of the electronic payment code on the electronic payment receiving device and a real-time image of the environment surrounding the electronic payment code in accordance with the payment code scanning operation; wherein the real-time image includes an image of the electronic payment receiving device and an image of a payment recipient corresponding to the electronic payment receiving device; an identification module, configured to process payment based on the payment code image and perform QR code recognition on the payment code image to obtain information on the payment receiving end corresponding to the payment code image; a determination module configured to identify the payment recipient's information determined by face recognition in the real-time image, identify the device identifier of the electronic payment device in the real-time image to obtain payment device information, and identify the surrounding environment of the electronic payment code in the real-time image to obtain consumption environment information; a verification module, configured to determine the information of the payment collector, the information of the payment terminal, the consumption environment information, the payment device information, and the real-time image as first consumption evidence data corresponding to the current consumption by scanning the payment code, and verify the consumption situation of the current consumption through the first consumption evidence data; The first video corresponding to the real-time image contains the consumption communication process data between the cashier and the consumer corresponding to the terminal device; the verification module is also used to: perform image analysis and voice analysis based on the consumption communication process data to obtain the consumption content, consumption quantity and consumer corresponding to the current consumption; analyze and judge the consumption type of the current consumption through the AI ​​system based on the consumption content, consumption quantity and consumer; perform a second verification of the consumption situation of the current consumption through the second consumption retained evidence data containing the consumption type, consumption content, consumption quantity and consumer; automatically calculate the amount to be deducted based on the account type and consumption location corresponding to the public consumption type, private consumption type and external consumption type in the consumption type.

9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to execute the method according to any one of claims 1 to 7.

Images