Information interaction method, system and computer readable storage medium

Abstract

The present invention discloses an information interaction method, system and computer-readable storage medium. The method generates multimedia information in response to a payment operation of a payment object on a first display screen, and then displays corresponding multimedia content on a second display screen, so that a settlement terminal can obtain the multimedia content displayed on the second display screen in response to a scanning operation, and then identify the payment information of the payment operation from the multimedia content. The payment information of the payment operation can be obtained by scanning the multimedia content on the second display screen. There is no need to communicate through a cable between a dual-screen cash register device and a settlement terminal, which avoids the risk of communication abnormality caused by accidentally touching the cable and improves the communication stability during the payment operation. There is no need to use wireless communication between the dual-screen cash register device and the settlement terminal to transmit payment information, which avoids the risk of communication abnormality caused by unstable wireless communication signals. The method can be widely used in the field of computer technology.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to an information interaction method, system and computer-readable storage medium. Background Art

[0002] A cash register is a settlement tool used in retail businesses, restaurants, supermarkets, bank counters, and other places that handle counter business. It consists of a display screen, a host, a cash box, and other parts. It can be connected to a scanner, a printer, or a POS (Point of Sales) terminal to complete the settlement process. Cash registers can be classified into single-screen cash registers and dual-screen cash registers according to the number of display screens.

[0003] In order to improve the interaction efficiency between the transaction object and the merchant, dual-screen cash registers are now used for order transactions. The two display screens of the dual-screen cash register are set on both sides of the cash register. The cashier uses the back screen to settle the goods purchased by the customer, and the customer can see the purchase order through the front screen.

[0004] At present, in the application scenario of dual-display cash registers, it is usually necessary to use a cable-based HID communication method to pass the payment information obtained by the dual-display cash register to the POS terminal to complete the settlement process. This communication method has low stability and is prone to communication anomalies due to accidental collisions with the cables on the cash register, making it impossible to complete normal settlement. Related technologies use wireless communication methods to improve the problems caused by cables. For example, the payment information obtained by the dual-display cash register is passed to the POS terminal through a WIFI network or Bluetooth communication technology. In this process, the signal of the wireless network also has the risk of signal anomalies causing payment and settlement interruption, and the communication stability in payment and settlement cannot be guaranteed. Summary of the invention

[0005] In view of this, embodiments of the present invention provide an information interaction method, system, and computer-readable storage medium to improve communication stability during payment settlement.

[0006] An aspect of an embodiment of the present invention provides an information interaction method, including:

[0007] In response to a payment operation on the first display screen, generating multimedia information; wherein the payment operation is used to trigger a payment order;

[0008] Displaying multimedia content on a second display screen according to the multimedia information; wherein the multimedia content is used to represent the payment information of the payment operation;

[0009] In response to a scanning operation of the settlement terminal, acquiring multimedia content displayed on the second display screen, and identifying payment information of the payment operation from the multimedia content;

[0010] Performing payment settlement at the settlement terminal according to the identified payment information;

[0011] The first display screen and the second display screen are two display screens in a dual-screen cash register device.

[0012] Another aspect of the embodiment of the present invention provides an information interaction system, including: a dual-screen cash register device and a settlement terminal, wherein the dual-screen cash register device includes a first display screen and a second display screen; the settlement terminal includes a code scanning module and a settlement module;

[0013] The first display screen is used to generate multimedia information in response to a payment operation; wherein the payment operation is used to trigger a payment order;

[0014] The second display screen is used to display multimedia content according to the multimedia information; wherein the multimedia content is used to represent the progress of the payment operation on the first display screen, and is used to represent the payment information of the payment operation;

[0015] The code scanning module is used to obtain the multimedia content displayed on the second display screen in response to the scanning operation, and identify the payment information of the payment operation from the multimedia content;

[0016] The settlement module is used to perform payment settlement according to the identified payment information.

[0017] Another aspect of the present invention provides an information interaction device, including:

[0018] A first module, configured to generate multimedia information in response to a payment operation on a first display screen; wherein the payment operation is used to trigger a payment order;

[0019] A second module is used to display multimedia content on a second display screen according to the multimedia information; wherein the multimedia content is used to represent the progress of the payment operation on the first display screen, and is used to represent the payment information of the payment operation;

[0020] a third module, configured to obtain multimedia content displayed on the second display screen in response to a scanning operation of the settlement terminal, and identify payment information of the payment operation from the multimedia content;

[0021] A fourth module is used to perform payment settlement at the settlement terminal according to the identified payment information;

[0022] The first display screen and the second display screen are two display screens in a dual-screen cash register device.

[0023] Optionally, the first module is specifically used to implement at least one of the following:

[0024] When the payment operation is a biometric payment, in response to the payment operation on the first display screen, identifying the identity information of the payment object, and generating multimedia information according to the payment information corresponding to the identity information;

[0025] Alternatively, when the payment operation is scan code payment, in response to the payment operation on the first display screen, the payment information displayed by the payment terminal of the payment object is obtained, and multimedia information is generated according to the payment information displayed by the payment terminal.

[0026] Optionally, the first module is further configured to implement at least one of the following:

[0027] The payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a target image frame and then inserted into a preset video stream, and the video stream after the insertion into the target image frame is used as multimedia information;

[0028] Alternatively, the payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a target image and then spliced ​​with at least one preset image, and the spliced ​​static image is used as the multimedia information;

[0029] Alternatively, the payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a target image and then combined with at least one preset image frame by frame, and the dynamic image obtained by the frame-by-frame combination is used as the multimedia information;

[0030] Alternatively, the payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a QR code image, and the QR code image is used as multimedia information.

[0031] Optionally, the first module is further configured to implement at least one of the following:

[0032] Obtain the video stream when the payment terminal displays payment information, and use the video stream as multimedia information;

[0033] Alternatively, a display screen of the payment terminal is obtained, and a payment code is identified from the display screen of the payment terminal, and the payment code is used as multimedia information.

[0034] Optionally, the first module is further configured to implement at least one of the following:

[0035] The payment code is converted into a target image frame and then inserted into a preset video stream, and the video stream after the insertion into the target image frame is used as multimedia information;

[0036] Alternatively, the payment code is converted into a target image and then spliced ​​with at least one preset image, and the spliced ​​static image is used as the multimedia information;

[0037] Alternatively, the payment code is converted into a target image and then combined with at least one preset image frame by frame, and a dynamic image obtained by the frame-by-frame combination is used as multimedia information;

[0038] Alternatively, the payment code is converted into a QR code image, and the QR code image is used as multimedia information.

[0039] Optionally, the third module is specifically used to implement at least one of the following:

[0040] In response to the scanning operation, performing an image scan on the video stream displayed on the second display screen to capture a payment code for the payment operation from the video stream;

[0041] Alternatively, in response to the scanning operation, an image scan is performed on the static image displayed on the second display screen to capture the payment code for the payment operation from the static image;

[0042] Alternatively, in response to the scanning operation, an image scan is performed on the dynamic image displayed on the second display screen to capture the payment code of the payment operation from the dynamic image;

[0043] Alternatively, in response to the scanning operation, the two-dimensional code image displayed on the second display screen is scanned, payment code information for the payment operation is obtained from the two-dimensional code image, and converted to obtain the payment code for the payment operation;

[0044] Alternatively, in response to the scanning operation, an image scan is performed on the payment code displayed on the second display screen to obtain the payment code for the payment operation.

[0045] Optionally, at least one of the first module, the second module, and the third module is specifically used for:

[0046] Obtain historical transaction data for payment settlement using dual-screen cash register devices;

[0047] Calculate payment settlement success rate based on historical transaction data;

[0048] Generate registration guidance instructions based on the payment settlement success rate;

[0049] In response to the registration guidance instruction, the posture of the second display screen of the dual-screen cash register device is adjusted.

[0050] Optionally, at least one of the first module, the second module, and the third module is further specifically used for:

[0051] In response to the height registration instruction, adjusting the screen height of the second display screen of the dual-screen cash register device;

[0052] Alternatively, in response to the angle alignment instruction, the screen angle of the second display screen of the dual-screen cash register device is adjusted;

[0053] Alternatively, in response to the brightness alignment instruction, the screen brightness of the second display screen of the dual-screen cash register device is adjusted.

[0054] Optionally, at least one of the first module, the second module, and the third module is further specifically used for:

[0055] Generate connection instructions based on payment settlement success rate;

[0056] According to the wiring instructions, configure the communication cable between the dual-screen cash register device and the settlement terminal.

[0057] Optionally, at least one of the first module, the second module, and the third module is further specifically used to implement at least one of the following:

[0058] In response to the payment completion instruction, displaying payment settlement information on the first display screen and the second display screen;

[0059] Alternatively, in response to the payment completion instruction, an audio signal indicating payment completion is broadcasted.

[0060] Another aspect of an embodiment of the present invention provides an electronic device, including a processor and a memory;

[0061] The memory is used to store programs;

[0062] The processor executes the program to implement the information interaction method.

[0063] Another aspect of an embodiment of the present invention provides a computer-readable storage medium, wherein the storage medium stores a program, and the program is executed by a processor to implement the information interaction method.

[0064] Another aspect of an embodiment of the present invention provides a computer program product, including a computer program, and the computer program implements the information interaction method when executed by a processor.

[0065] The embodiment of the present invention generates multimedia information in response to the payment operation of the payment object on the first display screen, and then displays the corresponding multimedia content on the second display screen, so that the settlement terminal can respond to the scanning operation, obtain the multimedia content displayed on the second display screen, and then identify the payment information of the payment operation from the multimedia content. The present invention can obtain the payment information of the payment operation by scanning the multimedia content on the second display screen, and does not need to communicate through the cable between the dual-screen cash register device and the settlement terminal, thereby avoiding the risk of communication abnormalities due to accidental touching of the cable, and improving the communication stability during the payment operation. Finally, payment settlement is performed at the settlement terminal based on the identified payment information. In addition, the dual-screen cash register device of the present invention and the settlement terminal do not need to use wireless communication to transmit payment information, thereby avoiding the risk of communication abnormalities due to unstable wireless communication signals, and further improving the communication stability during the payment operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0067] Figure 1 A schematic diagram of an implementation environment of the information interaction method provided by an embodiment of the present invention;

[0068] Figure 2 is a schematic diagram of a functional area in a first display screen according to an embodiment of the present invention;

[0069] Figure 3 A schematic block diagram of a backend service module, a settlement terminal and a dual-screen cash register device provided in an embodiment of the present invention;

[0070] Figure 4 A schematic diagram of a flow chart of an information interaction method provided by an embodiment of the present invention;

[0071] Figure 5 A schematic diagram of the structure of a second display terminal provided by an embodiment of the present invention;

[0072] Figure 6 A schematic diagram of a process for configuring a communication cable based on wiring instructions provided in an embodiment of the present invention;

[0073] Figure 7 A schematic diagram of a processing flow in response to a payment completion instruction provided in an embodiment of the present invention;

[0074] Figure 8A schematic diagram of the steps of a specific example of the information interaction method provided by an embodiment of the present invention;

[0075] Fig. 9 A schematic diagram of a camera module in a shooting process provided by an embodiment of the present invention;

[0076] Fig.10 A schematic diagram of a QR code displayed on a second display screen provided by an embodiment of the present invention;

[0077] Fig.11 A schematic diagram of displaying payment settlement information provided by an embodiment of the present invention;

[0078] Fig.12 A schematic diagram of the structure of an information interaction device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0079] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0080] First, the terms involved in the embodiments of the present invention are introduced:

[0081] 3D (Three Dimensions) camera module: refers to a component containing a three-dimensional (3D) camera, which is composed of multiple cameras and depth sensors. It can obtain conventional planar images and the depth information of the photographed object, that is, the three-dimensional position and size information, and can be applied to human-computer interaction, face recognition, gesture recognition, three-dimensional modeling, augmented reality (AR), security and assistance, driving and other fields.

[0082] Palm payment: It recognizes identity information by obtaining the image of the vein distribution in the palm of the hand, overcoming the shortcomings of slow fingerprint recognition and the inability to recognize due to stains or peeling of fingers. It is an identification technology that improves recognition efficiency.

[0083] Nowadays, in people's daily life, when people go to places such as retail enterprises, restaurants, supermarkets or bank counters to handle counter business, they have the actual need for payment and settlement, and need to use a cash register for settlement, such as a dual-screen cash register. The dual-screen cash register has a front screen facing the payment object (such as a customer) and a back screen facing the staff (such as a cashier). The front screen and the back screen are arranged on both sides of the counter. The front screen can display the purchase order or merchant activities to the payment object. The purchase order may include the name of the product, the purchase quantity, the price and other contents. When an error occurs in the purchase order, the customer can see the cashier modifying the purchase order through the front screen, and the staff can perform settlement operations on the products in the purchase order of the payment object through the back screen, and transmit the relevant payment information of the settlement operation to the POS terminal to complete the settlement process. However, in the related art, the dual-screen cash register and the POS terminal use a cable-based HID communication method for communication. The connection between the cable and the dual-screen cash register and the POS terminal is prone to loosening, resulting in communication anomalies, making it impossible to successfully pay for the purchase order of the payment object, reducing the payment success rate, and when the purchase order payment fails, the settlement operation needs to be re-performed, and manual inspection and re-insertion of the cable are required. The operation is cumbersome, time-consuming, and the payment efficiency is low, affecting the smooth progress of the entire payment process. In some cases, the cable is exposed on the counter. Due to the limited area of ​​the counter, when the staff is carrying out activities or performing settlement operations, it is easy to touch the cable, which increases the probability that the connection between the cable and the dual-screen cash register and the POS terminal is easy to loosen or the cable falls off, and there is a hidden danger of affecting normal payment and settlement. In response to the above-mentioned defects, the relevant technology has proposed a method of realizing communication between a dual-screen cash register and a POS terminal through wireless communication methods such as WIFI network or Bluetooth communication. However, in this method, since the signal of the wireless network may also be unstable and have other signal abnormalities, the payment settlement may not be completed normally, resulting in payment settlement interruption. The communication stability in the payment settlement cannot be guaranteed, and the payment success rate cannot be effectively improved.

[0084] Based on the above situation, the embodiments of the present invention provide an information interaction method, system and computer-readable storage medium, which generates multimedia information in response to the payment operation of the payment object on the first display screen, and then displays the corresponding multimedia content on the second display screen, so that the settlement terminal can respond to the scanning operation, and obtain the payment information of the payment operation by scanning the multimedia content on the second display screen. There is no need for the dual-screen cashier device and the settlement terminal to communicate through cables. According to the recognized payment information, payment settlement can be performed at the settlement terminal, avoiding the risk of communication abnormalities caused by accidentally touching the cable, which is conducive to improving the payment success rate and making the entire payment process go smoothly. In addition, by scanning the multimedia content on the second display screen to obtain the payment information of the payment operation, the dual-screen cashier device of the present invention and the settlement terminal do not need to communicate by wireless communication, and there is no need to transmit the payment information between the dual-screen cashier device and the settlement terminal by wireless communication, so the risk of communication abnormalities caused by unstable wireless communication signals can be avoided, and the communication stability during the payment operation is further improved, which is also conducive to improving the payment success rate and making the entire payment process go smoothly, and improving payment efficiency.

[0085] Reference Figure 1 , Figure 1 A schematic diagram of an implementation environment provided for an embodiment of the present invention, the implementation environment includes a dual-screen cash register device (including a first display terminal 100 and a second display terminal 200) and a settlement terminal 300.

[0086] In this implementation environment, the first display terminal may include a first display screen 101, a camera module 102, a code scanning module 103, and a fingerprint module (not shown); the first display screen 101 faces the payment object (such as the customer 400), and the first display screen 101 has a first display page, and the display content of the first display page is for the payment object to view, and the display content may include a purchase order or a function area, and the function area has a variety of payment methods for the payment object to choose, such as Figure 2 As shown, 100A is a function area for triggering corresponding payment operations, such as triggering corresponding payment operations through touch screen click instructions, gesture instructions, voice instructions, etc. Optionally, the payment method includes a biometric payment method and a code scanning payment method, and the biometric payment method includes but is not limited to face payment, fingerprint payment, palm payment, etc.

[0087] like Figure 1As shown, optionally, the camera module 102 includes but is not limited to a 3D camera module, and the camera module 102 is arranged above the first display screen 101. In other embodiments, the camera module 102 can be arranged on the left, right or bottom of the first display screen 101. Optionally, the camera module 102 is used to obtain a facial image or video stream of the payment object when the payment object selects face payment, obtain a palm image or video stream of the payment object when the payment object selects palm payment, and obtain a payment code image or video stream of the payment terminal of the payment object when the payment object selects code scanning payment.

[0088] Optionally, the fingerprint module is used to obtain the fingerprint information input by the payee when the payee selects fingerprint payment. The code scanning module 103 is arranged below the first display screen 101. In other embodiments, the code scanning module 103 can be arranged on the left, right or top of the first display screen 101. The code scanning module 103 can be used to scan the barcode of the product to generate a payment order, or can scan the payment code in the payment terminal of the payee to obtain an image of the payment code.

[0089] like Figure 1 As shown, optionally, the second display end 200 includes a second display screen 201, the second display screen 201 faces the staff (such as the cashier 500), and the second display screen 201 can display multimedia content. It should be noted that at least one of the second display terminal 200 and the first display terminal 100 may be installed with an APP. For example, the first display terminal 100 may have an APP installed, and the APP of the first display terminal 100 may generate multimedia information in response to the payment operation of the payment object on the first display screen 101, and generate multimedia content based on the multimedia information and display the multimedia content on the second display screen 201; or, the second display terminal 200 may have an APP installed, and the APP of the second display terminal 200 may generate multimedia information in response to the payment operation of the payment object on the first display screen 101, and generate multimedia content based on the multimedia information, and then display the multimedia content on the second display screen 201; or, both the first display terminal 100 and the second display terminal 200 may have an APP installed, and the APP of the first display terminal 100 may generate multimedia information in response to the payment operation of the payment object on the first display screen 101, and the APP of the second display terminal 200 may generate multimedia content based on the multimedia information, and then display the multimedia content on the second display screen 201, without specific limitation.

[0090] like Figure 3As shown, optionally, the APP in the first display terminal 100 and the second display terminal 200 includes but is not limited to an identification module, a generation module, a video transmission module, and an alignment guidance module. Among them, the identification module is used to call the camera module 102 to collect the current biometrics of the payment object or the payment information displayed in the payment terminal of the payment object. After obtaining the streaming media, the target image can be selected by comprehensive evaluation of coefficient indicators such as size, angle, image contrast, image brightness and clarity, and then the identity information of the payment object is obtained according to the target image, and the payment information corresponding to the identity information is further obtained. The generation module is used to convert the payment information into a payment code that can be recognized by the settlement terminal after obtaining the payment information. The video transmission module is used to directly display the streaming media of the payment information displayed in the payment terminal collected by the camera module 102 or the multimedia information obtained according to the collected biometric features on the second display screen 201 in a silent state. The second display terminal 200 has a video player that can play the collected streaming media in real time. In the default mode of the silent state, the streaming media is collected and played on the second display screen 201, thereby realizing two-dimensional transmission. It should be noted that other modes may be provided in other embodiments without specific limitation. The registration guidance module is used to obtain the historical transaction data of the payment settlement of the dual-screen cash register device and calculate the payment settlement success rate. Then, it can be determined whether the settlement terminal needs to actively identify the content in the second display screen 201 according to the payment settlement success rate, such as actively identifying the content in the second display screen 201 through the code scanning module. If the judgment result is necessary, the prompt instruction that needs to be actively identified will be sent to the settlement terminal. At the same time, alignment guidance instructions can be generated according to the payment settlement success rate. For example, the alignment guidance instructions include but are not limited to height alignment instructions, angle alignment instructions or brightness alignment instructions for controlling the second display screen 201, which is conducive to the content displayed in the second display screen 201 being successfully recognized by the settlement terminal.

[0091] like Figure 1 and Figure 3As shown, in this implementation environment, the settlement terminal 300 includes but is not limited to a code scanning module 301, an external camera and a settlement module 302. The settlement module 302 is connected to the code scanning module 301 and the external camera. In some embodiments, the settlement terminal may include one of the code scanning module 301 and the external camera; the settlement module 302 includes but is not limited to a POS machine. In some embodiments, the settlement module 302 and the code scanning module 301 can communicate through the built-in cable HID, the external camera and the settlement module 302 communicate through the serial port, and the settlement terminal and the dual-screen cash register device communicate through the cable HID. In an embodiment of the present invention, the code scanning module 301 is used to respond to the scanning operation of the settlement terminal, obtain the multimedia content displayed on the second display screen 201, identify the payment information of the payment operation from the multimedia content, and then transmit the identified payment information to the settlement module 302 for payment settlement. In some embodiments, the multimedia content displayed on the second display screen 201 can be obtained by shooting and scanning with an external camera, and the payment information of the payment operation can be identified from the multimedia content. It should be noted that the process of identifying payment information of payment operations from multimedia content can be completed in one of the code scanning module 301, the external camera or the settlement module 302, and is not specifically limited.

[0092] Optionally, the scanning operation of the settlement terminal can be actively triggered or passively triggered. For example, the active trigger can be a staff member clicking a mechanical button in the settlement module 302, clicking the screen of the settlement module 302, or issuing a voice command to the settlement module 302, so that the settlement module 302 obtains the multimedia content displayed on the second display screen 201 through the code scanning module 301 or the external camera in response to the scanning operation. For another example, the passive trigger can be a timed trigger, and a scanning instruction is generated as a scanning operation every time a timed interval is reached, so that the settlement module 302 obtains the multimedia content displayed on the second display screen 201 through the code scanning module 301 or the external camera in response to the scanning operation.

[0093] For example, when the code scanning module 301 and the external camera are actually used, the staff can hold the code scanning module 301 and the external camera, or the handheld code scanning module 301 and the external camera can be fixed to the counter so that the handheld code scanning module 301 and the external camera are aligned with the position of the second display screen 201, thereby improving convenience.

[0094] like Figure 3As shown, in this implementation environment, the dual-screen cash register device may further include a backend service module, which may be a module independent of the first display terminal 100 and the second display terminal 200, for example, a server or software or hardware with data processing functions, or the backend service module may be a module in the first display terminal 100 or the second display terminal 200, without specific limitation. Optionally, the backend service module includes but is not limited to an identification service unit, a basic account service unit, a basic payment service unit, and a payment status management service unit.

[0095] Optionally, the identification service unit is used to extract features from the received biometric features, compare the extracted features with the biometric features stored in the database to calculate the similarity, determine the matching target biometric features based on the similarity, and then obtain the identity information corresponding to the target biometric features and the payment information matched by the identity information by calling the basic payment service unit. It should be noted that in some embodiments, the identification module in the APP can obtain the identity information and the payment information matched by the identity information by calling the identification service unit and the basic payment service unit.

[0096] Optionally, the basic account service unit is called when the payment object successfully pays, so that the payment settlement information is displayed on the payment terminal to provide basic information services. For example, the identity information and payment information obtained by the basic payment service unit are the identity information and payment information in the payment software of the payment terminal. At this time, when the payment object successfully pays, the basic account service unit is called, so that the payment settlement information is displayed in the payment software of the payment terminal, so that the payment object can understand the relevant information of the payment settlement. It should be noted that the payment software refers to software that at least includes the payment function.

[0097] Optionally, the payment status management service unit is used to continuously determine the payment success rate of each dual-screen cash register device. When the payment success rate is lower than the success rate threshold, the success rate threshold is 10% by way of example. When the payment success rate is lower than 10%, it indicates that the communication between the current dual-screen cash register device and the settlement terminal is abnormal. For example, the cable may be loose, resulting in abnormal communication in the HID form or abnormal wireless communication. At this time, a mode adjustment instruction is sent to the dual-screen cash register device. The mode adjustment instruction can be played by voice or displayed on the second display screen 201. At this time, the staff adjusts the new recognition mode, specifically adjusting it to a mode for recognizing the multimedia content displayed on the second display screen 201 through the code scanning module. The payment status management service unit identifies the dual-screen cash register device after the current recognition mode is adjusted as a dual-screen cash register device using the new recognition mode, and continues to observe. It should be noted that each dual-screen cash register device has a unique string serial number for identifying each dual-screen cash register device.

[0098] Reference Figure 4 , Figure 4 A flow chart of an information interaction method provided by an embodiment of the present invention. The information interaction method may be performed by Figure 1 The dual-screen cash register device and the settlement terminal shown cooperate to perform the information interaction method, which includes but is not limited to the following steps S100-S400:

[0099] S100: Generate multimedia information in response to a payment operation on a first display screen.

[0100] In an embodiment of the present invention, after the payment object confirms the object (such as an item) to be purchased, the dual-screen cash register device will generate an order corresponding to the purchase object, and the content of the order can be displayed on the first display screen and / or the second display screen. When the payment object needs to pay for the order, the first display page of the first display screen displays the content for the payment object (such as a customer) to view, and the displayed content has at least one payment method for the payment object to choose, and the payment method is not limited to face payment, fingerprint payment, palm payment, code scanning payment, etc. The payment object can select one of the multiple payment methods through the payment operation, thereby triggering the payment order through the payment operation and generating multimedia information. Optionally, the payment operation can be a touch screen click instruction, a gesture instruction, a voice instruction, etc. For example, the payment object clicks the face payment in the displayed content through the touch screen, and the payment operation is a touch screen click instruction. The first display end will respond to the touch screen click instruction of the payment object, and trigger the payment order by the payment method of face payment through the touch screen click instruction. It should be noted that the multimedia information includes but is not limited to video streams, static images, dynamic images, etc., and the video streams, static images, and dynamic images all contain the payment information of the payment object, and the payment information is not limited to the payment code and payment number. Optionally, the payment code can be a QR code, a 3D code, a 4D code, a barcode, etc.; the payment number includes but is not limited to an identity identification number, a bank card number, etc., and the identity identification number can be the object name of the payment object in the software with payment function, a membership card number, etc.

[0101] S200: Display multimedia content on a second display screen according to the multimedia information.

[0102] Optionally, the multimedia content may be multimedia information or may be content obtained after adjusting the multimedia information, and the multimedia content is used to represent the payment information of the payment operation of the payment object. For example, the second display terminal receives the multimedia information and displays the multimedia information directly on the second display screen, or one of the first display terminal and the second display terminal adjusts the multimedia information including but not limited to brightness, contrast, saturation, clarity, hue, etc., and displays the adjusted multimedia information as multimedia content on the second display screen, thereby improving the effect of the multimedia content on the second display screen, facilitating the subsequent identification of the payment information of the payment operation from the multimedia content, and improving the success rate of the identification and acquisition of the payment information. It should be noted that the display position of the multimedia content in the second display screen is not specifically limited, for example, it can be displayed in full screen on the second display screen, or displayed in a certain area on the second display screen.

[0103] S300: In response to a scanning operation of the settlement terminal, multimedia content displayed on the second display screen is acquired, and payment information of the payment operation is identified from the multimedia content.

[0104] Optionally, the scanning operation can be clicking a mechanical button in the settlement module, clicking the screen of the settlement module, issuing a voice command to the settlement module, or the settlement terminal performing time detection, and generating a scanning instruction when the detection time reaches a timed interval, so that the settlement module in the settlement terminal responds to the scanning operation to turn on the code scanning module or the external camera, thereby acquiring the multimedia content displayed on the second display screen, and identifying the payment information of the payment operation from the multimedia content. For example, when the multimedia content is a video stream, the code scanning module or the external camera can identify the payment information of the payment operation from one or more frames of the video stream; when the multimedia content is a dynamic image, the code scanning module or the external camera can identify the payment information of the payment operation from the dynamic image; when the multimedia content is a static image, the code scanning module or the external camera can identify the payment information of the payment operation from the static image.

[0105] S400: Perform payment settlement at a settlement terminal according to the recognized payment information.

[0106] Specifically, when the code scanning module recognizes the payment information in the multimedia content, the settlement module in the settlement terminal settles the payment order of the payment object according to the recognized payment information, and deducts an amount equal to the amount of the payment order from the payment object.

[0107] Optionally, in some embodiments, at least one of the first display end, the second display end and the settlement terminal may include a speaker. After the payment settlement is successful, a prompt sound of payment success can be issued through the speaker, such as "beep", "du", "payment successful", "payment successful, welcome next time" and other prompt sounds; when the payment settlement fails, a prompt sound of payment failure can be issued through the speaker, such as "payment failed", "please pay again", "please reselect the payment method" and other prompt sounds.

[0108] In addition, after the payment settlement is successful, the first display screen or the second display screen may display a prompt of the successful settlement, such as: "Payment successful", "Verified", "Deduction of XX yuan", "Payment successful, welcome to visit next time" and other prompts; after the payment settlement fails, the first display screen or the second display screen may display a prompt of the failed settlement, such as: "Payment failed", "Please re-verify", "Deduction failed", "Please pay again" and other prompts, without specific limitation.

[0109] Optionally, step S100 includes step S110 or S120, and the execution order of S110 and S120 is arbitrary, specifically:

[0110] S110: When the payment operation is a biometric payment, in response to the payment operation on the first display screen, identify the identity information of the payment object, and generate multimedia information according to the payment information corresponding to the identity information.

[0111] In the embodiment of the present invention, the biometric features include but are not limited to face, fingerprint, palm, etc. When the payee selects the biometric payment method, the APP of the first display terminal or the second display terminal will respond to the payment operation on the first display screen, identify the identity information corresponding to the payment software corresponding to the biometric features of the payee, and further obtain the payment information corresponding to the identity information to generate multimedia information. For example, the APP of the first display terminal or the second display terminal has an identification module. When the biometric payment method selected by the payee is face payment, the camera module obtains the facial data of the payee, such as a facial video stream or a facial image as the input biometric feature. The acquired facial image can be one or more. The identification module can determine the appropriate facial image from the facial video stream or multiple facial images based on the input biometric features, including but not limited to coefficient indicators such as size, angle, image contrast, image brightness and clarity. It should be noted that the appropriate facial image can be, for example, a score determined by coefficient indicators such as size, angle, image contrast, image brightness and clarity, determined based on the facial image with the highest score, i.e., the optimal facial image, or determined based on one of the facial images with a score greater than a score threshold, without specific limitation. In the embodiment of the present invention, determining the appropriate facial image is conducive to improving the success rate of determining the identity information of the payment object.

[0112] Optionally, after determining a suitable facial image, the recognition module transmits the suitable facial image to the recognition service unit, and the recognition service unit extracts features from the suitable facial image, compares the extracted features with the facial features stored in the database, determines the similarity between the facial features and the extracted features, and uses the facial features with the highest similarity as the target facial features, and then calls the basic payment service unit to obtain the identity information corresponding to the target facial features and the payment information matched by the identity information. It should be noted that extracting features from suitable facial images includes but is not limited to using technical means such as neural network models and image processing algorithms, and the similarity can be characterized by a similarity score, and the higher the similarity score, the higher the similarity. Among them, the database can pre-store the identity information corresponding to the biometric features of all payment objects and the payment information corresponding to the identity information, so when an identity information is obtained, the payment information corresponding to the payment object of the identity information can be obtained in the database according to the identity information matching. For example, the identity information may be the account information of the payment object in the payment software, including but not limited to the account name, account ID (Identity document), etc. The payment information includes but is not limited to the payment code and payment number that can be used for the transaction, and the payment number includes but is not limited to the bank card number and the payment code number. Optionally, the payment software refers to all software that at least has a payment transaction function.

[0113] S120: When the payment operation is code scanning payment, in response to the payment operation on the first display screen, obtain payment information displayed by the payment terminal of the payment object, and generate multimedia information according to the payment information displayed by the payment terminal.

[0114] In an embodiment of the present invention, when the payment object chooses to scan the code to pay, the payment object directly displays the payment information in the payment software through the payment terminal. The payment information includes but is not limited to the payment code and the payment code number. The APP on the first display end or the second display end will respond to the payment operation on the first display screen, identify the payment code and payment code number displayed in the payment terminal of the payment object, and then generate multimedia information based on the payment code and payment code number.

[0115] It should be noted that in some embodiments, the function of the code scanning module of the settlement terminal may be limited. Therefore, the form of the payment code that can be recognized by the code scanning module may be different from the payment code in the payment information. In this case, the APP in the first display terminal or the second display terminal can convert the payment code in the payment information through the configured generation module, and convert it into a payment code form that can be recognized by the code scanning module, such as a payment code in the form of a string, image, etc., so that the subsequent code scanning module can successfully recognize the payment code and improve the recognition success rate. Optionally, the image format of the converted payment code includes but is not limited to PNG, JPEG, etc., and the size of the converted payment code image and the margins with the first display screen and the second display screen are not specifically limited.

[0116] Optionally, generating multimedia information according to the payment information corresponding to the identity information in step S110 includes one of steps S1101, S1102, S1103 and S1104:

[0117] S1101. Obtain payment information of the payment object according to identity information matching, convert the payment information into a target image frame and insert it into a preset video stream, and use the video stream after the insertion into the target image frame as multimedia information.

[0118] Specifically, the payment information of the payment object can be matched in the database according to the identity information, as described in the above step S110. For example, taking the payment information as a payment code as an example, the APP of the first display terminal or the second display terminal can convert the payment code into a target image frame, and insert it into the video stream after the target image frame to obtain multimedia information. For example, the payment code can be converted into an image format to obtain a payment code image, and then the payment code image is used as the target image frame; or, a preset background can be configured, and the payment code can be synthesized into the preset background to form an image containing both the preset background and the payment code as the target image frame, and the size and display position of the payment code are not limited, for example, the payment code can be located at the center, left side, right side, etc. of the preset background; the preset background can be a person photo, a landscape photo, a product photo, a poster, a solid color background, etc. Optionally, the preset video stream includes but is not limited to advertising videos, animation videos, variety shows, news videos, music videos, etc., and the target image frame is inserted into one or more frames in the preset video stream, such as inserting any frame between the first frame and the last frame of the preset video stream, without specific limitation.

[0119] In the embodiment of the present invention, the video stream after the target image frame is inserted is used as multimedia information, and multimedia content is displayed on the second display screen according to the multimedia information, so that the payment code contained in a certain frame or multiple frames in the video stream can be recognized by the settlement terminal and the risk of fraudulent payment by directly displaying the payment code image is reduced, which is conducive to improving security. It should be noted that in order to ensure that the recognition efficiency of the settlement terminal is maintained or improved to a certain extent, the preset video stream can be a short video, such as a short video of a few seconds.

[0120] S1102, obtaining payment information of the payment object according to the identity information matching, converting the payment information into a target image and then splicing it with at least one preset image, and using the spliced ​​static image as multimedia information.

[0121] Similarly, the payment information of the payment object can be matched in the database according to the identity information. Exemplarily, taking the payment information as a payment code as an example, the APP of the first display terminal or the second display terminal can convert the payment code into a target image, and splice it with at least one preset image to obtain a static image as multimedia information. The following is an example of having a preset image and the payment information as a payment code. The APP of the first display terminal or the second display terminal can convert the payment code into an image format to obtain a target image containing the payment code, and then splice the target image with the preset image to obtain a static image. Similarly, the preset image can include a person photo, a landscape photo, a product photo, a poster, a solid color background, etc. It should be noted that in the spliced ​​static image, the location and size ratio of the target image are not specifically limited. For example, the target image can be in the lower left corner, the lower right corner, the upper left corner, the upper right corner, and the center position of the static image, and the size ratio of the static image occupied by the target image can be adjusted so that the settlement terminal can successfully identify it and it is difficult to be stolen by other devices, thereby improving security.

[0122] S1103, obtaining payment information of the payment object according to the identity information matching, converting the payment information into a target image and combining it with at least one preset image frame by frame, and using the dynamic image obtained by the frame-by-frame combination as multimedia information.

[0123] Similarly, the payment information of the payment object can be matched in the database according to the identity information. Exemplarily, taking the payment information as a payment code as an example, the APP of the first display terminal or the second display terminal can convert the payment code into a target image, and then combine the target image with the preset image frame by frame, so as to obtain the dynamic image as multimedia information. For example, the APP of the first display terminal or the second display terminal has a corresponding dynamic image generation model, algorithm and production tool, which converts the payment code into an image to obtain a target image, and the target image contains the payment code. Similarly, the preset image can be a photo of a person, a landscape photo, a product photo, a poster, a solid color background, or an image of each frame captured from a video stream, and then the APP automatically combines the preset image and the target image frame by frame through the corresponding dynamic image generation model, algorithm and production tool, so that each frame of the image, one or more frames of the image contain the target image, that is, the target image is located in one or more frames of the dynamic image after frame-by-frame combination.

[0124] In the embodiment of the present invention, the payment code contained in one or more frames of the dynamic image can be recognized by the settlement terminal, while reducing the risk of fraudulent payment by directly displaying the payment code image, thereby improving security; in addition, compared with the video stream as multimedia information, it is also beneficial to reduce the amount of data and reduce the processing burden of the dual-screen cash register device. It should be noted that in order to ensure that the recognition efficiency of the settlement terminal maintains a certain degree of efficiency and improve the recognition efficiency to a certain extent to reduce the waiting time of the payment object, the time of the dynamic image can be several seconds.

[0125] S1104. Obtain payment information of the payment object according to the identity information matching, convert the payment information into a QR code image, and use the QR code image as multimedia information.

[0126] Similarly, the payment information of the payment object can be matched in the database according to the identity information. For example, taking the payment information as a QR code as an example, the APP of the first display terminal or the second display terminal can convert the payment information into a QR code image, thereby using the QR code image as multimedia information. Optionally, the payment code can be converted into an image format to obtain a QR code image. For example, after obtaining the QR code, the part containing the QR code can be intercepted to generate a QR code image containing the QR code, which is convenient and fast, and is conducive to improving the efficiency of generating multimedia information, while reducing the processing burden of the dual-screen cash register device.

[0127] Optionally, obtaining payment information displayed by the payment terminal of the payment object in step S120 and generating multimedia information according to the payment information displayed by the payment terminal may include at least one of steps S1201 and S1202. The execution order of steps S1201 and S1202 is arbitrary. Specifically:

[0128] S1201. Obtain a video stream when the payment terminal displays payment information, and use the video stream as multimedia information.

[0129] Specifically, the camera module of the first display terminal shoots the payment information displayed in the payment terminal of the payment object for a certain period of time. The payment information is exemplarily a payment code. The duration of the video stream can be set according to actual needs to ensure that the acquired video stream contains a complete payment code, which is not specifically limited. After the camera module acquires the video stream, the video stream is directly used as multimedia information, which is simple and fast, and improves the efficiency of generating multimedia information. It should be noted that the payment terminal includes but is not limited to mobile phones, computers, tablet computers, smart watches, etc.

[0130] S1202: Acquire a display screen of the payment terminal, identify a payment code from the display screen of the payment terminal, and use the payment code as multimedia information.

[0131] Specifically, the camera module of the first display end captures the display screen of the payment terminal, which is a screen including the payment code, and then identifies the payment code from the display screen of the payment terminal by means including but not limited to image recognition algorithms, neural network models, etc., and uses the payment code as multimedia information, which can reduce the amount of data processing relative to the video stream and improve the efficiency of generating multimedia information.

[0132] Optionally, using the payment code as multimedia information in S1202 may include at least one of steps SA1-SA4, and the execution order of SA1-SA4 is arbitrary and not specifically limited. Specifically:

[0133] SA1. Convert the payment code into a target image frame and insert it into a preset video stream, and use the video stream after inserting into the target image frame as multimedia information.

[0134] Specifically, after the payment code is identified, the APP of the first display terminal or the second display terminal can convert the payment code into a target image frame, and obtain multimedia information after inserting the target image frame into the video stream. Similarly, the payment code can be converted into an image format to obtain a payment code image, and then the payment code image is used as the target image frame; or, a preset background can be configured, and the payment code can be synthesized into the preset background to form an image that contains both the preset background and the payment code as the target image frame, and then the target image frame is inserted into one or more frames in the preset video stream, and the video stream after the target image frame is inserted is the multimedia information. Generating multimedia information in this way is conducive to reducing the risk of payment code fraud.

[0135] SA2. Convert the payment code into a target image and then splice it with at least one preset image, and use the spliced ​​static image as multimedia information.

[0136] Specifically, the APP on the first display terminal or the second display terminal can convert the payment code into a target image, and splice it with at least one preset image to obtain a static image as multimedia information. For example, assuming that there is a preset image, the payment code is converted into an image format to obtain a target image containing the payment code, and then the target image and the preset image are spliced ​​to obtain a static image. Among them, the target image can be in the lower left corner, lower right corner, upper left corner, upper right corner, and center position of the static image; the size ratio of the static image occupied by the target image can be set according to actual conditions and is not specifically limited.

[0137] SA3. Convert the payment code into a target image and combine it with at least one preset image frame by frame, and use the dynamic image obtained by the frame-by-frame combination as multimedia information.

[0138] Specifically, the APP of the first display terminal or the second display terminal can convert the payment code into a target image, and then combine the target image with the preset image frame by frame, so as to obtain the obtained dynamic image as multimedia information. For example, the APP of the first display terminal or the second display terminal has a corresponding dynamic image generation model, algorithm and production tool, which converts the payment code into an image to obtain the target image. The preset image can be based on actual settings, including but not limited to character photos, landscape photos, product photos, posters, solid color backgrounds, etc., including but not limited to combining the preset image and the target image frame by frame through the dynamic image generation model, algorithm and production tool to form a dynamic image. It should be noted that a frame or multiple frames in the dynamic image contain the payment code, so that the payment code in the dynamic image can be recognized by the settlement terminal, which can also reduce the risk of fraud. It should be noted that the time of the dynamic image is not limited, and in order to ensure that the recognition efficiency of the settlement terminal maintains a certain degree, improve the recognition efficiency to a certain extent, or reduce the waiting time of the payment object, the target image containing the payment code can appear in the first preset number of frames in the dynamic image.

[0139] SA4. Convert the payment code into a QR code image and use the QR code image as multimedia information.

[0140] Specifically, the APP on the first display terminal or the second display terminal can convert the payment code into an image format to obtain a QR code image. For example, after obtaining the QR code, the part containing the QR code can be intercepted or identified, thereby generating a QR code image containing the QR code as multimedia information, which is convenient and fast, and is conducive to improving the efficiency of generating multimedia information, while reducing the processing burden of the first display terminal or the second display terminal.

[0141] Optionally, step S300 includes at least one of steps S310-S360, and the execution order of steps S310-S360 is arbitrary, specifically:

[0142] S310. In response to the scanning operation, perform an image scan on the video stream displayed on the second display screen, and capture a payment code for the payment operation from the video stream.

[0143] Optionally, the scanning operation can be a staff member clicking a mechanical button in the settlement module, clicking the screen of the settlement module, or issuing a voice command to the settlement module, etc., or it can be a timed trigger, and a scanning instruction is generated as a scanning operation at each time interval. In an embodiment of the present invention, when the multimedia content is a video stream, the settlement terminal responds to the scanning operation, and scans the video stream displayed on the second display screen through a code scanning module or an external camera. During the video stream playback process, when a payment code appears in one or more frames of the video stream, the code scanning module or the external camera can capture the payment code of the payment object for the payment operation, thereby realizing the function of identifying the payment information of the payment operation from the multimedia content. The payment code obtained by identification is used for settlement by the settlement module.

[0144] S320: In response to the scanning operation, perform an image scan on the static image displayed on the second display screen, and capture a payment code for the payment operation from the static image.

[0145] Similarly, the scanning operation can be a staff member clicking a mechanical button in the settlement module, clicking the screen of the settlement module, or issuing a voice command to the settlement module, or a timed trigger. In an embodiment of the present invention, when the multimedia content is a static image, the settlement terminal responds to the scanning operation, and scans the static image displayed on the second display screen through a code scanning module or an external camera. The graphic sketch can be a comprehensive scan of the static image from top to bottom, from bottom to top, from left to right, from right to left, etc. in any order, so as to determine whether the entire static image contains a payment code. Among them, when the static image contains a payment code for the payment object to perform a payment operation, the payment code for the payment operation in the static image can be captured, and the captured payment code is provided for the settlement module to settle.

[0146] S330. In response to the scanning operation, perform an image scan on the dynamic image displayed on the second display screen, and capture a payment code for the payment operation from the dynamic image.

[0147] Similarly, the scanning operation can be a staff member clicking a mechanical button in the settlement module, clicking the screen of the settlement module, or issuing a voice command to the settlement module, or a timed trigger. In the embodiment of the present invention, when the multimedia content is a dynamic image, the settlement terminal responds to the scanning operation and scans the dynamic image displayed on the second display screen through the code scanning module or the external camera. During the dynamic image playback process, when a payment code appears in one or more frames of the dynamic image, the code scanning module or the external camera can capture the payment code of the payment object for payment operation, and the recognized payment code is provided to the settlement module for settlement.

[0148] S340. In response to the scanning operation, the two-dimensional code image displayed on the second display screen is scanned, payment code information of the payment operation is obtained from the two-dimensional code image, and the payment code of the payment operation is converted.

[0149] Similarly, the scanning operation can be a staff member clicking a mechanical button in the settlement module, clicking the screen of the settlement module, or issuing a voice command to the settlement module, or a timed trigger. In an embodiment of the present invention, when the multimedia content is a two-dimensional code image based on the payment code information, the settlement terminal responds to the scanning operation, and the scanning module or the external camera scans the two-dimensional code image displayed on the second display screen, thereby obtaining the payment code information of the payment operation of the payment object in the two-dimensional code image. It should be noted that in some embodiments, the scanning module has a format type of payment code that it can recognize. When the payment code information obtained in the two-dimensional code image is not a format type of payment code that can be recognized by the scanning module, the payment code information can be converted into a format type of payment code that can be recognized by the scanning module, thereby converting the payment code of the payment operation, and the payment code of the payment operation obtained by the conversion is used as the payment information of the payment operation finally recognized for settlement by the settlement module.

[0150] S350: In response to the scanning operation, an image scan is performed on the payment code displayed on the second display screen to obtain the payment code for the payment operation.

[0151] Similarly, the scanning operation can be a staff member clicking a mechanical button in the settlement module, clicking the screen of the settlement module, or issuing a voice command to the settlement module, or a timer trigger. In the embodiment of the present invention, when the multimedia content is a payment code, the settlement terminal responds to the scanning operation and scans the payment code displayed on the second display screen through the code scanning module or the external camera, thereby directly obtaining the payment code of the payment operation of the payment object for the settlement module to settle the payment.

[0152] S360: In response to the scanning operation, an image scan is performed on the payment code displayed on the second display screen to obtain the payment code for the payment operation.

[0153] Similarly, the scanning operation can be triggered by the staff clicking a mechanical button in the settlement module, clicking the screen of the settlement module, or issuing a voice command to the settlement module, etc., or by a timer. In the embodiment of the present invention, when the multimedia content is a payment code, the settlement terminal responds to the scanning operation and scans the payment code displayed on the second display screen through the code scanning module or the external camera, so that the settlement is directly performed by the settlement module.

[0154] Optionally, the information interaction method of the embodiment of the present invention further includes steps S510-S540:

[0155] S510: Obtain historical transaction data of payment settlement performed by the dual-screen cash register device.

[0156] Optionally, the historical transaction data of payment settlement may be the transaction data of each payment object when paying for the payment order within the time length before the current time, and the transaction data includes but is not limited to the transaction time (such as year, month, day, hour, minute), the identity information of the payment object, the payment information corresponding to the identity information, the consumption amount paid by the payment object, the number of times the multimedia content is generated, the number of times the multimedia content is recognized, the number of successful payment settlements, etc. It should be noted that the historical transaction data can be statistically stored in the first display terminal or the second display terminal, without specific limitation.

[0157] S520. Calculate the payment settlement success rate based on historical transaction data.

[0158] Optionally, the payment settlement success rate represents the ratio of the number of successful payment settlements of the payment object to the total number of all payment settlements. Exemplarily, assuming that each time the payment settlement of the payment object fails, the dual-screen cash register device will regenerate the multimedia content. At this time, the number of times the multimedia content is generated is the total number of all payment settlements, and the number of times the multimedia content is generated can also be the number of times the second display screen displays the multimedia content, the number of times the camera module shoots, etc.; assuming that the multimedia content is generated once for each payment object, the number of times the multimedia content is recognized can be regarded as the total number of payment settlements, the number of times it is recognized can include the number of successful recognition or recognition failures, and the number of times it is successfully recognized is the number of successful payment settlements. The payment settlement success rate is obtained according to the ratio of the number of successful payment settlements to the number of times the multimedia content is recognized. It should be noted that in other embodiments, the historical transaction data may include other types of data, and the payment settlement success rate can be calculated by other methods without specific limitation.

[0159] S530: Generate a registration guidance instruction according to the payment settlement success rate.

[0160] In the embodiment of the present invention, a success rate threshold can be set, and the value of the success rate threshold is not specifically limited. When the calculated payment settlement success rate is less than or equal to the success rate threshold, it is considered that the payment settlement success rate of the dual-screen cash register device is at a low level, and measures need to be taken to improve the payment settlement success rate of the dual-screen cash register device. Specifically, by generating a registration guidance instruction, including but not limited to a height registration instruction, an angle registration instruction, or a brightness registration instruction.

[0161] S540: In response to the registration guidance instruction, the posture of the second display screen of the dual-screen cash register device is adjusted.

[0162] Optionally, the alignment guidance instruction is used to adjust the posture of the second display screen of the dual-screen cash register device, the height alignment instruction corresponds to the up and down adjustment in the height direction, the angle alignment instruction corresponds to the angle adjustment, and the brightness alignment instruction corresponds to the brightness adjustment of the second display screen.

[0163] Specifically, step S540 includes at least one of steps S5401-S5403:

[0164] S5401. In response to the height alignment instruction, adjust the screen height of the second display screen of the dual-screen cash register device.

[0165] For example, Figure 5 As shown, the second display end of the dual-screen cash register device may include a rotating component 202, a telescopic component 203, a pole component 204 and a base 205. The base 205 is placed on the cash register counter, the pole component 204 is fixed to the base 205, the rotating component 202 is fixed to the pole component 204 and the second display screen, and the telescopic component 203 can move up and down in the height direction in the pole component 204. Specifically, in response to the height registration instruction, the telescopic component 203 is controlled to move upward or downward in the height direction, for example, the telescopic component 203 is controlled to move upward in the height direction. In the process of the telescopic component 203 moving upward, the rotating component 202 will be driven to move upward, thereby driving the second display screen to move upward, so as to adjust the screen height of the second display screen. The convenient and quick automatic adjustment is conducive to reducing the operation steps of the staff; and the downward movement in the height direction is similar, which will not be repeated. It should be noted that when the telescopic component 203 is telescoped, a preset telescopic distance can be set, and the preset telescopic distance is extended and retracted each time the height is adjusted, or when the telescopic component 203 is telescoped, the telescopic distance is stopped after being extended to the maximum limit, without limitation; at the same time, in other embodiments, the second display end can be composed of other structures to achieve height adjustment, without specific limitation.

[0166] S5402. In response to the angle alignment instruction, adjust the screen angle of the second display screen of the dual-screen cash register device.

[0167] For example, Figure 5As shown, in response to the angle alignment instruction, the rotating component 202 is controlled to rotate. Since the second display screen is fixed to the rotating component 202, the rotation of the rotating component 202 will drive the second display screen to rotate, so that the screen angle of the second display screen changes, thereby adjusting the screen angle of the second display screen. Convenient, fast, and automatic adjustment are conducive to reducing the operating steps of the staff. It should be noted that in other embodiments, the second display end can be composed of other structures to achieve angle adjustment. When the rotating component 202 rotates, a preset rotation angle can be set, and the preset rotation angle is rotated each time the angle is adjusted, or when the telescopic component 203 rotates, the rotating component 202 stops rotating after rotating to the maximum angle change position, and there is no specific limitation.

[0168] S5403. In response to the brightness alignment instruction, adjust the screen brightness of the second display screen of the dual-screen cash register device.

[0169] In an embodiment of the present invention, in response to the brightness registration instruction, the screen brightness of the second display screen is adjusted, for example, the brightness value of the screen can be increased, which is conducive to the effective recognition of the content in the second display screen by the code scanning module of the settlement terminal, thereby improving the recognition success rate and thus improving the payment settlement success rate. Optionally, taking the increase of the screen brightness value as an example, when increasing the screen brightness value, a preset increase in brightness can be set, and the preset increase in brightness can be a specific brightness value or ratio, such as increasing the brightness value of 10 or 10% of the brightness, which is not specifically limited; each time the screen brightness of the second display screen is increased, a specific brightness value or ratio can be added, so that while improving the recognition success rate of the code scanning module, it is possible to avoid consuming more power and save resources; or directly adjusting the screen brightness of the second display screen to the maximum value is conducive to effectively improving the recognition success rate of the code scanning module, which is not specifically limited.

[0170] like Figure 6 As shown, optionally, the information interaction method of the embodiment of the present invention further includes steps S610-S620:

[0171] S610: Generate a connection instruction based on the payment settlement success rate.

[0172] Optionally, in some embodiments, the dual-screen cashier device and the settlement terminal may include different communication connection methods at the same time, for example, the dual-screen cashier device and the settlement terminal communicate with each other through wireless connection, cable connection, or through a method in the implementation environment of the embodiment of the present invention. Specifically, when the payment settlement success rate is less than or equal to the success rate threshold, in addition to generating the registration guidance instruction, a mode adjustment instruction may also be generated, such as a wiring instruction, to remind the staff to connect the cable. It should be noted that the wiring instruction can be displayed on the second display screen or the settlement module, or played in the form of voice, without specific limitation.

[0173] S620. According to the wiring instruction, configure the communication cable between the dual-screen cash register device and the settlement terminal.

[0174] For example, when wireless communication is adopted between the dual-screen cash register device and the settlement terminal, the payment success rate may be too low due to an abnormality in the wireless network. At this time, the communication cable connecting the dual-screen cash register device and the settlement terminal can be configured according to the wiring instructions. For another example, when the dual-screen cash register device and the settlement terminal communicate with each other in the implementation environment of the embodiment of the present invention, when an abnormality occurs in the code scanning module or the external camera, the code scanning module or the external camera may make a recognition error or fail to recognize the content displayed on the second display screen, resulting in a too low payment success rate. At this time, the communication cable connecting the dual-screen cash register device and the settlement terminal can be configured according to the wiring instructions, so that the content on the second display screen of the dual-screen cash register device can be transmitted to the settlement module through the communication cable, so that the settlement module can directly recognize the content on the second display screen, which is conducive to improving the payment success rate.

[0175] like Figure 7 As shown, optionally, the information interaction method of the embodiment of the present invention further includes at least one of steps S710 and S720:

[0176] S710. In response to the payment completion instruction, display payment settlement information on the first display screen and the second display screen.

[0177] Optionally, the payment completion instruction can be generated after the payment settlement is successfully completed in the settlement module based on the payment information identified from the multimedia content. The payment completion instruction can be generated in the settlement module or in the dual-screen cash register device, and the specific details are not limited. Specifically, at least one of the first display screen and the second display screen displays the payment settlement information in response to the payment completion instruction; the payment settlement information includes but is not limited to the amount, the name of the merchant, the identity information of the payment object, the balance, the prompt text of "payment successful", the service evaluation for the payment object to enter, and the "complete" or "return" button or "view order" button for the payment object to click after viewing the information, etc. Among them, displaying the payment settlement information on the first display screen can remind the payment object that the payment has been successfully paid, and can allow the payment object to understand the detailed information of the current order and make evaluation feedback; displaying the payment settlement information on the second display screen can remind the staff that the payment object has been successfully paid, understand the information of the current order, and understand the evaluation of the payment object, or when the payment object is holding the purchased items and it is not convenient to manually evaluate, it can be told verbally to the staff, and the staff can help the payment object complete the evaluation on the second display screen, which is more humane.

[0178] S720: In response to the payment completion instruction, broadcast an audio signal indicating payment completion.

[0179] Similarly, the payment completion instruction can be generated based on the payment information identified from the multimedia content, and then after the payment settlement is successfully performed in the settlement module, the payment completion instruction can be generated in the settlement module or in the dual-screen cash register device. Specifically, at least one of the first display end, the second display end and the settlement terminal is provided with a speaker, and in response to the payment completion instruction, an audio signal of payment completion is played through the speaker. Optionally, the audio signal includes but is not limited to prompt sounds such as "beep", "duh", "payment successful", "payment successful, welcome next time", "welcome next time", "please make a service evaluation", etc.; in other embodiments, the audio signal can be other content, which is not specifically limited. Playing the audio signal of payment completion through the speaker allows the payment object or staff to understand that the current order has been paid, and there is no need to check the content in the first display screen or the second display screen, which is more convenient.

[0180] like Figure 8As shown, the information interaction method provided by the embodiment of the present invention is described in a specific implementation scenario. In this specific implementation scenario, the staff is a cashier, the payment object is a customer, the code scanning module is a code scanning gun, the payment method selected by the customer is face payment, and the settlement module is a POS machine. The specific implementation scenario is an offline supermarket. The dual-screen cash register device and the POS machine support the default HID cable communication and the communication mode (hereinafter referred to as the new communication mode) implemented by the information interaction method of the embodiment of the present invention. The specific process includes steps S801-S809:

[0181] S801. After a customer purchases the items they need in a supermarket, the cashier enters the items into the dual-screen cash register device to generate a purchase order. At this time, the first display screen 101 of the dual-screen cash register device can display relevant information of the purchase order and the function area 100A, such as Figure 2 As shown, the customer clicks "Face scan payment" in function area 100A.

[0182] S802, the dual-screen cash register device starts the camera module, such as Fig. 9 As shown, a frame area 110A is displayed in the first display screen 101, and the customer is prompted to place the face in the frame area 110A. The camera module obtains a video or picture of the customer's face in the frame area 110A as facial data for face recognition.

[0183] S803. After obtaining the facial data, the dual-screen cash register device obtains the matching identity information in the customer's payment software and the QR code corresponding to the identity information through the facial data, and transmits the QR code to the POS machine for payment settlement by communicating through the HID cable. Alternatively, the dual-screen cash register device obtains the matching identity information in the customer's payment software and the QR code corresponding to the identity information by calling the backend service module, and transmits the QR code to the POS machine for payment settlement by HID spitting through the HID cable.

[0184] S804, the back-end service module is used to record the historical transaction data of the payment settlement process, and calculate the payment settlement success rate (or payment settlement failure rate) based on the historical transaction data. When the payment settlement success rate is less than or equal to the success rate threshold, for example, the height, angle or brightness of the current second display screen may be inappropriate, or the current communication method through the HID cable causes the payment settlement success rate to be low, then a registration guidance instruction is generated and transmitted to the dual-screen cash register device. Among them, the registration guidance instruction can be a mode adjustment instruction, a height registration instruction of the second display screen, an angle registration instruction or a brightness registration instruction. The following takes the mode adjustment instruction as an example.

[0185] S805. The second display screen of the dual-screen cash register device displays the registration guidance instruction or the speaker of the dual-screen cash register device plays the registration guidance instruction. For example, the speaker plays "Please adopt a new communication mode" or the text "Please adopt a new communication mode" is displayed on the second display screen. At this time, the cashier learns of the registration guidance instruction and adjusts the communication between the dual-screen cash register device and the POS machine to the new communication mode.

[0186] S806, the current customer or the next customer, as recorded in steps S802 and S803, the dual-screen cash register device starts the camera module to obtain the customer's facial data for face recognition, for example, by calling the backend service module to obtain the matching identity information in the customer's payment software and the payment code corresponding to the identity information.

[0187] S807. The backend service module returns the payment code to the dual-screen cashier device, and the payment code content is displayed on the second display screen of the dual-screen cashier device. Among them, the backend service module can convert the payment code into a payment code image and return it to the dual-screen cashier device, or the dual-screen cashier device can convert the returned payment code into a QR code image. It should be noted that the barcode scanner usually supports a preset QR code format type, for example, it can recognize a QR code of a certain format type. Therefore, when the payment code is not a QR code of a preset format type supported by the barcode scanner, the dual-screen cashier device converts the payment code into a QR code of a preset format type and converts it into a target QR code image, or converts the payment code in the QR code image into a QR code of a preset format type to obtain a target QR code image, which is displayed on the second display screen, such as Fig.10 As shown, the target two-dimensional code image includes a two-dimensional code 201A that can be recognized by a barcode scanner.

[0188] S808, the cashier holds a barcode scanner to identify the QR code contained in the target QR code image displayed on the second display screen, and transmits the identified QR code to the POS machine for payment settlement, thereby improving the communication stability during the payment settlement process.

[0189] S809: After the payment is settled successfully, the dual-screen cash register device or POS machine generates a payment completion instruction. At this time, the first display screen of the dual-screen cash register device, the second display screen or the customer's payment terminal displays the payment settlement information, such as Fig.11 As shown, the displayed payment settlement information includes a prompt text 809A of "Payment Successful", a merchant name 809B, an amount 809C, a service evaluation 809D entered by the payment object, and a "Return" button 809E for the customer to click after viewing the information.

[0190] It should be noted that this embodiment uses offline supermarkets as the implementation scenario to describe the overall process. In addition to being applicable to supermarkets, it can also be applied in a similar manner to supermarkets to the catering industry (fast food restaurants, food stalls, restaurants, canteens, morning tea shops, milk tea shops, etc.), shops, convenience stores, amusement parks and gas stations, etc., where dual-screen cash registers are required for settlement and payment, without specific limitation.

[0191] Reference Figure 1 The information interaction system provided by the embodiment of the present invention includes a dual-screen cashier device and a settlement terminal, wherein the dual-screen cashier device includes a first display screen 101 and a second display screen 201; the settlement terminal includes a code scanning module 301 and a settlement module 302;

[0192] The first display screen 101 is used to generate multimedia information in response to a payment operation; wherein the payment operation is used to trigger a payment order;

[0193] The second display screen 201 is used to display multimedia content according to the multimedia information; wherein the multimedia content is used to represent the progress of the payment operation on the first display screen 101, and is used to represent the payment information of the payment operation;

[0194] The code scanning module 301 is used to obtain the multimedia content displayed on the second display screen 201 in response to the scanning operation, and identify the payment information of the payment operation from the multimedia content;

[0195] The settlement module 302 is used to perform payment settlement according to the recognized payment information.

[0196] Reference Fig.12 , Fig.12 This is a schematic diagram of the structure of an information interaction device provided by an embodiment of the present invention. The information interaction device 1200 includes:

[0197] The first module 1201 is used to generate multimedia information in response to a payment operation on the first display screen; wherein the payment operation is used to trigger a payment order;

[0198] The second module 1202 is used to display multimedia content on the second display screen according to the multimedia information; wherein the multimedia content is used to represent the progress of the payment operation on the first display screen, and is used to represent the payment information of the payment operation;

[0199] The third module 1203 is used to obtain multimedia content displayed on the second display screen in response to the scanning operation of the settlement terminal, and identify payment information of the payment operation from the multimedia content;

[0200] The fourth module 1204 is used to perform payment settlement at the settlement terminal according to the recognized payment information;

[0201] Among them, the first display screen and the second display screen are two display screens in a dual-screen cash register device.

[0202] Optionally, the first module 1201 is specifically configured to implement at least one of the following:

[0203] When the payment operation is a biometric payment, in response to the payment operation on the first display screen, identifying the identity information of the payment object, and generating multimedia information according to the payment information corresponding to the identity information;

[0204] Alternatively, when the payment operation is scan code payment, in response to the payment operation on the first display screen, the payment information displayed by the payment terminal of the payment object is obtained, and multimedia information is generated according to the payment information displayed by the payment terminal.

[0205] Optionally, the first module 1201 is further configured to implement at least one of the following:

[0206] The payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a target image frame and then inserted into a preset video stream, and the video stream after the insertion into the target image frame is used as multimedia information;

[0207] Alternatively, the payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a target image and then spliced ​​with at least one preset image, and the spliced ​​static image is used as the multimedia information;

[0208] Alternatively, the payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a target image and then combined with at least one preset image frame by frame, and the dynamic image obtained by the frame-by-frame combination is used as the multimedia information;

[0209] Alternatively, the payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a QR code image, and the QR code image is used as multimedia information.

[0210] Optionally, the first module 1201 is further configured to implement at least one of the following:

[0211] Obtain the video stream when the payment terminal displays payment information, and use the video stream as multimedia information;

[0212] Alternatively, a display screen of the payment terminal is obtained, and a payment code is identified from the display screen of the payment terminal, and the payment code is used as multimedia information.

[0213] Optionally, the first module 1201 is further configured to implement at least one of the following:

[0214] The payment code is converted into a target image frame and then inserted into a preset video stream, and the video stream after the insertion into the target image frame is used as multimedia information;

[0215] Alternatively, the payment code is converted into a target image and then spliced ​​with at least one preset image, and the spliced ​​static image is used as the multimedia information;

[0216] Alternatively, the payment code is converted into a target image and then combined with at least one preset image frame by frame, and a dynamic image obtained by the frame-by-frame combination is used as multimedia information;

[0217] Alternatively, the payment code is converted into a QR code image, and the QR code image is used as multimedia information.

[0218] Optionally, the third module 1203 is specifically configured to implement at least one of the following:

[0219] In response to the scanning operation, performing an image scan on the video stream displayed on the second display screen to capture a payment code for the payment operation from the video stream;

[0220] Alternatively, in response to the scanning operation, an image scan is performed on the static image displayed on the second display screen to capture the payment code for the payment operation from the static image;

[0221] Alternatively, in response to the scanning operation, an image scan is performed on the dynamic image displayed on the second display screen to capture the payment code of the payment operation from the dynamic image;

[0222] Alternatively, in response to the scanning operation, the two-dimensional code image displayed on the second display screen is scanned, payment code information for the payment operation is obtained from the two-dimensional code image, and converted to obtain the payment code for the payment operation;

[0223] Alternatively, in response to the scanning operation, an image scan is performed on the payment code displayed on the second display screen to obtain the payment code for the payment operation.

[0224] Optionally, at least one of the first module 1201, the second module 1202, and the third module 1203 is specifically used for:

[0225] Obtain historical transaction data for payment settlement using dual-screen cash register devices;

[0226] Calculate payment settlement success rate based on historical transaction data;

[0227] Generate registration guidance instructions based on the payment settlement success rate;

[0228] In response to the registration guidance instruction, the posture of the second display screen of the dual-screen cash register device is adjusted.

[0229] Optionally, at least one of the first module 1201, the second module 1202, and the third module 1203 is further specifically used for:

[0230] In response to the height registration instruction, adjusting the screen height of the second display screen of the dual-screen cash register device;

[0231] Alternatively, in response to the angle alignment instruction, the screen angle of the second display screen of the dual-screen cash register device is adjusted;

[0232] Alternatively, in response to the brightness alignment instruction, the screen brightness of the second display screen of the dual-screen cash register device is adjusted.

[0233] Optionally, at least one of the first module 1201, the second module 1202, and the third module 1203 is further specifically used for:

[0234] Generate connection instructions based on payment settlement success rate;

[0235] According to the wiring instructions, configure the communication cable between the dual-screen cash register device and the settlement terminal.

[0236] Optionally, at least one of the first module 1201, the second module 1202, and the third module 1203 is further specifically used to implement at least one of the following:

[0237] In response to the payment completion instruction, displaying payment settlement information on the first display screen and the second display screen;

[0238] Alternatively, in response to the payment completion instruction, an audio signal indicating payment completion is broadcasted.

[0239] An embodiment of the present invention further provides an electronic device, including a processor and a memory;

[0240] The memory is used to store programs;

[0241] The processor executes the program to implement the above-mentioned information interaction method.

[0242] An embodiment of the present invention further provides a computer-readable storage medium, which is used to store program codes, and the program codes are used to execute the aforementioned information interaction method.

[0243] The embodiment of the present invention further provides a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the aforementioned information interaction method.

[0244] The terms "first", "second", "third", "fourth", etc. (if any) in the description of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can, for example, be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0245] It should be understood that in the present invention, "at least one (item)" refers to one or more, and "plurality" refers to two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can represent: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0246] It should be understood that in the description of the embodiments of the present invention, the meaning of multiple (or multiple items) is more than two, greater than, less than, exceed, etc. are understood to exclude the number, and above, below, within, etc. are understood to include the number.

[0247] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0248] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0249] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0250] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or partly contributed to the prior art or all or part of the technical solution can be embodied in the form of a software product.

[0251] The computer software product is stored in a storage medium, including several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, etc., various media that can store program codes.

[0252] It should also be understood that the various implementations provided in the embodiments of the present invention can be combined arbitrarily to achieve different technical effects.

[0253] The above is a specific description of the preferred implementation of the present invention, but the present invention is not limited to the above-mentioned implementation mode. Technical personnel familiar with the field can also make various equivalent deformations or substitutions under the shared conditions without violating the spirit of the present invention. These equivalent deformations or substitutions are all included in the scope defined by the claims of the present invention.

Claims

1. An information interaction method, characterized in that: include: When the payment operation is biometric payment, in response to the payment operation on the first display screen, the identity information of the payment object is identified, and the multimedia information is generated according to the payment information corresponding to the identity information; or, when the payment operation is code scanning payment, in response to the payment operation on the first display screen, the payment information displayed by the payment terminal of the payment object is obtained, and the multimedia information is generated according to the payment information displayed by the payment terminal; wherein the payment operation is used to trigger a payment order; Displaying multimedia content on the second display screen according to the multimedia information; wherein the multimedia content is used to represent the payment information of the payment operation, and the multimedia content is the multimedia information or is content obtained by adjusting the multimedia information; In response to a scanning operation of the settlement terminal, acquiring multimedia content displayed on the second display screen, and identifying payment information of the payment operation from the multimedia content; Performing payment settlement at the settlement terminal according to the identified payment information; The first display screen and the second display screen are two display screens in a dual-screen cash register device.

2. The information interaction method according to claim 1, characterized in that: The generating of multimedia information according to the payment information corresponding to the identity information includes at least one of the following: Obtain payment information of the payment object according to the identity information matching, convert the payment information into a target image frame and insert it into a preset video stream, and use the video stream after inserting the target image frame as the multimedia information; Alternatively, the payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a target image and then spliced ​​with at least one preset image, and the spliced ​​static image is used as the multimedia information; Alternatively, the payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a target image and then combined with at least one preset image frame by frame, and the dynamic image obtained by the frame-by-frame combination is used as the multimedia information; Alternatively, the payment information of the payment object is obtained according to the identity information matching, the payment information is converted into a two-dimensional code image, and the two-dimensional code image is used as the multimedia information.

3. The information interaction method according to claim 1, characterized in that: The acquiring the payment information displayed by the payment terminal of the payment object and generating the multimedia information according to the payment information displayed by the payment terminal comprises at least one of the following: Acquire a video stream when the payment terminal displays payment information, and use the video stream as the multimedia information; Alternatively, a display screen of the payment terminal is obtained, a payment code is identified from the display screen of the payment terminal, and the payment code is used as the multimedia information.

4. The information interaction method according to claim 3, characterized in that: The using the payment code as the multimedia information includes at least one of the following: The payment code is converted into a target image frame and then inserted into a preset video stream, and the video stream after the insertion into the target image frame is used as the multimedia information; Alternatively, the payment code is converted into a target image and then spliced ​​with at least one preset image, and the spliced ​​static image is used as the multimedia information; Alternatively, the payment code is converted into a target image and then combined with at least one preset image frame by frame, and a dynamic image obtained by the frame-by-frame combination is used as the multimedia information; Alternatively, the payment code is converted into a two-dimensional code image, and the two-dimensional code image is used as the multimedia information.

5. The information interaction method according to claim 1, characterized in that: The step of acquiring multimedia content displayed on the second display screen in response to a scanning operation of the settlement terminal, and identifying payment information of the payment operation from the multimedia content, comprises at least one of the following: In response to the scanning operation, performing an image scan on the video stream displayed on the second display screen, and capturing a payment code for the payment operation from the video stream; Alternatively, in response to the scanning operation, performing an image scan on a static image displayed on the second display screen, and capturing a payment code for the payment operation from the static image; Alternatively, in response to the scanning operation, an image scan is performed on the dynamic image displayed on the second display screen to capture the payment code of the payment operation from the dynamic image; Alternatively, in response to the scanning operation, the two-dimensional code image displayed on the second display screen is scanned, the payment code information of the payment operation is obtained from the two-dimensional code image, and the payment code of the payment operation is converted; Alternatively, in response to the scanning operation, an image scan is performed on the payment code displayed on the second display screen to obtain the payment code for the payment operation.

6. The information interaction method according to claim 1, characterized in that: The method further comprises: Obtain historical transaction data of payment settlement performed by the dual-screen cash register device; Calculate the payment settlement success rate based on the historical transaction data; generating a registration guidance instruction according to the payment settlement success rate; In response to the registration guidance instruction, the posture of the second display screen of the dual-screen cash register device is adjusted.

7. An information interaction method according to claim 6, characterized in that: The registration guidance instruction includes at least one of the following: a height registration instruction, an angle registration instruction or a brightness registration instruction; The step of adjusting the posture of the second display screen of the dual-screen cash register device in response to the registration guidance instruction includes at least one of the following: In response to the height registration instruction, adjusting the screen height of the second display screen of the dual-screen cash register device; Alternatively, in response to the angle alignment instruction, adjusting the screen angle of the second display screen of the dual-screen cash register device; Alternatively, in response to the brightness alignment instruction, the screen brightness of the second display screen of the dual-screen cash register device is adjusted.

8. The information interaction method according to claim 6, characterized in that: The method further comprises: Generate a connection instruction according to the payment settlement success rate; According to the wiring instruction, configure the communication cable between the dual-screen cash register device and the settlement terminal.

9. The information interaction method according to claim 1, characterized in that: The method further comprises at least one of the following: In response to the payment completion instruction, displaying payment settlement information on the first display screen and the second display screen; Alternatively, in response to the payment completion instruction, an audio signal indicating payment completion is broadcasted.

10. An information interaction system, characterized in that: include: Dual-screen cash register equipment and settlement terminals; Wherein, the dual-screen cash register device includes a first display screen and a second display screen; the settlement terminal includes a code scanning module and a settlement module; The first display screen is used for, when the payment operation is biometric payment, responding to the payment operation on the first display screen, identifying the identity information of the payment object, and generating multimedia information according to the payment information corresponding to the identity information; or, when the payment operation is code scanning payment, responding to the payment operation on the first display screen, obtaining the payment information displayed by the payment terminal of the payment object, and generating the multimedia information according to the payment information displayed by the payment terminal; wherein the payment operation is used to trigger a payment order; The second display screen is used to display multimedia content according to the multimedia information; wherein the multimedia content is used to represent the progress of the payment operation on the first display screen, and is used to represent the payment information of the payment operation, and the multimedia content is the multimedia information or is content obtained by adjusting the multimedia information; The code scanning module is used to obtain multimedia content displayed on the second display screen in response to a scanning operation, and identify payment information of the payment operation from the multimedia content; The settlement module is used to perform payment settlement according to the identified payment information.

11. An information interaction device, characterized in that: include: The first module is used for, when the payment operation is biometric payment, responding to the payment operation on the first display screen, identifying the identity information of the payment object, and generating multimedia information according to the payment information corresponding to the identity information; or, when the payment operation is code scanning payment, responding to the payment operation on the first display screen, obtaining the payment information displayed by the payment terminal of the payment object, and generating the multimedia information according to the payment information displayed by the payment terminal; wherein the payment operation is used to trigger a payment order; A second module is used to display multimedia content on a second display screen according to the multimedia information; wherein the multimedia content is used to represent the progress of the payment operation on the first display screen, and is used to represent the payment information of the payment operation, and the multimedia content is the multimedia information or is content obtained by adjusting the multimedia information; a third module, configured to obtain multimedia content displayed on the second display screen in response to a scanning operation of the settlement terminal, and identify payment information of the payment operation from the multimedia content; A fourth module is used to perform payment settlement at the settlement terminal according to the identified payment information; The first display screen and the second display screen are two display screens in a dual-screen cash register device.

12. An electronic device, characterized in that: including a processor and a memory; The memory is used to store programs; The processor executes the program to implement the method according to any one of claims 1 to 9.

13. A computer-readable storage medium, characterized in that: The storage medium stores a program, and the program is executed by a processor to implement the method according to any one of claims 1 to 9.

14. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

Images