Intelligent consumption machine interaction method and system based on double-screen display

Abstract

The invention discloses an intelligent consumption machine interaction method and system based on double-screen display, and the method comprises the following steps: 1, responding to an interaction event, and controlling a first display screen and a second display screen to respectively present a first interaction interface and a second interaction interface which are independent; step 2, acquiring first operation data input through the first interactive interface; step 3, based on the first operation data, generating second operation data associated with the first operation data; and step 4, sending the second operation data to the second display screen so as to drive the second interaction interface to update the display content. Through the implementation of the invention, parallel processing of cashier and customer interaction and accurate scenario marketing are realized; the transaction efficiency and the user experience are obviously improved; and through a differential display strategy, the commercial value of the double-screen equipment is fully explored.

Description

Technical Field

[0001] This invention relates to the field of consumer electronics technology, and in particular to an interactive method and system for intelligent consumer electronics based on dual-screen display. Background Technology

[0002] Traditional POS machines typically employ a single-screen or dual-screen simultaneous display mode. In single-screen mode, the cashier and customer share a single screen, resulting in a sequential interaction process that is inefficient and provides a poor customer experience. Early dual-screen POS machines often used the customer screen merely as a simple mirror of the cashier's screen or only for statically displaying monetary information, offering limited functionality and failing to effectively utilize the customer-facing screen resources.

[0003] With technological advancements, some existing dual-screen devices attempt to display advertisements or QR codes on the customer's screen. However, these displays are typically pre-set and static, lacking strong relevance to the ongoing transaction and failing to achieve precise contextualized marketing. Furthermore, existing payment terminal interaction methods primarily rely on cashier operation and customer QR code payment, resulting in a single interaction modality and a lack of deep integration and collaborative management of diverse interaction methods such as facial recognition payment, voice interaction, and touch confirmation.

[0004] Existing dual-screen consumer devices mainly suffer from the following drawbacks:

[0005] The dual-screen collaboration is poor, with a lack of intelligent and dynamic data association between the two screens, and the customer screen cannot provide dynamic and related interactive feedback based on real-time transaction content;

[0006] The interaction mode is too simple and fails to fully utilize the dual-screen structure to achieve a multi-dimensional interactive experience for cashiers and customers in parallel. Both efficiency and experience need to be improved.

[0007] Weak marketing capabilities mean that the advertisements or information displayed on customer screens are disconnected from the transaction process, making it impossible to achieve precise and personalized marketing based on transaction data and user characteristics.

[0008] The system has a low level of intelligence, lacks the ability to analyze and learn user behavior, and is unable to provide continuously optimized personalized services.

[0009] In summary, a smart consumer terminal interaction method and system based on dual-screen display is needed to address the shortcomings of existing technologies. Summary of the Invention

[0010] To address the shortcomings of existing technologies, this invention provides an interactive method and system for smart consumer terminals based on dual-screen display, aiming to solve the aforementioned problems.

[0011] On the one hand, this application provides an interactive method for a smart consumer terminal based on dual-screen display, including the following steps:

[0012] Step 1: In response to the interactive event, control the first display screen and the second display screen to display independent first and second interactive interfaces respectively;

[0013] Step 2: Obtain the first operation data input through the first interactive interface;

[0014] Step 3: Based on the first operation data, generate second operation data associated with the first operation data;

[0015] Step 4: Send the second operation data to the second display screen to drive the second interactive interface to update the displayed content;

[0016] Step 5: Obtain input signals from at least one interactive module integrated with the second display screen, and execute corresponding processing logic based on the input signals. Through asynchronous dual-screen collaboration and data-driven association, parallel processing of cashier and customer interaction is achieved, upgrading the customer screen from a static display to an intelligent interactive terminal. It can dynamically push relevant advertisements and recommendations based on real-time transaction data, realizing precise contextualized marketing. Simultaneously, it deeply integrates multimodal interactions such as touch, facial recognition, and QR code scanning, significantly improving transaction efficiency and user experience. Furthermore, through differentiated display strategies, it fully leverages the commercial value of dual-screen devices.

[0017] Furthermore, in step 3, generating second operation data associated with the first operation data based on the first operation data includes the following steps:

[0018] The product information in the first operation data is parsed;

[0019] Based on the parsing results, target multimedia content associated with it is matched from the preset content library and used as the second operation data;

[0020] The target multimedia content includes product detail videos, coupon information, or related product recommendations.

[0021] Further, in step 5, obtaining the input signal from at least one interactive module integrated with the second display screen specifically involves:

[0022] Touch input signals are received via a touch sensor located on the second display screen;

[0023] And / or,

[0024] The system collects biometric input signals through an integrated facial recognition camera.

[0025] And / or,

[0026] The payment credential input signal is read using an integrated barcode scanner or card reader.

[0027] Furthermore, after collecting biometric input signals through the facial recognition camera, the method further includes the following steps:

[0028] The biometric input signal is subjected to attribute analysis to identify at least one attribute feature;

[0029] Based on the identified attribute features, customized content matching them is generated and sent to the second display screen as the second operation data or a part thereof.

[0030] Furthermore, in step 5, after executing the corresponding processing logic based on the input signal, the process further includes:

[0031] Based on the data generated during this interaction, user profile data is generated and stored.

[0032] In subsequent interaction events, the user profile data is invoked to generate personalized second operation data.

[0033] Furthermore, the method also includes:

[0034] Voice input signals are received through an integrated voice acquisition module;

[0035] The voice input signal is recognized, and the operation logic corresponding to the recognition result is triggered.

[0036] Furthermore, during the interaction process, the display content and interaction logic of the first display screen and the second display screen are independent of each other and processed in parallel;

[0037] The first interactive interface prioritizes responding to the cashier's input, while the second interactive interface prioritizes responding to the customer's input, and the core data of the two interactive interfaces is kept consistent through a data synchronization mechanism.

[0038] Furthermore, during system idle periods, the first display screen and the second display screen are controlled to execute differentiated display strategies, wherein the second display screen is controlled to play preset commercial promotional content that is unrelated to the current transaction.

[0039] On the other hand, this application provides a smart consumer terminal interaction system based on dual-screen display, including:

[0040] The display control module is configured to respond to interactive events and control the first display screen and the second display screen to display independent first and second interactive interfaces, respectively.

[0041] The data processing module is configured to acquire first operation data input through the first interactive interface, and generate second operation data based on the first operation data;

[0042] An interactive signal processing module is configured to acquire input signals from at least one interactive module integrated with the second display screen;

[0043] The logic execution module is configured to execute corresponding processing logic based on the input signal;

[0044] The display control module is further configured to receive the second operation data and drive the second interactive interface to update the displayed content.

[0045] Furthermore, the system also includes:

[0046] The intelligent content engine is configured to parse the first operation data or the input signal, and match or dynamically generate target content from the content library based on the parsing result, so as to serve as all or part of the content of the second operation data;

[0047] The user profile module is configured to build and update user profiles based on historical interaction data, and to provide data support for the intelligent content engine to generate personalized content.

[0048] The substantial effects of this invention:

[0049] 1. In this invention, by completely separating and parallelizing the cashier's interface and the customer's interface, transaction efficiency is significantly improved. Cashiers can focus on complex business operations, while customers can simultaneously confirm, pay, or browse information, reducing waiting time and optimizing user experience. Furthermore, by analyzing real-time transaction data, relevant multimedia advertisements, coupons, or product recommendations are intelligently pushed to the customer's screen, deeply binding marketing activities with consumption scenarios and greatly improving the conversion rate of advertisements and the accuracy of marketing.

[0050] 2. This invention deeply integrates multiple interaction methods such as touch, facial recognition, QR code / card scanning, and voice, providing users with natural, convenient, and diverse interaction options. In particular, through facial recognition technology, not only is convenient payment achieved, but also accurate user identification and attribute-based personalized content delivery are realized.

[0051] 3. In this invention, by establishing a user profile module, the system can record and analyze users' consumption history and preferences, enabling each interaction to generate and push highly personalized content and services, thereby enhancing user stickiness and improving customer loyalty. During system idle periods, dual-screen resources can be utilized in a differentiated manner, such as allowing the customer screen to play commercial advertisements, so that the device can continue to generate commercial value even during non-transaction hours, thus maximizing resource utilization. Attached Figure Description

[0052] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0053] Figure 1 This is a schematic diagram of the method flow in Example 1.

[0054] Figure 2 This is the core processing flowchart of Example 1.

[0055] Figure 3 This is a system principle block diagram for Example 4. Detailed Implementation

[0056] To facilitate understanding of the present invention, a more detailed description is provided below with reference to the accompanying drawings and specific embodiments. It should be noted that when an element is described as being "fixed to" another element, it can be directly on the other element, or one or more intermediate elements may exist between them. When an element is described as being "connected to" another element, it can be directly connected to the other element, or one or more intermediate elements may exist between them. The terms "vertical," "horizontal," "left," "right," and similar expressions used in this specification are for illustrative purposes only.

[0057] Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. The term "and / or" as used in this specification includes any and all combinations of one or more of the associated listed items.

[0058] Example 1:

[0059] Reference Figure 1 , Figure 2 As shown, a smart consumer terminal interaction method based on dual-screen display includes the following steps:

[0060] Step 1: In response to the interactive event, control the first display screen and the second display screen to display independent first and second interactive interfaces respectively;

[0061] Step 2: Obtain the first operation data input through the first interactive interface;

[0062] Step 3: Based on the first operation data, generate second operation data associated with the first operation data;

[0063] Step 4: Send the second operation data to the second display screen to drive the second interactive interface to update the displayed content;

[0064] Step 5: Obtain input signals from at least one interactive module integrated with the second display screen, and execute corresponding processing logic based on the input signals.

[0065] As one implementation method, step 3, generating second operation data associated with the first operation data based on the first operation data, includes the following steps:

[0066] The product information in the first operation data is parsed;

[0067] Based on the parsing results, target multimedia content associated with it is matched from the preset content library and used as the second operation data;

[0068] The target multimedia content includes product detail videos, coupon information, or related product recommendations.

[0069] In one implementation, step 5, obtaining the input signal from at least one interactive module integrated with the second display screen, specifically involves:

[0070] Touch input signals are received via a touch sensor located on the second display screen;

[0071] The system collects biometric input signals through an integrated facial recognition camera.

[0072] The payment credential input signal is read using an integrated barcode scanner or card reader.

[0073] As one implementation method, after collecting biometric input signals through a facial recognition camera, the method further includes the following steps:

[0074] Perform attribute analysis on biometric input signals to identify at least one attribute feature;

[0075] Based on the identified attribute features, customized content that matches them is generated and sent to the second display screen as second operation data or a part of it.

[0076] As one implementation method, after executing the corresponding processing logic based on the input signal in step 5, the method further includes:

[0077] Based on the data generated during this interaction, user profile data is generated and stored.

[0078] In subsequent interaction events, user profile data is invoked to generate personalized second operation data.

[0079] As one implementation method, the method further includes:

[0080] Voice input signals are received through an integrated voice acquisition module;

[0081] The voice input signal is recognized, and the corresponding operation logic is triggered based on the recognition result.

[0082] As one implementation method, during the interaction process, the display content and interaction logic of the first display screen and the second display screen are independent of each other and processed in parallel.

[0083] The first interactive interface prioritizes the cashier's input, while the second interactive interface prioritizes the customer's input, and a data synchronization mechanism is used to maintain the consistency of core data between the two interactive interfaces.

[0084] As one implementation method, during system idle periods, the first display screen and the second display screen are controlled to execute differentiated display strategies, wherein the second display screen is controlled to play preset commercial promotional content that is unrelated to the current transaction.

[0085] Example 2:

[0086] This embodiment is basically the same as embodiment 1, except that it provides specific steps for controlling the first display screen and the second display screen to respectively present independent first and second interactive interfaces in response to interactive events:

[0087] Step 1.1: Event Listening and Capturing

[0088] The operating system or main control application of the smart consumer machine continuously runs an event listening loop.

[0089] Cashier's end: Triggered via the touchscreen of the first display screen, connected barcode scanner, keyboard, or other peripherals. For example, the cashier scans a product barcode or clicks the "Start Transaction" button on the screen.

[0090] On the customer side: pre-triggered via an interactive module integrated into the second display screen. For example, a customer approaches the POS machine, is detected by a facial recognition camera, or an infrared sensor is triggered.

[0091] Internally: The system is woken up from an idle state or reaches a preset promotional time.

[0092] Generate a standard interactive event signal. This signal typically includes the event type (such as "transaction started" or "product search"), the event source (cashier / customer / system), and the necessary basic data.

[0093] Step 1.2: Event Resolution and Context Initialization

[0094] The central processing unit (CPU) or a dedicated display control module receives and parses the interactive event signal.

[0095] Determine the event type: This determines the interface template and business process that need to be loaded subsequently. For example, is it a regular transaction, a return, or a member inquiry?

[0096] Create a session: Create a unique session ID for this interaction, which will be used to associate and synchronize data between the two screens in subsequent steps.

[0097] Initialize data context: Allocate memory space for this interaction and prepare to store transaction data, user information, etc.

[0098] Step 1.3: Interface Strategy Decision and Resource Loading

[0099] The dual-screen display strategy is determined based on the parsed event type and system configuration.

[0100] First display screen (cashier screen) strategy:

[0101] Retrieve the cashier's user interface template corresponding to the event type from memory. For example, for the "Transaction Start" event, load a complex user interface that includes a product list, a total amount, and function buttons (discount, pending order, etc.).

[0102] Ensure that the interface prioritizes responding to the cashier's touch input, and design the interface elements with operational efficiency as the core.

[0103] Second display screen (customer screen) strategy:

[0104] Retrieve the customer interaction interface template from memory. This template may be weakly related to the event type, but places greater emphasis on brand presentation and interactive guidance.

[0105] The initial content may be: brand logo, welcome message, default advertising screen, or guidance information displayed according to the event type in step 1.2 (such as "Please confirm the product list").

[0106] Step 1.4: Independent Rendering and Asynchronous Display Output

[0107] The display control module drives the graphics processing units (GPUs) of the two displays to perform independent rendering tasks.

[0108] Parallel rendering: The system utilizes its graphics processing capabilities to simultaneously write different image data to the frame buffers of two screens.

[0109] Asynchronous control:

[0110] The primary display screen is set as the main interactive display, with a higher refresh rate and touch response priority to ensure smooth operation for cashiers.

[0111] The second display screen is configured for auxiliary information and interactive display. Its content updates are decoupled from the rendering cycle of the first display screen, and it can play animation or video content independently.

[0112] Two screens simultaneously but independently display completely different visual interfaces, namely the "first interactive interface" and the "second interactive interface".

[0113] Example 3:

[0114] This embodiment is basically the same as embodiment 1, except that it provides specific steps for obtaining the first operation data input through the first interactive interface:

[0115] Step 2.1: Input Event Listening and Capturing

[0116] The cashier's user interface application, running on the first display screen, continuously listens for interaction events from various input devices.

[0117] Touch input: Captures cashier's taps, swipes, and other gestures via the touchscreen on the first display screen. For example, tapping the "product button" or swiping through the product list.

[0118] Barcode scanner: Captures successful barcode scan events and receives the decoded product barcode string.

[0119] Physical keyboard / cash drawer keyboard: Captures key events for quick input of quantity, amount, or shortcut keys.

[0120] Peripheral devices, such as card readers and barcode scanners, send data signals to the system via USB or serial port.

[0121] Software interface input: Users can input discount information and select membership levels using virtual controls on the interface, such as numeric keypads, drop-down menus, and checkboxes.

[0122] Step 2.2: Input Data Parsing and Preprocessing

[0123] The data processing module parses and performs preliminary processing on the captured raw events.

[0124] Data normalization: Heterogeneous data from different input sources are uniformly converted into a standardized data format defined internally by the system. For example, the barcode "6901234567890" sent by the scanner is wrapped into a BarcodeScanEvent object.

[0125] Data supplementation and correlation:

[0126] For product barcodes, the system will automatically trigger a local or online database query to associate the barcode with specific product information (such as name, unit price, inventory, etc.).

[0127] For manually selected products, retrieve complete information directly from the local product list.

[0128] Automatically add timestamps, session IDs for this transaction, and other contextual information to the input data.

[0129] Perform basic validity checks on the input data, such as checking if the product barcode exists and whether the entered quantity is a valid number.

[0130] Step 2.3: Building and Updating "First Operation Data"

[0131] The system creates and maintains a dynamic data structure in memory (usually within the context of the current session), which is the first operational data.

[0132] This data is typically a structured object or collection, with core fields including:

[0133] sessionId: A unique identifier for this transaction.

[0134] goodsList: A list of goods, each item including name, unit price, quantity, subtotal, etc.

[0135] totalAmount: The total amount of the current transaction.

[0136] Additional Info: Additional information, such as discount amount, member ID, operator ID, etc.

[0137] Data update:

[0138] Add a new product: Add the parsed product information to the goodsList.

[0139] Modify product: If the quantity is modified, the subtotal of the corresponding product item will be updated, and the totalAmount will be recalculated.

[0140] Delete item: Removes the specified item from goodsList and recalculates totalAmount.

[0141] Step 2.4: Real-time feedback and interface updates

[0142] System Behavior: To ensure visual feedback of cashier operations, the system will immediately drive a partial refresh of the first interactive interface after updating the first operation data.

[0143] Specific manifestations:

[0144] Newly added product rows are displayed in real time in the product list.

[0145] The total amount area on the screen updates in real time.

[0146] The status of the operation buttons may change (e.g., after the quantity is entered, the "Pend Order" button becomes available).

[0147] Step 2.5: Data Temporary Storage and Transfer Ready

[0148] Once the updated and verified "first operation data" is stored in memory, it is set to a state where it can be read by subsequent steps.

[0149] System status: This indicates the completion of step 2, the data flow channel is open, and it awaits the triggering of step 3 (usually triggered at the moment of stable data change, or automatically after a short time delay).

[0150] Example 4:

[0151] Reference Figure 3 As shown, this embodiment is basically the same as embodiment 1, except that it provides a smart consumer terminal interaction system based on dual-screen display, including:

[0152] The display control module is configured to respond to interactive events and control the first display screen and the second display screen to display independent first and second interactive interfaces, respectively.

[0153] The data processing module is configured to acquire first operation data input through the first interactive interface, and generate second operation data based on the first operation data;

[0154] An interactive signal processing module is configured to acquire input signals from at least one interactive module integrated with a second display screen;

[0155] The logic execution module is configured to execute corresponding processing logic based on input signals.

[0156] The display control module is further configured to receive second operation data and drive the second interactive interface to update the displayed content.

[0157] As one implementation method, it also includes:

[0158] The intelligent content engine is configured to parse the first operation data or input signal, and match or dynamically generate target content from the content library based on the parsing results, so as to serve as all or part of the content of the second operation data.

[0159] The user profile module is configured to build and update user profiles based on historical interaction data, and to provide data support for the intelligent content engine to generate personalized content.

[0160] It should be noted that while the preferred embodiments of the present invention are provided in the specification and accompanying drawings, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. These embodiments are not intended to impose additional limitations on the content of the present invention; their purpose is to provide a more thorough and comprehensive understanding of the disclosure of the present invention. Furthermore, the above-described technical features can be combined with each other to form various embodiments not listed above, all of which are considered to be within the scope of the present invention specification. Moreover, those skilled in the art can make improvements or modifications based on the above description, and all such improvements and modifications should fall within the protection scope of the appended claims.

Claims

1. A smart consumer terminal interaction method based on dual-screen display, characterized in that, Includes the following steps: Step 1: In response to the interactive event, control the first display screen and the second display screen to display independent first and second interactive interfaces respectively; Step 2: Obtain the first operation data input through the first interactive interface; Step 3: Based on the first operation data, generate second operation data associated with the first operation data; Step 4: Send the second operation data to the second display screen to drive the second interactive interface to update the displayed content; Step 5: Obtain input signals from at least one interactive module integrated with the second display screen, and execute corresponding processing logic based on the input signals.

2. The interactive method for a smart consumer terminal based on dual-screen display according to claim 1, characterized in that, In step 3, generating second operation data associated with the first operation data based on the first operation data includes the following steps: The product information in the first operation data is parsed; Based on the parsing results, target multimedia content associated with it is matched from the preset content library and used as the second operation data; The target multimedia content includes product detail videos, coupon information, or related product recommendations.

3. The interactive method for a smart consumer terminal based on dual-screen display according to claim 1, characterized in that, In step 5, obtaining the input signal from at least one interactive module integrated with the second display screen specifically involves: Touch input signals are received via a touch sensor located on the second display screen; And / or, The system collects biometric input signals through an integrated facial recognition camera. And / or, The payment credential input signal is read using an integrated barcode scanner or card reader.

4. The interactive method for a smart consumer terminal based on dual-screen display according to claim 3, characterized in that, After acquiring biometric input signals through the facial recognition camera, the process further includes the following steps: The biometric input signal is subjected to attribute analysis to identify at least one attribute feature; Based on the identified attribute features, customized content matching them is generated and sent to the second display screen as the second operation data or a part thereof.

5. The interactive method for a smart consumer terminal based on dual-screen display according to claim 1, characterized in that, In step 5, after executing the corresponding processing logic based on the input signal, the method further includes: Based on the data generated during this interaction, user profile data is generated and stored. In subsequent interaction events, the user profile data is invoked to generate personalized second operation data.

6. The interactive method for a smart consumer terminal based on dual-screen display according to claim 1, characterized in that, The method also includes: Voice input signals are received through an integrated voice acquisition module; The voice input signal is recognized, and the operation logic corresponding to the recognition result is triggered.

7. The interactive method for a smart consumer terminal based on dual-screen display according to claim 1, characterized in that, During the interaction, the display content and interaction logic of the first display screen and the second display screen are independent of each other and processed in parallel. The first interactive interface prioritizes responding to the cashier's input, while the second interactive interface prioritizes responding to the customer's input, and the core data of the two interactive interfaces is kept consistent through a data synchronization mechanism.

8. The interactive method for a smart consumer terminal based on dual-screen display according to claim 1, characterized in that, During system idle periods, the first display screen and the second display screen are controlled to execute differentiated display strategies, wherein the second display screen is controlled to play preset commercial promotional content that is unrelated to the current transaction.

9. A smart consumer terminal interaction system based on dual-screen display, used to implement the interaction method as described in any one of claims 1-8, characterized in that, include: The display control module is configured to respond to interactive events and control the first display screen and the second display screen to display independent first and second interactive interfaces, respectively. The data processing module is configured to acquire first operation data input through the first interactive interface, and generate second operation data based on the first operation data; An interactive signal processing module is configured to acquire input signals from at least one interactive module integrated with the second display screen; The logic execution module is configured to execute corresponding processing logic based on the input signal; The display control module is further configured to receive the second operation data and drive the second interactive interface to update the displayed content.

10. The intelligent consumer terminal interaction system based on dual-screen display according to claim 9, characterized in that, Also includes: The intelligent content engine is configured to parse the first operation data or the input signal, and match or dynamically generate target content from the content library based on the parsing result, so as to serve as all or part of the content of the second operation data; The user profile module is configured to build and update user profiles based on historical interaction data, and to provide data support for the intelligent content engine to generate personalized content.

Images