Checkout system and method based on generative artificial intelligence
By introducing generative artificial intelligence technology into the self-service checkout system, the limitations of existing system interaction methods, insufficient intelligence and data security are solved, and an efficient, personalized and secure checkout process is achieved.
Patent Information
- Application Number
- CN202510083469.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-20
- Publication Date
- 2025-05-13
AI Technical Summary
The existing self-service checkout system has problems such as limitations in interaction methods, insufficient intelligence, privacy and data security challenges, and cumbersome operations, which cannot effectively improve user experience and checkout efficiency.
The checkout system based on generative artificial intelligence is adopted, and multi-modal interaction requests are received through the interactive module. The intelligent module uses a large language model to identify customer intentions and generates personalized checkout guidance information. The payment module processes checkout information, and the privacy and security module encrypts or destroys data.
It significantly improves the efficiency and user experience of the checkout process, provides personalized service capabilities, ensures data privacy and security, and is suitable for diverse business needs.
Smart Images
Figure CN119991105A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of intelligent checkout, and in particular relates to a checkout system based on generative artificial intelligence. Background Art
[0002] Existing self-service checkout systems generally have the following technical defects:
[0003] 1. Limited interaction methods
[0004] Existing systems mostly use static menus or fixed instructions, which cannot flexibly guide customers according to their immediate needs. When customers are not familiar with the process, it is easy to cause operational errors or delays, reducing user experience and checkout efficiency.
[0005] 2. Insufficient intelligence
[0006] Although a small number of systems have introduced voice interaction functions, most of them are based on rule engines or preset instructions and cannot achieve dynamic dialogue or targeted guidance. For example, in terms of payment method selection or discount confirmation, there is a lack of personalized service capabilities.
[0007] 3. Privacy and data security challenges
[0008] Some systems use facial recognition technology to improve operational convenience, but the protection of private data is insufficient, and there is a risk of data leakage or abuse. In addition, data processing is mostly concentrated on remote servers, posing a potential threat to users' privacy rights.
[0009] 4. Examples of limitations of existing technologies
[0010] The existing technologies only describe the self-service checkout process based on barcode scanning, lacking intelligent interactive design. Other existing technologies mention the application potential of generative artificial intelligence, but do not apply it to the checkout scenario.
[0011] In addition, the existing self-checkout technology has the following major problems in the application process:
[0012] 1. Complicated operation and low efficiency
[0013] The existing self-service checkout system relies on static menu operations, and users need to manually complete multiple steps of selection and confirmation. The overall process is cumbersome, resulting in low checkout efficiency, especially during peak hours, and unable to quickly meet customer needs.
[0014] 2. Lack of intelligent interaction and dynamic guidance
[0015] Traditional systems are mainly based on fixed menus or commands, lacking flexibility and unable to dynamically adjust to customers’ immediate needs. Especially when it comes to payment selection, discount confirmation or abnormal situation handling, they are limited in functionality.
[0016] 3. Lack of applications of generative AI
[0017] The voice interaction functions of existing systems are mostly based on simple instructions or rule engines, and are unable to use generative artificial intelligence (such as GPT) for natural language conversations, limiting the room for improving user experience.
[0018] 4. Lack of personalization in customer experience
[0019] The system lacks insight and feedback into customers’ immediate needs and is unable to provide context-based personalized operational guidance, resulting in a lack of immersive experience for customers during use. Summary of the invention
[0020] To solve the problems raised by the background technology, a first aspect of the present invention provides a checkout system based on generative artificial intelligence, including: an interaction module, used to receive a customer's multimodal interaction request, transmit the multimodal interaction request to an intelligent module, and feed back personalized checkout guidance information generated by the intelligent module to the customer; an intelligent module, used to receive the multimodal interaction request, identify the customer's intention from the multimodal interaction request through a large language model to generate personalized checkout guidance information, and issue a control request to a payment module or a privacy and security module according to the customer's intention; a payment module, used to generate checkout information according to the control request of the intelligent module; the checkout information includes payment method, order information and transaction voucher; a privacy and security module, used to encrypt or destroy the customer's personalized checkout guidance information and transaction information based on the control request of the intelligent module.
[0021] In some embodiments of the present invention, the interactive module includes: a voice device for receiving a customer's voice input and broadcasting the personalized checkout guidance information generated by the intelligent module to the customer; a display device for receiving a customer's touch request and displaying the personalized checkout guidance information generated by the intelligent module to the customer.
[0022] In some embodiments of the present invention, the intelligent module includes: an identification unit, which is used to receive a multimodal interaction request and identify the customer's intention from the multimodal interaction request through a large language model; a guidance unit, which is used to generate personalized checkout guidance information according to the customer's intention; and a control unit, which is used to issue a control request to a payment module or a privacy and security module according to the customer's language intention.
[0023] Furthermore, the guidance information includes personalized payment suggestions and preferential information.
[0024] In some embodiments of the present invention, the privacy and security module includes: an encryption module, which is used to respond to a first control request of the intelligent module and encrypt the customer's identity characteristics, personalized checkout guidance information and transaction information; and a destruction module, which is used to respond to a second control request of the intelligent module and destroy the customer's identity characteristics, personalized checkout guidance information and transaction information.
[0025] In some embodiments of the present invention, it also includes: a face recognition module, which is used to identify the customer's identity characteristics and transmit the identity characteristics to the intelligent module to optimize the large language model to generate personalized checkout guidance information.
[0026] According to a second aspect of the present invention, a checkout method based on generative artificial intelligence is provided, comprising an interactive module, an intelligent module, a payment module and a privacy and security module, wherein the interactive module receives a multimodal interaction request from a customer, transmits the multimodal interaction request to the intelligent module, and feeds back personalized checkout guidance information generated by the intelligent module to the customer; the intelligent module receives the multimodal interaction request, identifies the customer's intention from the multimodal interaction request through a large language model to generate personalized checkout guidance information, and issues a control request to the payment module or the privacy and security module according to the customer's intention; the payment module generates checkout information according to the control request of the intelligent module; the checkout information includes payment method, order information and transaction voucher; the privacy and security module encrypts or destroys the customer's personalized checkout guidance information and transaction information based on the control request of the intelligent module.
[0027] Furthermore, the encrypting or destroying the customer's personalized checkout guide information and transaction information based on the control request of the intelligent module includes: responding to a first control request of the intelligent module to encrypt the customer's identity characteristics, personalized checkout guide information and transaction information; responding to a second control request of the intelligent module to destroy the customer's identity characteristics, personalized checkout guide information and transaction information.
[0028] The third aspect of the present invention provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the generative artificial intelligence based checkout method provided in the second aspect of the present invention.
[0029] A fourth aspect of the present invention provides a computer-readable medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the checkout method based on generative artificial intelligence provided in the second aspect of the present invention is implemented.
[0030] The beneficial effects of the present invention are:
[0031] The present invention is based on a large language model, and can achieve instant response to user needs through voice or touch input, dynamically generate payment guidance and operation suggestions, and significantly improve the efficiency and user experience of the checkout process. Through multimodal interaction (voice and touch), the personalized service capability is further enhanced with optional auxiliary modules (such as face recognition module) to capture non-sensitive features (such as gender, age, etc.), but this module is not a necessary condition for the operation of the system. This system is suitable for retail, catering, supermarkets, parking lots and other scenarios that require efficient checkout, and can flexibly adapt to diverse business needs. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 is a schematic diagram of the basic structure of a checkout system based on generative artificial intelligence in some embodiments of the present invention;
[0033] Figure 2 is a schematic diagram of a specific structure of a checkout method based on generative artificial intelligence in some embodiments of the present invention;
[0034] Figure 3 is a schematic diagram of a checkout method based on generative artificial intelligence in some embodiments of the present invention;
[0035] Figure 4 It is a schematic diagram of the structure of an electronic device in some embodiments of the present invention. DETAILED DESCRIPTION
[0036] The principles and features of the present invention are described below in conjunction with the accompanying drawings. The examples given are only used to explain the present invention and are not used to limit the scope of the present invention.
[0037] refer to Figure 1 and Figure 2 In a first aspect of the present invention, a checkout system 1 based on generative artificial intelligence is provided, comprising: an interaction module 11, for receiving a multimodal interaction request from a customer, transmitting the multimodal interaction request to an intelligent module, and feeding back personalized checkout guidance information generated by the intelligent module to the customer; an intelligent module 12, for receiving a multimodal interaction request, identifying the customer's intention from the multimodal interaction request through a large language model to generate personalized checkout guidance information, and issuing a control request to a payment module or a privacy and security module according to the customer's intention; a payment module 13, for generating checkout information according to the control request of the intelligent module; the checkout information includes a payment method, order information and a transaction voucher; a privacy and security module 14, for encrypting or destroying the customer's personalized checkout guidance information and transaction information based on the control request of the intelligent module.
[0038] It is understandable that generative artificial intelligence can realize intelligent and personalized checkout process, lowering the operation threshold. It supports voice interaction and touch input to meet the needs of different scenarios. It complies with data privacy protection regulations, and all data is only used during the transaction.
[0039] In some embodiments of the present invention, the interaction module 11 includes: a voice device for receiving voice input from a customer and broadcasting the personalized checkout guidance information generated by the intelligent module to the customer;
[0040] Specifically, it supports voice and touch input, and customers can freely choose the operation mode according to actual needs, reducing learning costs and improving operational convenience. Specifically, the voice device consists of a highly sensitive microphone, which is used to capture the customer's voice input and convert the voice data into a digital signal. The voice data is transmitted to the voice processing module (GPT) for analysis and response generation. For example, a highly sensitive microphone (such as a 16kHz recording device), an embedded processor that supports API calls (such as ARMCortex-A53), and a standard POS payment module.
[0041] The display device is used to receive the customer's touch request and display the personalized checkout guidance information generated by the smart module to the customer.
[0042] Specifically, it consists of a high-resolution touch screen, which is used to display the text content generated by the GPT module and support users to select or operate through touch. It also displays the interactive content of GPT synchronously and transmits the user's touch selection to the control module.
[0043] It can be understood that the intelligent module 12 provides customized payment suggestions and preferential information by analyzing customer behavior and context, making the checkout process more efficient and in line with user needs.
[0044] In some embodiments of the present invention, the intelligent module 12 includes: an identification unit, which is used to receive a multimodal interaction request and identify the customer's intention from the multimodal interaction request through a large language model; a guidance unit, which is used to generate personalized checkout guidance information according to the customer's intention; and a control unit, which is used to issue a control request to the payment module or the privacy and security module according to the customer's language intention.
[0045] Specifically, the intelligent module processes customer voice input based on GPT technology and generates real-time responses, thereby realizing voice interaction with customers (users); based on customer behavior and contextual information, dynamic payment suggestions and personalized product recommendations are provided. Voice recognition accuracy: The accuracy of the voice input module is guaranteed to reach more than 95%. Response time: The time from the GPT module receiving input data to generating a response should be less than 1 second. Data processing security: All data processing modules comply with GDPR and CCPA privacy regulations to ensure that data is not leaked. Voice recognition module (Google Speech-to-Text), GPT API deployment method (local or cloud) and payment interface. Exemplarily, the present invention converts voice into text based on Google Speech-to-Text API, uses the GPT-4 API provided by OpenAI to process text and generate responses, and completes the transaction through the local payment interface.
[0046] Schematically, the smart module startup phase: When the user approaches the system device, the system starts the voice input module and prompts the user to start the operation. Voice interaction: The user enters the checkout requirements, the system converts the voice into text, and transmits it to the GPT module for parsing and generation. Dynamic generation: The GPT module provides real-time guidance based on user needs, such as recommending payment methods or notifying preferential information. Operation completion: After the user confirms the operation, the system completes the payment and provides a transaction voucher.
[0047] Optionally, the above GPT API can also be replaced by other large language models, such as Doubao, L l ama series models, etc.
[0048] In some embodiments of the present invention, the payment module 13 includes three payment methods: scanning payment, card payment and cash payment, integrates the POS system, and supports fast and secure transactions. The payment module 13 accepts the payment suggestion provided by the GPT and feeds back the payment result to the display module.
[0049] In some embodiments of the present invention, the privacy and security module 14 includes: an encryption module, which is used to respond to the first control request of the intelligent module and encrypt the customer's identity characteristics, personalized checkout guidance information and transaction information; a destruction module, which is used to respond to the second control request of the intelligent module and destroy the customer's identity characteristics, personalized checkout guidance information and transaction information.
[0050] Specifically, the data encryption and destruction algorithm ensures that all user data is only processed locally and deleted immediately after the operation is completed. It works in conjunction with the smart module 13 to ensure that the system complies with privacy regulations.
[0051] In some embodiments of the present invention, it also includes: a face recognition module 15, which is used to identify the identity characteristics of the customer and transmit the identity characteristics to the intelligent module to optimize the large language model to generate personalized checkout guidance information.
[0052] Specifically, the face recognition module is used for identity recognition: capturing basic customer characteristics (such as gender and age) and generating non-sensitive data for personalized recommendations. Auxiliary analysis: If enabled, the data is transferred to the ChatGPT module to generate more targeted recommendations, but this module is not a necessary configuration.
[0053] In one specific embodiment, the generative artificial intelligence based checkout system initiates:
[0054] 1. When the customer approaches the device, the voice input module is activated and prompts the user to start the operation.
[0055] 2. Voice input and processing: Customers input their needs through voice (such as "I want to check out" or "Use credit card"), and the data is transmitted to the GPT module for processing. 3. Natural language generation: The GPT module generates appropriate guidance content (such as recommended payment methods or notification of discount information) based on customer needs and context. 4. Display and operation: The content generated by GPT is displayed on the touch screen, and customers can choose to touch or voice confirm to proceed to the next step. 5. Payment and feedback: The system starts the payment module, completes the payment according to the method selected by the customer, and provides a successful payment prompt on the display module. 6. Data destruction and reset: All transaction-related data is destroyed immediately after completion, and the system is restored to its initial state, ready to accept the next customer.
[0056] It can be understood that the system design follows the principle of real-time data processing, only performs necessary data analysis locally, and destroys it immediately after the operation is completed to ensure data security and privacy compliance.
[0057] In a specific embodiment, the following steps are included: 1. The user stands in front of the checkout machine and says: "I want a bowl of beef noodles and a braised egg." 2. The voice input module converts the voice into text and passes it to the GPT module. 3. GPT responds: "We offer three types of beef noodles: braised, boiled and spicy, please choose." and displays it on the screen. 4. The user chooses braised beef noodles, GPT updates the order and guides payment. 5. The system completes the transaction and provides an electronic receipt.
[0058] In a specific embodiment, a voice input module is set to convert the sound signal collected by the microphone into a digital signal, and generate text through a voice recognition tool. The text is input into the GPT module, and natural language processing is implemented through API calls to generate a response suitable for the current scenario. A display module is set to present the response content of GPT on the screen and accept the user's touch or voice selection. The user's final choice is passed to the order management module, which records the order information and guides it to the payment module. The transaction is completed through the payment interface, and confirmation information of the successful transaction is displayed on the screen.
[0059] In a specific embodiment, when a customer approaches the front desk device (1000) of the smart checkout machine, the system starts the following process:
[0060] 1. Startup and data capture
[0061] The camera module (200) automatically starts to capture the frontal environmental image or facial features of the customer. All captured image data will be instantly transmitted to the core control module (260) in the KIOSK host (2000). For ease of description, the core control module (260) is referred to as the control module (260); the control module (260) is responsible for processing the data transmitted by the camera module and determining whether it is necessary to call the auxiliary recognition module (280) for further analysis (for example, to determine gender, age or body characteristics). If there is no camera module or auxiliary recognition module, the system will directly jump to the operation process of the voice module.
[0062] 2. Intelligent analysis and suggestion generation
[0063] If the system enables the auxiliary recognition module (280), the module can further analyze the customer's non-sensitive characteristics (such as gender, age, and body shape). For example, the system will calculate the customer's height, body fat percentage and other data, and generate personalized suggestions based on these characteristics. The system transmits the recognition results to the voice interaction module (300) through the core control module (260), and the GPT technology generates targeted guidance dialogue content.
[0064] 3. Interaction and payment prompts
[0065] The customer's needs are transmitted to the voice interaction module (300) via the sound receiving module (100). The module generates voice guidance content suitable for the customer's needs through natural language processing (NLP) and GPT algorithm, such as "Do you need to choose a payment method?" or "There is a special promotion today, do you want to participate?" The generated voice content will be synchronously displayed on the display module (220), providing clear operation options.
[0066] 4. Payment Operation
[0067] The system calls the multi-mode payment module, and the customer can complete the payment through the scanning module (160), coin module, or POS module (180).
[0068] If using mobile payment, the scanning module will accept the customer's payment code and complete the transaction quickly.
[0069] 5. Complete transactions and data cleaning
[0070] After all operations are completed, the system will display the transaction success information on the display module (220), and the printing module will output the transaction receipt.
[0071] The cache storage module (320) is responsible for the immediate clearing of temporarily stored data to ensure data privacy compliance.
[0072] Module function description:
[0073] Auxiliary camera module / camera module (200): assists in capturing customer features, optional configuration.
[0074] Core control module (260): coordinates the operation of all modules, handles data flow and module calls.
[0075] Auxiliary identification module (280): Analyzes the non-sensitive characteristics of customers (optional).
[0076] Voice interaction module (300): Generates guided dialogue based on GPT technology and provides efficient voice interaction function.
[0077] Display module (220): displays operation options and prompts, and supports touch interaction, i.e. Figure 2 Central information display module (touch screen);
[0078] ·Multi-mode payment module (160, 180): supports multiple payment methods to ensure transaction flexibility.
[0079] · Cache storage module (320): Data is cleared immediately after processing, meeting privacy requirements.
[0080] Remote server (360): provides computing support to ensure stable operation of the system; Figure 2 Provide remote computing support for voice processing and payment system connection 360;
[0081] 1. Front desk equipment (1000)
[0082] Functionality: The main interface for customers to interact with the system, including installation points for all external modules, such as display module, radio module, payment module, etc.
[0083] Description: Provide a visual operating environment, customers can complete the operation by standing in front of the front desk equipment.
[0084] 2. Camera module (200)
[0085] Function: Assist in capturing customer’s facial or environmental images for further analysis.
[0086] Note: This module is an optional configuration and is used to capture non-sensitive data (such as gender and age). It can improve the accuracy of personalized recommendations, but it is not a necessary module for the system.
[0087] Privacy advice: If sensitive data is involved, it should be made clear that the data is not stored and is processed immediately.
[0088] 3. Display module (220)
[0089] Function: Provide a user interface to display the conversation content and operation instructions generated by GPT.
[0090] Description: Supports displaying a variety of content, including payment amount, operation prompts, discount information, etc., and is used to display user interaction options.
[0091] Supplementary functions: If it is a touch screen, it can support user input and selection at the same time.
[0092] 4. Radio module (100)
[0093] Function: Capture customer voice input.
[0094] Description: The user's voice command is transmitted to the voice interaction module (300) for analysis and processing.
[0095] 5. Control module (260)
[0096] Function: The core module of the system, used to coordinate the operation of various modules.
[0097] Description: Process the data from the sound receiving module (100) and the display module (220), and call the voice module (300) and the payment module to perform related operations to ensure the continuity and efficiency of the entire process.
[0098] 6. Auxiliary identification module (280, optional)
[0099] Function: Capture and analyze customers’ facial features (such as gender and age).
[0100] Description: This module is used as an auxiliary module to improve the accuracy of recommended content, but it is not the core function of the system.
[0101] 7. Voice interaction module (300)
[0102] Function: Process user voice input based on generative artificial intelligence (such as GPT) to generate dynamic guidance content.
[0103] Description: The core innovation module is responsible for converting the user's voice needs into natural language response content and providing guidance in conjunction with the display module.
[0104] 8. Storage module (320), corresponding to Figure 2 Cache storage module (320)
[0105] Function: Temporarily store data to support data processing in the process.
[0106] Note: This module is only used as a short-term data cache and will not store user data for a long time. It will ensure that the data is destroyed immediately after the operation is completed.
[0107] 9. Remote Server (360)
[0108] Function: Provide computing and data support for the voice interaction module and payment module.
[0109] Description: Responsible for handling complex voice recognition and payment processes. All data transmission is encrypted to ensure security.
[0110] 10. Message display device (380)
[0111] Function: Display system status and operation results.
[0112] Description: As an auxiliary display tool, it is used to prompt the user's operation progress or display a success prompt.
[0113] 11. KIOSK Host (2000)
[0114] Function: Serves as the main hardware platform of the device, responsible for performing all computing tasks and system management.
[0115] Description: This module runs all system software and coordinates other modules through the control module
[0116] 12. Multi-mode payment module
[0117] Coin module (160), scanning module (160), POS module (180);
[0118] Function: Provides multiple payment methods, including cash, barcode scanning, credit card, etc.
[0119] Description: Combine different payment modules to ensure that users can choose the most convenient way to complete the transaction.
[0120] ·Suggestion: It can be integrated into a "multi-mode payment module" to simplify the structure of the flowchart.
[0121] 13. Print module
[0122] Function: Print receipts or transaction vouchers.
[0123] Description: Provides a physical voucher for customer transaction records, usually used in situations where an invoice is required.
[0124] Example 2
[0125] refer to Figure 3 In a second aspect of the present invention, a checkout method based on generative artificial intelligence is provided, comprising an interactive module, an intelligent module, a payment module and a privacy and security module.
[0126] S100. The interaction module receives the customer's multimodal interaction request, transmits the multimodal interaction request to the intelligent module, and feeds back the personalized checkout guidance information generated by the intelligent module to the customer; S200. The intelligent module receives the multimodal interaction request, identifies the customer's intention from the multimodal interaction request through the large language model to generate personalized checkout guidance information, and sends a control request to the payment module or the privacy and security module according to the customer's intention; S300 The payment module generates checkout information according to the control request of the intelligent module; the checkout information includes payment method, order information and transaction voucher; S400. The privacy and security module encrypts or destroys the customer's personalized checkout guidance information and transaction information based on the control request of the intelligent module.
[0127] Furthermore, in step S200, the encrypting or destroying the customer's personalized checkout guide information and transaction information based on the control request of the intelligent module includes: responding to a first control request of the intelligent module, encrypting the customer's identity characteristics, personalized checkout guide information and transaction information; responding to a second control request of the intelligent module, destroying the customer's identity characteristics, personalized checkout guide information and transaction information.
[0128] Example 3
[0129] refer to Figure 4 According to the third aspect of the present invention, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the generative artificial intelligence-based checkout method according to the second aspect of the present invention.
[0130] The electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.
[0131] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 4 The electronic device 500 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead. Figure 4 Each block shown in the figure may represent one device, or may represent multiple devices as required.
[0132] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing device 501, the above functions defined in the method of the embodiment of the present disclosure are executed. It should be noted that the computer-readable medium described in the embodiment of the present disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection with one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In an embodiment of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, an apparatus, or a device. In an embodiment of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, an apparatus, or a device. The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the foregoing.
[0133] The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device. The computer-readable medium carries one or more computer programs. When the one or more programs are executed by the electronic device, the electronic device:
[0134] Computer program code for performing the operations of the embodiments of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, Python, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0135] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0136] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims
1. A checkout system based on generative artificial intelligence, characterized in that: include: An interaction module, configured to receive a multimodal interaction request from a customer, transmit the multimodal interaction request to the intelligent module, and feed back to the customer personalized checkout guidance information generated by the intelligent module; An intelligent module, which is used to receive multimodal interaction requests, identify the customer's intention from the multimodal interaction requests through a large language model to generate personalized checkout guidance information, and send a control request to the payment module or the privacy and security module according to the customer's intention; A payment module, used to generate checkout information according to the control request of the intelligent module; the checkout information includes payment method, order information and transaction voucher; The privacy security module is used to encrypt or destroy the customer's personalized checkout guidance information and transaction information based on the control request of the intelligent module.
2. The checkout system based on generative artificial intelligence according to claim 1, characterized in that: The interaction module includes: A voice device for receiving voice input from customers and broadcasting personalized checkout guidance information generated by the intelligent module to customers; The display device is used to receive the customer's touch request and display the personalized checkout guidance information generated by the smart module to the customer.
3. The checkout system based on generative artificial intelligence according to claim 1, characterized in that: The smart module comprises: A recognition unit, configured to receive a multimodal interaction request and recognize a customer's intention from the multimodal interaction request by using a large language model; A guidance unit, used to generate personalized checkout guidance information according to the customer's intention; The control unit is used to send a control request to the payment module or the privacy security module according to the customer's language intention.
4. The checkout system based on generative artificial intelligence according to claim 3, characterized in that: The guidance information includes personalized payment suggestions and preferential information.
5. The checkout system based on generative artificial intelligence according to claim 1, characterized in that: The privacy and security module includes: An encryption module, for responding to the first control request of the intelligent module, and encrypting the customer's identity characteristics, personalized checkout guidance information and transaction information; The destruction module is used to respond to the second control request of the intelligent module and destroy the customer's identity characteristics, personalized checkout guidance information and transaction information.
6. The checkout system based on generative artificial intelligence according to claim 1, characterized in that: Also includes: The face recognition module is used to identify the customer's identity features and transmit the identity features to the intelligent module to optimize the large language model to generate personalized checkout guidance information.
7. A checkout method based on generative artificial intelligence, comprising an interactive module, an intelligent module, a payment module and a privacy and security module, characterized in that: The interactive module receives the multimodal interaction request from the customer, transmits the multimodal interaction request to the intelligent module, and feeds back the personalized checkout guidance information generated by the intelligent module to the customer; The intelligent module receives the multimodal interaction request, identifies the customer's intention from the multimodal interaction request through a large language model to generate personalized checkout guidance information, and sends a control request to the payment module or the privacy and security module according to the customer's intention; The payment module generates checkout information according to the control request of the intelligent module; the checkout information includes payment method, order information and transaction voucher; The privacy and security module encrypts or destroys the customer's personalized checkout guidance information and transaction information based on the control request of the intelligent module.
8. The checkout method based on generative artificial intelligence according to claim 7, characterized in that: The control request based on the intelligent module to encrypt or destroy the customer's personalized checkout guide information and transaction information includes: In response to the first control request of the intelligent module, encrypt the customer's identity characteristics, personalized checkout guidance information and transaction information; In response to the second control request of the intelligent module, the customer's identity features, personalized checkout guidance information and transaction information are destroyed.
9. An electronic device, comprising: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the one or more processors to implement the generative artificial intelligence-based checkout method as described in any one of claims 1 to 6.
10. A computer readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the checkout method based on generative artificial intelligence as described in any one of claims 1 to 6 is implemented.