System

Abstract

A system is provided.SOLUTION: A system comprising: an input unit configured to receive an input from a member store; a database unit configured to store input data; a document generation unit configured to generate a support document based on the stored data; an AI unit configured to provide support to the member store based on the generated support document; a communication unit configured to connect to the AI in real time at a time designated by the member store; and a document provision unit configured to generate and download an effect verification document of a coupon or a stamp card.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, there is no support system that can respond 24 hours a day in any language to meet diverse needs. As a result, it is difficult to provide fast, multilingual support to franchisees with diverse customer bases and operating environments, especially to stores with foreign owners or that require support at night. This issue could lead to a lack of adoption of paid plans and a decline in commission income. Therefore, a system that can respond to diverse needs is needed. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing a system including an input means for accepting input from affiliated stores, a database means for saving the input data, a material generation means for generating support materials based on the saved data, an AI means for providing support to affiliated stores based on the generated support materials, a communication means for connecting with the AI ​​in real time at a time specified by the affiliated store, and a material provision means for generating and making available for downloading materials for verifying the effectiveness of coupons and stamp cards. The present invention builds a system that can provide multilingual support 24 hours a day, and can quickly respond to the diverse needs of affiliated stores.

[0006] "Affiliated stores" are companies or stores that provide specific services or products, and are entities that use this system to receive coupons and support.

[0007] "Input means" refers to a device or software that provides an interface for a user to input necessary information.

[0008] "Database means" refers to a database system that can store, manage, and search input information.

[0009] "Material generation means" refers to a function or program that automatically creates the necessary support materials based on input data.

[0010] "AI means" is a system that uses artificial intelligence to provide users with real-time support and advice.

[0011] "Communication means" refers to an online conference system and network infrastructure that connects AI and affiliated stores in real time.

[0012] The "material provision means" is a function that generates materials for verifying the effectiveness of coupons and stamp cards and provides them in a form that is accessible to users.

[0013] A "coupon" is a code or ticket that provides a discount or special offer on a specific product or service.

[0014] A "stamp card" is a card that provides rewards or benefits for a specific number of uses. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] This invention is a system that helps merchants efficiently use specific services, and provides 24-hour, multilingual AI support. This system receives input data from merchants, generates necessary support materials based on that data, and provides real-time support through AI.

[0037] Program processing explanation

[0038] Initial Setup

[0039] When a user (a franchisee owner) creates a new account, they enter basic information, including the store name, location, representative name, and contact information. The server receives this information and stores it in a database. Once a new account is created, the server sends a confirmation email to the user.

[0040] Example: When a user enters the store name "ABC Cafe," location "Tokyo," representative name "Yamada Taro," and contact information "123-4567" into an online form and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[0041] Receiving form input

[0042] Users enter their desired support needs or concerns into an online form. For example, options such as issuing coupons, issuing stamp cards, or signing up for a light plan are displayed. Users can check these options or enter details in the text boxes.

[0043] Example: The user checks "Issue Coupon" and enters the text "10% discount rate." The device sends this to the server.

[0044] Data transmission and processing

[0045] The terminal sends the data entered by the user to the server, which receives the data, stores it in a database, and prepares it for further processing.

[0046] Example: The server receives the information "Coupon issued, 10% discount rate" and records it in the database.

[0047] Preparation of support content

[0048] The server automatically generates appropriate support materials based on the received data, including coupon templates and stamp card design materials, and organizes the generated materials so that support can be provided at the time specified by the user.

[0049] Example: The server generates a template for a "10% discount coupon" and also provides explanatory material about it.

[0050] Real-time support with AI

[0051] The server connects the user to the AI ​​via an online conference system at a time specified by the user. The AI ​​communicates with the user via video and audio, providing support based on pre-prepared materials.

[0052] Example: At the time specified by the user, the server starts a Zoom meeting, and the AI ​​provides a detailed explanation in response to the question, "How can we use the coupon service to increase sales?"

[0053] Providing data to verify effectiveness

[0054] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials and translates them into the user's preferred language. These materials can be accessed from a dedicated download page.

[0055] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as specified by the user, and provides a download link from a dedicated portal.

[0056] Paid service information and support

[0057] If a user shows interest in a new paid service, the server will use AI to explain the details of the service, guide them on how to install it, and also support them in the contract process.

[0058] Example: When a user sends a request saying, "I'd like to know about the new paid plan," the server schedules a detailed briefing session with AI and then sends the contract documents.

[0059] The present invention allows the construction of a system that can provide multilingual support 24 hours a day, enabling the various needs of member stores to be met promptly and effectively.

[0060] The processing flow will be explained below.

[0061] Step 1: Create a new account

[0062] To create a new account, a user enters basic information such as the store name, location, representative name, and contact information into the online form and presses the submit button. The terminal sends the entered data to the server, which stores the received data in a database and sends a confirmation email to the user.

[0063] Step 2: Enter your support request

[0064] The user accesses the provided online form and selects the support they want (coupon issuance, stamp card issuance, light plan contract, etc.). For example, the user checks "coupon issuance" and enters "10% discount rate." The terminal sends this data to the server.

[0065] Step 3: Save your data

[0066] The server receives the support request and detailed information sent from the device and stores it in a database. Based on this data, it prepares for the next processing step.

[0067] Step 4: Generate supporting materials

[0068] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" and related explanatory materials. The generated materials are organized so that support can be provided at the time specified by the user.

[0069] Step 5: Preparing for real-time support

[0070] The user receives a link to access the online conference system at a pre-specified time. The server then launches the online conference system (e.g., Zoom) at the specified time and prepares to connect the AI ​​with the user.

[0071] Step 6: Real-time support with AI

[0072] The server starts an online meeting at the specified time and connects the AI ​​with the user. The AI ​​interacts with the user via video and audio, providing detailed support based on pre-generated support materials. For example, it provides an explanation in response to a question such as, "How can we use coupon services to increase sales?"

[0073] Step 7: Create materials to verify effectiveness

[0074] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[0075] Step 8: Provide data to verify effectiveness

[0076] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials. For example, a "Coupon Campaign Effectiveness Report" can be made available for download in both Japanese and English.

[0077] Step 9: Paid service information

[0078] The server uses AI to provide users with information about new paid services. If the user shows interest in a paid plan, the AI ​​will provide a detailed explanation and instructions on how to install it, and will also assist with the necessary contract procedures.

[0079] The above steps will realize an AI support system that can provide multilingual support 24 hours a day, allowing it to respond quickly and effectively to the diverse needs of member stores.

[0080] Example 1

[0081] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0082] Currently, many affiliated stores struggle with providing 24-hour multilingual support, requiring fast and efficient support. However, current systems make it difficult to provide real-time support or generate effective support materials, making it particularly difficult to respond quickly to a wide range of support requests. For this reason, a system is needed to improve the operational efficiency of affiliated stores and enhance the quality of customer service.

[0083] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0084] In this invention, the server includes input means for accepting input from affiliated stores, database means for saving the input data, material generation means for generating support materials based on the saved data, artificial intelligence means for providing support to affiliated stores based on the generated support materials, communication means for connecting with the artificial intelligence in real time at a time specified by the affiliated store, material provision means for generating effectiveness verification materials for coupons and point cards and making them available for download, selection means for selecting the type of support desired, schedule means for organizing the support materials at a set time, and analysis means for answering user questions. This enables multilingual support 24 hours a day, making it possible to respond quickly and effectively to the diverse needs of affiliated stores.

[0085] "Input means" refers to a means for accepting input data from affiliated stores.

[0086] The "database means" is a means for saving and managing input data.

[0087] The "material generation means" is a means for automatically generating support materials based on the stored data.

[0088] "Artificial intelligence means" means means for providing real-time assistance to merchants based on the generated support materials.

[0089] "Communication means" refers to the means by which a member store can connect with artificial intelligence in real time at a time specified by the member store.

[0090] The "material providing means" is a means for generating effectiveness verification materials such as coupons and point cards and making them available for download.

[0091] The "selection means" is a means for the user to select the type of support they would like to receive.

[0092] The "scheduling means" is a means for organizing and providing the generated support materials at a set time.

[0093] "Analysis means" is a means for deriving appropriate answers to user questions and requests.

[0094] This invention is a system that supports member stores in efficiently using specific services, and provides 24-hour, multilingual artificial intelligence (AI) support. The system is configured as follows:

[0095] System Configuration

[0096] 1. Input Method

[0097] When a user (a franchisee owner) creates a new account, he or she inputs basic information through input means. The basic information includes the store name, location, representative name, contact information, etc. The information received through the input means is sent to the server.

[0098] 2. Database Means

[0099] The server receives the basic information sent from the input means and stores the information in a database using the database means. The database centrally manages the basic information and history data of each member store.

[0100] 3. Material generation means

[0101] The server includes a material generation unit for automatically generating supporting materials based on the data stored in the database, such as coupon templates and point card design materials.

[0102] 4. Artificial Intelligence Means

[0103] The server uses artificial intelligence (AI) to provide support to merchants based on the generated support materials. AI uses machine learning models (e.g., generative AI models) to generate optimal answers to user questions.

[0104] 5. Means of communication

[0105] The server is equipped with a communication method that allows the merchant to connect with the AI ​​in real time at a time designated by the merchant, such as a video conferencing system like Zoom.

[0106] 6. Means of providing materials

[0107] The server automatically generates and provides downloadable materials for verifying the effectiveness of coupons and point card campaigns after they have ended. The materials are translated into multiple languages ​​and uploaded to a dedicated download page accessible to users.

[0108] 7. Selection Method

[0109] Users use a selection method to select the type of support they would like to receive. For example, an online form displays options such as "Coupon issue," "Point card issue," and "Light plan contract," and the user can select the option they want.

[0110] 8. Scheduling Tools

[0111] The server is provided with a scheduling means for organizing the generated support materials at a set time, thereby enabling support to be provided with appropriate materials at a user-specified time.

[0112] 9. Analysis methods

[0113] The server has an analysis means for deriving appropriate answers to the user's questions. This analysis means analyzes the received data and provides the most appropriate answers and support materials.

[0114] Specific examples

[0115] When a user enters the store name "XYZ Cafe," location "Osaka Prefecture," representative name "Ichiro Tanaka," and contact information "987-6543" into the online form and presses the send button, the server receives this information and stores it in a database. The server then sends a confirmation email to the user. Similarly, if the user checks "Issue Coupon" and enters a discount rate of "5%," the device sends this information to the server. Based on the received data, the server generates a "5% Discount Coupon" template and organizes it using a scheduling tool along with explanatory materials. At the specified time, the server starts a Zoom meeting via communication means, and AI provides real-time support to the user.

[0116] In this way, the system is capable of providing multilingual support 24 hours a day, enabling it to quickly and effectively respond to the diverse needs of member stores.

[0117] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0118] Step 1:

[0119] A user accesses the system's login page and selects to create a new account. They enter the store name, address, representative name, and contact information in the online form and click the submit button.

[0120] Input: Store name, address, representative name, contact information

[0121] Output: Send to server

[0122] Specific operation: The server receives this information, stores it in the database, and simultaneously sends a confirmation email to the user's email address.

[0123] Step 2:

[0124] The user clicks on the link in the confirmation email to verify their email address.

[0125] Input: Click on the link in the confirmation email

[0126] Output: Account Activation

[0127] What happens: The server detects that the link was clicked and validates the user's email address. The user can then log in to the system.

[0128] Step 3:

[0129] The user logs in to the system and accesses the support request form.

[0130] Check the desired option from the options such as coupon issuance, stamp card issuance, etc., and enter detailed information in the text box.

[0131] Input: Select the support you want and enter detailed information

[0132] Output: From the terminal to the server

[0133] Specific operation: The terminal sends this information to the server, which stores the received information in a database.

[0134] Step 4:

[0135] The server automatically generates supporting materials based on the received data using a material generation means, for example, generating coupon templates and stamp card design materials.

[0136] Input: Support request stored in the database

[0137] Output: Generated coupon or design document

[0138] Specific operation: The server generates a template based on the coupon's discount rate and conditions, and creates corresponding explanatory materials.

[0139] Step 5:

[0140] The server organizes the generated support materials using a scheduling means and sets them up so that they can be provided at a time designated by the user.

[0141] Input: Generated support materials, user-specified time

[0142] Output: Scheduled material delivery

[0143] Specific operation: The server sets a schedule and makes the necessary preparations to distribute the material at the specified time.

[0144] Step 6:

[0145] The server connects the AI ​​and the user at the designated time through a communication method, such as a video conferencing system like Zoom.

[0146] Input: A specified time, a user connection request

[0147] Output: Real-time connection between user and AI

[0148] Specific operation: The server starts a Zoom meeting, and the AI ​​communicates with the user via video and audio. The AI ​​provides support based on pre-prepared materials.

[0149] Step 7:

[0150] The AI ​​uses analytical tools to provide answers to user questions and requests, and shares the screen if necessary.

[0151] Input: User question or request

[0152] Output: Optimized answer or support

[0153] Specific operation: The AI ​​analyzes the received data and derives appropriate answers. It also provides specific explanations while sharing materials on the screen.

[0154] Step 8:

[0155] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials, translates them into the desired language, and makes them accessible from a dedicated download page.

[0156] Input: Campaign result data

[0157] Output: Effectiveness verification materials, download link

[0158] Specific operation: The server retrieves the campaign results from the database and analyzes specific indicators (number of users, sales increase rate, etc.). It then generates effectiveness verification documents translated into Japanese and English and uploads them to a dedicated portal.

[0159] Step 9:

[0160] If a user shows interest in a new paid service, the server will provide details, guide them through the installation process, and assist with the contract process.

[0161] Input: User request

[0162] Output: Paid plan details, contract documents

[0163] Specific operation: The server receives a request from the user, schedules a detailed explanation session for the paid plan, and then sends the contract documents and assists in the contract procedure.

[0164] This enables the system to provide multilingual support 24 hours a day, enabling it to respond quickly and effectively to the diverse needs of member stores.

[0165] (Application example 1)

[0166] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0167] Conventional systems make it difficult for affiliated stores to efficiently carry out marketing activities, and do not adequately support multiple languages. As a result, real-time support and the provision of effectiveness verification materials tend to be delayed, and there are problems with the quality of customer support declining due to time and language constraints. The present invention aims to solve these problems and provide a system that allows affiliated stores to efficiently carry out various marketing activities and receive support in multiple languages.

[0168] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0169] In this invention, the server includes input means for accepting input from affiliated stores, database means for saving the input data, material generation means for generating support materials based on the saved data, AI means for providing support to affiliated stores based on the generated support materials, communication means for connecting with the AI ​​in real time at a time specified by the affiliated store, material provision means for generating effectiveness verification materials for coupons and stamp cards and making them available for download, multilingual support means for providing support for effectively conducting marketing activities based on the generated support materials, and translation means for translating the effectiveness verification materials into a desired language. This allows affiliated stores to receive efficient multilingual support and conduct high-quality marketing activities in real time.

[0170] "Input means" refers to devices and software for accepting input from affiliated stores.

[0171] "Database means" refers to a system for storing and managing input data.

[0172] The "material generation means" is a function that automatically creates the necessary supporting materials based on the stored data.

[0173] "AI means" refers to artificial intelligence that provides support to affiliated stores based on the generated support materials.

[0174] "Communication means" refers to the communication technology and systems that enable member stores to connect with AI in real time at the time they specify.

[0175] "Material provision means" refers to a system that generates materials for verifying the effectiveness of coupons and stamp cards and makes them available for member stores to download.

[0176] "Multilingual support means" refers to a function that provides support for effectively conducting marketing activities in multiple languages ​​based on generated support materials.

[0177] "Translation means" refers to a device or software that automatically translates the effectiveness verification materials into the desired language.

[0178] This invention is a system that provides 24-hour, multilingual AI support to affiliated stores. This system consists of the following main components:

[0179] 1. Input method for accepting input from affiliated stores

[0180] The server provides an input method for accepting data entered by franchise owners, including basic information such as store name, address, representative name, contact details, etc. This data is entered using a web form or a smartphone application.

[0181] Examples:

[0182] When a user enters the store name "Cafe ABC," location "Tokyo," representative name "Yamada Taro," and contact information "123-4567" into the online form and presses the submit button, the server receives this information, registers it in the database, and sends a confirmation email.

[0183] 2. Database Means

[0184] The server has a database to store and manage the input data. SQLAlchemy is used to store the data in the SQL database.

[0185] 3. Material generation means

[0186] The server automatically generates marketing support materials such as coupons and stamp cards based on the stored data, allowing affiliated stores to easily obtain effective marketing tools.

[0187] Examples:

[0188] The server generates a template for a "10% off coupon" and also provides specific explanatory material about it.

[0189] 4. AI means

[0190] The AI ​​method provides real-time multilingual support to merchants based on the generated support materials, and is implemented using a generative AI model.

[0191] 5. Means of communication

[0192] The communication method is a technology or system that allows the affiliated store to connect with the AI ​​in real time at a time specified by the affiliated store, and the connection is made via a video conferencing system (e.g., Zoom).

[0193] Examples:

[0194] At the time specified by the user, the server will start a Zoom meeting, and the AI ​​will provide a detailed explanation in response to the question, "How can we use the coupon service to increase sales?"

[0195] 6. Means of providing materials

[0196] The server automatically generates campaign effectiveness verification materials, translates them into the desired language, and makes them accessible from a dedicated download page.

[0197] Examples:

[0198] The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as specified by the user, and provides a download link from a dedicated portal.

[0199] 7. Multilingual support and translation methods

[0200] The server provides multilingual support to ensure effective marketing activities based on the generated support materials, and also has the function to automatically translate the effectiveness verification materials into the desired language.

[0201] Example prompt sentence:

[0202] "The owner of Cafe ABC would like to issue a coupon (10% discount). Please prepare supporting materials and explain them during a Zoom meeting at the specified time. After the meeting, please generate effectiveness verification materials in Japanese and English and make them accessible from the download page."

[0203] This system allows affiliated stores to receive efficient multilingual support and conduct high-quality marketing activities in real time.

[0204] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0205] Step 1:

[0206] A user enters basic information into an online form.

[0207] Specifically, enter the store name, address, representative name, contact information, etc., and press the send button. At this time, the entered information is sent from the terminal to the server.

[0208] Input: Basic information such as store name, address, representative name, contact information, etc.

[0209] Output: Basic information data sent to the server

[0210] Step 2:

[0211] The server saves the received basic information data to the database. At this time, it stores the data in the SQL database using SQLAlchemy. After the information is saved correctly, it sends a confirmation email.

[0212] Input: Basic information data

[0213] Output: Information stored in database, confirmation email sent

[0214] Step 3:

[0215] The user enters the support request (coupon issuance, stamp card issuance, etc.) into the online form. Specifically, the user selects and fills in the desired content and details, and presses the send button. This data is sent from the terminal to the server.

[0216] Input: Support request and details

[0217] Output: Support request data sent to the server

[0218] Step 4:

[0219] The server stores the received support request data in a database. It then generates support materials based on the stored data. Specifically, it automatically generates coupons and stamp cards using templates.

[0220] Input: Support request data

[0221] Output: Generated supporting materials

[0222] Step 5:

[0223] At the time specified by the user, the server connects the AI ​​and the user using a communication method. Specifically, the connection is made in real time using a video conferencing system (e.g., Zoom). The AI ​​provides support to the affiliated store in real time based on the generated support materials.

[0224] Input: Connection time, generated support materials

[0225] Output: Real-time AI support

[0226] Step 6:

[0227] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials. It also translates them into the desired language and makes them accessible from a dedicated download page. Specifically, the server uses a generative AI model to automatically generate effectiveness verification materials in multiple languages.

[0228] Input: Campaign result data, desired language

[0229] Output: Multilingual support effectiveness verification materials

[0230] Step 7:

[0231] The server uploads the generated effectiveness verification materials to a dedicated portal for member stores to download. Users can download the necessary materials from the dedicated portal.

[0232] Input: Multilingual support effectiveness verification materials

[0233] Output: Download link, downloaded verification data

[0234] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0235] This invention is a system that helps member stores use services efficiently, and is available 24 hours a day in multiple languages, and provides AI support including an emotion engine that recognizes user emotions. This system receives input data from member stores, generates necessary support materials based on that data, provides support in real time through AI, and recognizes user emotions to respond and make appropriate suggestions.

[0236] Program processing explanation

[0237] Initial Setup

[0238] When a user (a member store owner) creates a new account, they enter basic information such as the store name, location, representative name, and contact details into an online form and press the submit button. The server stores the received data in a database and sends a confirmation email to the user.

[0239] Example: When a user fills out an online form with "XYZ Cafe," its location "Osaka Prefecture," its representative's name "Ichiro Sato," and contact information "080-1234-5678," and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[0240] Enter your support request

[0241] The user accesses the provided online form, selects the desired support content (e.g., coupon issuance, stamp card issuance, light plan contract), and enters the necessary details. For example, if "coupon issuance" is selected, the user enters "10% discount rate."

[0242] Example: When a user checks "Issue coupon" and enters the text "10% discount rate," the terminal sends this to the server.

[0243] Data transmission and processing

[0244] The terminal sends the data entered by the user to the server, which receives the data and stores it in a database.

[0245] Example: The server receives the information "Coupon issued, 10% discount" and records it in the database.

[0246] Generate supporting materials

[0247] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" and related explanatory materials. The generated materials are organized so that support can be provided at the time specified by the user.

[0248] Example: The server generates a template for a "10% off coupon" and provides explanatory materials about it.

[0249] Real-time support with emotion engine

[0250] The server connects the user to the AI ​​via an online conference system at a time specified by the user. The AI ​​communicates with the user via video and audio, providing support based on pre-prepared materials. In addition, the emotion engine identifies emotions from the user's facial expressions and voice, and adjusts responses and suggestions accordingly.

[0251] Example: At the time specified by the user, the server starts a Zoom meeting, and the AI ​​explains how to use the coupon service to increase sales. The emotion engine analyzes the user's tone of voice and facial expressions, detects excitement or anxiety, and makes appropriate suggestions accordingly.

[0252] Creation of effectiveness verification materials

[0253] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[0254] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into Japanese and English as desired by the user, and makes it available for download from a dedicated portal.

[0255] Providing data to verify effectiveness

[0256] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[0257] Example: A user downloads a "Coupon Campaign Effectiveness Report" in Japanese and English.

[0258] Paid service information

[0259] The server uses AI to provide users with information about new paid services, providing detailed explanations and instructions on how to install them, and assisting with contract procedures if necessary.

[0260] Example: When a user sends a request to "learn about new paid plans," the server schedules a detailed briefing session with AI and then sends the contract documents.

[0261] The system of this invention provides 24-hour, multilingual AI support, and by recognizing user emotions and adjusting responses accordingly, it is possible to quickly and effectively respond to the diverse needs of member stores.

[0262] The processing flow will be explained below.

[0263] Step 1: Create a new account

[0264] To create a new account, a user enters basic information such as the store name, location, representative name, and contact information into the online form and presses the submit button. The terminal sends the entered data to the server, which stores the received data in a database and sends a confirmation email to the user.

[0265] Example: When a user fills out an online form with "XYZ Cafe," its location "Osaka Prefecture," its representative's name "Ichiro Sato," and contact information "080-1234-5678," and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[0266] Step 2: Enter your support request

[0267] The user accesses the provided online form, selects the desired support content (e.g., coupon issuance, stamp card issuance, light plan contract), and enters the necessary details. For example, if "coupon issuance" is selected, the user enters "10% discount rate."

[0268] Example: When a user checks "Issue coupon" and enters the text "10% discount rate," the terminal sends this to the server.

[0269] Step 3: Send and process data

[0270] The terminal sends the data entered by the user to the server, which receives the data and stores it in a database.

[0271] Example: The server receives the information "Coupon issued, 10% discount" and records it in the database.

[0272] Step 4: Generate supporting materials

[0273] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" or design materials for a stamp card. The generated materials are organized so that support can be provided at the time specified by the user.

[0274] Example: The server generates a template for a "10% off coupon" and also provides explanatory material about it.

[0275] Step 5: Preparing for real-time support

[0276] The user receives a link to access the online conference system at a pre-specified time. The server then launches the online conference system (e.g., Zoom) at the specified time and prepares to connect the user with the AI.

[0277] Example: The server sends a Zoom meeting invitation link to the user at the time specified by the user.

[0278] Step 6: Real-time support with AI

[0279] The server starts an online meeting at the specified time and connects the AI ​​with the user. The AI ​​interacts with the user via video and audio, providing detailed support based on pre-generated support materials. The emotion engine also identifies emotions from the user's facial expressions and voice, and adjusts responses and suggestions accordingly.

[0280] Example: When a user joins a Zoom meeting, the server connects with the user via AI, which then provides detailed explanations in response to questions such as, "How can we use coupon services to increase sales?" The emotion engine analyzes the user's tone of voice and facial expressions, detects excitement or anxiety, and makes appropriate suggestions accordingly.

[0281] Step 7: Create materials to verify effectiveness

[0282] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[0283] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as desired by the user, and provides a download link from a dedicated portal.

[0284] Step 8: Provide data to verify effectiveness

[0285] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[0286] Example: A user downloads a "Coupon Campaign Effectiveness Report" in Japanese and English.

[0287] Step 9: Paid service information

[0288] The server uses AI to provide users with information about new paid services, providing detailed explanations and instructions on how to install them, and assisting with contract procedures if necessary.

[0289] Example: When a user sends a request to "learn about new paid plans," the server schedules a detailed briefing session with AI and then sends the contract documents.

[0290] Through these steps, an AI support system that can provide multilingual support 24 hours a day will be realized, and by recognizing user emotions and adjusting responses accordingly, it will be able to quickly and effectively respond to the diverse needs of affiliated stores.

[0291] Example 2

[0292] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0293] With the previous system, it was difficult for affiliated stores to receive multilingual support 24 hours a day. It was also unable to recognize user emotions and provide appropriate responses and suggestions in real time, which could result in a decline in the quality of support. Furthermore, the creation of documents to verify the effectiveness of coupons and stamp cards was not automated, which was a time-consuming process.

[0294] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for accepting input from affiliated stores, a database means for saving the input data, a material generation means for generating support materials based on the saved data, an AI means for providing support to affiliated stores based on the generated support materials, a communication means for connecting with the AI ​​in real time at a time specified by the affiliated store, a material provision means for generating and downloading coupon and stamp card effectiveness verification materials, and an emotion recognition means for identifying the user's emotions and adjusting responses and suggestions. This enables high-quality support in multiple languages ​​around the clock, allowing appropriate responses and suggestions to be made based on the user's emotions. Furthermore, it enables automatic generation of coupon and stamp card effectiveness verification materials, enabling more effective support to be provided.

[0295] "Affiliate" refers to a company or individual business that provides a specific service or product.

[0296] "Input means" refers to an interface through which a user inputs information into a system.

[0297] "Database means" refers to a system or software for storing and managing input information.

[0298] "Material generation means" refers to a system or software that automatically generates the necessary support materials based on stored data.

[0299] "AI means" refers to a system that uses artificial intelligence technology to provide automated support.

[0300] "Communication means" refers to the interface or network for sending and receiving information and data between the system and the user in real time.

[0301] "Material provision means" refers to a system or software that generates materials for verifying the effectiveness of coupons or stamp cards and provides them to users in a downloadable format.

[0302] "Emotion recognition means" refers to a system or software that identifies emotions from a user's facial expressions and voice and adjusts responses and suggestions accordingly.

[0303] This invention is a system that supports member stores in efficiently using their services. This system provides 24-hour, multilingual support, and is characterized by its ability to recognize users' emotions and provide appropriate responses and suggestions. Specific embodiments are described below.

[0304] 1. The user accesses the system, opens the new account creation page, enters basic information such as the store name, location, representative name, and contact information into the online form, and presses the submit button. For example, a user enters "Cafe ABC," location "Tokyo," representative name "Taro Tanaka," and contact information "090-1234-5678" into the online form and presses the submit button.

[0305] 2. The device receives the entered information and sends it to the server as an HTTP POST request. The server verifies the received data and saves it in the database. After saving is complete, the server sends a confirmation email to the user.

[0306] 3. The user accesses the support request entry form, selects the support they want (e.g., coupon issuance, stamp card issuance, etc.), and enters the necessary details. For example, they select "coupon issuance" and enter "10% discount rate." The terminal sends this information to the server.

[0307] 4. The server stores the received data in a database and automatically generates the necessary support materials based on the stored data. For example, it generates a template and explanatory materials for a "10% discount coupon." The generated materials are organized so that support can be provided at the time specified by the user.

[0308] 5. At the time specified by the user, the server connects the AI ​​to the user via a video conferencing system. For example, it can send a Zoom link and connect the AI ​​to the user at the specified time. The AI ​​provides support based on pre-prepared materials and identifies emotions from the user's facial expressions and voice to provide appropriate responses and suggestions.

[0309] 6. Once the coupon or stamp card campaign has ended, the server collects data for effectiveness verification and automatically generates effectiveness verification materials. These materials are translated into the user's preferred language and provided in a downloadable format. Users can access the effectiveness verification materials from a dedicated download page and download the materials they need. For example, they can download a "Coupon Campaign Effectiveness Report" in both Japanese and English.

[0310] The system provides 24-hour, multilingual AI support, and by identifying user emotions and responding appropriately, it can quickly and effectively meet the diverse needs of affiliated stores. Furthermore, it can provide effective support by automatically generating materials to verify the effectiveness of coupons and stamp cards.

[0311] Example prompt sentence:

[0312] To create a new account, please enter your store name, address, representative name, and contact information.

[0313] "Select the support you would like and enter details, such as the discount rate."

[0314] "Please join the online support meeting at the specified time. We will also be conducting a sentiment analysis, so please relax and enjoy the meeting."

[0315] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0316] Step 1:

[0317] The user accesses the system, opens the new account creation page, and enters basic information such as the store name, location, representative name, contact information, etc. into the online form. The entered data is captured by the terminal as HTML form data.

[0318] Input: "Store name", "Address", "Representative name", "Contact information"

[0319] Output: The device generates an HTTP POST request and sends the input data to the server.

[0320] Specific operation: The user enters "Cafe ABC", location "Tokyo", representative name "Taro Tanaka", contact information "090-1234-5678", and presses the send button.

[0321] Step 2:

[0322] The server parses the received HTTP POST request and validates the data to prepare it for storage in the database. After the validation is complete, the server saves the information in the database and sends a confirmation email to the user.

[0323] Input: User information received from the device

[0324] Output: User information stored in the database and a confirmation email sent to the user.

[0325] What happens: The server saves the user information in a database and sends a confirmation email to the user's email address.

[0326] Step 3:

[0327] The user accesses the support request input form, selects the support type they want, and enters detailed information. The device captures this information and sends it to the server as an HTTP POST request.

[0328] Input: "Support details", "Detailed information"

[0329] Output: The device generates an HTTP POST request and sends the input data to the server.

[0330] Specific operation: The user selects "Issue coupon", enters "10% discount rate", and presses the submit button.

[0331] Step 4:

[0332] The server stores the received data in a database and automatically generates the necessary support materials based on the stored data. For example, it creates a template for a "10% discount coupon" and its explanatory materials.

[0333] Input: Support request received from device

[0334] Output: Supporting materials (e.g., "10% off coupon" template and explanatory materials)

[0335] Specific operation: The server generates and saves a "10% discount coupon" template and related explanatory materials.

[0336] Step 5:

[0337] At the time specified by the user, the server connects the user to the AI ​​via a video conferencing system. The AI ​​provides support to the user based on pre-prepared materials and adjusts its responses and suggestions based on the user's facial expressions and voice.

[0338] Input: User-specified time, URL of video conferencing system

[0339] Output: AI-user connection and support provided

[0340] How it works: The server generates a Zoom meeting link and connects the user with the AI ​​at the specified time. The AI ​​explains how to use the coupon service, and the emotion engine identifies the user's emotions and makes appropriate suggestions.

[0341] Step 6:

[0342] Once the coupon or stamp card campaign has ended, the server collects data for effectiveness verification and automatically generates effectiveness verification materials, which are translated into the user's preferred language and made available in a downloadable format.

[0343] Input: Campaign usage data

[0344] Output: Effectiveness verification document (translated)

[0345] Specific operation: The server generates a "Coupon Campaign Effectiveness Report," translates it into Japanese and English, and provides it to the user.

[0346] Step 7:

[0347] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[0348] Input: User download request

[0349] Output: Downloadable effectiveness verification materials

[0350] Specific operation: The user downloads the "Coupon Campaign Effectiveness Report" from the system's download page.

[0351] Step 8:

[0352] The server will provide information about new paid services, set up an AI session to provide detailed explanations and instructions on how to implement them, and assist with the contract process if necessary.

[0353] Input: User request

[0354] Output: AI-generated detailed explanation and contract documents

[0355] Specific operation: The server schedules an AI briefing based on the user request and then sends the contract documents.

[0356] In this way, this system helps member stores use its services efficiently, is available 24 hours a day, supports multiple languages, and can recognize users' emotions to provide appropriate responses and suggestions.

[0357] (Application example 2)

[0358] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0359] Recently, many stores have been facing challenges in providing multilingual services and customer support. With the increasing number of foreign tourists, it has become increasingly difficult for employees to provide multilingual support, creating a need to improve customer satisfaction. Understanding customer sentiment and providing appropriate responses is also important, but implementing this in real time requires advanced technology. Furthermore, properly analyzing the effectiveness of coupons and promotions and implementing promotional activities tailored to each customer has become an essential element of store management. A system that can effectively resolve these issues is needed.

[0360] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes emotion recognition means, multilingual support means, and material provision means. This enables real-time support in multiple languages ​​and responses based on customer emotions. In addition, by automatically generating materials to verify the effectiveness of coupons and stamp cards and making the analysis results available for download, the efficiency of store operations and customer satisfaction are improved.

[0361] "Input means" refers to the devices and software used to accept data input from affiliated stores.

[0362] "Database means" refers to a system for saving input data and keeping it available for reference.

[0363] "Materials generation means" means the process or software for automatically generating the necessary supporting materials based on the stored data.

[0364] "AI means" refers to devices or systems that use artificial intelligence to provide appropriate support to affiliated stores based on the generated support materials.

[0365] "Communication means" refers to the network or device that allows the affiliated store to connect with the AI ​​in real time at the time specified by the affiliated store.

[0366] "Material provision means" refers to the process or system for generating materials for verifying the effectiveness of coupons and stamp cards and making them available for download.

[0367] "Emotion recognition means" refers to technology or software that recognizes emotions from customers' facial expressions, voice, etc., and adjusts responses and suggestions based on that information.

[0368] "Multilingual support means" refers to technologies and systems for generating multilingual content and responding appropriately to customers.

[0369] This invention provides a customer support system for brick-and-mortar stores that supports multiple languages ​​and has emotion recognition capabilities. The following describes the procedure and specific configuration for building this system.

[0370] First, this system includes "input means," "database means," "document generation means," "AI means," "communication means," "document provision means," "emotion recognition means," and "multilingual support means." Each of these means will be explained below.

[0371] 1. Input method:

[0372] Store staff, who are users, use smartphones or smart glasses to input data necessary for customer service, including customer questions, requests, images, and videos.

[0373] 2. Database means:

[0374] The server receives the entered data and stores it in a database, which contains customer details and transaction history.

[0375] 3. Material generation means:

[0376] The server automatically generates supporting materials such as coupons and stamp cards based on the stored data.

[0377] 4. AI means:

[0378] Based on the generated materials, AI provides appropriate support to users. AI utilizes generative AI models to make optimal proposals to individual customers.

[0379] 5. Means of communication:

[0380] The server connects to the AI ​​in real time via an online conference system (e.g., Zoom, Microsoft Teams) at a time designated by the store staff, enabling real-time support.

[0381] 6. Material provision method:

[0382] The server analyzes the effectiveness of coupon and stamp card campaigns, generates effectiveness verification materials based on the analysis results, and provides them in a downloadable format.

[0383] 7. Emotion recognition means:

[0384] The server uses emotion analysis software (e.g., Azure Face API, Google Cloud Vision API) to recognize emotions from the customer's facial expressions and voice, and adjusts the response appropriately.

[0385] 8. Multilingual support means:

[0386] The server uses the Google Translate API or similar to generate multilingual content and respond to the customer.

[0387] For example, if a foreign tourist visiting a physical store asks in English, "Please tell me more about this product," the system works as follows: First, a store staff member inputs the customer's video and audio through smart glasses and sends them to the server. Based on this video and audio, the server uses the emotion recognition means to analyze the customer's emotions. At the same time, the multilingual support means analyzes the English question and generates an appropriate response. The AI ​​means then uses the generated AI model to provide the customer with the most appropriate product information and related benefits. Specific examples of prompt sentences include:

[0388] “Given the customer's query: 'Can you tell me more about this product?' and the detected emotion: 'interest', generate a detailed response in English that includes related product suggestions and a special discount offer.”

[0389] In this way, a system that combines a server and various means can effectively provide customer support in physical stores through multilingual support and emotion recognition.

[0390] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0391] Step 1:

[0392] The store staff, who are the users, use the smart glasses to input customer questions and requests. The terminal captures images and videos of the customer and also accepts voice input. This input data includes the customer's questions, images, and voice data.

[0393] Step 2:

[0394] The terminal transmits the acquired data to the server. The server receives this data and stores it in a database. Specifically, the database stores the customer's question, video data, and audio data.

[0395] Step 3:

[0396] The server analyzes emotions using emotion recognition techniques based on the data stored in the database. For example, it uses Azure Face API or Google Cloud Vision API to read emotions from the customer's facial expressions. This process outputs emotional data such as whether the customer is interested or anxious.

[0397] Step 4:

[0398] The server analyzes the customer's question using multilingual support. Using a Google Translate API or similar, it converts the input language (e.g., English) into Japanese and generates an appropriate response. The response is created using a generative AI model, and answer data in text format is generated.

[0399] Step 5:

[0400] The server combines the generated response data with the emotion data to generate optimal suggestions. Using a generative AI model, it provides appropriate product information and special offers based on the prompt. The following prompts are used in this step:

[0401] “Given the customer's query: 'Can you tell me more about this product?' and the detected emotion: 'interest', generate a detailed response in English that includes related product suggestions and a special discount offer.”

[0402] Step 6:

[0403] The server sends the generated suggestions and response data to the terminal, which then displays this data to the store staff member who is the user. The staff member then responds appropriately to the customer through the smart glasses.

[0404] Step 7:

[0405] After the interaction with the customer is completed, the server analyzes the effectiveness of the coupons and promotions. The server generates effectiveness verification materials using the material generation means and provides them in a downloadable format through the material provision means. The materials include campaign results and customer feedback.

[0406] In this way, customer support is provided across the entire system, improving customer satisfaction and streamlining store operations.

[0407] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0408] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0409] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0410] [Second embodiment]

[0411] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0412] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0413] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0414] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0415] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0416] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0417] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0418] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0419] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0420] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0421] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0422] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0423] This invention is a system that helps merchants efficiently use specific services, and provides 24-hour, multilingual AI support. This system receives input data from merchants, generates necessary support materials based on that data, and provides real-time support through AI.

[0424] Program processing explanation

[0425] Initial Setup

[0426] When a user (a franchisee owner) creates a new account, they enter basic information, including the store name, location, representative name, and contact information. The server receives this information and stores it in a database. Once a new account is created, the server sends a confirmation email to the user.

[0427] Example: When a user enters the store name "ABC Cafe," location "Tokyo," representative name "Yamada Taro," and contact information "123-4567" into an online form and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[0428] Receiving form input

[0429] Users enter their desired support needs or concerns into an online form. For example, options such as issuing coupons, issuing stamp cards, or signing up for a light plan are displayed. Users can check these options or enter details in the text boxes.

[0430] Example: The user checks "Issue Coupon" and enters the text "10% discount rate." The device sends this to the server.

[0431] Data transmission and processing

[0432] The terminal sends the data entered by the user to the server, which receives the data, stores it in a database, and prepares it for further processing.

[0433] Example: The server receives the information "Coupon issued, 10% discount rate" and records it in the database.

[0434] Preparation of support content

[0435] The server automatically generates appropriate support materials based on the received data, including coupon templates and stamp card design materials, and organizes the generated materials so that support can be provided at the time specified by the user.

[0436] Example: The server generates a template for a "10% discount coupon" and also provides explanatory material about it.

[0437] Real-time support with AI

[0438] The server connects the user to the AI ​​via an online conference system at a time specified by the user. The AI ​​communicates with the user via video and audio, providing support based on pre-prepared materials.

[0439] Example: At the time specified by the user, the server starts a Zoom meeting, and the AI ​​provides a detailed explanation in response to the question, "How can we use the coupon service to increase sales?"

[0440] Providing data to verify effectiveness

[0441] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials and translates them into the user's preferred language. These materials can be accessed from a dedicated download page.

[0442] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as specified by the user, and provides a download link from a dedicated portal.

[0443] Paid service information and support

[0444] If a user shows interest in a new paid service, the server will use AI to explain the details of the service, guide them on how to install it, and also support them in the contract process.

[0445] Example: When a user sends a request saying, "I'd like to know about the new paid plan," the server schedules a detailed briefing session with AI and then sends the contract documents.

[0446] The present invention allows the construction of a system that can provide multilingual support 24 hours a day, enabling the various needs of member stores to be met promptly and effectively.

[0447] The processing flow will be explained below.

[0448] Step 1: Create a new account

[0449] To create a new account, a user enters basic information such as the store name, location, representative name, and contact information into the online form and presses the submit button. The terminal sends the entered data to the server, which stores the received data in a database and sends a confirmation email to the user.

[0450] Step 2: Enter your support request

[0451] The user accesses the provided online form and selects the support they want (coupon issuance, stamp card issuance, light plan contract, etc.). For example, the user checks "coupon issuance" and enters "10% discount rate." The terminal sends this data to the server.

[0452] Step 3: Save your data

[0453] The server receives the support request and detailed information sent from the device and stores it in a database. Based on this data, it prepares for the next processing step.

[0454] Step 4: Generate supporting materials

[0455] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" and related explanatory materials. The generated materials are organized so that support can be provided at the time specified by the user.

[0456] Step 5: Preparing for real-time support

[0457] The user receives a link to access the online conference system at a pre-specified time. The server then launches the online conference system (e.g., Zoom) at the specified time and prepares to connect the AI ​​with the user.

[0458] Step 6: Real-time support with AI

[0459] The server starts an online meeting at the specified time and connects the AI ​​with the user. The AI ​​interacts with the user via video and audio, providing detailed support based on pre-generated support materials. For example, it provides an explanation in response to a question such as, "How can we use coupon services to increase sales?"

[0460] Step 7: Create materials to verify effectiveness

[0461] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[0462] Step 8: Provide data to verify effectiveness

[0463] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials. For example, a "Coupon Campaign Effectiveness Report" can be made available for download in both Japanese and English.

[0464] Step 9: Paid service information

[0465] The server uses AI to provide users with information about new paid services. If the user shows interest in a paid plan, the AI ​​will provide a detailed explanation and instructions on how to install it, and will also assist with the necessary contract procedures.

[0466] The above steps will realize an AI support system that can provide multilingual support 24 hours a day, allowing it to respond quickly and effectively to the diverse needs of member stores.

[0467] Example 1

[0468] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0469] Currently, many affiliated stores struggle with providing 24-hour multilingual support, requiring fast and efficient support. However, current systems make it difficult to provide real-time support or generate effective support materials, making it particularly difficult to respond quickly to a wide range of support requests. For this reason, a system is needed to improve the operational efficiency of affiliated stores and enhance the quality of customer service.

[0470] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0471] In this invention, the server includes input means for accepting input from affiliated stores, database means for saving the input data, material generation means for generating support materials based on the saved data, artificial intelligence means for providing support to affiliated stores based on the generated support materials, communication means for connecting with the artificial intelligence in real time at a time specified by the affiliated store, material provision means for generating effectiveness verification materials for coupons and point cards and making them available for download, selection means for selecting the type of support desired, schedule means for organizing the support materials at a set time, and analysis means for answering user questions. This enables multilingual support 24 hours a day, making it possible to respond quickly and effectively to the diverse needs of affiliated stores.

[0472] "Input means" refers to a means for accepting input data from affiliated stores.

[0473] The "database means" is a means for saving and managing input data.

[0474] The "material generation means" is a means for automatically generating support materials based on the stored data.

[0475] "Artificial intelligence means" means means for providing real-time assistance to merchants based on the generated support materials.

[0476] "Communication means" refers to the means by which a member store can connect with artificial intelligence in real time at a time specified by the member store.

[0477] The "material providing means" is a means for generating effectiveness verification materials such as coupons and point cards and making them available for download.

[0478] The "selection means" is a means for the user to select the type of support they would like to receive.

[0479] The "scheduling means" is a means for organizing and providing the generated support materials at a set time.

[0480] "Analysis means" is a means for deriving appropriate answers to user questions and requests.

[0481] This invention is a system that supports member stores in efficiently using specific services, and provides 24-hour, multilingual artificial intelligence (AI) support. The system is configured as follows:

[0482] System Configuration

[0483] 1. Input Method

[0484] When a user (a franchisee owner) creates a new account, he or she inputs basic information through input means. The basic information includes the store name, location, representative name, contact information, etc. The information received through the input means is sent to the server.

[0485] 2. Database Means

[0486] The server receives the basic information sent from the input means and stores the information in a database using the database means. The database centrally manages the basic information and history data of each member store.

[0487] 3. Material generation means

[0488] The server includes a material generation unit for automatically generating supporting materials based on the data stored in the database, such as coupon templates and point card design materials.

[0489] 4. Artificial Intelligence Means

[0490] The server uses artificial intelligence (AI) to provide support to merchants based on the generated support materials. AI uses machine learning models (e.g., generative AI models) to generate optimal answers to user questions.

[0491] 5. Means of communication

[0492] The server is equipped with a communication method that allows the merchant to connect with the AI ​​in real time at a time designated by the merchant, such as a video conferencing system like Zoom.

[0493] 6. Means of providing materials

[0494] The server automatically generates and provides downloadable materials for verifying the effectiveness of coupons and point card campaigns after they have ended. The materials are translated into multiple languages ​​and uploaded to a dedicated download page accessible to users.

[0495] 7. Selection Method

[0496] Users use a selection method to select the type of support they would like to receive. For example, an online form displays options such as "Coupon issue," "Point card issue," and "Light plan contract," and the user can select the option they want.

[0497] 8. Scheduling Tools

[0498] The server is provided with a scheduling means for organizing the generated support materials at a set time, thereby enabling support to be provided with appropriate materials at a user-specified time.

[0499] 9. Analysis methods

[0500] The server has an analysis means for deriving appropriate answers to the user's questions. This analysis means analyzes the received data and provides the most appropriate answers and support materials.

[0501] Specific examples

[0502] When a user enters the store name "XYZ Cafe," location "Osaka Prefecture," representative name "Ichiro Tanaka," and contact information "987-6543" into the online form and presses the send button, the server receives this information and stores it in a database. The server then sends a confirmation email to the user. Similarly, if the user checks "Issue Coupon" and enters a discount rate of "5%," the device sends this information to the server. Based on the received data, the server generates a "5% Discount Coupon" template and organizes it using a scheduling tool along with explanatory materials. At the specified time, the server starts a Zoom meeting via communication means, and AI provides real-time support to the user.

[0503] In this way, the system is capable of providing multilingual support 24 hours a day, enabling it to quickly and effectively respond to the diverse needs of member stores.

[0504] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0505] Step 1:

[0506] A user accesses the system's login page and selects to create a new account. They enter the store name, address, representative name, and contact information in the online form and click the submit button.

[0507] Input: Store name, address, representative name, contact information

[0508] Output: Send to server

[0509] Specific operation: The server receives this information, stores it in the database, and simultaneously sends a confirmation email to the user's email address.

[0510] Step 2:

[0511] The user clicks on the link in the confirmation email to verify their email address.

[0512] Input: Click on the link in the confirmation email

[0513] Output: Account Activation

[0514] What happens: The server detects that the link was clicked and validates the user's email address. The user can then log in to the system.

[0515] Step 3:

[0516] The user logs in to the system and accesses the support request form.

[0517] Check the desired option from the options such as coupon issuance, stamp card issuance, etc., and enter detailed information in the text box.

[0518] Input: Select the support you want and enter detailed information

[0519] Output: From the terminal to the server

[0520] Specific operation: The terminal sends this information to the server, which stores the received information in a database.

[0521] Step 4:

[0522] The server automatically generates supporting materials based on the received data using a material generation means, for example, generating coupon templates and stamp card design materials.

[0523] Input: Support request stored in the database

[0524] Output: Generated coupon or design document

[0525] Specific operation: The server generates a template based on the coupon's discount rate and conditions, and creates corresponding explanatory materials.

[0526] Step 5:

[0527] The server organizes the generated support materials using a scheduling means and sets them up so that they can be provided at a time designated by the user.

[0528] Input: Generated support materials, user-specified time

[0529] Output: Scheduled material delivery

[0530] Specific operation: The server sets a schedule and makes the necessary preparations to distribute the material at the specified time.

[0531] Step 6:

[0532] The server connects the AI ​​and the user at the designated time through a communication method, such as a video conferencing system like Zoom.

[0533] Input: A specified time, a user connection request

[0534] Output: Real-time connection between user and AI

[0535] Specific operation: The server starts a Zoom meeting, and the AI ​​communicates with the user via video and audio. The AI ​​provides support based on pre-prepared materials.

[0536] Step 7:

[0537] The AI ​​uses analytical tools to provide answers to user questions and requests, and shares the screen if necessary.

[0538] Input: User question or request

[0539] Output: Optimized answer or support

[0540] Specific operation: The AI ​​analyzes the received data and derives appropriate answers. It also provides specific explanations while sharing materials on the screen.

[0541] Step 8:

[0542] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials, translates them into the desired language, and makes them accessible from a dedicated download page.

[0543] Input: Campaign result data

[0544] Output: Effectiveness verification materials, download link

[0545] Specific operation: The server retrieves the campaign results from the database and analyzes specific indicators (number of users, sales increase rate, etc.). It then generates effectiveness verification documents translated into Japanese and English and uploads them to a dedicated portal.

[0546] Step 9:

[0547] If a user shows interest in a new paid service, the server will provide details, guide them through the installation process, and assist with the contract process.

[0548] Input: User request

[0549] Output: Paid plan details, contract documents

[0550] Specific operation: The server receives a request from the user, schedules a detailed explanation session for the paid plan, and then sends the contract documents and assists in the contract procedure.

[0551] This enables the system to provide multilingual support 24 hours a day, enabling it to respond quickly and effectively to the diverse needs of member stores.

[0552] (Application example 1)

[0553] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0554] Conventional systems make it difficult for affiliated stores to efficiently carry out marketing activities, and do not adequately support multiple languages. As a result, real-time support and the provision of effectiveness verification materials tend to be delayed, and there are problems with the quality of customer support declining due to time and language constraints. The present invention aims to solve these problems and provide a system that allows affiliated stores to efficiently carry out various marketing activities and receive support in multiple languages.

[0555] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0556] In this invention, the server includes input means for accepting input from affiliated stores, database means for saving the input data, material generation means for generating support materials based on the saved data, AI means for providing support to affiliated stores based on the generated support materials, communication means for connecting with the AI ​​in real time at a time specified by the affiliated store, material provision means for generating effectiveness verification materials for coupons and stamp cards and making them available for download, multilingual support means for providing support for effectively conducting marketing activities based on the generated support materials, and translation means for translating the effectiveness verification materials into a desired language. This allows affiliated stores to receive efficient multilingual support and conduct high-quality marketing activities in real time.

[0557] "Input means" refers to devices and software for accepting input from affiliated stores.

[0558] "Database means" refers to a system for storing and managing input data.

[0559] The "material generation means" is a function that automatically creates the necessary supporting materials based on the stored data.

[0560] "AI means" refers to artificial intelligence that provides support to affiliated stores based on the generated support materials.

[0561] "Communication means" refers to the communication technology and systems that enable member stores to connect with AI in real time at the time they specify.

[0562] "Material provision means" refers to a system that generates materials for verifying the effectiveness of coupons and stamp cards and makes them available for member stores to download.

[0563] "Multilingual support means" refers to a function that provides support for effectively conducting marketing activities in multiple languages ​​based on generated support materials.

[0564] "Translation means" refers to a device or software that automatically translates the effectiveness verification materials into the desired language.

[0565] This invention is a system that provides 24-hour, multilingual AI support to affiliated stores. This system consists of the following main components:

[0566] 1. Input method for accepting input from affiliated stores

[0567] The server provides an input method for accepting data entered by franchise owners, including basic information such as store name, address, representative name, contact details, etc. This data is entered using a web form or a smartphone application.

[0568] Examples:

[0569] When a user enters the store name "Cafe ABC," location "Tokyo," representative name "Yamada Taro," and contact information "123-4567" into the online form and presses the submit button, the server receives this information, registers it in the database, and sends a confirmation email.

[0570] 2. Database Means

[0571] The server has a database to store and manage the input data. SQLAlchemy is used to store the data in the SQL database.

[0572] 3. Material generation means

[0573] The server automatically generates marketing support materials such as coupons and stamp cards based on the stored data, allowing affiliated stores to easily obtain effective marketing tools.

[0574] Examples:

[0575] The server generates a template for a "10% off coupon" and also provides specific explanatory material about it.

[0576] 4. AI means

[0577] The AI ​​method provides real-time multilingual support to merchants based on the generated support materials, and is implemented using a generative AI model.

[0578] 5. Means of communication

[0579] The communication method is a technology or system that allows the affiliated store to connect with the AI ​​in real time at a time specified by the affiliated store, and the connection is made via a video conferencing system (e.g., Zoom).

[0580] Examples:

[0581] At the time specified by the user, the server will start a Zoom meeting, and the AI ​​will provide a detailed explanation in response to the question, "How can we use the coupon service to increase sales?"

[0582] 6. Means of providing materials

[0583] The server automatically generates campaign effectiveness verification materials, translates them into the desired language, and makes them accessible from a dedicated download page.

[0584] Examples:

[0585] The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as specified by the user, and provides a download link from a dedicated portal.

[0586] 7. Multilingual support and translation methods

[0587] The server provides multilingual support to ensure effective marketing activities based on the generated support materials, and also has the function to automatically translate the effectiveness verification materials into the desired language.

[0588] Example prompt sentence:

[0589] "The owner of Cafe ABC would like to issue a coupon (10% discount). Please prepare supporting materials and explain them during a Zoom meeting at the specified time. After the meeting, please generate effectiveness verification materials in Japanese and English and make them accessible from the download page."

[0590] This system allows affiliated stores to receive efficient multilingual support and conduct high-quality marketing activities in real time.

[0591] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0592] Step 1:

[0593] A user enters basic information into an online form.

[0594] Specifically, enter the store name, address, representative name, contact information, etc., and press the send button. At this time, the entered information is sent from the terminal to the server.

[0595] Input: Basic information such as store name, address, representative name, contact information, etc.

[0596] Output: Basic information data sent to the server

[0597] Step 2:

[0598] The server saves the received basic information data to the database. At this time, it stores the data in the SQL database using SQLAlchemy. After the information is saved correctly, it sends a confirmation email.

[0599] Input: Basic information data

[0600] Output: Information stored in database, confirmation email sent

[0601] Step 3:

[0602] The user enters the support request (coupon issuance, stamp card issuance, etc.) into the online form. Specifically, the user selects and fills in the desired content and details, and presses the send button. This data is sent from the terminal to the server.

[0603] Input: Support request and details

[0604] Output: Support request data sent to the server

[0605] Step 4:

[0606] The server stores the received support request data in a database. It then generates support materials based on the stored data. Specifically, it automatically generates coupons and stamp cards using templates.

[0607] Input: Support request data

[0608] Output: Generated supporting materials

[0609] Step 5:

[0610] At the time specified by the user, the server connects the AI ​​and the user using a communication method. Specifically, the connection is made in real time using a video conferencing system (e.g., Zoom). The AI ​​provides support to the affiliated store in real time based on the generated support materials.

[0611] Input: Connection time, generated support materials

[0612] Output: Real-time AI support

[0613] Step 6:

[0614] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials. It also translates them into the desired language and makes them accessible from a dedicated download page. Specifically, the server uses a generative AI model to automatically generate effectiveness verification materials in multiple languages.

[0615] Input: Campaign result data, desired language

[0616] Output: Multilingual support effectiveness verification materials

[0617] Step 7:

[0618] The server uploads the generated effectiveness verification materials to a dedicated portal for member stores to download. Users can download the necessary materials from the dedicated portal.

[0619] Input: Multilingual support effectiveness verification materials

[0620] Output: Download link, downloaded verification data

[0621] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0622] This invention is a system that helps member stores use services efficiently, and is available 24 hours a day in multiple languages, and provides AI support including an emotion engine that recognizes user emotions. This system receives input data from member stores, generates necessary support materials based on that data, provides support in real time through AI, and recognizes user emotions to respond and make appropriate suggestions.

[0623] Program processing explanation

[0624] Initial Setup

[0625] When a user (a member store owner) creates a new account, they enter basic information such as the store name, location, representative name, and contact details into an online form and press the submit button. The server stores the received data in a database and sends a confirmation email to the user.

[0626] Example: When a user fills out an online form with "XYZ Cafe," its location "Osaka Prefecture," its representative's name "Ichiro Sato," and contact information "080-1234-5678," and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[0627] Enter your support request

[0628] The user accesses the provided online form, selects the desired support content (e.g., coupon issuance, stamp card issuance, light plan contract), and enters the necessary details. For example, if "coupon issuance" is selected, the user enters "10% discount rate."

[0629] Example: When a user checks "Issue coupon" and enters the text "10% discount rate," the terminal sends this to the server.

[0630] Data transmission and processing

[0631] The terminal sends the data entered by the user to the server, which receives the data and stores it in a database.

[0632] Example: The server receives the information "Coupon issued, 10% discount" and records it in the database.

[0633] Generate supporting materials

[0634] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" and related explanatory materials. The generated materials are organized so that support can be provided at the time specified by the user.

[0635] Example: The server generates a template for a "10% off coupon" and provides explanatory materials about it.

[0636] Real-time support with emotion engine

[0637] The server connects the user to the AI ​​via an online conference system at a time specified by the user. The AI ​​communicates with the user via video and audio, providing support based on pre-prepared materials. In addition, the emotion engine identifies emotions from the user's facial expressions and voice, and adjusts responses and suggestions accordingly.

[0638] Example: At the time specified by the user, the server starts a Zoom meeting, and the AI ​​explains how to use the coupon service to increase sales. The emotion engine analyzes the user's tone of voice and facial expressions, detects excitement or anxiety, and makes appropriate suggestions accordingly.

[0639] Creation of effectiveness verification materials

[0640] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[0641] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into Japanese and English as desired by the user, and makes it available for download from a dedicated portal.

[0642] Providing data to verify effectiveness

[0643] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[0644] Example: A user downloads a "Coupon Campaign Effectiveness Report" in Japanese and English.

[0645] Paid service information

[0646] The server uses AI to provide users with information about new paid services, providing detailed explanations and instructions on how to install them, and assisting with contract procedures if necessary.

[0647] Example: When a user sends a request to "learn about new paid plans," the server schedules a detailed briefing session with AI and then sends the contract documents.

[0648] The system of this invention provides 24-hour, multilingual AI support, and by recognizing user emotions and adjusting responses accordingly, it is possible to quickly and effectively respond to the diverse needs of member stores.

[0649] The processing flow will be explained below.

[0650] Step 1: Create a new account

[0651] To create a new account, a user enters basic information such as the store name, location, representative name, and contact information into the online form and presses the submit button. The terminal sends the entered data to the server, which stores the received data in a database and sends a confirmation email to the user.

[0652] Example: When a user fills out an online form with "XYZ Cafe," its location "Osaka Prefecture," its representative's name "Ichiro Sato," and contact information "080-1234-5678," and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[0653] Step 2: Enter your support request

[0654] The user accesses the provided online form, selects the desired support content (e.g., coupon issuance, stamp card issuance, light plan contract), and enters the necessary details. For example, if "coupon issuance" is selected, the user enters "10% discount rate."

[0655] Example: When a user checks "Issue coupon" and enters the text "10% discount rate," the terminal sends this to the server.

[0656] Step 3: Send and process data

[0657] The terminal sends the data entered by the user to the server, which receives the data and stores it in a database.

[0658] Example: The server receives the information "Coupon issued, 10% discount" and records it in the database.

[0659] Step 4: Generate supporting materials

[0660] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" or design materials for a stamp card. The generated materials are organized so that support can be provided at the time specified by the user.

[0661] Example: The server generates a template for a "10% off coupon" and also provides explanatory material about it.

[0662] Step 5: Preparing for real-time support

[0663] The user receives a link to access the online conference system at a pre-specified time. The server then launches the online conference system (e.g., Zoom) at the specified time and prepares to connect the user with the AI.

[0664] Example: The server sends a Zoom meeting invitation link to the user at the time specified by the user.

[0665] Step 6: Real-time support with AI

[0666] The server starts an online meeting at the specified time and connects the AI ​​with the user. The AI ​​interacts with the user via video and audio, providing detailed support based on pre-generated support materials. The emotion engine also identifies emotions from the user's facial expressions and voice, and adjusts responses and suggestions accordingly.

[0667] Example: When a user joins a Zoom meeting, the server connects with the user via AI, which then provides detailed explanations in response to questions such as, "How can we use coupon services to increase sales?" The emotion engine analyzes the user's tone of voice and facial expressions, detects excitement or anxiety, and makes appropriate suggestions accordingly.

[0668] Step 7: Create materials to verify effectiveness

[0669] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[0670] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as desired by the user, and provides a download link from a dedicated portal.

[0671] Step 8: Provide data to verify effectiveness

[0672] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[0673] Example: A user downloads a "Coupon Campaign Effectiveness Report" in Japanese and English.

[0674] Step 9: Paid service information

[0675] The server uses AI to provide users with information about new paid services, providing detailed explanations and instructions on how to install them, and assisting with contract procedures if necessary.

[0676] Example: When a user sends a request to "learn about new paid plans," the server schedules a detailed briefing session with AI and then sends the contract documents.

[0677] Through these steps, an AI support system that can provide multilingual support 24 hours a day will be realized, and by recognizing user emotions and adjusting responses accordingly, it will be able to quickly and effectively respond to the diverse needs of affiliated stores.

[0678] Example 2

[0679] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0680] With the previous system, it was difficult for affiliated stores to receive multilingual support 24 hours a day. It was also unable to recognize user emotions and provide appropriate responses and suggestions in real time, which could result in a decline in the quality of support. Furthermore, the creation of documents to verify the effectiveness of coupons and stamp cards was not automated, which was a time-consuming process.

[0681] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for accepting input from affiliated stores, a database means for saving the input data, a material generation means for generating support materials based on the saved data, an AI means for providing support to affiliated stores based on the generated support materials, a communication means for connecting with the AI ​​in real time at a time specified by the affiliated store, a material provision means for generating and downloading coupon and stamp card effectiveness verification materials, and an emotion recognition means for identifying the user's emotions and adjusting responses and suggestions. This enables high-quality support in multiple languages ​​around the clock, allowing appropriate responses and suggestions to be made based on the user's emotions. Furthermore, it enables automatic generation of coupon and stamp card effectiveness verification materials, enabling more effective support to be provided.

[0682] "Affiliate" refers to a company or individual business that provides a specific service or product.

[0683] "Input means" refers to an interface through which a user inputs information into a system.

[0684] "Database means" refers to a system or software for storing and managing input information.

[0685] "Material generation means" refers to a system or software that automatically generates the necessary support materials based on stored data.

[0686] "AI means" refers to a system that uses artificial intelligence technology to provide automated support.

[0687] "Communication means" refers to the interface or network for sending and receiving information and data between the system and the user in real time.

[0688] "Material provision means" refers to a system or software that generates materials for verifying the effectiveness of coupons or stamp cards and provides them to users in a downloadable format.

[0689] "Emotion recognition means" refers to a system or software that identifies emotions from a user's facial expressions and voice and adjusts responses and suggestions accordingly.

[0690] This invention is a system that supports member stores in efficiently using their services. This system provides 24-hour, multilingual support, and is characterized by its ability to recognize users' emotions and provide appropriate responses and suggestions. Specific embodiments are described below.

[0691] 1. The user accesses the system, opens the new account creation page, enters basic information such as the store name, location, representative name, and contact information into the online form, and presses the submit button. For example, a user enters "Cafe ABC," location "Tokyo," representative name "Taro Tanaka," and contact information "090-1234-5678" into the online form and presses the submit button.

[0692] 2. The device receives the entered information and sends it to the server as an HTTP POST request. The server verifies the received data and saves it in the database. After saving is complete, the server sends a confirmation email to the user.

[0693] 3. The user accesses the support request entry form, selects the support they want (e.g., coupon issuance, stamp card issuance, etc.), and enters the necessary details. For example, they select "coupon issuance" and enter "10% discount rate." The terminal sends this information to the server.

[0694] 4. The server stores the received data in a database and automatically generates the necessary support materials based on the stored data. For example, it generates a template and explanatory materials for a "10% discount coupon." The generated materials are organized so that support can be provided at the time specified by the user.

[0695] 5. At the time specified by the user, the server connects the AI ​​to the user via a video conferencing system. For example, it can send a Zoom link and connect the AI ​​to the user at the specified time. The AI ​​provides support based on pre-prepared materials and identifies emotions from the user's facial expressions and voice to provide appropriate responses and suggestions.

[0696] 6. Once the coupon or stamp card campaign has ended, the server collects data for effectiveness verification and automatically generates effectiveness verification materials. These materials are translated into the user's preferred language and provided in a downloadable format. Users can access the effectiveness verification materials from a dedicated download page and download the materials they need. For example, they can download a "Coupon Campaign Effectiveness Report" in both Japanese and English.

[0697] The system provides 24-hour, multilingual AI support, and by identifying user emotions and responding appropriately, it can quickly and effectively meet the diverse needs of affiliated stores. Furthermore, it can provide effective support by automatically generating materials to verify the effectiveness of coupons and stamp cards.

[0698] Example prompt sentence:

[0699] To create a new account, please enter your store name, address, representative name, and contact information.

[0700] "Select the support you would like and enter details, such as the discount rate."

[0701] "Please join the online support meeting at the specified time. We will also be conducting a sentiment analysis, so please relax and enjoy the meeting."

[0702] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0703] Step 1:

[0704] The user accesses the system, opens the new account creation page, and enters basic information such as the store name, location, representative name, contact information, etc. into the online form. The entered data is captured by the terminal as HTML form data.

[0705] Input: "Store name", "Address", "Representative name", "Contact information"

[0706] Output: The device generates an HTTP POST request and sends the input data to the server.

[0707] Specific operation: The user enters "Cafe ABC", location "Tokyo", representative name "Taro Tanaka", contact information "090-1234-5678", and presses the send button.

[0708] Step 2:

[0709] The server parses the received HTTP POST request and validates the data to prepare it for storage in the database. After the validation is complete, the server saves the information in the database and sends a confirmation email to the user.

[0710] Input: User information received from the device

[0711] Output: User information stored in the database and a confirmation email sent to the user.

[0712] What happens: The server saves the user information in a database and sends a confirmation email to the user's email address.

[0713] Step 3:

[0714] The user accesses the support request input form, selects the support type they want, and enters detailed information. The device captures this information and sends it to the server as an HTTP POST request.

[0715] Input: "Support details", "Detailed information"

[0716] Output: The device generates an HTTP POST request and sends the input data to the server.

[0717] Specific operation: The user selects "Issue coupon", enters "10% discount rate", and presses the submit button.

[0718] Step 4:

[0719] The server stores the received data in a database and automatically generates the necessary support materials based on the stored data. For example, it creates a template for a "10% discount coupon" and its explanatory materials.

[0720] Input: Support request received from device

[0721] Output: Supporting materials (e.g., "10% off coupon" template and explanatory materials)

[0722] Specific operation: The server generates and saves a "10% discount coupon" template and related explanatory materials.

[0723] Step 5:

[0724] At the time specified by the user, the server connects the user to the AI ​​via a video conferencing system. The AI ​​provides support to the user based on pre-prepared materials and adjusts its responses and suggestions based on the user's facial expressions and voice.

[0725] Input: User-specified time, URL of video conferencing system

[0726] Output: AI-user connection and support provided

[0727] How it works: The server generates a Zoom meeting link and connects the user with the AI ​​at the specified time. The AI ​​explains how to use the coupon service, and the emotion engine identifies the user's emotions and makes appropriate suggestions.

[0728] Step 6:

[0729] Once the coupon or stamp card campaign has ended, the server collects data for effectiveness verification and automatically generates effectiveness verification materials, which are translated into the user's preferred language and made available in a downloadable format.

[0730] Input: Campaign usage data

[0731] Output: Effectiveness verification document (translated)

[0732] Specific operation: The server generates a "Coupon Campaign Effectiveness Report," translates it into Japanese and English, and provides it to the user.

[0733] Step 7:

[0734] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[0735] Input: User download request

[0736] Output: Downloadable effectiveness verification materials

[0737] Specific operation: The user downloads the "Coupon Campaign Effectiveness Report" from the system's download page.

[0738] Step 8:

[0739] The server will provide information about new paid services, set up an AI session to provide detailed explanations and instructions on how to implement them, and assist with the contract process if necessary.

[0740] Input: User request

[0741] Output: AI-generated detailed explanation and contract documents

[0742] Specific operation: The server schedules an AI briefing based on the user request and then sends the contract documents.

[0743] In this way, this system helps member stores use its services efficiently, is available 24 hours a day, supports multiple languages, and can recognize users' emotions to provide appropriate responses and suggestions.

[0744] (Application example 2)

[0745] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0746] Recently, many stores have been facing challenges in providing multilingual services and customer support. With the increasing number of foreign tourists, it has become increasingly difficult for employees to provide multilingual support, creating a need to improve customer satisfaction. Understanding customer sentiment and providing appropriate responses is also important, but implementing this in real time requires advanced technology. Furthermore, properly analyzing the effectiveness of coupons and promotions and implementing promotional activities tailored to each customer has become an essential element of store management. A system that can effectively resolve these issues is needed.

[0747] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes emotion recognition means, multilingual support means, and material provision means. This enables real-time support in multiple languages ​​and responses based on customer emotions. In addition, by automatically generating materials to verify the effectiveness of coupons and stamp cards and making the analysis results available for download, the efficiency of store operations and customer satisfaction are improved.

[0748] "Input means" refers to the devices and software used to accept data input from affiliated stores.

[0749] "Database means" refers to a system for saving input data and keeping it available for reference.

[0750] "Materials generation means" means the process or software for automatically generating the necessary supporting materials based on the stored data.

[0751] "AI means" refers to devices or systems that use artificial intelligence to provide appropriate support to affiliated stores based on the generated support materials.

[0752] "Communication means" refers to the network or device that allows the affiliated store to connect with the AI ​​in real time at the time specified by the affiliated store.

[0753] "Material provision means" refers to the process or system for generating materials for verifying the effectiveness of coupons and stamp cards and making them available for download.

[0754] "Emotion recognition means" refers to technology or software that recognizes emotions from customers' facial expressions, voice, etc., and adjusts responses and suggestions based on that information.

[0755] "Multilingual support means" refers to technologies and systems for generating multilingual content and responding appropriately to customers.

[0756] This invention provides a customer support system for brick-and-mortar stores that supports multiple languages ​​and has emotion recognition capabilities. The following describes the procedure and specific configuration for building this system.

[0757] First, this system includes "input means," "database means," "document generation means," "AI means," "communication means," "document provision means," "emotion recognition means," and "multilingual support means." Each of these means will be explained below.

[0758] 1. Input method:

[0759] Store staff, who are users, use smartphones or smart glasses to input data necessary for customer service, including customer questions, requests, images, and videos.

[0760] 2. Database means:

[0761] The server receives the entered data and stores it in a database, which contains customer details and transaction history.

[0762] 3. Material generation means:

[0763] The server automatically generates supporting materials such as coupons and stamp cards based on the stored data.

[0764] 4. AI means:

[0765] Based on the generated materials, AI provides appropriate support to users. AI utilizes generative AI models to make optimal proposals to individual customers.

[0766] 5. Means of communication:

[0767] The server connects to the AI ​​in real time via an online conference system (e.g., Zoom, Microsoft Teams) at a time designated by the store staff, enabling real-time support.

[0768] 6. Material provision method:

[0769] The server analyzes the effectiveness of coupon and stamp card campaigns, generates effectiveness verification materials based on the analysis results, and provides them in a downloadable format.

[0770] 7. Emotion recognition means:

[0771] The server uses emotion analysis software (e.g., Azure Face API, Google Cloud Vision API) to recognize emotions from the customer's facial expressions and voice, and adjusts the response appropriately.

[0772] 8. Multilingual support means:

[0773] The server uses the Google Translate API or similar to generate multilingual content and respond to the customer.

[0774] For example, if a foreign tourist visiting a physical store asks in English, "Please tell me more about this product," the system works as follows: First, a store staff member inputs the customer's video and audio through smart glasses and sends them to the server. Based on this video and audio, the server uses the emotion recognition means to analyze the customer's emotions. At the same time, the multilingual support means analyzes the English question and generates an appropriate response. The AI ​​means then uses the generated AI model to provide the customer with the most appropriate product information and related benefits. Specific examples of prompt sentences include:

[0775] "Given the customer's query: 'Can you tell me more about this product?' and the detected emotion: 'interest', generate a detailed response in English that includes related product suggestions and a special discount offer."

[0776] In this way, a system that combines a server and various means can effectively provide customer support in physical stores through multilingual support and emotion recognition.

[0777] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0778] Step 1:

[0779] The store staff, who are the users, use the smart glasses to input customer questions and requests. The terminal captures images and videos of the customer and also accepts voice input. This input data includes the customer's questions, images, and voice data.

[0780] Step 2:

[0781] The terminal transmits the acquired data to the server. The server receives this data and stores it in a database. Specifically, the database stores the customer's question, video data, and audio data.

[0782] Step 3:

[0783] The server analyzes emotions using emotion recognition techniques based on the data stored in the database. For example, it uses Azure Face API or Google Cloud Vision API to read emotions from the customer's facial expressions. This process outputs emotional data such as whether the customer is interested or anxious.

[0784] Step 4:

[0785] The server analyzes the customer's question using multilingual support. Using a Google Translate API or similar, it converts the input language (e.g., English) into Japanese and generates an appropriate response. The response is created using a generative AI model, and answer data in text format is generated.

[0786] Step 5:

[0787] The server combines the generated response data with the emotion data to generate optimal suggestions. Using a generative AI model, it provides appropriate product information and special offers based on the prompt. The following prompts are used in this step:

[0788] "Given the customer's query: 'Can you tell me more about this product?' and the detected emotion: 'interest', generate a detailed response in English that includes related product suggestions and a special discount offer."

[0789] Step 6:

[0790] The server sends the generated suggestions and response data to the terminal, which then displays this data to the store staff member who is the user. The staff member then responds appropriately to the customer through the smart glasses.

[0791] Step 7:

[0792] After the interaction with the customer is completed, the server analyzes the effectiveness of the coupons and promotions. The server generates effectiveness verification materials using the material generation means and provides them in a downloadable format through the material provision means. The materials include campaign results and customer feedback.

[0793] In this way, customer support is provided across the entire system, improving customer satisfaction and streamlining store operations.

[0794] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0795] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0796] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0797] [Third embodiment]

[0798] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0799] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0800] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0801] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0802] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0803] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0804] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0805] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0806] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0807] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0808] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0809] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0810] This invention is a system that helps merchants efficiently use specific services, and provides 24-hour, multilingual AI support. This system receives input data from merchants, generates necessary support materials based on that data, and provides real-time support through AI.

[0811] Program processing explanation

[0812] Initial Setup

[0813] When a user (a franchisee owner) creates a new account, they enter basic information, including the store name, location, representative name, and contact information. The server receives this information and stores it in a database. Once a new account is created, the server sends a confirmation email to the user.

[0814] Example: When a user enters the store name "ABC Cafe," location "Tokyo," representative name "Yamada Taro," and contact information "123-4567" into an online form and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[0815] Receiving form input

[0816] Users enter their desired support needs or concerns into an online form. For example, options such as issuing coupons, issuing stamp cards, or signing up for a light plan are displayed. Users can check these options or enter details in the text boxes.

[0817] Example: The user checks "Issue Coupon" and enters the text "10% discount rate." The device sends this to the server.

[0818] Data transmission and processing

[0819] The terminal sends the data entered by the user to the server, which receives the data, stores it in a database, and prepares it for further processing.

[0820] Example: The server receives the information "Coupon issued, 10% discount rate" and records it in the database.

[0821] Preparation of support content

[0822] The server automatically generates appropriate support materials based on the received data, including coupon templates and stamp card design materials, and organizes the generated materials so that support can be provided at the time specified by the user.

[0823] Example: The server generates a template for a "10% discount coupon" and also provides explanatory material about it.

[0824] Real-time support with AI

[0825] The server connects the user to the AI ​​via an online conference system at a time specified by the user. The AI ​​communicates with the user via video and audio, providing support based on pre-prepared materials.

[0826] Example: At the time specified by the user, the server starts a Zoom meeting, and the AI ​​provides a detailed explanation in response to the question, "How can we use the coupon service to increase sales?"

[0827] Providing data to verify effectiveness

[0828] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials and translates them into the user's preferred language. These materials can be accessed from a dedicated download page.

[0829] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as specified by the user, and provides a download link from a dedicated portal.

[0830] Paid service information and support

[0831] If a user shows interest in a new paid service, the server will use AI to explain the details of the service, guide them on how to install it, and also support them in the contract process.

[0832] Example: When a user sends a request saying, "I'd like to know about the new paid plan," the server schedules a detailed briefing session with AI and then sends the contract documents.

[0833] The present invention allows the construction of a system that can provide multilingual support 24 hours a day, enabling the various needs of member stores to be met promptly and effectively.

[0834] The processing flow will be explained below.

[0835] Step 1: Create a new account

[0836] To create a new account, a user enters basic information such as the store name, location, representative name, and contact information into the online form and presses the submit button. The terminal sends the entered data to the server, which stores the received data in a database and sends a confirmation email to the user.

[0837] Step 2: Enter your support request

[0838] The user accesses the provided online form and selects the support they want (coupon issuance, stamp card issuance, light plan contract, etc.). For example, the user checks "coupon issuance" and enters "10% discount rate." The terminal sends this data to the server.

[0839] Step 3: Save your data

[0840] The server receives the support request and detailed information sent from the device and stores it in a database. Based on this data, it prepares for the next processing step.

[0841] Step 4: Generate supporting materials

[0842] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" and related explanatory materials. The generated materials are organized so that support can be provided at the time specified by the user.

[0843] Step 5: Preparing for real-time support

[0844] The user receives a link to access the online conference system at a pre-specified time. The server then launches the online conference system (e.g., Zoom) at the specified time and prepares to connect the AI ​​with the user.

[0845] Step 6: Real-time support with AI

[0846] The server starts an online meeting at the specified time and connects the AI ​​with the user. The AI ​​interacts with the user via video and audio, providing detailed support based on pre-generated support materials. For example, it provides an explanation in response to a question such as, "How can we use coupon services to increase sales?"

[0847] Step 7: Create materials to verify effectiveness

[0848] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[0849] Step 8: Provide data to verify effectiveness

[0850] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials. For example, a "Coupon Campaign Effectiveness Report" can be made available for download in both Japanese and English.

[0851] Step 9: Paid service information

[0852] The server uses AI to provide users with information about new paid services. If the user shows interest in a paid plan, the AI ​​will provide a detailed explanation and instructions on how to install it, and will also assist with the necessary contract procedures.

[0853] The above steps will realize an AI support system that can provide multilingual support 24 hours a day, allowing it to respond quickly and effectively to the diverse needs of member stores.

[0854] Example 1

[0855] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0856] Currently, many affiliated stores struggle with providing 24-hour multilingual support, requiring fast and efficient support. However, current systems make it difficult to provide real-time support or generate effective support materials, making it particularly difficult to respond quickly to a wide range of support requests. For this reason, a system is needed to improve the operational efficiency of affiliated stores and enhance the quality of customer service.

[0857] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0858] In this invention, the server includes input means for accepting input from affiliated stores, database means for saving the input data, material generation means for generating support materials based on the saved data, artificial intelligence means for providing support to affiliated stores based on the generated support materials, communication means for connecting with the artificial intelligence in real time at a time specified by the affiliated store, material provision means for generating effectiveness verification materials for coupons and point cards and making them available for download, selection means for selecting the type of support desired, schedule means for organizing the support materials at a set time, and analysis means for answering user questions. This enables multilingual support 24 hours a day, making it possible to respond quickly and effectively to the diverse needs of affiliated stores.

[0859] "Input means" refers to a means for accepting input data from affiliated stores.

[0860] The "database means" is a means for saving and managing input data.

[0861] The "material generation means" is a means for automatically generating support materials based on the stored data.

[0862] "Artificial intelligence means" means means for providing real-time assistance to merchants based on the generated support materials.

[0863] "Communication means" refers to the means by which a member store can connect with artificial intelligence in real time at a time specified by the member store.

[0864] The "material providing means" is a means for generating effectiveness verification materials such as coupons and point cards and making them available for download.

[0865] The "selection means" is a means for the user to select the type of support they would like to receive.

[0866] The "scheduling means" is a means for organizing and providing the generated support materials at a set time.

[0867] "Analysis means" is a means for deriving appropriate answers to user questions and requests.

[0868] This invention is a system that supports member stores in efficiently using specific services, and provides 24-hour, multilingual artificial intelligence (AI) support. The system is configured as follows:

[0869] System Configuration

[0870] 1. Input Method

[0871] When a user (a franchisee owner) creates a new account, he or she inputs basic information through input means. The basic information includes the store name, location, representative name, contact information, etc. The information received through the input means is sent to the server.

[0872] 2. Database Means

[0873] The server receives the basic information sent from the input means and stores the information in a database using the database means. The database centrally manages the basic information and history data of each member store.

[0874] 3. Material generation means

[0875] The server includes a material generation unit for automatically generating supporting materials based on the data stored in the database, such as coupon templates and point card design materials.

[0876] 4. Artificial Intelligence Means

[0877] The server uses artificial intelligence (AI) to provide support to merchants based on the generated support materials. AI uses machine learning models (e.g., generative AI models) to generate optimal answers to user questions.

[0878] 5. Means of communication

[0879] The server is equipped with a communication method that allows the merchant to connect with the AI ​​in real time at a time designated by the merchant, such as a video conferencing system like Zoom.

[0880] 6. Means of providing materials

[0881] The server automatically generates and provides downloadable materials for verifying the effectiveness of coupons and point card campaigns after they have ended. The materials are translated into multiple languages ​​and uploaded to a dedicated download page accessible to users.

[0882] 7. Selection Method

[0883] Users use a selection method to select the type of support they would like to receive. For example, an online form displays options such as "Coupon issue," "Point card issue," and "Light plan contract," and the user can select the option they want.

[0884] 8. Scheduling Tools

[0885] The server is provided with a scheduling means for organizing the generated support materials at a set time, thereby enabling support to be provided with appropriate materials at a user-specified time.

[0886] 9. Analysis methods

[0887] The server has an analysis means for deriving appropriate answers to the user's questions. This analysis means analyzes the received data and provides the most appropriate answers and support materials.

[0888] Specific examples

[0889] When a user enters the store name "XYZ Cafe," location "Osaka Prefecture," representative name "Ichiro Tanaka," and contact information "987-6543" into the online form and presses the send button, the server receives this information and stores it in a database. The server then sends a confirmation email to the user. Similarly, if the user checks "Issue Coupon" and enters a discount rate of "5%," the device sends this information to the server. Based on the received data, the server generates a "5% Discount Coupon" template and organizes it using a scheduling tool along with explanatory materials. At the specified time, the server starts a Zoom meeting via communication means, and AI provides real-time support to the user.

[0890] In this way, the system is capable of providing multilingual support 24 hours a day, enabling it to quickly and effectively respond to the diverse needs of member stores.

[0891] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0892] Step 1:

[0893] A user accesses the system's login page and selects to create a new account. They enter the store name, address, representative name, and contact information in the online form and click the submit button.

[0894] Input: Store name, address, representative name, contact information

[0895] Output: Send to server

[0896] Specific operation: The server receives this information, stores it in the database, and simultaneously sends a confirmation email to the user's email address.

[0897] Step 2:

[0898] The user clicks on the link in the confirmation email to verify their email address.

[0899] Input: Click on the link in the confirmation email

[0900] Output: Account Activation

[0901] What happens: The server detects that the link was clicked and validates the user's email address. The user can then log in to the system.

[0902] Step 3:

[0903] The user logs in to the system and accesses the support request form.

[0904] Check the desired option from the options such as coupon issuance, stamp card issuance, etc., and enter detailed information in the text box.

[0905] Input: Select the support you want and enter detailed information

[0906] Output: From the terminal to the server

[0907] Specific operation: The terminal sends this information to the server, which stores the received information in a database.

[0908] Step 4:

[0909] The server automatically generates supporting materials based on the received data using a material generation means, for example, generating coupon templates and stamp card design materials.

[0910] Input: Support request stored in the database

[0911] Output: Generated coupon or design document

[0912] Specific operation: The server generates a template based on the coupon's discount rate and conditions, and creates corresponding explanatory materials.

[0913] Step 5:

[0914] The server organizes the generated support materials using a scheduling means and sets them up so that they can be provided at a time designated by the user.

[0915] Input: Generated support materials, user-specified time

[0916] Output: Scheduled material delivery

[0917] Specific operation: The server sets a schedule and makes the necessary preparations to distribute the material at the specified time.

[0918] Step 6:

[0919] The server connects the AI ​​and the user at the designated time through a communication method, such as a video conferencing system like Zoom.

[0920] Input: A specified time, a user connection request

[0921] Output: Real-time connection between user and AI

[0922] Specific operation: The server starts a Zoom meeting, and the AI ​​communicates with the user via video and audio. The AI ​​provides support based on pre-prepared materials.

[0923] Step 7:

[0924] The AI ​​uses analytical tools to provide answers to user questions and requests, and shares the screen if necessary.

[0925] Input: User question or request

[0926] Output: Optimized answer or support

[0927] Specific operation: The AI ​​analyzes the received data and derives appropriate answers. It also provides specific explanations while sharing materials on the screen.

[0928] Step 8:

[0929] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials, translates them into the desired language, and makes them accessible from a dedicated download page.

[0930] Input: Campaign result data

[0931] Output: Effectiveness verification materials, download link

[0932] Specific operation: The server retrieves the campaign results from the database and analyzes specific indicators (number of users, sales increase rate, etc.). It then generates effectiveness verification documents translated into Japanese and English and uploads them to a dedicated portal.

[0933] Step 9:

[0934] If a user shows interest in a new paid service, the server will provide details, guide them through the installation process, and assist with the contract process.

[0935] Input: User request

[0936] Output: Paid plan details, contract documents

[0937] Specific operation: The server receives a request from the user, schedules a detailed explanation session for the paid plan, and then sends the contract documents and assists in the contract procedure.

[0938] This enables the system to provide multilingual support 24 hours a day, enabling it to respond quickly and effectively to the diverse needs of member stores.

[0939] (Application example 1)

[0940] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0941] Conventional systems make it difficult for affiliated stores to efficiently carry out marketing activities, and do not adequately support multiple languages. As a result, real-time support and the provision of effectiveness verification materials tend to be delayed, and there are problems with the quality of customer support declining due to time and language constraints. The present invention aims to solve these problems and provide a system that allows affiliated stores to efficiently carry out various marketing activities and receive support in multiple languages.

[0942] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0943] In this invention, the server includes input means for accepting input from affiliated stores, database means for saving the input data, material generation means for generating support materials based on the saved data, AI means for providing support to affiliated stores based on the generated support materials, communication means for connecting with the AI ​​in real time at a time specified by the affiliated store, material provision means for generating effectiveness verification materials for coupons and stamp cards and making them available for download, multilingual support means for providing support for effectively conducting marketing activities based on the generated support materials, and translation means for translating the effectiveness verification materials into a desired language. This allows affiliated stores to receive efficient multilingual support and conduct high-quality marketing activities in real time.

[0944] "Input means" refers to devices and software for accepting input from affiliated stores.

[0945] "Database means" refers to a system for storing and managing input data.

[0946] The "material generation means" is a function that automatically creates the necessary supporting materials based on the stored data.

[0947] "AI means" refers to artificial intelligence that provides support to affiliated stores based on the generated support materials.

[0948] "Communication means" refers to the communication technology and systems that enable member stores to connect with AI in real time at the time they specify.

[0949] "Material provision means" refers to a system that generates materials for verifying the effectiveness of coupons and stamp cards and makes them available for member stores to download.

[0950] "Multilingual support means" refers to a function that provides support for effectively conducting marketing activities in multiple languages ​​based on generated support materials.

[0951] "Translation means" refers to a device or software that automatically translates the effectiveness verification materials into the desired language.

[0952] This invention is a system that provides 24-hour, multilingual AI support to affiliated stores. This system consists of the following main components:

[0953] 1. Input method for accepting input from affiliated stores

[0954] The server provides an input method for accepting data entered by franchise owners, including basic information such as store name, address, representative name, contact details, etc. This data is entered using a web form or a smartphone application.

[0955] Examples:

[0956] When a user enters the store name "Cafe ABC," location "Tokyo," representative name "Yamada Taro," and contact information "123-4567" into the online form and presses the submit button, the server receives this information, registers it in the database, and sends a confirmation email.

[0957] 2. Database Means

[0958] The server has a database to store and manage the input data. SQLAlchemy is used to store the data in the SQL database.

[0959] 3. Material generation means

[0960] The server automatically generates marketing support materials such as coupons and stamp cards based on the stored data, allowing affiliated stores to easily obtain effective marketing tools.

[0961] Examples:

[0962] The server generates a template for a "10% off coupon" and also provides specific explanatory material about it.

[0963] 4. AI means

[0964] The AI ​​method provides real-time multilingual support to merchants based on the generated support materials, and is implemented using a generative AI model.

[0965] 5. Means of communication

[0966] The communication method is a technology or system that allows the affiliated store to connect with the AI ​​in real time at a time specified by the affiliated store, and the connection is made via a video conferencing system (e.g., Zoom).

[0967] Examples:

[0968] At the time specified by the user, the server will start a Zoom meeting, and the AI ​​will provide a detailed explanation in response to the question, "How can we use the coupon service to increase sales?"

[0969] 6. Means of providing materials

[0970] The server automatically generates campaign effectiveness verification materials, translates them into the desired language, and makes them accessible from a dedicated download page.

[0971] Examples:

[0972] The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as specified by the user, and provides a download link from a dedicated portal.

[0973] 7. Multilingual support and translation methods

[0974] The server provides multilingual support to ensure effective marketing activities based on the generated support materials, and also has the function to automatically translate the effectiveness verification materials into the desired language.

[0975] Example prompt sentence:

[0976] "The owner of Cafe ABC would like to issue a coupon (10% discount). Please prepare supporting materials and explain them during a Zoom meeting at the specified time. After the meeting, please generate effectiveness verification materials in Japanese and English and make them accessible from the download page."

[0977] This system allows affiliated stores to receive efficient multilingual support and conduct high-quality marketing activities in real time.

[0978] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0979] Step 1:

[0980] A user enters basic information into an online form.

[0981] Specifically, enter the store name, address, representative name, contact information, etc., and press the send button. At this time, the entered information is sent from the terminal to the server.

[0982] Input: Basic information such as store name, address, representative name, contact information, etc.

[0983] Output: Basic information data sent to the server

[0984] Step 2:

[0985] The server saves the received basic information data to the database. At this time, it stores the data in the SQL database using SQLAlchemy. After the information is saved correctly, it sends a confirmation email.

[0986] Input: Basic information data

[0987] Output: Information stored in database, confirmation email sent

[0988] Step 3:

[0989] The user enters the support request (coupon issuance, stamp card issuance, etc.) into the online form. Specifically, the user selects and fills in the desired content and details, and presses the send button. This data is sent from the terminal to the server.

[0990] Input: Support request and details

[0991] Output: Support request data sent to the server

[0992] Step 4:

[0993] The server stores the received support request data in a database. It then generates support materials based on the stored data. Specifically, it automatically generates coupons and stamp cards using templates.

[0994] Input: Support request data

[0995] Output: Generated supporting materials

[0996] Step 5:

[0997] At the time specified by the user, the server connects the AI ​​and the user using a communication method. Specifically, the connection is made in real time using a video conferencing system (e.g., Zoom). The AI ​​provides support to the affiliated store in real time based on the generated support materials.

[0998] Input: Connection time, generated support materials

[0999] Output: Real-time AI support

[1000] Step 6:

[1001] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials. It also translates them into the desired language and makes them accessible from a dedicated download page. Specifically, the server uses a generative AI model to automatically generate effectiveness verification materials in multiple languages.

[1002] Input: Campaign result data, desired language

[1003] Output: Multilingual support effectiveness verification materials

[1004] Step 7:

[1005] The server uploads the generated effectiveness verification materials to a dedicated portal for member stores to download. Users can download the necessary materials from the dedicated portal.

[1006] Input: Multilingual support effectiveness verification materials

[1007] Output: Download link, downloaded verification data

[1008] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1009] This invention is a system that helps member stores use services efficiently, and is available 24 hours a day in multiple languages, and provides AI support including an emotion engine that recognizes user emotions. This system receives input data from member stores, generates necessary support materials based on that data, provides support in real time through AI, and recognizes user emotions to respond and make appropriate suggestions.

[1010] Program processing explanation

[1011] Initial Setup

[1012] When a user (a member store owner) creates a new account, they enter basic information such as the store name, location, representative name, and contact details into an online form and press the submit button. The server stores the received data in a database and sends a confirmation email to the user.

[1013] Example: When a user fills out an online form with "XYZ Cafe," its location "Osaka Prefecture," its representative's name "Ichiro Sato," and contact information "080-1234-5678," and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[1014] Enter your support request

[1015] The user accesses the provided online form, selects the desired support content (e.g., coupon issuance, stamp card issuance, light plan contract), and enters the necessary details. For example, if "coupon issuance" is selected, the user enters "10% discount rate."

[1016] Example: When a user checks "Issue coupon" and enters the text "10% discount rate," the terminal sends this to the server.

[1017] Data transmission and processing

[1018] The terminal sends the data entered by the user to the server, which receives the data and stores it in a database.

[1019] Example: The server receives the information "Coupon issued, 10% discount" and records it in the database.

[1020] Generate supporting materials

[1021] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" and related explanatory materials. The generated materials are organized so that support can be provided at the time specified by the user.

[1022] Example: The server generates a template for a "10% off coupon" and provides explanatory materials about it.

[1023] Real-time support with emotion engine

[1024] The server connects the user to the AI ​​via an online conference system at a time specified by the user. The AI ​​communicates with the user via video and audio, providing support based on pre-prepared materials. In addition, the emotion engine identifies emotions from the user's facial expressions and voice, and adjusts responses and suggestions accordingly.

[1025] Example: At the time specified by the user, the server starts a Zoom meeting, and the AI ​​explains how to use the coupon service to increase sales. The emotion engine analyzes the user's tone of voice and facial expressions, detects excitement or anxiety, and makes appropriate suggestions accordingly.

[1026] Creation of effectiveness verification materials

[1027] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[1028] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into Japanese and English as desired by the user, and makes it available for download from a dedicated portal.

[1029] Providing data to verify effectiveness

[1030] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[1031] Example: A user downloads a "Coupon Campaign Effectiveness Report" in Japanese and English.

[1032] Paid service information

[1033] The server uses AI to provide users with information about new paid services, providing detailed explanations and instructions on how to install them, and assisting with contract procedures if necessary.

[1034] Example: When a user sends a request to "learn about new paid plans," the server schedules a detailed briefing session with AI and then sends the contract documents.

[1035] The system of this invention provides 24-hour, multilingual AI support, and by recognizing user emotions and adjusting responses accordingly, it is possible to quickly and effectively respond to the diverse needs of member stores.

[1036] The processing flow will be explained below.

[1037] Step 1: Create a new account

[1038] To create a new account, a user enters basic information such as the store name, location, representative name, and contact information into the online form and presses the submit button. The terminal sends the entered data to the server, which stores the received data in a database and sends a confirmation email to the user.

[1039] Example: When a user fills out an online form with "XYZ Cafe," its location "Osaka Prefecture," its representative's name "Ichiro Sato," and contact information "080-1234-5678," and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[1040] Step 2: Enter your support request

[1041] The user accesses the provided online form, selects the desired support content (e.g., coupon issuance, stamp card issuance, light plan contract), and enters the necessary details. For example, if "coupon issuance" is selected, the user enters "10% discount rate."

[1042] Example: When a user checks "Issue coupon" and enters the text "10% discount rate," the terminal sends this to the server.

[1043] Step 3: Send and process data

[1044] The terminal sends the data entered by the user to the server, which receives the data and stores it in a database.

[1045] Example: The server receives the information "Coupon issued, 10% discount" and records it in the database.

[1046] Step 4: Generate supporting materials

[1047] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" or design materials for a stamp card. The generated materials are organized so that support can be provided at the time specified by the user.

[1048] Example: The server generates a template for a "10% off coupon" and also provides explanatory material about it.

[1049] Step 5: Preparing for real-time support

[1050] The user receives a link to access the online conference system at a pre-specified time. The server then launches the online conference system (e.g., Zoom) at the specified time and prepares to connect the user with the AI.

[1051] Example: The server sends a Zoom meeting invitation link to the user at the time specified by the user.

[1052] Step 6: Real-time support with AI

[1053] The server starts an online meeting at the specified time and connects the AI ​​with the user. The AI ​​interacts with the user via video and audio, providing detailed support based on pre-generated support materials. The emotion engine also identifies emotions from the user's facial expressions and voice, and adjusts responses and suggestions accordingly.

[1054] Example: When a user joins a Zoom meeting, the server connects with the user via AI, which then provides detailed explanations in response to questions such as, "How can we use coupon services to increase sales?" The emotion engine analyzes the user's tone of voice and facial expressions, detects excitement or anxiety, and makes appropriate suggestions accordingly.

[1055] Step 7: Create materials to verify effectiveness

[1056] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[1057] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as desired by the user, and provides a download link from a dedicated portal.

[1058] Step 8: Provide data to verify effectiveness

[1059] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[1060] Example: A user downloads a "Coupon Campaign Effectiveness Report" in Japanese and English.

[1061] Step 9: Paid service information

[1062] The server uses AI to provide users with information about new paid services, providing detailed explanations and instructions on how to install them, and assisting with contract procedures if necessary.

[1063] Example: When a user sends a request to "learn about new paid plans," the server schedules a detailed briefing session with AI and then sends the contract documents.

[1064] Through these steps, an AI support system that can provide multilingual support 24 hours a day will be realized, and by recognizing user emotions and adjusting responses accordingly, it will be able to quickly and effectively respond to the diverse needs of affiliated stores.

[1065] Example 2

[1066] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1067] With the previous system, it was difficult for affiliated stores to receive multilingual support 24 hours a day. It was also unable to recognize user emotions and provide appropriate responses and suggestions in real time, which could result in a decline in the quality of support. Furthermore, the creation of documents to verify the effectiveness of coupons and stamp cards was not automated, which was a time-consuming process.

[1068] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for accepting input from affiliated stores, a database means for saving the input data, a material generation means for generating support materials based on the saved data, an AI means for providing support to affiliated stores based on the generated support materials, a communication means for connecting with the AI ​​in real time at a time specified by the affiliated store, a material provision means for generating and downloading coupon and stamp card effectiveness verification materials, and an emotion recognition means for identifying the user's emotions and adjusting responses and suggestions. This enables high-quality support in multiple languages ​​around the clock, allowing appropriate responses and suggestions to be made based on the user's emotions. Furthermore, it enables automatic generation of coupon and stamp card effectiveness verification materials, enabling more effective support to be provided.

[1069] "Affiliate" refers to a company or individual business that provides a specific service or product.

[1070] "Input means" refers to an interface through which a user inputs information into a system.

[1071] "Database means" refers to a system or software for storing and managing input information.

[1072] "Material generation means" refers to a system or software that automatically generates the necessary support materials based on stored data.

[1073] "AI means" refers to a system that uses artificial intelligence technology to provide automated support.

[1074] "Communication means" refers to the interface or network for sending and receiving information and data between the system and the user in real time.

[1075] "Material provision means" refers to a system or software that generates materials for verifying the effectiveness of coupons or stamp cards and provides them to users in a downloadable format.

[1076] "Emotion recognition means" refers to a system or software that identifies emotions from a user's facial expressions and voice and adjusts responses and suggestions accordingly.

[1077] This invention is a system that supports member stores in efficiently using their services. This system provides 24-hour, multilingual support, and is characterized by its ability to recognize users' emotions and provide appropriate responses and suggestions. Specific embodiments are described below.

[1078] 1. The user accesses the system, opens the new account creation page, enters basic information such as the store name, location, representative name, and contact information into the online form, and presses the submit button. For example, a user enters "Cafe ABC," location "Tokyo," representative name "Taro Tanaka," and contact information "090-1234-5678" into the online form and presses the submit button.

[1079] 2. The device receives the entered information and sends it to the server as an HTTP POST request. The server verifies the received data and saves it in the database. After saving is complete, the server sends a confirmation email to the user.

[1080] 3. The user accesses the support request entry form, selects the support they want (e.g., coupon issuance, stamp card issuance, etc.), and enters the necessary details. For example, they select "coupon issuance" and enter "10% discount rate." The terminal sends this information to the server.

[1081] 4. The server stores the received data in a database and automatically generates the necessary support materials based on the stored data. For example, it generates a template and explanatory materials for a "10% discount coupon." The generated materials are organized so that support can be provided at the time specified by the user.

[1082] 5. At the time specified by the user, the server connects the AI ​​to the user via a video conferencing system. For example, it can send a Zoom link and connect the AI ​​to the user at the specified time. The AI ​​provides support based on pre-prepared materials and identifies emotions from the user's facial expressions and voice to provide appropriate responses and suggestions.

[1083] 6. Once the coupon or stamp card campaign has ended, the server collects data for effectiveness verification and automatically generates effectiveness verification materials. These materials are translated into the user's preferred language and provided in a downloadable format. Users can access the effectiveness verification materials from a dedicated download page and download the materials they need. For example, they can download a "Coupon Campaign Effectiveness Report" in both Japanese and English.

[1084] The system provides 24-hour, multilingual AI support, and by identifying user emotions and responding appropriately, it can quickly and effectively meet the diverse needs of affiliated stores. Furthermore, it can provide effective support by automatically generating materials to verify the effectiveness of coupons and stamp cards.

[1085] Example prompt sentence:

[1086] To create a new account, please enter your store name, address, representative name, and contact information.

[1087] "Select the support you would like and enter details, such as the discount rate."

[1088] "Please join the online support meeting at the specified time. We will also be conducting a sentiment analysis, so please relax and enjoy the meeting."

[1089] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1090] Step 1:

[1091] The user accesses the system, opens the new account creation page, and enters basic information such as the store name, location, representative name, contact information, etc. into the online form. The entered data is captured by the terminal as HTML form data.

[1092] Input: "Store name", "Address", "Representative name", "Contact information"

[1093] Output: The device generates an HTTP POST request and sends the input data to the server.

[1094] Specific operation: The user enters "Cafe ABC", location "Tokyo", representative name "Taro Tanaka", contact information "090-1234-5678", and presses the send button.

[1095] Step 2:

[1096] The server parses the received HTTP POST request and validates the data to prepare it for storage in the database. After the validation is complete, the server saves the information in the database and sends a confirmation email to the user.

[1097] Input: User information received from the device

[1098] Output: User information stored in the database and a confirmation email sent to the user.

[1099] What happens: The server saves the user information in a database and sends a confirmation email to the user's email address.

[1100] Step 3:

[1101] The user accesses the support request input form, selects the support type they want, and enters detailed information. The device captures this information and sends it to the server as an HTTP POST request.

[1102] Input: "Support details", "Detailed information"

[1103] Output: The device generates an HTTP POST request and sends the input data to the server.

[1104] Specific operation: The user selects "Issue coupon", enters "10% discount rate", and presses the submit button.

[1105] Step 4:

[1106] The server stores the received data in a database and automatically generates the necessary support materials based on the stored data. For example, it creates a template for a "10% discount coupon" and its explanatory materials.

[1107] Input: Support request received from device

[1108] Output: Supporting materials (e.g., "10% off coupon" template and explanatory materials)

[1109] Specific operation: The server generates and saves a "10% discount coupon" template and related explanatory materials.

[1110] Step 5:

[1111] At the time specified by the user, the server connects the user to the AI ​​via a video conferencing system. The AI ​​provides support to the user based on pre-prepared materials and adjusts its responses and suggestions based on the user's facial expressions and voice.

[1112] Input: User-specified time, URL of video conferencing system

[1113] Output: AI-user connection and support provided

[1114] How it works: The server generates a Zoom meeting link and connects the user with the AI ​​at the specified time. The AI ​​explains how to use the coupon service, and the emotion engine identifies the user's emotions and makes appropriate suggestions.

[1115] Step 6:

[1116] Once the coupon or stamp card campaign has ended, the server collects data for effectiveness verification and automatically generates effectiveness verification materials, which are translated into the user's preferred language and made available in a downloadable format.

[1117] Input: Campaign usage data

[1118] Output: Effectiveness verification document (translated)

[1119] Specific operation: The server generates a "Coupon Campaign Effectiveness Report," translates it into Japanese and English, and provides it to the user.

[1120] Step 7:

[1121] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[1122] Input: User download request

[1123] Output: Downloadable effectiveness verification materials

[1124] Specific operation: The user downloads the "Coupon Campaign Effectiveness Report" from the system's download page.

[1125] Step 8:

[1126] The server will provide information about new paid services, set up an AI session to provide detailed explanations and instructions on how to implement them, and assist with the contract process if necessary.

[1127] Input: User request

[1128] Output: AI-generated detailed explanation and contract documents

[1129] Specific operation: The server schedules an AI briefing based on the user request and then sends the contract documents.

[1130] In this way, this system helps member stores use its services efficiently, is available 24 hours a day, supports multiple languages, and can recognize users' emotions to provide appropriate responses and suggestions.

[1131] (Application example 2)

[1132] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1133] Recently, many stores have been facing challenges in providing multilingual services and customer support. With the increasing number of foreign tourists, it has become increasingly difficult for employees to provide multilingual support, creating a need to improve customer satisfaction. Understanding customer sentiment and providing appropriate responses is also important, but implementing this in real time requires advanced technology. Furthermore, properly analyzing the effectiveness of coupons and promotions and implementing promotional activities tailored to each customer has become an essential element of store management. A system that can effectively resolve these issues is needed.

[1134] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes emotion recognition means, multilingual support means, and material provision means. This enables real-time support in multiple languages ​​and responses based on customer emotions. In addition, by automatically generating materials to verify the effectiveness of coupons and stamp cards and making the analysis results available for download, the efficiency of store operations and customer satisfaction are improved.

[1135] "Input means" refers to the devices and software used to accept data input from affiliated stores.

[1136] "Database means" refers to a system for saving input data and keeping it available for reference.

[1137] "Materials generation means" means the process or software for automatically generating the necessary supporting materials based on the stored data.

[1138] "AI means" refers to devices or systems that use artificial intelligence to provide appropriate support to affiliated stores based on the generated support materials.

[1139] "Communication means" refers to the network or device that allows the affiliated store to connect with the AI ​​in real time at the time specified by the affiliated store.

[1140] "Material provision means" refers to the process or system for generating materials for verifying the effectiveness of coupons and stamp cards and making them available for download.

[1141] "Emotion recognition means" refers to technology or software that recognizes emotions from customers' facial expressions, voice, etc., and adjusts responses and suggestions based on that information.

[1142] "Multilingual support means" refers to technologies and systems for generating multilingual content and responding appropriately to customers.

[1143] This invention provides a customer support system for brick-and-mortar stores that supports multiple languages ​​and has emotion recognition capabilities. The following describes the procedure and specific configuration for building this system.

[1144] First, this system includes "input means," "database means," "document generation means," "AI means," "communication means," "document provision means," "emotion recognition means," and "multilingual support means." Each of these means will be explained below.

[1145] 1. Input method:

[1146] Store staff, who are users, use smartphones or smart glasses to input data necessary for customer service, including customer questions, requests, images, and videos.

[1147] 2. Database means:

[1148] The server receives the entered data and stores it in a database, which contains customer details and transaction history.

[1149] 3. Material generation means:

[1150] The server automatically generates supporting materials such as coupons and stamp cards based on the stored data.

[1151] 4. AI means:

[1152] Based on the generated materials, AI provides appropriate support to users. AI utilizes generative AI models to make optimal proposals to individual customers.

[1153] 5. Means of communication:

[1154] The server connects to the AI ​​in real time via an online conference system (e.g., Zoom, Microsoft Teams) at a time designated by the store staff, enabling real-time support.

[1155] 6. Material provision method:

[1156] The server analyzes the effectiveness of coupon and stamp card campaigns, generates effectiveness verification materials based on the analysis results, and provides them in a downloadable format.

[1157] 7. Emotion recognition means:

[1158] The server uses emotion analysis software (e.g., Azure Face API, Google Cloud Vision API) to recognize emotions from the customer's facial expressions and voice, and adjusts the response appropriately.

[1159] 8. Multilingual support means:

[1160] The server uses the Google Translate API or similar to generate multilingual content and respond to the customer.

[1161] For example, if a foreign tourist visiting a physical store asks in English, "Please tell me more about this product," the system works as follows: First, a store staff member inputs the customer's video and audio through smart glasses and sends them to the server. Based on this video and audio, the server uses the emotion recognition means to analyze the customer's emotions. At the same time, the multilingual support means analyzes the English question and generates an appropriate response. The AI ​​means then uses the generated AI model to provide the customer with the most appropriate product information and related benefits. Specific examples of prompt sentences include:

[1162] "Given the customer's query: 'Can you tell me more about this product?' and the detected emotion: 'interest', generate a detailed response in English that includes related product suggestions and a special discount offer."

[1163] In this way, a system that combines a server and various means can effectively provide customer support in physical stores through multilingual support and emotion recognition.

[1164] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1165] Step 1:

[1166] The store staff, who are the users, use the smart glasses to input customer questions and requests. The terminal captures images and videos of the customer and also accepts voice input. This input data includes the customer's questions, images, and voice data.

[1167] Step 2:

[1168] The terminal transmits the acquired data to the server. The server receives this data and stores it in a database. Specifically, the database stores the customer's question, video data, and audio data.

[1169] Step 3:

[1170] The server analyzes emotions using emotion recognition techniques based on the data stored in the database. For example, it uses Azure Face API or Google Cloud Vision API to read emotions from the customer's facial expressions. This process outputs emotional data such as whether the customer is interested or anxious.

[1171] Step 4:

[1172] The server analyzes the customer's question using multilingual support. Using a Google Translate API or similar, it converts the input language (e.g., English) into Japanese and generates an appropriate response. The response is created using a generative AI model, and answer data in text format is generated.

[1173] Step 5:

[1174] The server combines the generated response data with the emotion data to generate optimal suggestions. Using a generative AI model, it provides appropriate product information and special offers based on the prompt. The following prompts are used in this step:

[1175] "Given the customer's query: 'Can you tell me more about this product?' and the detected emotion: 'interest', generate a detailed response in English that includes related product suggestions and a special discount offer."

[1176] Step 6:

[1177] The server sends the generated suggestions and response data to the terminal, which then displays this data to the store staff member who is the user. The staff member then responds appropriately to the customer through the smart glasses.

[1178] Step 7:

[1179] After the interaction with the customer is completed, the server analyzes the effectiveness of the coupons and promotions. The server generates effectiveness verification materials using the material generation means and provides them in a downloadable format through the material provision means. The materials include campaign results and customer feedback.

[1180] In this way, customer support is provided across the entire system, improving customer satisfaction and streamlining store operations.

[1181] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1182] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1183] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1184] [Fourth embodiment]

[1185] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1186] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1187] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1188] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1189] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1190] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1191] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1192] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1193] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1194] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1195] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1196] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1197] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1198] This invention is a system that helps merchants efficiently use specific services, and provides 24-hour, multilingual AI support. This system receives input data from merchants, generates necessary support materials based on that data, and provides real-time support through AI.

[1199] Program processing explanation

[1200] Initial Setup

[1201] When a user (a franchisee owner) creates a new account, they enter basic information, including the store name, location, representative name, and contact information. The server receives this information and stores it in a database. Once a new account is created, the server sends a confirmation email to the user.

[1202] Example: When a user enters the store name "ABC Cafe," location "Tokyo," representative name "Yamada Taro," and contact information "123-4567" into an online form and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[1203] Receiving form input

[1204] Users enter their desired support needs or concerns into an online form. For example, options such as issuing coupons, issuing stamp cards, or signing up for a light plan are displayed. Users can check these options or enter details in the text boxes.

[1205] Example: The user checks "Issue Coupon" and enters the text "10% discount rate." The device sends this to the server.

[1206] Data transmission and processing

[1207] The terminal sends the data entered by the user to the server, which receives the data, stores it in a database, and prepares it for further processing.

[1208] Example: The server receives the information "Coupon issued, 10% discount rate" and records it in the database.

[1209] Preparation of support content

[1210] The server automatically generates appropriate support materials based on the received data, including coupon templates and stamp card design materials, and organizes the generated materials so that support can be provided at the time specified by the user.

[1211] Example: The server generates a template for a "10% discount coupon" and also provides explanatory material about it.

[1212] Real-time support with AI

[1213] The server connects the user to the AI ​​via an online conference system at a time specified by the user. The AI ​​communicates with the user via video and audio, providing support based on pre-prepared materials.

[1214] Example: At the time specified by the user, the server starts a Zoom meeting, and the AI ​​provides a detailed explanation in response to the question, "How can we use the coupon service to increase sales?"

[1215] Providing data to verify effectiveness

[1216] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials and translates them into the user's preferred language. These materials can be accessed from a dedicated download page.

[1217] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as specified by the user, and provides a download link from a dedicated portal.

[1218] Paid service information and support

[1219] If a user shows interest in a new paid service, the server will use AI to explain the details of the service, guide them on how to install it, and also support them in the contract process.

[1220] Example: When a user sends a request saying, "I'd like to know about the new paid plan," the server schedules a detailed briefing session with AI and then sends the contract documents.

[1221] The present invention allows the construction of a system that can provide multilingual support 24 hours a day, enabling the various needs of member stores to be met promptly and effectively.

[1222] The processing flow will be explained below.

[1223] Step 1: Create a new account

[1224] To create a new account, a user enters basic information such as the store name, location, representative name, and contact information into the online form and presses the submit button. The terminal sends the entered data to the server, which stores the received data in a database and sends a confirmation email to the user.

[1225] Step 2: Enter your support request

[1226] The user accesses the provided online form and selects the support they want (coupon issuance, stamp card issuance, light plan contract, etc.). For example, the user checks "coupon issuance" and enters "10% discount rate." The terminal sends this data to the server.

[1227] Step 3: Save your data

[1228] The server receives the support request and detailed information sent from the device and stores it in a database. Based on this data, it prepares for the next processing step.

[1229] Step 4: Generate supporting materials

[1230] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" and related explanatory materials. The generated materials are organized so that support can be provided at the time specified by the user.

[1231] Step 5: Preparing for real-time support

[1232] The user receives a link to access the online conference system at a pre-specified time. The server then launches the online conference system (e.g., Zoom) at the specified time and prepares to connect the AI ​​with the user.

[1233] Step 6: Real-time support with AI

[1234] The server starts an online meeting at the specified time and connects the AI ​​with the user. The AI ​​interacts with the user via video and audio, providing detailed support based on pre-generated support materials. For example, it provides an explanation in response to a question such as, "How can we use coupon services to increase sales?"

[1235] Step 7: Create materials to verify effectiveness

[1236] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[1237] Step 8: Provide data to verify effectiveness

[1238] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials. For example, a "Coupon Campaign Effectiveness Report" can be made available for download in both Japanese and English.

[1239] Step 9: Paid service information

[1240] The server uses AI to provide users with information about new paid services. If the user shows interest in a paid plan, the AI ​​will provide a detailed explanation and instructions on how to install it, and will also assist with the necessary contract procedures.

[1241] The above steps will realize an AI support system that can provide multilingual support 24 hours a day, allowing it to respond quickly and effectively to the diverse needs of member stores.

[1242] Example 1

[1243] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1244] Currently, many affiliated stores struggle with providing 24-hour multilingual support, requiring fast and efficient support. However, current systems make it difficult to provide real-time support or generate effective support materials, making it particularly difficult to respond quickly to a wide range of support requests. For this reason, a system is needed to improve the operational efficiency of affiliated stores and enhance the quality of customer service.

[1245] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1246] In this invention, the server includes input means for accepting input from affiliated stores, database means for saving the input data, material generation means for generating support materials based on the saved data, artificial intelligence means for providing support to affiliated stores based on the generated support materials, communication means for connecting with the artificial intelligence in real time at a time specified by the affiliated store, material provision means for generating effectiveness verification materials for coupons and point cards and making them available for download, selection means for selecting the type of support desired, schedule means for organizing the support materials at a set time, and analysis means for answering user questions. This enables multilingual support 24 hours a day, making it possible to respond quickly and effectively to the diverse needs of affiliated stores.

[1247] "Input means" refers to a means for accepting input data from affiliated stores.

[1248] The "database means" is a means for saving and managing input data.

[1249] The "material generation means" is a means for automatically generating support materials based on the stored data.

[1250] "Artificial intelligence means" means means for providing real-time assistance to merchants based on the generated support materials.

[1251] "Communication means" refers to the means by which a member store can connect with artificial intelligence in real time at a time specified by the member store.

[1252] The "material providing means" is a means for generating effectiveness verification materials such as coupons and point cards and making them available for download.

[1253] The "selection means" is a means for the user to select the type of support they would like to receive.

[1254] The "scheduling means" is a means for organizing and providing the generated support materials at a set time.

[1255] "Analysis means" is a means for deriving appropriate answers to user questions and requests.

[1256] This invention is a system that supports member stores in efficiently using specific services, and provides 24-hour, multilingual artificial intelligence (AI) support. The system is configured as follows:

[1257] System Configuration

[1258] 1. Input Method

[1259] When a user (a franchisee owner) creates a new account, he or she inputs basic information through input means. The basic information includes the store name, location, representative name, contact information, etc. The information received through the input means is sent to the server.

[1260] 2. Database Means

[1261] The server receives the basic information sent from the input means and stores the information in a database using the database means. The database centrally manages the basic information and history data of each member store.

[1262] 3. Material generation means

[1263] The server includes a material generation unit for automatically generating supporting materials based on the data stored in the database, such as coupon templates and point card design materials.

[1264] 4. Artificial Intelligence Means

[1265] The server uses artificial intelligence (AI) to provide support to merchants based on the generated support materials. AI uses machine learning models (e.g., generative AI models) to generate optimal answers to user questions.

[1266] 5. Means of communication

[1267] The server is equipped with a communication method that allows the merchant to connect with the AI ​​in real time at a time designated by the merchant, such as a video conferencing system like Zoom.

[1268] 6. Means of providing materials

[1269] The server automatically generates and provides downloadable materials for verifying the effectiveness of coupons and point card campaigns after they have ended. The materials are translated into multiple languages ​​and uploaded to a dedicated download page accessible to users.

[1270] 7. Selection Method

[1271] Users use a selection method to select the type of support they would like to receive. For example, an online form displays options such as "Coupon issue," "Point card issue," and "Light plan contract," and the user can select the option they want.

[1272] 8. Scheduling Tools

[1273] The server is provided with a scheduling means for organizing the generated support materials at a set time, thereby enabling support to be provided with appropriate materials at a user-specified time.

[1274] 9. Analysis methods

[1275] The server has an analysis means for deriving appropriate answers to the user's questions. This analysis means analyzes the received data and provides the most appropriate answers and support materials.

[1276] Specific examples

[1277] When a user enters the store name "XYZ Cafe," location "Osaka Prefecture," representative name "Ichiro Tanaka," and contact information "987-6543" into the online form and presses the send button, the server receives this information and stores it in a database. The server then sends a confirmation email to the user. Similarly, if the user checks "Issue Coupon" and enters a discount rate of "5%," the device sends this information to the server. Based on the received data, the server generates a "5% Discount Coupon" template and organizes it using a scheduling tool along with explanatory materials. At the specified time, the server starts a Zoom meeting via communication means, and AI provides real-time support to the user.

[1278] In this way, the system is capable of providing multilingual support 24 hours a day, enabling it to quickly and effectively respond to the diverse needs of member stores.

[1279] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1280] Step 1:

[1281] A user accesses the system's login page and selects to create a new account. They enter the store name, address, representative name, and contact information in the online form and click the submit button.

[1282] Input: Store name, address, representative name, contact information

[1283] Output: Send to server

[1284] Specific operation: The server receives this information, stores it in the database, and simultaneously sends a confirmation email to the user's email address.

[1285] Step 2:

[1286] The user clicks on the link in the confirmation email to verify their email address.

[1287] Input: Click on the link in the confirmation email

[1288] Output: Account Activation

[1289] What happens: The server detects that the link was clicked and validates the user's email address. The user can then log in to the system.

[1290] Step 3:

[1291] The user logs in to the system and accesses the support request form.

[1292] Check the desired option from the options such as coupon issuance, stamp card issuance, etc., and enter detailed information in the text box.

[1293] Input: Select the support you want and enter detailed information

[1294] Output: From the terminal to the server

[1295] Specific operation: The terminal sends this information to the server, which stores the received information in a database.

[1296] Step 4:

[1297] The server automatically generates supporting materials based on the received data using a material generation means, for example, generating coupon templates and stamp card design materials.

[1298] Input: Support request stored in the database

[1299] Output: Generated coupon or design document

[1300] Specific operation: The server generates a template based on the coupon's discount rate and conditions, and creates corresponding explanatory materials.

[1301] Step 5:

[1302] The server organizes the generated support materials using a scheduling means and sets them up so that they can be provided at a time designated by the user.

[1303] Input: Generated support materials, user-specified time

[1304] Output: Scheduled material delivery

[1305] Specific operation: The server sets a schedule and makes the necessary preparations to distribute the material at the specified time.

[1306] Step 6:

[1307] The server connects the AI ​​and the user at the designated time through a communication method, such as a video conferencing system like Zoom.

[1308] Input: A specified time, a user connection request

[1309] Output: Real-time connection between user and AI

[1310] Specific operation: The server starts a Zoom meeting, and the AI ​​communicates with the user via video and audio. The AI ​​provides support based on pre-prepared materials.

[1311] Step 7:

[1312] The AI ​​uses analytical tools to provide answers to user questions and requests, and shares the screen if necessary.

[1313] Input: User question or request

[1314] Output: Optimized answer or support

[1315] Specific operation: The AI ​​analyzes the received data and derives appropriate answers. It also provides specific explanations while sharing materials on the screen.

[1316] Step 8:

[1317] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials, translates them into the desired language, and makes them accessible from a dedicated download page.

[1318] Input: Campaign result data

[1319] Output: Effectiveness verification materials, download link

[1320] Specific operation: The server retrieves the campaign results from the database and analyzes specific indicators (number of users, sales increase rate, etc.). It then generates effectiveness verification documents translated into Japanese and English and uploads them to a dedicated portal.

[1321] Step 9:

[1322] If a user shows interest in a new paid service, the server will provide details, guide them through the installation process, and assist with the contract process.

[1323] Input: User request

[1324] Output: Paid plan details, contract documents

[1325] Specific operation: The server receives a request from the user, schedules a detailed explanation session for the paid plan, and then sends the contract documents and assists in the contract procedure.

[1326] This enables the system to provide multilingual support 24 hours a day, enabling it to respond quickly and effectively to the diverse needs of member stores.

[1327] (Application example 1)

[1328] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1329] Conventional systems make it difficult for affiliated stores to efficiently carry out marketing activities, and do not adequately support multiple languages. As a result, real-time support and the provision of effectiveness verification materials tend to be delayed, and there are problems with the quality of customer support declining due to time and language constraints. The present invention aims to solve these problems and provide a system that allows affiliated stores to efficiently carry out various marketing activities and receive support in multiple languages.

[1330] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1331] In this invention, the server includes input means for accepting input from affiliated stores, database means for saving the input data, material generation means for generating support materials based on the saved data, AI means for providing support to affiliated stores based on the generated support materials, communication means for connecting with the AI ​​in real time at a time specified by the affiliated store, material provision means for generating effectiveness verification materials for coupons and stamp cards and making them available for download, multilingual support means for providing support for effectively conducting marketing activities based on the generated support materials, and translation means for translating the effectiveness verification materials into a desired language. This allows affiliated stores to receive efficient multilingual support and conduct high-quality marketing activities in real time.

[1332] "Input means" refers to devices and software for accepting input from affiliated stores.

[1333] "Database means" refers to a system for storing and managing input data.

[1334] The "material generation means" is a function that automatically creates the necessary supporting materials based on the stored data.

[1335] "AI means" refers to artificial intelligence that provides support to affiliated stores based on the generated support materials.

[1336] "Communication means" refers to the communication technology and systems that enable member stores to connect with AI in real time at the time they specify.

[1337] "Material provision means" refers to a system that generates materials for verifying the effectiveness of coupons and stamp cards and makes them available for member stores to download.

[1338] "Multilingual support means" refers to a function that provides support for effectively conducting marketing activities in multiple languages ​​based on generated support materials.

[1339] "Translation means" refers to a device or software that automatically translates the effectiveness verification materials into the desired language.

[1340] This invention is a system that provides 24-hour, multilingual AI support to affiliated stores. This system consists of the following main components:

[1341] 1. Input method for accepting input from affiliated stores

[1342] The server provides an input method for accepting data entered by franchise owners, including basic information such as store name, address, representative name, contact details, etc. This data is entered using a web form or a smartphone application.

[1343] Examples:

[1344] When a user enters the store name "Cafe ABC," location "Tokyo," representative name "Yamada Taro," and contact information "123-4567" into the online form and presses the submit button, the server receives this information, registers it in the database, and sends a confirmation email.

[1345] 2. Database Means

[1346] The server has a database to store and manage the input data. SQLAlchemy is used to store the data in the SQL database.

[1347] 3. Material generation means

[1348] The server automatically generates marketing support materials such as coupons and stamp cards based on the stored data, allowing affiliated stores to easily obtain effective marketing tools.

[1349] Examples:

[1350] The server generates a template for a "10% off coupon" and also provides specific explanatory material about it.

[1351] 4. AI means

[1352] The AI ​​method provides real-time multilingual support to merchants based on the generated support materials, and is implemented using a generative AI model.

[1353] 5. Means of communication

[1354] The communication method is a technology or system that allows the affiliated store to connect with the AI ​​in real time at a time specified by the affiliated store, and the connection is made via a video conferencing system (e.g., Zoom).

[1355] Examples:

[1356] At the time specified by the user, the server will start a Zoom meeting, and the AI ​​will provide a detailed explanation in response to the question, "How can we use the coupon service to increase sales?"

[1357] 6. Means of providing materials

[1358] The server automatically generates campaign effectiveness verification materials, translates them into the desired language, and makes them accessible from a dedicated download page.

[1359] Examples:

[1360] The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as specified by the user, and provides a download link from a dedicated portal.

[1361] 7. Multilingual support and translation methods

[1362] The server provides multilingual support to ensure effective marketing activities based on the generated support materials, and also has the function to automatically translate the effectiveness verification materials into the desired language.

[1363] Example prompt sentence:

[1364] "The owner of Cafe ABC would like to issue a coupon (10% discount). Please prepare supporting materials and explain them during a Zoom meeting at the specified time. After the meeting, please generate effectiveness verification materials in Japanese and English and make them accessible from the download page."

[1365] This system allows affiliated stores to receive efficient multilingual support and conduct high-quality marketing activities in real time.

[1366] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1367] Step 1:

[1368] A user enters basic information into an online form.

[1369] Specifically, enter the store name, address, representative name, contact information, etc., and press the send button. At this time, the entered information is sent from the terminal to the server.

[1370] Input: Basic information such as store name, address, representative name, contact information, etc.

[1371] Output: Basic information data sent to the server

[1372] Step 2:

[1373] The server saves the received basic information data to the database. At this time, it stores the data in the SQL database using SQLAlchemy. After the information is saved correctly, it sends a confirmation email.

[1374] Input: Basic information data

[1375] Output: Information stored in database, confirmation email sent

[1376] Step 3:

[1377] The user enters the support request (coupon issuance, stamp card issuance, etc.) into the online form. Specifically, the user selects and fills in the desired content and details, and presses the send button. This data is sent from the terminal to the server.

[1378] Input: Support request and details

[1379] Output: Support request data sent to the server

[1380] Step 4:

[1381] The server stores the received support request data in a database. It then generates support materials based on the stored data. Specifically, it automatically generates coupons and stamp cards using templates.

[1382] Input: Support request data

[1383] Output: Generated supporting materials

[1384] Step 5:

[1385] At the time specified by the user, the server connects the AI ​​and the user using a communication method. Specifically, the connection is made in real time using a video conferencing system (e.g., Zoom). The AI ​​provides support to the affiliated store in real time based on the generated support materials.

[1386] Input: Connection time, generated support materials

[1387] Output: Real-time AI support

[1388] Step 6:

[1389] After the coupon or stamp card campaign ends, the server automatically generates effectiveness verification materials. It also translates them into the desired language and makes them accessible from a dedicated download page. Specifically, the server uses a generative AI model to automatically generate effectiveness verification materials in multiple languages.

[1390] Input: Campaign result data, desired language

[1391] Output: Multilingual support effectiveness verification materials

[1392] Step 7:

[1393] The server uploads the generated effectiveness verification materials to a dedicated portal for member stores to download. Users can download the necessary materials from the dedicated portal.

[1394] Input: Multilingual support effectiveness verification materials

[1395] Output: Download link, downloaded verification data

[1396] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1397] This invention is a system that helps member stores use services efficiently, and is available 24 hours a day in multiple languages, and provides AI support including an emotion engine that recognizes user emotions. This system receives input data from member stores, generates necessary support materials based on that data, provides support in real time through AI, and recognizes user emotions to respond and make appropriate suggestions.

[1398] Program processing explanation

[1399] Initial Setup

[1400] When a user (a member store owner) creates a new account, they enter basic information such as the store name, location, representative name, and contact details into an online form and press the submit button. The server stores the received data in a database and sends a confirmation email to the user.

[1401] Example: When a user fills out an online form with "XYZ Cafe," its location "Osaka Prefecture," its representative's name "Ichiro Sato," and contact information "080-1234-5678," and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[1402] Enter your support request

[1403] The user accesses the provided online form, selects the desired support content (e.g., coupon issuance, stamp card issuance, light plan contract), and enters the necessary details. For example, if "coupon issuance" is selected, the user enters "10% discount rate."

[1404] Example: When a user checks "Issue coupon" and enters the text "10% discount rate," the terminal sends this to the server.

[1405] Data transmission and processing

[1406] The terminal sends the data entered by the user to the server, which receives the data and stores it in a database.

[1407] Example: The server receives the information "Coupon issued, 10% discount" and records it in the database.

[1408] Generate supporting materials

[1409] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" and related explanatory materials. The generated materials are organized so that support can be provided at the time specified by the user.

[1410] Example: The server generates a template for a "10% off coupon" and provides explanatory materials about it.

[1411] Real-time support with emotion engine

[1412] The server connects the user to the AI ​​via an online conference system at a time specified by the user. The AI ​​communicates with the user via video and audio, providing support based on pre-prepared materials. In addition, the emotion engine identifies emotions from the user's facial expressions and voice, and adjusts responses and suggestions accordingly.

[1413] Example: At the time specified by the user, the server starts a Zoom meeting, and the AI ​​explains how to use the coupon service to increase sales. The emotion engine analyzes the user's tone of voice and facial expressions, detects excitement or anxiety, and makes appropriate suggestions accordingly.

[1414] Creation of effectiveness verification materials

[1415] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[1416] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into Japanese and English as desired by the user, and makes it available for download from a dedicated portal.

[1417] Providing data to verify effectiveness

[1418] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[1419] Example: A user downloads a "Coupon Campaign Effectiveness Report" in Japanese and English.

[1420] Paid service information

[1421] The server uses AI to provide users with information about new paid services, providing detailed explanations and instructions on how to install them, and assisting with contract procedures if necessary.

[1422] Example: When a user sends a request to "learn about new paid plans," the server schedules a detailed briefing session with AI and then sends the contract documents.

[1423] The system of this invention provides 24-hour, multilingual AI support, and by recognizing user emotions and adjusting responses accordingly, it is possible to quickly and effectively respond to the diverse needs of member stores.

[1424] The processing flow will be explained below.

[1425] Step 1: Create a new account

[1426] To create a new account, a user enters basic information such as the store name, location, representative name, and contact information into the online form and presses the submit button. The terminal sends the entered data to the server, which stores the received data in a database and sends a confirmation email to the user.

[1427] Example: When a user fills out an online form with "XYZ Cafe," its location "Osaka Prefecture," its representative's name "Ichiro Sato," and contact information "080-1234-5678," and presses the submit button, the server receives this information, registers it in a database, and sends a confirmation email.

[1428] Step 2: Enter your support request

[1429] The user accesses the provided online form, selects the desired support content (e.g., coupon issuance, stamp card issuance, light plan contract), and enters the necessary details. For example, if "coupon issuance" is selected, the user enters "10% discount rate."

[1430] Example: When a user checks "Issue coupon" and enters the text "10% discount rate," the terminal sends this to the server.

[1431] Step 3: Send and process data

[1432] The terminal sends the data entered by the user to the server, which receives the data and stores it in a database.

[1433] Example: The server receives the information "Coupon issued, 10% discount" and records it in the database.

[1434] Step 4: Generate supporting materials

[1435] The server automatically generates appropriate support materials based on the stored data. For example, it generates a template for a "10% discount coupon" or design materials for a stamp card. The generated materials are organized so that support can be provided at the time specified by the user.

[1436] Example: The server generates a template for a "10% off coupon" and also provides explanatory material about it.

[1437] Step 5: Preparing for real-time support

[1438] The user receives a link to access the online conference system at a pre-specified time. The server then launches the online conference system (e.g., Zoom) at the specified time and prepares to connect the user with the AI.

[1439] Example: The server sends a Zoom meeting invitation link to the user at the time specified by the user.

[1440] Step 6: Real-time support with AI

[1441] The server starts an online meeting at the specified time and connects the AI ​​with the user. The AI ​​interacts with the user via video and audio, providing detailed support based on pre-generated support materials. The emotion engine also identifies emotions from the user's facial expressions and voice, and adjusts responses and suggestions accordingly.

[1442] Example: When a user joins a Zoom meeting, the server connects with the user via AI, which then provides detailed explanations in response to questions such as, "How can we use coupon services to increase sales?" The emotion engine analyzes the user's tone of voice and facial expressions, detects excitement or anxiety, and makes appropriate suggestions accordingly.

[1443] Step 7: Create materials to verify effectiveness

[1444] Once the coupon or stamp card campaign has ended, the server collects data to verify its effectiveness and automatically generates verification materials, which are translated into the user's preferred language and made available for download.

[1445] Example: The server generates a "Coupon Campaign Effectiveness Report," translates it into both Japanese and English as desired by the user, and provides a download link from a dedicated portal.

[1446] Step 8: Provide data to verify effectiveness

[1447] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[1448] Example: A user downloads a "Coupon Campaign Effectiveness Report" in Japanese and English.

[1449] Step 9: Paid service information

[1450] The server uses AI to provide users with information about new paid services, providing detailed explanations and instructions on how to install them, and assisting with contract procedures if necessary.

[1451] Example: When a user sends a request to "learn about new paid plans," the server schedules a detailed briefing session with AI and then sends the contract documents.

[1452] Through these steps, an AI support system that can provide multilingual support 24 hours a day will be realized, and by recognizing user emotions and adjusting responses accordingly, it will be able to quickly and effectively respond to the diverse needs of affiliated stores.

[1453] Example 2

[1454] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1455] With the previous system, it was difficult for affiliated stores to receive multilingual support 24 hours a day. It was also unable to recognize user emotions and provide appropriate responses and suggestions in real time, which could result in a decline in the quality of support. Furthermore, the creation of documents to verify the effectiveness of coupons and stamp cards was not automated, which was a time-consuming process.

[1456] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for accepting input from affiliated stores, a database means for saving the input data, a material generation means for generating support materials based on the saved data, an AI means for providing support to affiliated stores based on the generated support materials, a communication means for connecting with the AI ​​in real time at a time specified by the affiliated store, a material provision means for generating and downloading coupon and stamp card effectiveness verification materials, and an emotion recognition means for identifying the user's emotions and adjusting responses and suggestions. This enables high-quality support in multiple languages ​​around the clock, allowing appropriate responses and suggestions to be made based on the user's emotions. Furthermore, it enables automatic generation of coupon and stamp card effectiveness verification materials, enabling more effective support to be provided.

[1457] "Affiliate" refers to a company or individual business that provides a specific service or product.

[1458] "Input means" refers to an interface through which a user inputs information into a system.

[1459] "Database means" refers to a system or software for storing and managing input information.

[1460] "Material generation means" refers to a system or software that automatically generates the necessary support materials based on stored data.

[1461] "AI means" refers to a system that uses artificial intelligence technology to provide automated support.

[1462] "Communication means" refers to the interface or network for sending and receiving information and data between the system and the user in real time.

[1463] "Material provision means" refers to a system or software that generates materials for verifying the effectiveness of coupons or stamp cards and provides them to users in a downloadable format.

[1464] "Emotion recognition means" refers to a system or software that identifies emotions from a user's facial expressions and voice and adjusts responses and suggestions accordingly.

[1465] This invention is a system that supports member stores in efficiently using their services. This system provides 24-hour, multilingual support, and is characterized by its ability to recognize users' emotions and provide appropriate responses and suggestions. Specific embodiments are described below.

[1466] 1. The user accesses the system, opens the new account creation page, enters basic information such as the store name, location, representative name, and contact information into the online form, and presses the submit button. For example, a user enters "Cafe ABC," location "Tokyo," representative name "Taro Tanaka," and contact information "090-1234-5678" into the online form and presses the submit button.

[1467] 2. The device receives the entered information and sends it to the server as an HTTP POST request. The server verifies the received data and saves it in the database. After saving is complete, the server sends a confirmation email to the user.

[1468] 3. The user accesses the support request entry form, selects the support they want (e.g., coupon issuance, stamp card issuance, etc.), and enters the necessary details. For example, they select "coupon issuance" and enter "10% discount rate." The terminal sends this information to the server.

[1469] 4. The server stores the received data in a database and automatically generates the necessary support materials based on the stored data. For example, it generates a template and explanatory materials for a "10% discount coupon." The generated materials are organized so that support can be provided at the time specified by the user.

[1470] 5. At the time specified by the user, the server connects the AI ​​to the user via a video conferencing system. For example, it can send a Zoom link and connect the AI ​​to the user at the specified time. The AI ​​provides support based on pre-prepared materials and identifies emotions from the user's facial expressions and voice to provide appropriate responses and suggestions.

[1471] 6. Once the coupon or stamp card campaign has ended, the server collects data for effectiveness verification and automatically generates effectiveness verification materials. These materials are translated into the user's preferred language and provided in a downloadable format. Users can access the effectiveness verification materials from a dedicated download page and download the materials they need. For example, they can download a "Coupon Campaign Effectiveness Report" in both Japanese and English.

[1472] The system provides 24-hour, multilingual AI support, and by identifying user emotions and responding appropriately, it can quickly and effectively meet the diverse needs of affiliated stores. Furthermore, it can provide effective support by automatically generating materials to verify the effectiveness of coupons and stamp cards.

[1473] Example prompt sentence:

[1474] To create a new account, please enter your store name, address, representative name, and contact information.

[1475] "Select the support you would like and enter details, such as the discount rate."

[1476] "Please join the online support meeting at the specified time. We will also be conducting a sentiment analysis, so please relax and enjoy the meeting."

[1477] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1478] Step 1:

[1479] The user accesses the system, opens the new account creation page, and enters basic information such as the store name, location, representative name, contact information, etc. into the online form. The entered data is captured by the terminal as HTML form data.

[1480] Input: "Store name", "Address", "Representative name", "Contact information"

[1481] Output: The device generates an HTTP POST request and sends the input data to the server.

[1482] Specific operation: The user enters "Cafe ABC", location "Tokyo", representative name "Taro Tanaka", contact information "090-1234-5678", and presses the send button.

[1483] Step 2:

[1484] The server parses the received HTTP POST request and validates the data to prepare it for storage in the database. After the validation is complete, the server saves the information in the database and sends a confirmation email to the user.

[1485] Input: User information received from the device

[1486] Output: User information stored in the database and a confirmation email sent to the user.

[1487] What happens: The server saves the user information in a database and sends a confirmation email to the user's email address.

[1488] Step 3:

[1489] The user accesses the support request input form, selects the support type they want, and enters detailed information. The device captures this information and sends it to the server as an HTTP POST request.

[1490] Input: "Support details", "Detailed information"

[1491] Output: The device generates an HTTP POST request and sends the input data to the server.

[1492] Specific operation: The user selects "Issue coupon", enters "10% discount rate", and presses the submit button.

[1493] Step 4:

[1494] The server stores the received data in a database and automatically generates the necessary support materials based on the stored data. For example, it creates a template for a "10% discount coupon" and its explanatory materials.

[1495] Input: Support request received from device

[1496] Output: Supporting materials (e.g., "10% off coupon" template and explanatory materials)

[1497] Specific operation: The server generates and saves a "10% discount coupon" template and related explanatory materials.

[1498] Step 5:

[1499] At the time specified by the user, the server connects the user to the AI ​​via a video conferencing system. The AI ​​provides support to the user based on pre-prepared materials and adjusts its responses and suggestions based on the user's facial expressions and voice.

[1500] Input: User-specified time, URL of video conferencing system

[1501] Output: AI-user connection and support provided

[1502] How it works: The server generates a Zoom meeting link and connects the user with the AI ​​at the specified time. The AI ​​explains how to use the coupon service, and the emotion engine identifies the user's emotions and makes appropriate suggestions.

[1503] Step 6:

[1504] Once the coupon or stamp card campaign has ended, the server collects data for effectiveness verification and automatically generates effectiveness verification materials, which are translated into the user's preferred language and made available in a downloadable format.

[1505] Input: Campaign usage data

[1506] Output: Effectiveness verification document (translated)

[1507] Specific operation: The server generates a "Coupon Campaign Effectiveness Report," translates it into Japanese and English, and provides it to the user.

[1508] Step 7:

[1509] Users can access the effectiveness verification materials from a dedicated download page and download the necessary materials.

[1510] Input: User download request

[1511] Output: Downloadable effectiveness verification materials

[1512] Specific operation: The user downloads the "Coupon Campaign Effectiveness Report" from the system's download page.

[1513] Step 8:

[1514] The server will provide information about new paid services, set up an AI session to provide detailed explanations and instructions on how to implement them, and assist with the contract process if necessary.

[1515] Input: User request

[1516] Output: AI-generated detailed explanation and contract documents

[1517] Specific operation: The server schedules an AI briefing based on the user request and then sends the contract documents.

[1518] In this way, this system helps member stores use its services efficiently, is available 24 hours a day, supports multiple languages, and can recognize users' emotions to provide appropriate responses and suggestions.

[1519] (Application example 2)

[1520] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1521] Recently, many stores have been facing challenges in providing multilingual services and customer support. With the increasing number of foreign tourists, it has become increasingly difficult for employees to provide multilingual support, creating a need to improve customer satisfaction. Understanding customer sentiment and providing appropriate responses is also important, but implementing this in real time requires advanced technology. Furthermore, properly analyzing the effectiveness of coupons and promotions and implementing promotional activities tailored to each customer has become an essential element of store management. A system that can effectively resolve these issues is needed.

[1522] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes emotion recognition means, multilingual support means, and material provision means. This enables real-time support in multiple languages ​​and responses based on customer emotions. In addition, by automatically generating materials to verify the effectiveness of coupons and stamp cards and making the analysis results available for download, the efficiency of store operations and customer satisfaction are improved.

[1523] "Input means" refers to the devices and software used to accept data input from affiliated stores.

[1524] "Database means" refers to a system for saving input data and keeping it available for reference.

[1525] "Materials generation means" means the process or software for automatically generating the necessary supporting materials based on the stored data.

[1526] "AI means" refers to devices or systems that use artificial intelligence to provide appropriate support to affiliated stores based on the generated support materials.

[1527] "Communication means" refers to the network or device that allows the affiliated store to connect with the AI ​​in real time at the time specified by the affiliated store.

[1528] "Material provision means" refers to the process or system for generating materials for verifying the effectiveness of coupons and stamp cards and making them available for download.

[1529] "Emotion recognition means" refers to technology or software that recognizes emotions from customers' facial expressions, voice, etc., and adjusts responses and suggestions based on that information.

[1530] "Multilingual support means" refers to technologies and systems for generating multilingual content and responding appropriately to customers.

[1531] This invention provides a customer support system for brick-and-mortar stores that supports multiple languages ​​and has emotion recognition capabilities. The following describes the procedure and specific configuration for building this system.

[1532] First, this system includes "input means," "database means," "document generation means," "AI means," "communication means," "document provision means," "emotion recognition means," and "multilingual support means." Each of these means will be explained below.

[1533] 1. Input method:

[1534] Store staff, who are users, use smartphones or smart glasses to input data necessary for customer service, including customer questions, requests, images, and videos.

[1535] 2. Database means:

[1536] The server receives the entered data and stores it in a database, which contains customer details and transaction history.

[1537] 3. Material generation means:

[1538] The server automatically generates supporting materials such as coupons and stamp cards based on the stored data.

[1539] 4. AI means:

[1540] Based on the generated materials, AI provides appropriate support to users. AI utilizes generative AI models to make optimal proposals to individual customers.

[1541] 5. Means of communication:

[1542] The server connects to the AI ​​in real time via an online conference system (e.g., Zoom, Microsoft Teams) at a time designated by the store staff, enabling real-time support.

[1543] 6. Material provision method:

[1544] The server analyzes the effectiveness of coupon and stamp card campaigns, generates effectiveness verification materials based on the analysis results, and provides them in a downloadable format.

[1545] 7. Emotion recognition means:

[1546] The server uses emotion analysis software (e.g., Azure Face API, Google Cloud Vision API) to recognize emotions from the customer's facial expressions and voice, and adjusts the response appropriately.

[1547] 8. Multilingual support means:

[1548] The server uses the Google Translate API or similar to generate multilingual content and respond to the customer.

[1549] For example, if a foreign tourist visiting a physical store asks in English, "Please tell me more about this product," the system works as follows: First, a store staff member inputs the customer's video and audio through smart glasses and sends them to the server. Based on this video and audio, the server uses the emotion recognition means to analyze the customer's emotions. At the same time, the multilingual support means analyzes the English question and generates an appropriate response. The AI ​​means then uses the generated AI model to provide the customer with the most appropriate product information and related benefits. Specific examples of prompt sentences include:

[1550] "Given the customer's query: 'Can you tell me more about this product?' and the detected emotion: 'interest', generate a detailed response in English that includes related product suggestions and a special discount offer."

[1551] In this way, a system that combines a server and various means can effectively provide customer support in physical stores through multilingual support and emotion recognition.

[1552] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1553] Step 1:

[1554] The store staff, who are the users, use the smart glasses to input customer questions and requests. The terminal captures images and videos of the customer and also accepts voice input. This input data includes the customer's questions, images, and voice data.

[1555] Step 2:

[1556] The terminal transmits the acquired data to the server. The server receives this data and stores it in a database. Specifically, the database stores the customer's question, video data, and audio data.

[1557] Step 3:

[1558] The server analyzes emotions using emotion recognition techniques based on the data stored in the database. For example, it uses Azure Face API or Google Cloud Vision API to read emotions from the customer's facial expressions. This process outputs emotional data such as whether the customer is interested or anxious.

[1559] Step 4:

[1560] The server analyzes the customer's question using multilingual support. Using a Google Translate API or similar, it converts the input language (e.g., English) into Japanese and generates an appropriate response. The response is created using a generative AI model, and answer data in text format is generated.

[1561] Step 5:

[1562] The server combines the generated response data with the emotion data to generate optimal suggestions. Using a generative AI model, it provides appropriate product information and special offers based on the prompt. The following prompts are used in this step:

[1563] "Given the customer's query: 'Can you tell me more about this product?' and the detected emotion: 'interest', generate a detailed response in English that includes related product suggestions and a special discount offer."

[1564] Step 6:

[1565] The server sends the generated suggestions and response data to the terminal, which then displays this data to the store staff member who is the user. The staff member then responds appropriately to the customer through the smart glasses.

[1566] Step 7:

[1567] After the interaction with the customer is completed, the server analyzes the effectiveness of the coupons and promotions. The server generates effectiveness verification materials using the material generation means and provides them in a downloadable format through the material provision means. The materials include campaign results and customer feedback.

[1568] In this way, customer support is provided across the entire system, improving customer satisfaction and streamlining store operations.

[1569] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1570] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1571] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1572] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1573] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1574] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1575] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1576] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1577] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1578] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1579] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1580] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1581] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1582] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1583] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1584] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1585] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1586] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1587] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1588] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1589] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1590] The following is further disclosed regarding the above embodiment.

[1591] (Claim 1)

[1592] an input means for receiving input from a member store;

[1593] a database means for storing input data;

[1594] a material generating means for generating supporting materials based on the stored data;

[1595] AI means to provide support to merchants based on the generated support materials;

[1596] A means of communication that connects with AI in real time at a time designated by the member store,

[1597] A means for generating and downloading materials to verify the effectiveness of coupons and stamp cards;

[1598] A system including:

[1599] (Claim 2)

[1600] 2. The system according to claim 1, wherein the communication means connects the member store and the AI ​​via a video conferencing system.

[1601] (Claim 3)

[1602] 2. The system according to claim 1, wherein said material generating means automatically generates design materials for coupon templates and stamp cards.

[1603] "Example 1"

[1604] (Claim 1)

[1605] an input means for receiving input from a member store;

[1606] a database means for storing input data;

[1607] a material generating means for generating supporting materials based on the stored data;

[1608] an artificial intelligence means for providing support to the merchant based on the generated support materials;

[1609] A means of communication that connects with AI in real time at the time specified by the member store,

[1610] A means for generating and downloading materials to verify the effectiveness of coupons and point cards;

[1611] A selection means for selecting the support desired content;

[1612] A scheduling means to organize support materials at set times;

[1613] an analytical means for answering a user's question;

[1614] A system including:

[1615] (Claim 2)

[1616] 2. The system according to claim 1, wherein the communication means connects the member store and the artificial intelligence via a video conferencing system.

[1617] (Claim 3)

[1618] 2. The system according to claim 1, wherein the material generating means automatically generates design materials for coupon templates and point cards.

[1619] "Application Example 1"

[1620] (Claim 1)

[1621] an input means for receiving input from a member store;

[1622] a database means for storing input data;

[1623] a material generating means for generating supporting materials based on the stored data;

[1624] AI means to provide support to merchants based on the generated support materials;

[1625] A means of communication that connects with AI in real time at a time designated by the member store,

[1626] A means for generating and downloading materials to verify the effectiveness of coupons and stamp cards;

[1627] Multilingual support means to provide assistance in effectively conducting marketing activities based on the generated support materials;

[1628] A translation tool to translate the effectiveness verification materials into the desired language;

[1629] A system including:

[1630] (Claim 2)

[1631] 2. The system according to claim 1, wherein the communication means connects the member store and the AI ​​via a video conferencing system.

[1632] (Claim 3)

[1633] 2. The system according to claim 1, wherein said material generating means automatically generates design materials for coupon templates and stamp cards.

[1634] "Example 2: Combining Emotion Engines"

[1635] (Claim 1)

[1636] an input means for receiving input from a member store;

[1637] a database means for storing input data;

[1638] a material generating means for generating supporting materials based on the stored data;

[1639] AI means to provide support to merchants based on the generated support materials;

[1640] A means of communication that connects with AI in real time at a time designated by the member store,

[1641] A means for generating and downloading materials to verify the effectiveness of coupons and stamp cards;

[1642] an emotion recognition means for identifying the user's emotion and adjusting responses or suggestions;

[1643] A system including:

[1644] (Claim 2)

[1645] 2. The system according to claim 1, wherein the communication means connects the member store and the AI ​​via a video conferencing system.

[1646] (Claim 3)

[1647] 2. The system according to claim 1, wherein said material generating means automatically generates design materials for coupon templates and stamp cards.

[1648] "Application example 2 when combining emotion engines"

[1649] (Claim 1)

[1650] an input means for receiving input from a member store;

[1651] a database means for storing input data;

[1652] a material generating means for generating supporting materials based on the stored data;

[1653] AI means to provide support to merchants based on the generated support materials;

[1654] A means of communication that connects with AI in real time at a time designated by the member store,

[1655] A means for generating and downloading materials to verify the effectiveness of coupons and stamp cards;

[1656] An emotion recognition means for recognizing customer emotions and adjusting responses and suggestions;

[1657] a multilingual support means for generating multilingual content and responding appropriately to customers;

[1658] A system including:

[1659] (Claim 2)

[1660] 2. The system according to claim 1, wherein the communication means connects the member store and the AI ​​via a video conferencing system.

[1661] (Claim 3)

[1662] 2. The system according to claim 1, wherein said material generating means automatically generates design materials for coupon templates and stamp cards. [Explanation of symbols]

[1663] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. an input means for receiving input from a member store; a database means for storing input data; a material generating means for generating supporting materials based on the stored data; AI means to provide support to merchants based on the generated support materials; A means of communication that connects with AI in real time at a time designated by the member store, A means for generating and downloading materials to verify the effectiveness of coupons and stamp cards; A system including:

2. 2. The system according to claim 1, wherein the communication means connects the member store and the AI ​​via a video conferencing system.

3. 2. The system according to claim 1, wherein said material generating means automatically generates design materials for coupon templates and stamp cards.

Images