System

Abstract

A system is provided.SOLUTION: A system comprising: means for utilizing a generative data model to collect inputs from users in a chat format; means for storing the inputs in a database; means for interfacing with an inventory control system based on the stored information; and means for analyzing and displaying the AI in real time.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The current registration system is complicated to operate, and training new crew members to register takes a lot of time. Furthermore, store inventory checks and attendance reports are often done manually, reducing operational efficiency. Customer registration procedures are also cumbersome, and answering questions can take time. Furthermore, it is difficult to check sales performance in real time during sales management, making it difficult to quickly develop sales strategies. The objective of this invention is to solve these problems and improve the efficiency of registration procedures and operational efficiency. [Means for solving the problem]

[0005] This invention utilizes a generative AI model to provide a means for collecting input information from users in chat format. This allows crew members and customers to easily enter the necessary information, which is then stored in a database. Furthermore, the stored information is linked to an inventory management system, automating inventory checks. Furthermore, a means for analyzing and displaying data in real time allows sales representatives to quickly check sales performance and develop sales strategies based on that data. This invention significantly improves registration procedures and operational efficiency. Specifically, this invention solves these issues by utilizing a generative AI model to collect information in chat format and store it in a database during crew registration, customer registration, and sales management.

[0006] A "generative AI model" is an algorithm that uses artificial intelligence to generate, analyze, and infer natural language based on data and context.

[0007] "Chat-style" refers to a style in which a user interacts with an interface through text messages, exchanging information in the form of questions and answers.

[0008] A "database" is a structured collection of data for efficiently storing and managing large amounts of information.

[0009] An "inventory management system" is a computer system that tracks and manages product and merchandise inventory information, ensuring appropriate replenishment of inventory and preventing stockouts.

[0010] "Real-time" refers to the quality or state of responding immediately to user requests or operations and providing processing results instantly.

[0011] "Data analysis" is the process of using statistics and algorithms to gain insight into trends and patterns from collected data and extract useful information.

[0012] "Tables and graphs" are a general term for methods of visually representing numerical data and statistical information, and are a means of making data easier to understand and compare.

[0013] "Sales performance" is a collection of recorded data such as the sales quantity, sales amount, and profit margin of a product within a certain period of time.

[0014] A "sales strategy" refers to a series of actions and measures planned to maximize sales of a product or service, and includes market research, targeting, and promotional activities. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The system of the present invention utilizes generative AI models to streamline crew registration, customer registration, and sales management. This system allows users to input information in chat format, which is then stored in a database and processed in conjunction with related systems.

[0037] Crew registration system

[0038] 1. User (crew member) accesses the new registration screen:

[0039] A user accesses the registration screen for a new crew member using a device (such as a PC or tablet).

[0040] 2. The device uses the generative AI model to collect the necessary information from the user:

[0041] The device uses a generative AI model to ask the user for necessary information such as name, employee ID, store ID, etc. in a chat format, allowing the crew to input the information easily and intuitively.

[0042] 3. The server saves the input data to the database:

[0043] The device sends the collected information to a server, which stores the information in a database.

[0044] 4. The server interfaces with the inventory management system:

[0045] The server connects to the inventory management system based on the saved data and updates the inventory information for the store to which the new crew belongs.

[0046] Customer registration system

[0047] 1. User (customer) visits the registration site:

[0048] Customers access the service's registration site using their smartphone or PC.

[0049] 2. The device uses generative AI models to answer customer questions via chat:

[0050] The device uses a generative AI model to ask customers questions to help them select the model and plan they want, and provides appropriate answers and plan suggestions based on their input.

[0051] 3. The server saves the input data to the database:

[0052] The terminal transmits the collected customer information to a server, which stores the information in a database.

[0053] 4. The server completes the contract procedure:

[0054] The server automatically completes the contract process based on the stored information and sends the customer a message confirming the contract details.

[0055] Sales management system

[0056] 1. A user (sales representative) logs in to their work PC:

[0057] The sales representative logs in to their work PC and accesses the sales management screen.

[0058] 2. PC collects and displays data in real time:

[0059] After the PC confirms the login, it sends a request to the server, which then collects the latest sales performance data from the database.

[0060] 3. The server displays the data as a table or graph:

[0061] The server converts the collected data into tables and graphs and sends them to a PC, which displays them to the sales representative.

[0062] 4. Users develop sales strategies:

[0063] Sales representatives can develop sales strategies based on the displayed data and perform real-time data analysis.

[0064] Specific examples

[0065] Crew registration example

[0066] User (Crew): "I want to register a new staff member."

[0067] Terminal: "Hello! First, please tell me your name and employee ID."

[0068] User: "Yamada Taro, ID12345"

[0069] Terminal: "Next, please tell me your store ID."

[0070] User: "Store ID 1001"

[0071] Terminal: "Signed up. Let's check inventory information next."

[0072] Server: Links with the inventory management system and updates inventory information.

[0073] Example of customer registration

[0074] User (customer): "I want to sign up for a new smartphone contract."

[0075] Terminal: "Is there a model you would like?"

[0076] User: "iPhone(R)14"

[0077] Device: "What plan would you like? You can choose your data volume and calling rates."

[0078] User: "I'd like an unlimited data and unlimited calling plan."

[0079] Device: "Thank you. This completes the registration process. Please confirm your details."

[0080] Server: Stores registration information and completes contract procedures.

[0081] Specific examples of sales management

[0082] User (Salesperson): "I want to check this month's sales performance."

[0083] PC: "Retrieving current performance data. Please wait."

[0084] Server: Collects performance data from the database, formats it, and sends it to the PC.

[0085] PC: "Below are this month's sales results." (Shows table and graph)

[0086] This will reduce crew registration training time, simplify customer registration procedures, and improve sales management efficiency.

[0087] The processing flow will be explained below.

[0088] Crew registration system

[0089] Step 1:

[0090] The user accesses the new registration screen. The device confirms the user's permission to access the device and displays the registration screen.

[0091] Step 2:

[0092] The device uses the generative AI model to prompt the user to enter their name and employee ID. Specifically, it displays the message "Please enter your name and employee ID" in chat format.

[0093] Step 3:

[0094] The user enters their name and employee ID and sends it to the terminal. For example, they enter "Yamada Taro, ID12345."

[0095] Step 4:

[0096] The device uses the generated AI model to ask the user for the next piece of information needed: the store ID. It displays the message, "Please enter your store ID."

[0097] Step 5:

[0098] The user enters the store ID and sends it to the terminal. For example, the user enters "Store ID 1001."

[0099] Step 6:

[0100] The terminal sends all collected input data to the server.

[0101] Step 7:

[0102] The server stores the received data in a database.

[0103] Step 8:

[0104] The server links with the inventory management system based on the stored information and updates the inventory information.

[0105] Step 9:

[0106] The server sends a message to the terminal indicating that registration and inventory information update is complete.

[0107] Step 10:

[0108] The terminal displays a completion message to the user: "Registration completed. Stock information has also been updated."

[0109] Customer registration system

[0110] Step 1:

[0111] The user accesses the registration site. The device confirms the user's permission to access the site and displays the registration screen.

[0112] Step 2:

[0113] The device uses the generated AI model to ask the user about their desired model, displaying the message, "Is there a model you would like?"

[0114] Step 3:

[0115] The user inputs the desired model and sends it to the device. For example, input "iPhone14."

[0116] Step 4:

[0117] The device then uses the generative AI model to ask the user about the next necessary information: the plan. It displays, "What plan would you like? You can choose your data volume and call charges."

[0118] Step 5:

[0119] The user inputs the desired plan and sends it to the device. For example, they might input "I'd like an unlimited data and unlimited calling plan."

[0120] Step 6:

[0121] The terminal sends all collected input data to the server.

[0122] Step 7:

[0123] The server stores the received data in a database.

[0124] Step 8:

[0125] The server automatically carries out contract procedures based on the stored information.

[0126] Step 9:

[0127] The server sends a message to the terminal indicating that the contract procedure has been completed.

[0128] Step 10:

[0129] The device displays a confirmation message to the user: "The procedure is complete. Please confirm your registration details."

[0130] Sales management system

[0131] Step 1:

[0132] A user (sales representative) logs in to a work PC. The PC requests the user's authentication information, and if authentication is successful, the management screen is displayed.

[0133] Step 2:

[0134] A user requests a confirmation of sales performance. Enters, "I would like to check this month's sales performance."

[0135] Step 3:

[0136] The PC sends a data request to the server. "Sales performance data requested" is sent to the server.

[0137] Step 4:

[0138] The server collects the latest sales performance data from the database.

[0139] Step 5:

[0140] The server formats the collected data into tables and graphs.

[0141] Step 6:

[0142] The server sends the formatted data to the PC.

[0143] Step 7:

[0144] The PC displays sales performance data to the user. It displays "This month's sales performance" and shows tables and graphs.

[0145] This will streamline all processes for crew registration, customer registration, and sales management.

[0146] Example 1

[0147] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0148] Conventional user information collection systems require manual data entry and management, which requires a great deal of time and human effort. Furthermore, the need to link with inventory management systems and contract procedure systems is cumbersome, making it inefficient for business personnel to check and analyze data in real time. Furthermore, there is a need for a method to quickly and accurately acquire and process information when registering users from remote locations.

[0149] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0150] In this invention, the server includes means for utilizing a generative AI model to collect input information from users in chat format, means for saving the input information in a database, means for linking with an inventory management system based on the saved information, means for analyzing and displaying data in real time, means for a terminal to collect information from users using a generative AI model and for the server to analyze the information, and means for linking with the inventory management system using the collected data. This makes information collection from users more efficient, reduces manual input work, enables smooth inventory management and contract procedures, and makes it possible to provide accurate data to business personnel in real time.

[0151] A "generative AI model" is an artificial intelligence system that collects and analyzes input information from users using technologies such as natural language processing, and responds in an interactive, conversational format.

[0152] A "terminal" is an electronic device that a user uses to input information and interact with a system, and refers to general devices such as PCs, tablets, and smartphones.

[0153] "Server" refers to a remotely located computer or system responsible for receiving and analyzing data collected from users and storing that information in a database.

[0154] A "database" is a collection of systems and software that store and manage collected information in an organized manner and quickly search and retrieve data as needed.

[0155] An "inventory management system" is a system for tracking and managing product inventory information in real time, maintaining data on product inventory and optimizing inventory.

[0156] The "chat format" refers to a method in which interaction with a user is conducted in a text-based conversational format, in which questions are presented to the user and information is collected by the user responding to the questions.

[0157] "Real-time" means that data is processed and displayed the moment it is generated, meaning that the latest information is available without delay.

[0158] "Analysis" refers to the means and process of converting collected data into an understandable form and extracting and utilizing the necessary information from it.

[0159] "Federation" refers to the means of connection and integration that allows different systems to share and utilize data and services.

[0160] "Interaction" refers to the interaction between a user and a system, and the process by which the system responds to user input.

[0161] "Business personnel" refers to personnel who are in charge of specific tasks within a company or organization and who carry out and manage those tasks.

[0162] MODE FOR CARRYING OUT THE INVENTION

[0163] This invention is a system that utilizes a generative AI model to improve the efficiency of crew registration, customer registration, and sales management. The main components of the system include a generative AI model, a terminal for collecting user information, a server, and a database. Specific examples will be provided below.

[0164] Crew registration system

[0165] First, a user accesses the registration page for a new crew member using a device such as a PC or tablet. The device sends a request to the web server, retrieves the registration page, and displays it.

[0166] The device then uses a generative AI model (e.g., ChatGPT®) to prompt the user for necessary information such as name, employee ID, store ID, etc. in chat format. This interaction allows the crew member to input information easily and intuitively.

[0167] The collected information is sent from the terminal to a server, which stores it in a database (e.g., MySQL (registered trademark)). Based on the stored data, the server connects to an inventory management system and updates the inventory information for the store to which the new crew belongs.

[0168] Examples:

[0169] User (Crew): "I want to register a new staff member."

[0170] Terminal: "Hello! First, please tell me your name and employee ID."

[0171] User: "Yamada Taro, ID12345"

[0172] Terminal: "Next, please tell me your store ID."

[0173] User: "Store ID 1001"

[0174] Terminal: "Signed up. Let's check inventory information next."

[0175] Server: Links with the inventory management system and updates inventory information.

[0176] Customer registration system

[0177] Customers access the service's registration site using their smartphones or PCs. The device sends a request to the web server, which retrieves and displays the HTML page of the registration site.

[0178] The device launches the generative AI model within the page and begins a dialogue with the customer. The generative AI model asks questions about models and plans, and the customer responds via chat. The collected information is sent from the device to a server, which stores it in a database.

[0179] The server carries out the contract procedures based on the stored information and sends the customer a confirmation message of the contract contents.

[0180] Examples:

[0181] User (customer): "I want to sign up for a new smartphone contract."

[0182] Terminal: "Is there a model you would like?"

[0183] User: "iPhone14"

[0184] Device: "What plan would you like? You can choose your data volume and calling rates."

[0185] User: "I'd like an unlimited data and unlimited calling plan."

[0186] Device: "Thank you. This completes the registration process. Please confirm your details."

[0187] Server: Stores registration information and completes contract procedures.

[0188] Sales management system

[0189] The sales representative accesses the login screen of their work PC and enters their user ID and password. The terminal sends the authentication information to the server, which then authenticates them. If authentication is successful, the business sales management screen is displayed.

[0190] The PC sends a request to the server for the latest sales performance data. The server retrieves the sales performance data from the database, formats it, and sends it back to the PC. The PC displays the received data to the sales representative as a table or graph. The sales representative then uses this data to develop a sales strategy in real time.

[0191] Examples:

[0192] User (Salesperson): "I want to check this month's sales performance."

[0193] PC: "Retrieving current performance data. Please wait."

[0194] Server: Collects performance data from the database, formats it, and sends it to the PC.

[0195] PC: "Below are this month's sales results." (Shows table and graph)

[0196] The above system is expected to reduce the time required for crew registration training, simplify customer registration procedures, and improve the efficiency of sales management.

[0197] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0198] Crew registration system processing flow

[0199] Step 1:

[0200] The user accesses the new registration screen using a device such as a PC or tablet.

[0201] Input: User's access request

[0202] Output: Display of registration screen

[0203] Specific operation: The user opens a web browser and enters the registration URL. The device sends an HTTP request to the web server, retrieves the HTML of the registration screen, and displays it.

[0204] Step 2:

[0205] The device launches the generative AI model and collects necessary information from the user, such as name, employee ID, and store ID.

[0206] Input: User input information (e.g., name, employee ID, store ID)

[0207] Output: Collected data

[0208] Specific operation: The generative AI model starts up and displays prompts such as "Please enter your name" or "Please enter your employee ID." The user enters information into each field and presses the submit button. The device passes the user's input to the generative AI model and collects the information.

[0209] Step 3:

[0210] The device sends the collected information to a server, which stores it in a database.

[0211] Input: Collected user information

[0212] Output: Information stored in the database

[0213] Specific operation: The device sends the collected information as an HTTP request to the backend server, which parses the received information, generates an SQL query, and stores it in a database (e.g., MySQL).

[0214] Step 4:

[0215] The server connects to the inventory management system based on the stored data.

[0216] Input: Crew information stored in the database

[0217] Output: Information reflected in the inventory management system

[0218] Specific operation: The server calls the inventory management system's API based on the saved crew information and sends data about the new crew's affiliated store. The inventory management system reflects that information and responds to the server that the update is complete.

[0219] Processing flow of the customer registration system

[0220] Step 1:

[0221] The user (customer) accesses the registration site using a smartphone or PC.

[0222] Input: Customer Access Request

[0223] Output: Display of registration site

[0224] Specific operation: The customer opens a web browser and enters the URL of the registration site to access it. The device sends an HTTP request to the web server, retrieves the HTML of the registration site, and displays it.

[0225] Step 2:

[0226] The device uses the generated AI model to answer customer questions in chat format and collect the necessary information.

[0227] Input: Customer selection and registration information (e.g., model, plan)

[0228] Output: Collected data

[0229] How it works: The generative AI model launches and presents prompts such as "What model do you want?" or "Please select a plan." The customer enters information into the input field and presses the send button. The device passes that information to the generative AI model, which then generates the next prompt.

[0230] Step 3:

[0231] The terminal sends the collected customer information to a server, which stores it in a database.

[0232] Input: Collected customer information

[0233] Output: Information stored in the database

[0234] Specific operation: The device sends the collected information as an HTTP request to the backend server, which parses the received information, generates an SQL query, and stores it in the database.

[0235] Step 4:

[0236] The server carries out the contract procedures based on the stored information.

[0237] Input: Customer information stored in a database

[0238] Output: Contract procedure completion message

[0239] Specific operation: The server automatically performs contract procedures based on the stored customer information. Once the procedures are completed, the server sends a confirmation message of the contract details to the customer's device. The customer confirms the message and confirms that the procedures are complete.

[0240] Processing flow of the sales management system

[0241] Step 1:

[0242] A user (sales representative) logs in to a work PC.

[0243] Input: User ID, Password

[0244] Output: Authentication results, sales management screen display

[0245] Specific operation: A sales representative accesses the login screen of their work PC and enters their user ID and password. The terminal sends the authentication information to the server, and the server successfully authenticates. The business sales management screen is displayed.

[0246] Step 2:

[0247] The PC sends a request to the server, asking for the latest sales data.

[0248] Input: Request

[0249] Output: Sales performance data

[0250] Specific operation: After authentication, the PC sends a request for sales performance data to the server. The server retrieves the latest sales performance data from the database and returns it to the PC.

[0251] Step 3:

[0252] The sales performance data collected by the server is converted into tables and graphs, and sent to a PC for display.

[0253] Input: Sales performance data

[0254] Output: Data in tabular and graphical format

[0255] Specific operation: The server generates tables and graphs based on sales performance data using a graph generation library (e.g., D3.js), and sends the generated data to the PC, which then displays it visually.

[0256] Step 4:

[0257] The user creates a sales strategy based on the displayed data.

[0258] Input: Data for tables and graphs

[0259] Output: Sales Strategy

[0260] Specific actions: The sales representative analyzes the displayed data and formulates a specific action plan to create a new sales strategy.

[0261] (Application example 1)

[0262] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0263] The traditional crew and customer registration process in brick-and-mortar stores was highly manual, taking time and effort, and was prone to errors. Furthermore, there was a lack of efficient ways to visually grasp performance data in real time, making it difficult to quickly formulate operational strategies. This resulted in inefficient store operations, lower customer satisfaction, and delays in understanding performance.

[0264] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0265] In this invention, the server includes a means for utilizing a generative AI model to collect input data from users in chat format, a means for storing the collected input data in a database system, a means for linking with an asset management system based on the stored data, and a means for using a visual device to analyze and display data in real time, thereby making it possible to improve the efficiency of store operations, reduce errors in crew and customer registration, and grasp performance data in real time.

[0266] A "generative AI model" is a type of artificial intelligence system that uses natural language processing to understand user input data and generate appropriate questions and answers.

[0267] "Chat format" refers to an interface format in which a user interacts with a system, asking and answering questions using text or voice.

[0268] "Input data" refers to the information a user provides to the system, including their name, ID, and details of the product they want.

[0269] A "database system" is a system for storing, managing, and searching information in an organized manner, and is often operated using a language such as SQL.

[0270] An "asset management system" is a system for efficiently managing the goods and inventory information held by stores and companies.

[0271] "Analyzing data in real time" means processing newly collected data immediately and quickly deriving results.

[0272] A "visual device" is a device that allows a user to visually view information, including smart glasses and monitors.

[0273] "Customer interface" refers to the user interface through which customers input information and perform operations.

[0274] "Operations staff" refers to staff involved in the operation of a store or company, and are responsible for managing performance and formulating strategies.

[0275] "Performance data" refers to data that indicates the business results of a store or company, such as sales and sales performance.

[0276] "Interactive data analysis means" means that users can directly manipulate data and obtain analysis results in real time.

[0277] The following describes in detail the mode for carrying out the present invention. This invention is a system that utilizes a generative AI model to streamline the crew registration and customer registration processes in physical stores. The system collects input data from users in chat format and stores it in a database. Based on the stored data, the system also links with an asset management system and uses a visual device to analyze and display the data in real time.

[0278] Overall system configuration

[0279] Hardware and software used

[0280] Hardware: Smart glasses (e.g., Google® Glass®, HoloLens®)

[0281] Software: Generative AI models (e.g., GPT-4 (registered trademark), BERT), database systems (e.g., MySQL, PostgreSQL), secure server environments (e.g., AWS (registered trademark), Microsoft (registered trademark) Azure (registered trademark))

[0282] System processing flow

[0283] 1. Crew Registration

[0284] The server uses a generative AI model to collect input data from users in chat format, such as crew names, employee IDs, and store IDs.

[0285] The terminal (smart glasses) sends the collected input data to the server and stores it in a database system.

[0286] The server interacts with the asset management system based on the stored data.

[0287] 2. Customer Registration

[0288] The server uses generative AI models to provide a chat-style interface for customers to select and register their desired product and service options at home or in-store.

[0289] The terminal stores the customer's selection and registration information in a database.

[0290] The server completes the contract procedure based on the registered information and provides an interface for making corrections as necessary.

[0291] 3. Analysis and display of performance data

[0292] The server utilizes generative AI models to enable operations staff to view performance data in real time.

[0293] The server provides an interactive data analysis tool to format and display the collected performance data in visual formats (tables and graphs).

[0294] The terminal (smart glasses) provides an interface that allows operations personnel to analyze data in real time and develop operational strategies.

[0295] Specific examples

[0296] Crew registration example

[0297] User (Crew Member): "I want to register a new staff member."

[0298] Terminal (Smart Glasses): "Hello! First, please tell us your name and employee ID."

[0299] User: "Yamada Taro, ID12345"

[0300] Terminal: "Next, please tell me your store ID."

[0301] User: "Store ID 1001"

[0302] Device: "Registration complete. Thank you."

[0303] Example of customer registration

[0304] User (customer): "I want to sign up for a new smartphone contract."

[0305] Terminal: "Is there a model you would like?"

[0306] User: "iPhone14"

[0307] Device: "What plan would you like? Unlimited data and unlimited calling, please."

[0308] Terminal: "Thank you. This completes the procedure."

[0309] Examples of performance data analysis and display

[0310] User (Operations Manager): "I want to check this month's sales performance."

[0311] Terminal: "Retrieving current performance data. Please wait."

[0312] Server: Collects performance data from the database, formats it, and sends it to the terminal.

[0313] Device: "Below are this month's sales results." (displays table and graph)

[0314] Prompt Sentence Examples

[0315] When a user says, "I want to register a new staff member"

[0316] "Hello! First, please tell me your name and employee ID."

[0317] Next, please tell us your store ID.

[0318] When a user says, "I want to sign a new smartphone contract"

[0319] Is there a model you would like?

[0320] "Please select a plan. You can choose the amount of data and call charges."

[0321] In this way, it is possible to build a system that streamlines the crew and customer registration processes in physical stores and enables real-time performance data to be tracked.

[0322] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0323] Step 1:

[0324] The user (crew member) puts on the smart glasses and switches to new crew registration mode. Specifically, the user selects "crew registration" from the smart glasses menu. The input is the user's (crew member's) operation, and the output is "start crew registration mode."

[0325] Step 2:

[0326] The device (smart glasses) uses a generative AI model to collect the user's (crew member's) name, employee ID, and store ID by asking questions in a chat format. Specifically, it accepts input via voice or tap. The input for this step is voice or tap input from the user (crew member), and the output is the collected name, employee ID, and store ID data.

[0327] Step 3:

[0328] The terminal (smart glasses) transmits the collected data to the server. Specifically, the smart glasses transmit the data via the Internet. The input of this step is the collected user data, and the output is the completion of data transmission to the server.

[0329] Step 4:

[0330] The server stores the received data in the database system. Specifically, the server executes an SQL command to insert the data. The input of this step is the user data sent from the terminal, and the output is the successful storage in the database.

[0331] Step 5:

[0332] The server interacts with the asset management system based on the stored data. Specifically, the server calls the API to update inventory information. The input for this step is the user data stored in the database, and the output is the updated inventory information.

[0333] Step 6:

[0334] The user (customer) interacts with a crew member wearing smart glasses to select desired product or service options. Specifically, the crew member uses the smart glasses to present questions to the generative AI model. The input to this step is the user's (customer's) desired information, and the output is the selected and registered option information.

[0335] Step 7:

[0336] The terminal (smart glasses) sends the customer's selection information to the server and stores it in the database. Specifically, the smart glasses send data through the network. The input of this step is the customer's option selection information, and the output is the successful storage in the database.

[0337] Step 8:

[0338] The server completes the contract procedure based on the registered information and provides the customer with an interface for confirmation and modification. Specifically, the server generates a contract and displays a confirmation screen. The input for this step is the customer information stored in the database, and the output is the completion of the contract procedure and the display of a confirmation screen.

[0339] Step 9:

[0340] The user (operator) puts on the smart glasses and starts real-time analysis of performance data. Specifically, the operator selects "Performance Data Analysis." The input for this step is the operator's operation, and the output is the start of analysis mode.

[0341] Step 10:

[0342] The server uses a generative AI model to collect performance data and display the analysis results on a visual device. Specifically, the server retrieves data from a database, analyzes it, and generates it as graphs and tables. The input for this step is performance data from the database, and the output is the display results on the visual device.

[0343] Step 11:

[0344] The terminal (smart glasses) provides an interface for the operations manager to check the data analysis results in real time and formulate an operations strategy. Specifically, the smart glasses display the analysis results, and the operations manager operates based on them. The input for this step is the analysis results sent from the server, and the output is the analysis results for formulating an operations strategy.

[0345] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0346] The system of the present invention utilizes a generative AI model and combines it with an emotion engine that recognizes user emotions, thereby improving the efficiency of crew registration, customer registration, and sales management. With this system, users can input information in chat format, and the information and emotion data are stored in a database, which then processes the data in conjunction with related systems.

[0347] Crew registration system

[0348] 1. User (crew member) accesses the new registration screen:

[0349] A user accesses the registration screen for a new crew member using a device (such as a PC or tablet).

[0350] 2. The device uses the generative AI model to collect the necessary information from the user:

[0351] The device uses a generative AI model to ask the user necessary information, such as their name, employee ID, or store ID, via chat. It also uses an emotion engine to analyze the user's emotions in real time as they ask questions. This allows the crew member to input information easily and intuitively, and their emotions are also recorded.

[0352] 3. The server saves the input data to the database:

[0353] The device sends the collected information and emotional data to a server, which stores it in a database.

[0354] 4. The server interfaces with the inventory management system:

[0355] The server connects to the inventory management system based on the saved data and updates the inventory information for the store to which the new crew belongs.

[0356] 5. Improved user experience:

[0357] The emotion engine analyzes the emotional data and provides feedback to improve the user experience. For example, if the user feels anxious, the device will provide a more detailed explanation.

[0358] Customer registration system

[0359] 1. User (customer) visits the registration site:

[0360] Customers access the service's registration site using their smartphone or PC.

[0361] 2. The device uses generative AI models to answer customer questions via chat:

[0362] The device uses a generative AI model to ask questions to help customers select the model and plan they want, and an emotion engine to analyze customer sentiment in real time and dynamically change the questions and responses.

[0363] 3. The server stores the input data and emotion data in a database:

[0364] The terminal transmits the collected customer information and emotional data to a server, which stores it in a database.

[0365] 4. The server completes the contract procedure:

[0366] The server automatically completes the contract process based on the stored information and sends the customer a message confirming the contract details.

[0367] 5. Improved customer experience:

[0368] Based on emotional data analyzed by the emotion engine, feedback is provided to help customers proceed with the process smoothly and without stress.

[0369] Sales management system

[0370] 1. A user (sales representative) logs in to their work PC:

[0371] The sales representative logs in to their work PC and accesses the sales management screen.

[0372] 2. PC collects and displays data in real time:

[0373] After the PC confirms the login, it sends a request to the server, which collects the latest sales performance data and related emotion data from the database.

[0374] 3. The server displays the data as a table or graph:

[0375] The server converts the collected data into tables and graphs and sends them to a PC, which displays them to the sales representative.

[0376] 4. Sales strategy planning:

[0377] Sales representatives can develop sales strategies based on the displayed data and sentiment data, and perform real-time data analysis.

[0378] Specific examples

[0379] Crew registration example

[0380] User (Crew): "I want to register a new staff member."

[0381] Terminal: "Hello! First, please tell me your name and employee ID."

[0382] User: "Yamada Taro, ID12345"

[0383] Terminal: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[0384] User: "Store ID 1001"

[0385] Terminal: "Signed up. Let's check inventory information next."

[0386] Server: Links with the inventory management system and updates inventory information.

[0387] Example of customer registration

[0388] User (customer): "I want to sign up for a new smartphone contract."

[0389] Terminal: "Is there a model you would like?"

[0390] User: "iPhone14"

[0391] Device: The emotion engine detects excitement and displays, "What plan would you like? Choose your data and calling options. We also offer great savings!"

[0392] User: "I'd like an unlimited data and unlimited calling plan."

[0393] Device: "Thank you. This completes the registration process. Please confirm your details."

[0394] Server: Stores registration information and completes contract procedures.

[0395] Specific examples of sales management

[0396] User (Salesperson): "I want to check this month's sales performance."

[0397] PC: "Retrieving current performance data. Please wait."

[0398] Server: Collects performance data and emotion data from the database, formats them, and sends them to the PC.

[0399] PC: "Below are this month's sales results." (Shows table and graph)

[0400] Also includes emotional data: analysis results such as "when customers were excited" and "when crew members felt anxious."

[0401] This allows the system to recognize the emotions of crew members and customers in real time and provide appropriate feedback, thereby improving the user experience and significantly increasing operational efficiency.

[0402] The processing flow will be explained below.

[0403] Crew registration system

[0404] Step 1:

[0405] The user accesses the new registration screen. The terminal confirms the user's access and displays the registration screen.

[0406] Step 2:

[0407] The device uses the generative AI model to prompt the user to enter their name and employee ID. Specifically, it displays the message "Please enter your name and employee ID" in chat format.

[0408] Step 3:

[0409] The user enters their name and employee ID and sends it to the terminal. For example, they enter "Yamada Taro, ID12345."

[0410] Step 4:

[0411] The device then uses the generated AI model to ask for the next piece of information, the store ID, and displays the message, "Please enter your store ID."

[0412] Step 5:

[0413] The user enters the store ID and sends it to the terminal. For example, the user enters "Store ID 1001."

[0414] Step 6:

[0415] The device uses an emotion engine to analyze the user's emotions in real time. For example, if the user is feeling anxious, the device will analyze that information.

[0416] Step 7:

[0417] All input data and emotion data collected by the device are sent to the server.

[0418] Step 8:

[0419] The server stores the received data in a database, simultaneously storing user information and analyzed emotion data.

[0420] Step 9:

[0421] The server links with the inventory management system based on the stored information and updates the inventory information, keeping the inventory information of the new crew member's assigned store up to date.

[0422] Step 10:

[0423] The server sends a message to the terminal indicating that registration and inventory information update is complete.

[0424] Step 11:

[0425] The terminal displays a completion message to the user: "Registration is complete. Stock information has also been updated."

[0426] Customer registration system

[0427] Step 1:

[0428] The user accesses the registration site. The device confirms the user's access and displays the registration screen.

[0429] Step 2:

[0430] The device uses the generated AI model to ask the user about their desired model, displaying the message, "Is there a model you would like?"

[0431] Step 3:

[0432] The user inputs the desired model and sends it to the device. For example, input "iPhone14."

[0433] Step 4:

[0434] The device then uses the generative AI model to ask about the next necessary information, the plan, and displays the message, "What plan would you like? You can choose your data volume and call charges."

[0435] Step 5:

[0436] The user inputs the desired plan and sends it to the device. For example, they might input "I'd like an unlimited data and unlimited calling plan."

[0437] Step 6:

[0438] The device uses an emotion engine to analyze the user's emotions in real time. For example, if the user is feeling excited, the device will analyze that information.

[0439] Step 7:

[0440] All input data and emotion data collected by the device are sent to the server.

[0441] Step 8:

[0442] The server stores the received data in a database, simultaneously storing user information and analyzed emotion data.

[0443] Step 9:

[0444] The server automatically carries out contract procedures based on the stored information.

[0445] Step 10:

[0446] The server sends a message to the terminal indicating that the contract procedure has been completed.

[0447] Step 11:

[0448] The device displays a confirmation message to the user: "The procedure is complete. Please confirm your registration details."

[0449] Sales management system

[0450] Step 1:

[0451] A user (sales representative) logs in to a work PC. The PC checks the user's authentication information and displays the management screen if authentication is successful.

[0452] Step 2:

[0453] A user requests a confirmation of sales performance. Enters, "I would like to check this month's sales performance."

[0454] Step 3:

[0455] The PC sends a data request to the server, saying, "I would like to request sales performance data."

[0456] Step 4:

[0457] A server collects the latest sales performance data and associated sentiment data from a database.

[0458] Step 5:

[0459] The server formats the collected data into tables and graphs, including emotional data, so that it can be displayed visually.

[0460] Step 6:

[0461] The server sends the formatted data to the PC.

[0462] Step 7:

[0463] The PC displays sales performance data and emotion data to the user. It displays "This month's sales performance is as follows," and displays tables and graphs.

[0464] Step 8:

[0465] The user develops a sales strategy based on the displayed data and sentiment data, and adjusts the strategy based on customer and crew feedback indicated by the sentiment data.

[0466] This allows the system to recognize the emotions of crew members and customers in real time and provide appropriate feedback, thereby improving the user experience and significantly increasing operational efficiency.

[0467] Example 2

[0468] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0469] Existing systems have difficulty efficiently collecting and processing user input. They also lack the ability to recognize user emotions and provide appropriate feedback, resulting in a poor user experience. Furthermore, sales representatives have limited means to check sales performance in real time, making it difficult to develop effective sales strategies.

[0470] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0471] In this invention, the server includes means for utilizing a generative AI model to collect input information and emotional data from users in chat format, means for storing the collected input information and emotional data in a database, means for linking with other management systems based on the stored information, means for analyzing and displaying the collected data in real time, and means for providing feedback to improve the user experience based on the emotional data, thereby enabling a significant improvement in user experience and business efficiency.

[0472] A "generative AI model" is a type of artificial intelligence that learns from large amounts of data and performs natural language processing and question answering.

[0473] "Chat format" refers to a format in which a user and a system communicate through text messages.

[0474] "Information input from the user" refers to data such as name, ID, and store information that the user provides to the system.

[0475] "Emotion data" is data that indicates an emotional state analyzed from a user's text input.

[0476] A "database" is a system for efficiently storing, retrieving, and managing data.

[0477] A "management system" is a system for performing specific tasks such as inventory management and customer management.

[0478] The "means for analyzing and displaying collected data in real time" is a function for processing collected data in real time and visually presenting it to the user.

[0479] "Means for providing feedback to improve the user experience" refers to a function that provides appropriate responses and information based on the user's emotional data to enable the user to use the system more comfortably.

[0480] This invention is a system that utilizes a generative AI model and combines it with an emotion engine that recognizes user emotions to highly streamline crew registration, customer registration, and sales management. Specific embodiments are described below.

[0481] Hardware and software used

[0482] This system consists of devices such as PCs and tablets used by users, a central processing server, and a database for storing data. The main software used includes a generative AI model (e.g., GPT-4) for implementing chatbot functions, an emotion engine for analyzing emotional data, a relational database (e.g., MySQL, PostgreSQL) for data storage and retrieval, and other management systems (e.g., SAP or Oracle for inventory management systems).

[0483] An embodiment of a system dedicated to crew registration

[0484] 1. User (crew member) accesses the new registration screen:

[0485] When a user accesses the specified URL using a PC or tablet device, the registration screen will be displayed.

[0486] 2. The device uses the generative AI model to collect the necessary information from the user:

[0487] The device uses a generative AI model (e.g., GPT-4) to ask the user necessary information in the form of a chatbot, such as their name, employee ID, store ID, etc. At the same time, it uses an emotion engine to analyze the user's emotional data in real time.

[0488] Examples:

[0489] User (Crew): "I want to register a new staff member."

[0490] Terminal: "Hello! First, please tell me your name and employee ID."

[0491] User: "Yamada Taro, ID12345"

[0492] Terminal: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[0493] 3. The server saves the input data to the database:

[0494] The device sends the collected information and emotion data to a server, which stores them in a relational database (e.g., MySQL, PostgreSQL).

[0495] 4. The server interfaces with the inventory management system:

[0496] The server uses the stored data to link with other management systems (e.g., SAP or Oracle) and updates the inventory information for the store to which the new crew belongs.

[0497] 5. Improved user experience:

[0498] Based on the emotional data analyzed by the emotion engine, the device provides feedback to improve the user experience. For example, if the user is feeling anxious, the device will provide a more detailed explanation.

[0499] Embodiment of a system dedicated to customer registration

[0500] 1. User (customer) visits the registration site:

[0501] When customers access the designated service registration site using their smartphone or PC, the registration screen will be displayed.

[0502] 2. The device uses generative AI models to answer customer questions via chat:

[0503] The device uses a generative AI model (e.g., GPT-4) to ask customers questions about their desired model and plan in chatbot format, while simultaneously analyzing customer sentiment data in real time using an emotion engine.

[0504] Examples:

[0505] User (customer): "I want to sign up for a new smartphone contract."

[0506] Terminal: "Is there a model you would like?"

[0507] User: "iPhone14"

[0508] Device: The emotion engine detects excitement and displays, "What plan would you like? Choose your data and calling options. We also offer great savings!"

[0509] 3. The server stores the input data and emotion data in a database:

[0510] The device sends the collected information and emotion data to a server, which stores them in a relational database (e.g., MySQL, PostgreSQL).

[0511] 4. The server completes the contract procedure:

[0512] The server automatically processes the contract based on the stored information and sends the customer a message confirming the contract details.

[0513] 5. Improved customer experience:

[0514] Based on emotional data analyzed by the emotion engine, feedback is provided to customers to help them proceed with the process without stress.

[0515] Embodiment of a sales management system

[0516] 1. A user (sales representative) logs in to their work PC:

[0517] A sales representative logs in to their work PC and accesses the sales management screen. They enter their authentication information and complete the login.

[0518] 2. PC collects and displays data in real time:

[0519] The device confirms the login and sends a request to the server, which collects the latest sales performance data and related emotion data from the database and sends them to the device.

[0520] 3. The server displays the data as a table or graph:

[0521] The server formats the collected data, visualizes it using a chart conversion library (e.g., Chart.js or D3.js), and displays it on the device.

[0522] 4. Sales strategy planning:

[0523] Salespeople can devise sales strategies based on the displayed data and sentiment data, and perform real-time data analysis. By analyzing sentiment data, they can formulate effective countermeasures.

[0524] With the above-described configuration and procedures, the present invention is a system that performs advanced management and analysis based on the user's input information and emotion data, and realizes efficient registration and management operations.

[0525] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0526] Crew registration system processing flow

[0527] Step 1:

[0528] The user accesses the specified URL using a PC or tablet device and arrives at the new registration screen.

[0529] Input: URL accessed by user.

[0530] Output: Registration screen displayed.

[0531] Specific operation: The user opens a browser and enters the URL of the registration site. The server receives the request and returns the HTML of the registration screen to the user's device.

[0532] Step 2:

[0533] Using a generative AI model, the device asks the user for necessary information (name, employee ID, store ID) in chat format, while the emotion engine simultaneously analyzes the user's emotional data in real time.

[0534] Input: User's first access information.

[0535] Output: Collection of necessary information and analysis of emotion data.

[0536] How it works: The device uses a generative AI model (e.g., GPT-4) to prompt the user, asking, "What is your name and employee ID?", and upon receiving the user's response, the emotion engine analyzes the user's emotional state.

[0537] Step 3:

[0538] The terminal transmits the collected input information and emotion data to a server.

[0539] Input: User-entered information and emotional data.

[0540] Output: Transfer of input information and emotion data to the server.

[0541] Specific operation: A data packet containing the user's name, employee ID, store ID, and emotion data is sent from the device to the server. The server receives this data.

[0542] Step 4:

[0543] The server stores the received data in a database.

[0544] Input: User data and emotion data sent from the device.

[0545] Output: Information stored in a database.

[0546] What happens: The server runs an SQL query against the database and inserts the received information into a table, like this: INSERT INTO crew_data (name, employee_id, store_id, emotion) VALUES ('Yamada Taro', 'ID12345', '1001', 'Anxiety').

[0547] Step 5:

[0548] The server works in conjunction with the inventory management system based on the information in the database.

[0549] Input: User information stored in the database.

[0550] Output: An update request to the inventory management system.

[0551] Specific operation: The server sends a request to the inventory management system's API to update the inventory information for the new crew member's store. It sends the necessary data to the API endpoint, such as "POST / inventory / update."

[0552] Step 6:

[0553] Based on the analysis results of the emotion engine, feedback is provided to improve the user experience.

[0554] Input: Analysis results of the emotion engine.

[0555] Output: Feedback to the user.

[0556] Specific operation: If the user is feeling anxious, the device will provide a message to reassure the user, such as "Don't worry, you can fix it later."

[0557] Processing flow of the customer registration system

[0558] Step 1:

[0559] The user accesses the designated registration site using a smartphone or PC.

[0560] Input: URL accessed by user.

[0561] Output: Registration screen displayed.

[0562] Specific operation: The user enters the specified URL, the server receives the request, and returns the HTML of the registration site.

[0563] Step 2:

[0564] Using a generative AI model, the device asks customers via chat about their desired model and plan, while an emotion engine simultaneously analyzes the customer's emotional data in real time.

[0565] Input: Customer's first visit information.

[0566] Output: Collection of desired models and plans and analysis results of emotional data.

[0567] How it works: The device uses a generative AI model (e.g., GPT-4) to prompt, "What model do you want?" If the customer answers "iPhone 14," the emotion engine will detect excitement.

[0568] Step 3:

[0569] The terminal transmits the input information and emotion data collected from the customer to the server.

[0570] Input: Customer-entered information and sentiment data.

[0571] Output: Transfer of input information and emotion data to the server.

[0572] Specific operation: A data packet containing the customer's desired model, plan details, and emotional data is sent from the device to the server, which receives this data.

[0573] Step 4:

[0574] The server stores the received data in a database.

[0575] Input: Customer data and sentiment data sent from the device.

[0576] Output: Information stored in a database.

[0577] What happens: The server runs an SQL query against the database to insert the information you entered into a table. This is similar to the operation "INSERT INTO customer_data (device, plan, emotion) VALUES ('iPhone14', 'Unlimited Data, Unlimited Call Plan', 'Excitement')".

[0578] Step 5:

[0579] The server completes the contract procedure based on the stored information.

[0580] Input: Customer information stored in a database.

[0581] Output: Contract procedure completed and a confirmation message to the customer.

[0582] Specific operation: The server sends a contract processing request to the backend system, and after the procedure is completed, it sends a confirmation message to the customer.

[0583] Step 6:

[0584] Based on the analysis results of emotional data, we provide feedback to improve the customer experience.

[0585] Input: Analysis results of the emotion engine.

[0586] Output: Feedback to the customer.

[0587] What it does: If a customer is feeling stressed during the process, the device will provide a reassuring message by displaying "The process is almost complete. You're almost there."

[0588] Processing flow of the sales management system

[0589] Step 1:

[0590] The sales representative logs in to their work PC and accesses the sales management screen.

[0591] Input: Salesperson credentials.

[0592] Output: Display of sales management screen.

[0593] What happens: The sales rep enters their credentials, the server verifies the authentication, and the dashboard is displayed.

[0594] Step 2:

[0595] The PC collects data in real time and sends requests to the server for display.

[0596] Enter your login details.

[0597] Output: Display of requested data.

[0598] Specific operation: The PC sends a data collection request to the server, and the server retrieves the latest sales performance data and emotion data from the database.

[0599] Step 3:

[0600] The server formats the collected data and sends it back to the PC for display as tables and graphs.

[0601] Input: Performance and sentiment data retrieved from the database.

[0602] Output: Visualized data in the form of tables and graphs.

[0603] Specific operation: The server uses Chart.js or D3.js to convert the data into tables and graphs, and then sends the data to the PC.

[0604] Step 4:

[0605] Sales representatives develop sales strategies based on the displayed data and sentiment data.

[0606] Input: Performance and sentiment data converted into tables and graphs.

[0607] Output: Planning and implementation of sales strategies.

[0608] Specific actions: Salespeople analyze the data on the dashboard and decide on the next action. Taking sentiment data into account, they develop effective sales strategies.

[0609] (Application example 2)

[0610] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0611] In modern business activities, personnel registration, customer contract procedures, and sales activity management are extremely important. However, traditionally, these procedures have often been performed manually, making efficient operation difficult. In particular, input errors and the time and effort required to manage and verify data have become issues. Furthermore, one-way information collection and display that ignores the user's or customer's feelings can detract from the user experience. Therefore, there is a need for a system that streamlines these procedures and takes the user's or customer's feelings into consideration.

[0612] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for utilizing a generative AI model to collect input information from users in a chat format, means for saving the input information and emotion data in a database, means for linking with an inventory management system based on the saved information and emotion data, means for analyzing and displaying data in real time, means for the user to proceed with the registration process using a smart device, and means for providing feedback based on user emotion analysis. This enables efficient registration procedures, dynamic feedback based on emotions, and the development of data-driven sales strategies.

[0613] A "generative AI model" is an artificial intelligence technology that understands and generates human language in order to achieve natural interactions with users.

[0614] "Emotion data" is data that analyzes and records the user's emotional state in real time.

[0615] A "database" is a system for permanently storing and managing collected information and emotional data.

[0616] An "inventory management system" is a system for tracking and managing inventory status at stores and businesses in real time.

[0617] "Chat format" is an interface in which a user and a computer exchange information in an interactive format.

[0618] "Means for analyzing and displaying data in real time" refers to a function for instantly analyzing collected data and immediately visually displaying the results.

[0619] A "smart device" is an advanced digital device that users use to input information and receive feedback.

[0620] The "registration process" is the series of steps a new user or customer takes to provide their information to the system and become officially registered.

[0621] "Feedback" is a function in which a system dynamically provides responses and instructions based on a user's actions and emotions.

[0622] A "sales strategy" is a set of policies and techniques for planning and executing more effective sales methods based on collected data.

[0623] "Administrative personnel" is a person or position responsible for the operation and management of a store or an entire business.

[0624] The system of the present invention utilizes various smart devices (smart glasses, smartphones, etc.) to improve the efficiency of user information registration and data management. Specific embodiments of the system are described below.

[0625] Crew registration system

[0626] 1. New user (crew) registration

[0627] The crew puts on the smart glasses and accesses the registration screen. Utilizing a generative AI model, necessary information such as name, employee ID, and store ID is entered via chat. The emotion engine analyzes the user's emotions in real time. For example, if anxiety is detected, the system displays the message, "Next, please tell us your store ID. Don't worry, you can correct it later."

[0628] 2. Data storage

[0629] The crew's information and emotional data collected by the terminal is sent to a server and stored in a database, which is a system for permanently storing and managing the collected information and emotional data.

[0630] 3. Integration with inventory management systems

[0631] The server links with the inventory management system based on the saved data and updates the inventory information for the store to which the new crew member belongs.

[0632] Customer registration system

[0633] 1. Customer Registration Process

[0634] Customers use their smart devices in-store to register for a digital membership. A generative AI model asks the customer about their desired plan, and an emotion engine analyzes the customer's emotions in real time. For example, if excitement is detected, the message will appear: "What plan would you like? You can choose your data volume and calling rates. We also have great value options!"

[0635] 2. Data storage and contract procedures

[0636] The customer information and emotional data collected by the device are sent to a server and stored in a database. The server then automatically completes the contract based on the stored information and emotional data, and asks the customer to confirm the contract details.

[0637] Sales management system

[0638] 1. Check sales performance

[0639] When a manager logs in using a smart device, the server collects the latest sales performance data and related emotional data from the database and displays it to the manager in real time. This data also includes emotional analysis results such as "when customers were excited" and "when crew members felt anxious."

[0640] 2. Displaying data and developing strategies

[0641] The server converts the collected data into tables and graphs and sends them to the smart device, allowing the manager to develop sales strategies based on this data.

[0642] Examples of specific examples and prompts

[0643] Examples:

[0644] User (Crew): "I want to register a new staff member."

[0645] Smart Glasses Display: "Hello! First, please tell us your name and employee ID."

[0646] User: "Yamada Taro, ID12345"

[0647] Display: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[0648] User: "Store ID 1001"

[0649] Display: "Crew registration completed."

[0650] Example prompt for a generative AI model:

[0651] When a user puts on smart glasses and says, "I want to register a new staff member,"

[0652] View the following questions:

[0653] 1. What is your name?

[0654] 2. What is your employee ID?

[0655] 3. What is your store ID?

[0656] Analyze the user's responses to see if they are feeling anxious, and if so, display a message saying, "Don't worry, you can fix it later."

[0657] In this way, the present invention consists of a system that combines a generative AI model and an emotion engine to achieve efficient information collection and management while taking user emotions into consideration.

[0658] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0659] Step 1:

[0660] The user (crew member) wears a smart device and accesses the new registration screen. At this stage, the user indicates their intention to register a new staff member to the system. The input is the user's voice command, and the output is for the generative AI model to prepare to display the next question prompt.

[0661] Step 2:

[0662] The generative AI model asks the user for necessary information such as name, employee ID, and store ID in chat format. The input is the user's voice response, and the output is the response content and emotional analysis data generated by the emotion engine. When the user inputs information such as "Yamada Taro, ID 12345," the device simultaneously analyzes anxiety, excitement, etc. using the emotion engine.

[0663] Step 3:

[0664] The terminal sends the collected crew information and emotional data to the server. The input is the collected crew basic data and emotional analysis data, and the output is that it is accurately stored in a database. The server adds the information to the database for easy access later.

[0665] Step 4:

[0666] The server connects to the inventory management system based on the stored information and emotion data. The input is crew information and emotion data in the database, and the output is updates to related inventory information. The server updates the inventory status at the crew's assigned store in real time, instantly reflecting the necessary information.

[0667] Step 5:

[0668] To improve the user experience, the device provides feedback based on emotional data analyzed by the emotion engine. The input is the user's emotional data provided in real time by the emotion engine, and the output is dynamic feedback to the user. For example, when a user enters "Store ID 1001," if emotion analysis detects anxiety, the device displays the message, "Next, please enter your store ID. Don't worry, you can correct it later."

[0669] In this way, each processing step leverages generative AI models and emotion engines to streamline user information collection and associated data management, improving the user experience.

[0670] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0671] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0672] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0673] [Second embodiment]

[0674] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0675] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0676] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0677] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0678] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0679] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0680] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0681] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0682] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0683] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0684] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0685] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0686] The system of the present invention utilizes generative AI models to streamline crew registration, customer registration, and sales management. This system allows users to input information in chat format, which is then stored in a database and processed in conjunction with related systems.

[0687] Crew registration system

[0688] 1. User (crew member) accesses the new registration screen:

[0689] A user accesses the registration screen for a new crew member using a device (such as a PC or tablet).

[0690] 2. The device uses the generative AI model to collect the necessary information from the user:

[0691] The device uses a generative AI model to ask the user for necessary information such as name, employee ID, store ID, etc. in a chat format, allowing the crew to input the information easily and intuitively.

[0692] 3. The server saves the input data to the database:

[0693] The device sends the collected information to a server, which stores the information in a database.

[0694] 4. The server interfaces with the inventory management system:

[0695] The server connects to the inventory management system based on the saved data and updates the inventory information for the store to which the new crew belongs.

[0696] Customer registration system

[0697] 1. User (customer) visits the registration site:

[0698] Customers access the service's registration site using their smartphone or PC.

[0699] 2. The device uses generative AI models to answer customer questions via chat:

[0700] The device uses a generative AI model to ask customers questions to help them select the model and plan they want, and provides appropriate answers and plan suggestions based on their input.

[0701] 3. The server saves the input data to the database:

[0702] The terminal transmits the collected customer information to a server, which stores the information in a database.

[0703] 4. The server completes the contract procedure:

[0704] The server automatically completes the contract process based on the stored information and sends the customer a message confirming the contract details.

[0705] Sales management system

[0706] 1. A user (sales representative) logs in to their work PC:

[0707] The sales representative logs in to their work PC and accesses the sales management screen.

[0708] 2. PC collects and displays data in real time:

[0709] After the PC confirms the login, it sends a request to the server, which then collects the latest sales performance data from the database.

[0710] 3. The server displays the data as a table or graph:

[0711] The server converts the collected data into tables and graphs and sends them to a PC, which displays them to the sales representative.

[0712] 4. Users develop sales strategies:

[0713] Sales representatives can develop sales strategies based on the displayed data and perform real-time data analysis.

[0714] Specific examples

[0715] Crew registration example

[0716] User (Crew): "I want to register a new staff member."

[0717] Terminal: "Hello! First, please tell me your name and employee ID."

[0718] User: "Yamada Taro, ID12345"

[0719] Terminal: "Next, please tell me your store ID."

[0720] User: "Store ID 1001"

[0721] Terminal: "Signed up. Let's check inventory information next."

[0722] Server: Links with the inventory management system and updates inventory information.

[0723] Example of customer registration

[0724] User (customer): "I want to sign up for a new smartphone contract."

[0725] Terminal: "Is there a model you would like?"

[0726] User: "iPhone14"

[0727] Device: "What plan would you like? You can choose your data volume and calling rates."

[0728] User: "I'd like an unlimited data and unlimited calling plan."

[0729] Device: "Thank you. This completes the registration process. Please confirm your details."

[0730] Server: Stores registration information and completes contract procedures.

[0731] Specific examples of sales management

[0732] User (Salesperson): "I want to check this month's sales performance."

[0733] PC: "Retrieving current performance data. Please wait."

[0734] Server: Collects performance data from the database, formats it, and sends it to the PC.

[0735] PC: "Below are this month's sales results." (Shows table and graph)

[0736] This will reduce crew registration training time, simplify customer registration procedures, and improve sales management efficiency.

[0737] The processing flow will be explained below.

[0738] Crew registration system

[0739] Step 1:

[0740] The user accesses the new registration screen. The device confirms the user's permission to access the device and displays the registration screen.

[0741] Step 2:

[0742] The device uses the generative AI model to prompt the user to enter their name and employee ID. Specifically, it displays the message "Please enter your name and employee ID" in chat format.

[0743] Step 3:

[0744] The user enters their name and employee ID and sends it to the terminal. For example, they enter "Yamada Taro, ID12345."

[0745] Step 4:

[0746] The device uses the generated AI model to ask the user for the next piece of information needed: the store ID. It displays the message, "Please enter your store ID."

[0747] Step 5:

[0748] The user enters the store ID and sends it to the terminal. For example, the user enters "Store ID 1001."

[0749] Step 6:

[0750] The terminal sends all collected input data to the server.

[0751] Step 7:

[0752] The server stores the received data in a database.

[0753] Step 8:

[0754] The server links with the inventory management system based on the stored information and updates the inventory information.

[0755] Step 9:

[0756] The server sends a message to the terminal indicating that registration and inventory information update is complete.

[0757] Step 10:

[0758] The terminal displays a completion message to the user: "Registration completed. Stock information has also been updated."

[0759] Customer registration system

[0760] Step 1:

[0761] The user accesses the registration site. The device confirms the user's permission to access the site and displays the registration screen.

[0762] Step 2:

[0763] The device uses the generated AI model to ask the user about their desired model, displaying the message, "Is there a model you would like?"

[0764] Step 3:

[0765] The user inputs the desired model and sends it to the device. For example, input "iPhone14."

[0766] Step 4:

[0767] The device then uses the generative AI model to ask the user about the next necessary information: the plan. It displays, "What plan would you like? You can choose your data volume and call charges."

[0768] Step 5:

[0769] The user inputs the desired plan and sends it to the device. For example, they might input "I'd like an unlimited data and unlimited calling plan."

[0770] Step 6:

[0771] The terminal sends all collected input data to the server.

[0772] Step 7:

[0773] The server stores the received data in a database.

[0774] Step 8:

[0775] The server automatically carries out contract procedures based on the stored information.

[0776] Step 9:

[0777] The server sends a message to the terminal indicating that the contract procedure has been completed.

[0778] Step 10:

[0779] The device displays a confirmation message to the user: "The procedure is complete. Please confirm your registration details."

[0780] Sales management system

[0781] Step 1:

[0782] A user (sales representative) logs in to a work PC. The PC requests the user's authentication information, and if authentication is successful, the management screen is displayed.

[0783] Step 2:

[0784] A user requests a confirmation of sales performance. Enters, "I would like to check this month's sales performance."

[0785] Step 3:

[0786] The PC sends a data request to the server. "Sales performance data requested" is sent to the server.

[0787] Step 4:

[0788] The server collects the latest sales performance data from the database.

[0789] Step 5:

[0790] The server formats the collected data into tables and graphs.

[0791] Step 6:

[0792] The server sends the formatted data to the PC.

[0793] Step 7:

[0794] The PC displays sales performance data to the user. It displays "This month's sales performance" and shows tables and graphs.

[0795] This will streamline all processes for crew registration, customer registration, and sales management.

[0796] Example 1

[0797] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0798] Conventional user information collection systems require manual data entry and management, which requires a great deal of time and human effort. Furthermore, the need to link with inventory management systems and contract procedure systems is cumbersome, making it inefficient for business personnel to check and analyze data in real time. Furthermore, there is a need for a method to quickly and accurately acquire and process information when registering users from remote locations.

[0799] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0800] In this invention, the server includes means for utilizing a generative AI model to collect input information from users in chat format, means for saving the input information in a database, means for linking with an inventory management system based on the saved information, means for analyzing and displaying data in real time, means for a terminal to collect information from users using a generative AI model and for the server to analyze the information, and means for linking with the inventory management system using the collected data. This makes information collection from users more efficient, reduces manual input work, enables smooth inventory management and contract procedures, and makes it possible to provide accurate data to business personnel in real time.

[0801] A "generative AI model" is an artificial intelligence system that collects and analyzes input information from users using technologies such as natural language processing, and responds in an interactive, conversational format.

[0802] A "terminal" is an electronic device that a user uses to input information and interact with a system, and refers to general devices such as PCs, tablets, and smartphones.

[0803] "Server" refers to a remotely located computer or system responsible for receiving and analyzing data collected from users and storing that information in a database.

[0804] A "database" is a collection of systems and software that store and manage collected information in an organized manner and quickly search and retrieve data as needed.

[0805] An "inventory management system" is a system for tracking and managing product inventory information in real time, maintaining data on product inventory and optimizing inventory.

[0806] The "chat format" refers to a method in which interaction with a user is conducted in a text-based conversational format, in which questions are presented to the user and information is collected by the user responding to the questions.

[0807] "Real-time" means that data is processed and displayed the moment it is generated, meaning that the latest information is available without delay.

[0808] "Analysis" refers to the means and process of converting collected data into an understandable form and extracting and utilizing the necessary information from it.

[0809] "Federation" refers to the means of connection and integration that allows different systems to share and utilize data and services.

[0810] "Interaction" refers to the interaction between a user and a system, and the process by which the system responds to user input.

[0811] "Business personnel" refers to personnel who are in charge of specific tasks within a company or organization and who carry out and manage those tasks.

[0812] MODE FOR CARRYING OUT THE INVENTION

[0813] This invention is a system that utilizes a generative AI model to improve the efficiency of crew registration, customer registration, and sales management. The main components of the system include a generative AI model, a terminal for collecting user information, a server, and a database. Specific examples will be provided below.

[0814] Crew registration system

[0815] First, a user accesses the registration page for a new crew member using a device such as a PC or tablet. The device sends a request to the web server, retrieves the registration page, and displays it.

[0816] The device then uses a generative AI model (e.g., ChatGPT) to prompt the user for necessary information such as name, employee ID, store ID, etc. in chat format using prompt sentences. This interaction allows the crew member to input information easily and intuitively.

[0817] The collected information is sent from the terminal to a server, which stores it in a database (e.g., MySQL). Based on the stored data, the server connects to an inventory management system and updates the inventory information for the new crew member's store.

[0818] Examples:

[0819] User (Crew): "I want to register a new staff member."

[0820] Terminal: "Hello! First, please tell me your name and employee ID."

[0821] User: "Yamada Taro, ID12345"

[0822] Terminal: "Next, please tell me your store ID."

[0823] User: "Store ID 1001"

[0824] Terminal: "Signed up. Let's check inventory information next."

[0825] Server: Links with the inventory management system and updates inventory information.

[0826] Customer registration system

[0827] Customers access the service's registration site using their smartphones or PCs. The device sends a request to the web server, which retrieves and displays the HTML page of the registration site.

[0828] The device launches the generative AI model within the page and begins a dialogue with the customer. The generative AI model asks questions about models and plans, and the customer responds via chat. The collected information is sent from the device to a server, which stores it in a database.

[0829] The server carries out the contract procedures based on the stored information and sends the customer a confirmation message of the contract contents.

[0830] Examples:

[0831] User (customer): "I want to sign up for a new smartphone contract."

[0832] Terminal: "Is there a model you would like?"

[0833] User: "iPhone14"

[0834] Device: "What plan would you like? You can choose your data volume and calling rates."

[0835] User: "I'd like an unlimited data and unlimited calling plan."

[0836] Device: "Thank you. This completes the registration process. Please confirm your details."

[0837] Server: Stores registration information and completes contract procedures.

[0838] Sales management system

[0839] The sales representative accesses the login screen of their work PC and enters their user ID and password. The terminal sends the authentication information to the server, which then authenticates them. If authentication is successful, the business sales management screen is displayed.

[0840] The PC sends a request to the server for the latest sales performance data. The server retrieves the sales performance data from the database, formats it, and sends it back to the PC. The PC displays the received data to the sales representative as a table or graph. The sales representative then uses this data to develop a sales strategy in real time.

[0841] Examples:

[0842] User (Salesperson): "I want to check this month's sales performance."

[0843] PC: "Retrieving current performance data. Please wait."

[0844] Server: Collects performance data from the database, formats it, and sends it to the PC.

[0845] PC: "Below are this month's sales results." (Shows table and graph)

[0846] The above system is expected to reduce the time required for crew registration training, simplify customer registration procedures, and improve the efficiency of sales management.

[0847] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0848] Crew registration system processing flow

[0849] Step 1:

[0850] The user accesses the new registration screen using a device such as a PC or tablet.

[0851] Input: User's access request

[0852] Output: Display of registration screen

[0853] Specific operation: The user opens a web browser and enters the registration URL. The device sends an HTTP request to the web server, retrieves the HTML of the registration screen, and displays it.

[0854] Step 2:

[0855] The device launches the generative AI model and collects necessary information from the user, such as name, employee ID, and store ID.

[0856] Input: User input information (e.g., name, employee ID, store ID)

[0857] Output: Collected data

[0858] Specific operation: The generative AI model starts up and displays prompts such as "Please enter your name" or "Please enter your employee ID." The user enters information into each field and presses the submit button. The device passes the user's input to the generative AI model and collects the information.

[0859] Step 3:

[0860] The device sends the collected information to a server, which stores it in a database.

[0861] Input: Collected user information

[0862] Output: Information stored in the database

[0863] Specific operation: The device sends the collected information as an HTTP request to the backend server, which parses the received information, generates an SQL query, and stores it in a database (e.g., MySQL).

[0864] Step 4:

[0865] The server connects to the inventory management system based on the stored data.

[0866] Input: Crew information stored in the database

[0867] Output: Information reflected in the inventory management system

[0868] Specific operation: The server calls the inventory management system's API based on the saved crew information and sends data about the new crew's affiliated store. The inventory management system reflects that information and responds to the server that the update is complete.

[0869] Processing flow of the customer registration system

[0870] Step 1:

[0871] The user (customer) accesses the registration site using a smartphone or PC.

[0872] Input: Customer Access Request

[0873] Output: Display of registration site

[0874] Specific operation: The customer opens a web browser and enters the URL of the registration site to access it. The device sends an HTTP request to the web server, retrieves the HTML of the registration site, and displays it.

[0875] Step 2:

[0876] The device uses the generated AI model to answer customer questions in chat format and collect the necessary information.

[0877] Input: Customer selection and registration information (e.g., model, plan)

[0878] Output: Collected data

[0879] How it works: The generative AI model launches and presents prompts such as "What model do you want?" or "Please select a plan." The customer enters information into the input field and presses the send button. The device passes that information to the generative AI model, which then generates the next prompt.

[0880] Step 3:

[0881] The terminal sends the collected customer information to a server, which stores it in a database.

[0882] Input: Collected customer information

[0883] Output: Information stored in the database

[0884] Specific operation: The device sends the collected information as an HTTP request to the backend server, which parses the received information, generates an SQL query, and stores it in the database.

[0885] Step 4:

[0886] The server carries out the contract procedures based on the stored information.

[0887] Input: Customer information stored in a database

[0888] Output: Contract procedure completion message

[0889] Specific operation: The server automatically performs contract procedures based on the stored customer information. Once the procedures are completed, the server sends a confirmation message of the contract details to the customer's device. The customer confirms the message and confirms that the procedures are complete.

[0890] Processing flow of the sales management system

[0891] Step 1:

[0892] A user (sales representative) logs in to a work PC.

[0893] Input: User ID, Password

[0894] Output: Authentication results, sales management screen display

[0895] Specific operation: A sales representative accesses the login screen of their work PC and enters their user ID and password. The terminal sends the authentication information to the server, and the server successfully authenticates. The business sales management screen is displayed.

[0896] Step 2:

[0897] The PC sends a request to the server, asking for the latest sales data.

[0898] Input: Request

[0899] Output: Sales performance data

[0900] Specific operation: After authentication, the PC sends a request for sales performance data to the server. The server retrieves the latest sales performance data from the database and returns it to the PC.

[0901] Step 3:

[0902] The sales performance data collected by the server is converted into tables and graphs, and sent to a PC for display.

[0903] Input: Sales performance data

[0904] Output: Data in tabular and graphical format

[0905] Specific operation: The server generates tables and graphs based on sales performance data using a graph generation library (e.g., D3.js), and sends the generated data to the PC, which then displays it visually.

[0906] Step 4:

[0907] The user creates a sales strategy based on the displayed data.

[0908] Input: Data for tables and graphs

[0909] Output: Sales Strategy

[0910] Specific actions: The sales representative analyzes the displayed data and formulates a specific action plan to create a new sales strategy.

[0911] (Application example 1)

[0912] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0913] The traditional crew and customer registration process in brick-and-mortar stores was highly manual, taking time and effort, and was prone to errors. Furthermore, there was a lack of efficient ways to visually grasp performance data in real time, making it difficult to quickly formulate operational strategies. This resulted in inefficient store operations, lower customer satisfaction, and delays in understanding performance.

[0914] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0915] In this invention, the server includes a means for utilizing a generative AI model to collect input data from users in chat format, a means for storing the collected input data in a database system, a means for linking with an asset management system based on the stored data, and a means for using a visual device to analyze and display data in real time, thereby making it possible to improve the efficiency of store operations, reduce errors in crew and customer registration, and grasp performance data in real time.

[0916] A "generative AI model" is a type of artificial intelligence system that uses natural language processing to understand user input data and generate appropriate questions and answers.

[0917] "Chat format" refers to an interface format in which a user interacts with a system, asking and answering questions using text or voice.

[0918] "Input data" refers to the information a user provides to the system, including their name, ID, and details of the product they want.

[0919] A "database system" is a system for storing, managing, and searching information in an organized manner, and is often operated using a language such as SQL.

[0920] An "asset management system" is a system for efficiently managing the goods and inventory information held by stores and companies.

[0921] "Analyzing data in real time" means processing newly collected data immediately and quickly deriving results.

[0922] A "visual device" is a device that allows a user to visually view information, including smart glasses and monitors.

[0923] "Customer interface" refers to the user interface through which customers input information and perform operations.

[0924] "Operations staff" refers to staff involved in the operation of a store or company, and are responsible for managing performance and formulating strategies.

[0925] "Performance data" refers to data that indicates the business results of a store or company, such as sales and sales performance.

[0926] "Interactive data analysis means" means that users can directly manipulate data and obtain analysis results in real time.

[0927] The following describes in detail the mode for carrying out the present invention. This invention is a system that utilizes a generative AI model to streamline the crew registration and customer registration processes in physical stores. The system collects input data from users in chat format and stores it in a database. Based on the stored data, the system also links with an asset management system and uses a visual device to analyze and display the data in real time.

[0928] Overall system configuration

[0929] Hardware and software used

[0930] Hardware: Smart glasses (e.g., Google Glass, HoloLens)

[0931] Software: Generative AI models (e.g., GPT-4, BERT), database systems (e.g., MySQL, PostgreSQL), and secure server environments (e.g., AWS, Microsoft Azure)

[0932] System processing flow

[0933] 1. Crew Registration

[0934] The server uses a generative AI model to collect input data from users in chat format, such as crew names, employee IDs, and store IDs.

[0935] The terminal (smart glasses) sends the collected input data to the server and stores it in a database system.

[0936] The server interacts with the asset management system based on the stored data.

[0937] 2. Customer Registration

[0938] The server uses generative AI models to provide a chat-style interface for customers to select and register their desired product and service options at home or in-store.

[0939] The terminal stores the customer's selection and registration information in a database.

[0940] The server completes the contract procedure based on the registered information and provides an interface for making corrections as necessary.

[0941] 3. Analysis and display of performance data

[0942] The server utilizes generative AI models to enable operations staff to view performance data in real time.

[0943] The server provides an interactive data analysis tool to format and display the collected performance data in visual formats (tables and graphs).

[0944] The terminal (smart glasses) provides an interface that allows operations personnel to analyze data in real time and develop operational strategies.

[0945] Specific examples

[0946] Crew registration example

[0947] User (Crew Member): "I want to register a new staff member."

[0948] Terminal (Smart Glasses): "Hello! First, please tell us your name and employee ID."

[0949] User: "Yamada Taro, ID12345"

[0950] Terminal: "Next, please tell me your store ID."

[0951] User: "Store ID 1001"

[0952] Device: "Registration complete. Thank you."

[0953] Example of customer registration

[0954] User (customer): "I want to sign up for a new smartphone contract."

[0955] Terminal: "Is there a model you would like?"

[0956] User: "iPhone14"

[0957] Device: "What plan would you like? Unlimited data and unlimited calling, please."

[0958] Terminal: "Thank you. This completes the procedure."

[0959] Examples of performance data analysis and display

[0960] User (Operations Manager): "I want to check this month's sales performance."

[0961] Terminal: "Retrieving current performance data. Please wait."

[0962] Server: Collects performance data from the database, formats it, and sends it to the terminal.

[0963] Device: "Below are this month's sales results." (displays table and graph)

[0964] Prompt Sentence Examples

[0965] When a user says, "I want to register a new staff member"

[0966] "Hello! First, please tell me your name and employee ID."

[0967] Next, please tell us your store ID.

[0968] When a user says, "I want to sign a new smartphone contract"

[0969] Is there a model you would like?

[0970] "Please select a plan. You can choose the amount of data and call charges."

[0971] In this way, it is possible to build a system that streamlines the crew and customer registration processes in physical stores and enables real-time performance data to be tracked.

[0972] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0973] Step 1:

[0974] The user (crew member) puts on the smart glasses and switches to new crew registration mode. Specifically, the user selects "crew registration" from the smart glasses menu. The input is the user's (crew member's) operation, and the output is "start crew registration mode."

[0975] Step 2:

[0976] The device (smart glasses) uses a generative AI model to collect the user's (crew member's) name, employee ID, and store ID by asking questions in a chat format. Specifically, it accepts input via voice or tap. The input for this step is voice or tap input from the user (crew member), and the output is the collected name, employee ID, and store ID data.

[0977] Step 3:

[0978] The terminal (smart glasses) transmits the collected data to the server. Specifically, the smart glasses transmit the data via the Internet. The input of this step is the collected user data, and the output is the completion of data transmission to the server.

[0979] Step 4:

[0980] The server stores the received data in the database system. Specifically, the server executes an SQL command to insert the data. The input of this step is the user data sent from the terminal, and the output is the successful storage in the database.

[0981] Step 5:

[0982] The server interacts with the asset management system based on the stored data. Specifically, the server calls the API to update inventory information. The input for this step is the user data stored in the database, and the output is the updated inventory information.

[0983] Step 6:

[0984] The user (customer) interacts with a crew member wearing smart glasses to select desired product or service options. Specifically, the crew member uses the smart glasses to present questions to the generative AI model. The input to this step is the user's (customer's) desired information, and the output is the selected and registered option information.

[0985] Step 7:

[0986] The terminal (smart glasses) sends the customer's selection information to the server and stores it in the database. Specifically, the smart glasses send data through the network. The input of this step is the customer's option selection information, and the output is the successful storage in the database.

[0987] Step 8:

[0988] The server completes the contract procedure based on the registered information and provides the customer with an interface for confirmation and modification. Specifically, the server generates a contract and displays a confirmation screen. The input for this step is the customer information stored in the database, and the output is the completion of the contract procedure and the display of a confirmation screen.

[0989] Step 9:

[0990] The user (operator) puts on the smart glasses and starts real-time analysis of performance data. Specifically, the operator selects "Performance Data Analysis." The input for this step is the operator's operation, and the output is the start of analysis mode.

[0991] Step 10:

[0992] The server uses a generative AI model to collect performance data and display the analysis results on a visual device. Specifically, the server retrieves data from a database, analyzes it, and generates it as graphs and tables. The input for this step is performance data from the database, and the output is the display results on the visual device.

[0993] Step 11:

[0994] The terminal (smart glasses) provides an interface for the operations manager to check the data analysis results in real time and formulate an operations strategy. Specifically, the smart glasses display the analysis results, and the operations manager operates based on them. The input for this step is the analysis results sent from the server, and the output is the analysis results for formulating an operations strategy.

[0995] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0996] The system of the present invention utilizes a generative AI model and combines it with an emotion engine that recognizes user emotions, thereby improving the efficiency of crew registration, customer registration, and sales management. With this system, users can input information in chat format, and the information and emotion data are stored in a database, which then processes the data in conjunction with related systems.

[0997] Crew registration system

[0998] 1. User (crew member) accesses the new registration screen:

[0999] A user accesses the registration screen for a new crew member using a device (such as a PC or tablet).

[1000] 2. The device uses the generative AI model to collect the necessary information from the user:

[1001] The device uses a generative AI model to ask the user necessary information, such as their name, employee ID, or store ID, via chat. It also uses an emotion engine to analyze the user's emotions in real time as they ask questions. This allows the crew member to input information easily and intuitively, and their emotions are also recorded.

[1002] 3. The server saves the input data to the database:

[1003] The device sends the collected information and emotional data to a server, which stores it in a database.

[1004] 4. The server interfaces with the inventory management system:

[1005] The server connects to the inventory management system based on the saved data and updates the inventory information for the store to which the new crew belongs.

[1006] 5. Improved user experience:

[1007] The emotion engine analyzes the emotional data and provides feedback to improve the user experience. For example, if the user feels anxious, the device will provide a more detailed explanation.

[1008] Customer registration system

[1009] 1. User (customer) visits the registration site:

[1010] Customers access the service's registration site using their smartphone or PC.

[1011] 2. The device uses generative AI models to answer customer questions via chat:

[1012] The device uses a generative AI model to ask questions to help customers select the model and plan they want, and an emotion engine to analyze customer sentiment in real time and dynamically change the questions and responses.

[1013] 3. The server stores the input data and emotion data in a database:

[1014] The terminal transmits the collected customer information and emotional data to a server, which stores it in a database.

[1015] 4. The server completes the contract procedure:

[1016] The server automatically completes the contract process based on the stored information and sends the customer a message confirming the contract details.

[1017] 5. Improved customer experience:

[1018] Based on emotional data analyzed by the emotion engine, feedback is provided to help customers proceed with the process smoothly and without stress.

[1019] Sales management system

[1020] 1. A user (sales representative) logs in to their work PC:

[1021] The sales representative logs in to their work PC and accesses the sales management screen.

[1022] 2. PC collects and displays data in real time:

[1023] After the PC confirms the login, it sends a request to the server, which collects the latest sales performance data and related emotion data from the database.

[1024] 3. The server displays the data as a table or graph:

[1025] The server converts the collected data into tables and graphs and sends them to a PC, which displays them to the sales representative.

[1026] 4. Sales strategy planning:

[1027] Sales representatives can develop sales strategies based on the displayed data and sentiment data, and perform real-time data analysis.

[1028] Specific examples

[1029] Crew registration example

[1030] User (Crew): "I want to register a new staff member."

[1031] Terminal: "Hello! First, please tell me your name and employee ID."

[1032] User: "Yamada Taro, ID12345"

[1033] Terminal: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[1034] User: "Store ID 1001"

[1035] Terminal: "Signed up. Let's check inventory information next."

[1036] Server: Links with the inventory management system and updates inventory information.

[1037] Example of customer registration

[1038] User (customer): "I want to sign up for a new smartphone contract."

[1039] Terminal: "Is there a model you would like?"

[1040] User: "iPhone14"

[1041] Device: The emotion engine detects excitement and displays, "What plan would you like? Choose your data and calling options. We also offer great savings!"

[1042] User: "I'd like an unlimited data and unlimited calling plan."

[1043] Device: "Thank you. This completes the registration process. Please confirm your details."

[1044] Server: Stores registration information and completes contract procedures.

[1045] Specific examples of sales management

[1046] User (Salesperson): "I want to check this month's sales performance."

[1047] PC: "Retrieving current performance data. Please wait."

[1048] Server: Collects performance data and emotion data from the database, formats them, and sends them to the PC.

[1049] PC: "Below are this month's sales results." (Shows table and graph)

[1050] Also includes emotional data: analysis results such as "when customers were excited" and "when crew members felt anxious."

[1051] This allows the system to recognize the emotions of crew members and customers in real time and provide appropriate feedback, thereby improving the user experience and significantly increasing operational efficiency.

[1052] The processing flow will be explained below.

[1053] Crew registration system

[1054] Step 1:

[1055] The user accesses the new registration screen. The terminal confirms the user's access and displays the registration screen.

[1056] Step 2:

[1057] The device uses the generative AI model to prompt the user to enter their name and employee ID. Specifically, it displays the message "Please enter your name and employee ID" in chat format.

[1058] Step 3:

[1059] The user enters their name and employee ID and sends it to the terminal. For example, they enter "Yamada Taro, ID12345."

[1060] Step 4:

[1061] The device then uses the generated AI model to ask for the next piece of information, the store ID, and displays the message, "Please enter your store ID."

[1062] Step 5:

[1063] The user enters the store ID and sends it to the terminal. For example, the user enters "Store ID 1001."

[1064] Step 6:

[1065] The device uses an emotion engine to analyze the user's emotions in real time. For example, if the user is feeling anxious, the device will analyze that information.

[1066] Step 7:

[1067] All input data and emotion data collected by the device are sent to the server.

[1068] Step 8:

[1069] The server stores the received data in a database, simultaneously storing user information and analyzed emotion data.

[1070] Step 9:

[1071] The server links with the inventory management system based on the stored information and updates the inventory information, keeping the inventory information of the new crew member's assigned store up to date.

[1072] Step 10:

[1073] The server sends a message to the terminal indicating that registration and inventory information update is complete.

[1074] Step 11:

[1075] The terminal displays a completion message to the user: "Registration is complete. Stock information has also been updated."

[1076] Customer registration system

[1077] Step 1:

[1078] The user accesses the registration site. The device confirms the user's access and displays the registration screen.

[1079] Step 2:

[1080] The device uses the generated AI model to ask the user about their desired model, displaying the message, "Is there a model you would like?"

[1081] Step 3:

[1082] The user inputs the desired model and sends it to the device. For example, input "iPhone14."

[1083] Step 4:

[1084] The device then uses the generative AI model to ask about the next necessary information, the plan, and displays the message, "What plan would you like? You can choose your data volume and call charges."

[1085] Step 5:

[1086] The user inputs the desired plan and sends it to the device. For example, they might input "I'd like an unlimited data and unlimited calling plan."

[1087] Step 6:

[1088] The device uses an emotion engine to analyze the user's emotions in real time. For example, if the user is feeling excited, the device will analyze that information.

[1089] Step 7:

[1090] All input data and emotion data collected by the device are sent to the server.

[1091] Step 8:

[1092] The server stores the received data in a database, simultaneously storing user information and analyzed emotion data.

[1093] Step 9:

[1094] The server automatically carries out contract procedures based on the stored information.

[1095] Step 10:

[1096] The server sends a message to the terminal indicating that the contract procedure has been completed.

[1097] Step 11:

[1098] The device displays a confirmation message to the user: "The procedure is complete. Please confirm your registration details."

[1099] Sales management system

[1100] Step 1:

[1101] A user (sales representative) logs in to a work PC. The PC checks the user's authentication information and displays the management screen if authentication is successful.

[1102] Step 2:

[1103] A user requests a confirmation of sales performance. Enters, "I would like to check this month's sales performance."

[1104] Step 3:

[1105] The PC sends a data request to the server, saying, "I would like to request sales performance data."

[1106] Step 4:

[1107] A server collects the latest sales performance data and associated sentiment data from a database.

[1108] Step 5:

[1109] The server formats the collected data into tables and graphs, including emotional data, so that it can be displayed visually.

[1110] Step 6:

[1111] The server sends the formatted data to the PC.

[1112] Step 7:

[1113] The PC displays sales performance data and emotion data to the user. It displays "This month's sales performance is as follows," and displays tables and graphs.

[1114] Step 8:

[1115] The user develops a sales strategy based on the displayed data and sentiment data, and adjusts the strategy based on customer and crew feedback indicated by the sentiment data.

[1116] This allows the system to recognize the emotions of crew members and customers in real time and provide appropriate feedback, thereby improving the user experience and significantly increasing operational efficiency.

[1117] Example 2

[1118] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1119] Existing systems have difficulty efficiently collecting and processing user input. They also lack the ability to recognize user emotions and provide appropriate feedback, resulting in a poor user experience. Furthermore, sales representatives have limited means to check sales performance in real time, making it difficult to develop effective sales strategies.

[1120] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1121] In this invention, the server includes means for utilizing a generative AI model to collect input information and emotional data from users in chat format, means for storing the collected input information and emotional data in a database, means for linking with other management systems based on the stored information, means for analyzing and displaying the collected data in real time, and means for providing feedback to improve the user experience based on the emotional data, thereby enabling a significant improvement in user experience and business efficiency.

[1122] A "generative AI model" is a type of artificial intelligence that learns from large amounts of data and performs natural language processing and question answering.

[1123] "Chat format" refers to a format in which a user and a system communicate through text messages.

[1124] "Information input from the user" refers to data such as name, ID, and store information that the user provides to the system.

[1125] "Emotion data" is data that indicates an emotional state analyzed from a user's text input.

[1126] A "database" is a system for efficiently storing, retrieving, and managing data.

[1127] A "management system" is a system for performing specific tasks such as inventory management and customer management.

[1128] The "means for analyzing and displaying collected data in real time" is a function for processing collected data in real time and visually presenting it to the user.

[1129] "Means for providing feedback to improve the user experience" refers to a function that provides appropriate responses and information based on the user's emotional data to enable the user to use the system more comfortably.

[1130] This invention is a system that utilizes a generative AI model and combines it with an emotion engine that recognizes user emotions to highly streamline crew registration, customer registration, and sales management. Specific embodiments are described below.

[1131] Hardware and software used

[1132] This system consists of devices such as PCs and tablets used by users, a central processing server, and a database for storing data. The main software used includes a generative AI model (e.g., GPT-4) for implementing chatbot functions, an emotion engine for analyzing emotional data, a relational database (e.g., MySQL, PostgreSQL) for data storage and retrieval, and other management systems (e.g., SAP or Oracle for inventory management systems).

[1133] An embodiment of a system dedicated to crew registration

[1134] 1. User (crew member) accesses the new registration screen:

[1135] When a user accesses the specified URL using a PC or tablet device, the registration screen will be displayed.

[1136] 2. The device uses the generative AI model to collect the necessary information from the user:

[1137] The device uses a generative AI model (e.g., GPT-4) to ask the user necessary information in the form of a chatbot, such as their name, employee ID, store ID, etc. At the same time, it uses an emotion engine to analyze the user's emotional data in real time.

[1138] Examples:

[1139] User (Crew): "I want to register a new staff member."

[1140] Terminal: "Hello! First, please tell me your name and employee ID."

[1141] User: "Yamada Taro, ID12345"

[1142] Terminal: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[1143] 3. The server saves the input data to the database:

[1144] The device sends the collected information and emotion data to a server, which stores them in a relational database (e.g., MySQL, PostgreSQL).

[1145] 4. The server interfaces with the inventory management system:

[1146] The server uses the stored data to link with other management systems (e.g., SAP or Oracle) and updates the inventory information for the store to which the new crew belongs.

[1147] 5. Improved user experience:

[1148] Based on the emotional data analyzed by the emotion engine, the device provides feedback to improve the user experience. For example, if the user is feeling anxious, the device will provide a more detailed explanation.

[1149] Embodiment of a system dedicated to customer registration

[1150] 1. User (customer) visits the registration site:

[1151] When customers access the designated service registration site using their smartphone or PC, the registration screen will be displayed.

[1152] 2. The device uses generative AI models to answer customer questions via chat:

[1153] The device uses a generative AI model (e.g., GPT-4) to ask customers questions about their desired model and plan in chatbot format, while simultaneously analyzing customer sentiment data in real time using an emotion engine.

[1154] Examples:

[1155] User (customer): "I want to sign up for a new smartphone contract."

[1156] Terminal: "Is there a model you would like?"

[1157] User: "iPhone14"

[1158] Device: The emotion engine detects excitement and displays, "What plan would you like? Choose your data and calling options. We also offer great savings!"

[1159] 3. The server stores the input data and emotion data in a database:

[1160] The device sends the collected information and emotion data to a server, which stores them in a relational database (e.g., MySQL, PostgreSQL).

[1161] 4. The server completes the contract procedure:

[1162] The server automatically processes the contract based on the stored information and sends the customer a message confirming the contract details.

[1163] 5. Improved customer experience:

[1164] Based on emotional data analyzed by the emotion engine, feedback is provided to customers to help them proceed with the process without stress.

[1165] Embodiment of a sales management system

[1166] 1. A user (sales representative) logs in to their work PC:

[1167] A sales representative logs in to their work PC and accesses the sales management screen. They enter their authentication information and complete the login.

[1168] 2. PC collects and displays data in real time:

[1169] The device confirms the login and sends a request to the server, which collects the latest sales performance data and related emotion data from the database and sends them to the device.

[1170] 3. The server displays the data as a table or graph:

[1171] The server formats the collected data, visualizes it using a chart conversion library (e.g., Chart.js or D3.js), and displays it on the device.

[1172] 4. Sales strategy planning:

[1173] Salespeople can devise sales strategies based on the displayed data and sentiment data, and perform real-time data analysis. By analyzing sentiment data, they can formulate effective countermeasures.

[1174] With the above-described configuration and procedures, the present invention is a system that performs advanced management and analysis based on the user's input information and emotion data, and realizes efficient registration and management operations.

[1175] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1176] Crew registration system processing flow

[1177] Step 1:

[1178] The user accesses the specified URL using a PC or tablet device and arrives at the new registration screen.

[1179] Input: URL accessed by user.

[1180] Output: Registration screen displayed.

[1181] Specific operation: The user opens a browser and enters the URL of the registration site. The server receives the request and returns the HTML of the registration screen to the user's device.

[1182] Step 2:

[1183] Using a generative AI model, the device asks the user for necessary information (name, employee ID, store ID) in chat format, while the emotion engine simultaneously analyzes the user's emotional data in real time.

[1184] Input: User's first access information.

[1185] Output: Collection of necessary information and analysis of emotion data.

[1186] How it works: The device uses a generative AI model (e.g., GPT-4) to prompt the user, asking, "What is your name and employee ID?", and upon receiving the user's response, the emotion engine analyzes the user's emotional state.

[1187] Step 3:

[1188] The terminal transmits the collected input information and emotion data to a server.

[1189] Input: User-entered information and emotional data.

[1190] Output: Transfer of input information and emotion data to the server.

[1191] Specific operation: A data packet containing the user's name, employee ID, store ID, and emotion data is sent from the device to the server. The server receives this data.

[1192] Step 4:

[1193] The server stores the received data in a database.

[1194] Input: User data and emotion data sent from the device.

[1195] Output: Information stored in a database.

[1196] What happens: The server runs an SQL query against the database and inserts the received information into a table, like this: INSERT INTO crew_data (name, employee_id, store_id, emotion) VALUES ('Yamada Taro', 'ID12345', '1001', 'Anxiety').

[1197] Step 5:

[1198] The server works in conjunction with the inventory management system based on the information in the database.

[1199] Input: User information stored in the database.

[1200] Output: An update request to the inventory management system.

[1201] Specific operation: The server sends a request to the inventory management system's API to update the inventory information for the new crew member's store. It sends the necessary data to the API endpoint, such as "POST / inventory / update."

[1202] Step 6:

[1203] Based on the analysis results of the emotion engine, feedback is provided to improve the user experience.

[1204] Input: Analysis results of the emotion engine.

[1205] Output: Feedback to the user.

[1206] Specific operation: If the user is feeling anxious, the device will provide a message to reassure the user, such as "Don't worry, you can fix it later."

[1207] Processing flow of the customer registration system

[1208] Step 1:

[1209] The user accesses the designated registration site using a smartphone or PC.

[1210] Input: URL accessed by user.

[1211] Output: Registration screen displayed.

[1212] Specific operation: The user enters the specified URL, the server receives the request, and returns the HTML of the registration site.

[1213] Step 2:

[1214] Using a generative AI model, the device asks customers via chat about their desired model and plan, while an emotion engine simultaneously analyzes the customer's emotional data in real time.

[1215] Input: Customer's first visit information.

[1216] Output: Collection of desired models and plans and analysis results of emotional data.

[1217] How it works: The device uses a generative AI model (e.g., GPT-4) to prompt, "What model do you want?" If the customer answers "iPhone 14," the emotion engine will detect excitement.

[1218] Step 3:

[1219] The terminal transmits the input information and emotion data collected from the customer to the server.

[1220] Input: Customer-entered information and sentiment data.

[1221] Output: Transfer of input information and emotion data to the server.

[1222] Specific operation: A data packet containing the customer's desired model, plan details, and emotional data is sent from the device to the server, which receives this data.

[1223] Step 4:

[1224] The server stores the received data in a database.

[1225] Input: Customer data and sentiment data sent from the device.

[1226] Output: Information stored in a database.

[1227] What happens: The server runs an SQL query against the database to insert the information you entered into a table. This is similar to the operation "INSERT INTO customer_data (device, plan, emotion) VALUES ('iPhone14', 'Unlimited Data, Unlimited Call Plan', 'Excitement')".

[1228] Step 5:

[1229] The server completes the contract procedure based on the stored information.

[1230] Input: Customer information stored in a database.

[1231] Output: Contract procedure completed and a confirmation message to the customer.

[1232] Specific operation: The server sends a contract processing request to the backend system, and after the procedure is completed, it sends a confirmation message to the customer.

[1233] Step 6:

[1234] Based on the analysis results of emotional data, we provide feedback to improve the customer experience.

[1235] Input: Analysis results of the emotion engine.

[1236] Output: Feedback to the customer.

[1237] What it does: If a customer is feeling stressed during the process, the device will provide a reassuring message by displaying "The process is almost complete. You're almost there."

[1238] Processing flow of the sales management system

[1239] Step 1:

[1240] The sales representative logs in to their work PC and accesses the sales management screen.

[1241] Input: Salesperson credentials.

[1242] Output: Display of sales management screen.

[1243] What happens: The sales rep enters their credentials, the server verifies the authentication, and the dashboard is displayed.

[1244] Step 2:

[1245] The PC collects data in real time and sends requests to the server for display.

[1246] Enter your login details.

[1247] Output: Display of requested data.

[1248] Specific operation: The PC sends a data collection request to the server, and the server retrieves the latest sales performance data and emotion data from the database.

[1249] Step 3:

[1250] The server formats the collected data and sends it back to the PC for display as tables and graphs.

[1251] Input: Performance and sentiment data retrieved from the database.

[1252] Output: Visualized data in the form of tables and graphs.

[1253] Specific operation: The server uses Chart.js or D3.js to convert the data into tables and graphs, and then sends the data to the PC.

[1254] Step 4:

[1255] Sales representatives develop sales strategies based on the displayed data and sentiment data.

[1256] Input: Performance and sentiment data converted into tables and graphs.

[1257] Output: Planning and implementation of sales strategies.

[1258] Specific actions: Salespeople analyze the data on the dashboard and decide on the next action. Taking sentiment data into account, they develop effective sales strategies.

[1259] (Application example 2)

[1260] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1261] In modern business activities, personnel registration, customer contract procedures, and sales activity management are extremely important. However, traditionally, these procedures have often been performed manually, making efficient operation difficult. In particular, input errors and the time and effort required to manage and verify data have become issues. Furthermore, one-way information collection and display that ignores the user's or customer's feelings can detract from the user experience. Therefore, there is a need for a system that streamlines these procedures and takes the user's or customer's feelings into consideration.

[1262] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for utilizing a generative AI model to collect input information from users in a chat format, means for saving the input information and emotion data in a database, means for linking with an inventory management system based on the saved information and emotion data, means for analyzing and displaying data in real time, means for the user to proceed with the registration process using a smart device, and means for providing feedback based on user emotion analysis. This enables efficient registration procedures, dynamic feedback based on emotions, and the development of data-driven sales strategies.

[1263] A "generative AI model" is an artificial intelligence technology that understands and generates human language in order to achieve natural interactions with users.

[1264] "Emotion data" is data that analyzes and records the user's emotional state in real time.

[1265] A "database" is a system for permanently storing and managing collected information and emotional data.

[1266] An "inventory management system" is a system for tracking and managing inventory status at stores and businesses in real time.

[1267] "Chat format" is an interface in which a user and a computer exchange information in an interactive format.

[1268] "Means for analyzing and displaying data in real time" refers to a function for instantly analyzing collected data and immediately visually displaying the results.

[1269] A "smart device" is an advanced digital device that users use to input information and receive feedback.

[1270] The "registration process" is the series of steps a new user or customer takes to provide their information to the system and become officially registered.

[1271] "Feedback" is a function in which a system dynamically provides responses and instructions based on a user's actions and emotions.

[1272] A "sales strategy" is a set of policies and techniques for planning and executing more effective sales methods based on collected data.

[1273] "Administrative personnel" is a person or position responsible for the operation and management of a store or an entire business.

[1274] The system of the present invention utilizes various smart devices (smart glasses, smartphones, etc.) to improve the efficiency of user information registration and data management. Specific embodiments of the system are described below.

[1275] Crew registration system

[1276] 1. New user (crew) registration

[1277] The crew puts on the smart glasses and accesses the registration screen. Utilizing a generative AI model, necessary information such as name, employee ID, and store ID is entered via chat. The emotion engine analyzes the user's emotions in real time. For example, if anxiety is detected, the system displays the message, "Next, please tell us your store ID. Don't worry, you can correct it later."

[1278] 2. Data storage

[1279] The crew's information and emotional data collected by the terminal is sent to a server and stored in a database, which is a system for permanently storing and managing the collected information and emotional data.

[1280] 3. Integration with inventory management systems

[1281] The server links with the inventory management system based on the saved data and updates the inventory information for the store to which the new crew member belongs.

[1282] Customer registration system

[1283] 1. Customer Registration Process

[1284] Customers use their smart devices in-store to register for a digital membership. A generative AI model asks the customer about their desired plan, and an emotion engine analyzes the customer's emotions in real time. For example, if excitement is detected, the message will appear: "What plan would you like? You can choose your data volume and calling rates. We also have great value options!"

[1285] 2. Data storage and contract procedures

[1286] The customer information and emotional data collected by the device are sent to a server and stored in a database. The server then automatically completes the contract based on the stored information and emotional data, and asks the customer to confirm the contract details.

[1287] Sales management system

[1288] 1. Check sales performance

[1289] When a manager logs in using a smart device, the server collects the latest sales performance data and related emotional data from the database and displays it to the manager in real time. This data also includes emotional analysis results such as "when customers were excited" and "when crew members felt anxious."

[1290] 2. Displaying data and developing strategies

[1291] The server converts the collected data into tables and graphs and sends them to the smart device, allowing the manager to develop sales strategies based on this data.

[1292] Examples of specific examples and prompts

[1293] Examples:

[1294] User (Crew): "I want to register a new staff member."

[1295] Smart Glasses Display: "Hello! First, please tell us your name and employee ID."

[1296] User: "Yamada Taro, ID12345"

[1297] Display: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[1298] User: "Store ID 1001"

[1299] Display: "Crew registration completed."

[1300] Example prompt for a generative AI model:

[1301] When a user puts on smart glasses and says, "I want to register a new staff member,"

[1302] View the following questions:

[1303] 1. What is your name?

[1304] 2. What is your employee ID?

[1305] 3. What is your store ID?

[1306] Analyze the user's responses to see if they are feeling anxious, and if so, display a message saying, "Don't worry, you can fix it later."

[1307] In this way, the present invention consists of a system that combines a generative AI model and an emotion engine to achieve efficient information collection and management while taking user emotions into consideration.

[1308] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1309] Step 1:

[1310] The user (crew member) wears a smart device and accesses the new registration screen. At this stage, the user indicates their intention to register a new staff member to the system. The input is the user's voice command, and the output is for the generative AI model to prepare to display the next question prompt.

[1311] Step 2:

[1312] The generative AI model asks the user for necessary information such as name, employee ID, and store ID in chat format. The input is the user's voice response, and the output is the response content and emotional analysis data generated by the emotion engine. When the user inputs information such as "Yamada Taro, ID 12345," the device simultaneously analyzes anxiety, excitement, etc. using the emotion engine.

[1313] Step 3:

[1314] The terminal sends the collected crew information and emotional data to the server. The input is the collected crew basic data and emotional analysis data, and the output is that it is accurately stored in a database. The server adds the information to the database for easy access later.

[1315] Step 4:

[1316] The server connects to the inventory management system based on the stored information and emotion data. The input is crew information and emotion data in the database, and the output is updates to related inventory information. The server updates the inventory status at the crew's assigned store in real time, instantly reflecting the necessary information.

[1317] Step 5:

[1318] To improve the user experience, the device provides feedback based on emotional data analyzed by the emotion engine. The input is the user's emotional data provided in real time by the emotion engine, and the output is dynamic feedback to the user. For example, when a user enters "Store ID 1001," if emotion analysis detects anxiety, the device displays the message, "Next, please enter your store ID. Don't worry, you can correct it later."

[1319] In this way, each processing step leverages generative AI models and emotion engines to streamline user information collection and associated data management, improving the user experience.

[1320] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1321] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1322] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1323] [Third embodiment]

[1324] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1325] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1326] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1327] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1328] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1329] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1330] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1331] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1332] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1333] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1334] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1335] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1336] The system of the present invention utilizes generative AI models to streamline crew registration, customer registration, and sales management. This system allows users to input information in chat format, which is then stored in a database and processed in conjunction with related systems.

[1337] Crew registration system

[1338] 1. User (crew member) accesses the new registration screen:

[1339] A user accesses the registration screen for a new crew member using a device (such as a PC or tablet).

[1340] 2. The device uses the generative AI model to collect the necessary information from the user:

[1341] The device uses a generative AI model to ask the user for necessary information such as name, employee ID, store ID, etc. in a chat format, allowing the crew to input the information easily and intuitively.

[1342] 3. The server saves the input data to the database:

[1343] The device sends the collected information to a server, which stores the information in a database.

[1344] 4. The server interfaces with the inventory management system:

[1345] The server connects to the inventory management system based on the saved data and updates the inventory information for the store to which the new crew belongs.

[1346] Customer registration system

[1347] 1. User (customer) visits the registration site:

[1348] Customers access the service's registration site using their smartphone or PC.

[1349] 2. The device uses generative AI models to answer customer questions via chat:

[1350] The device uses a generative AI model to ask customers questions to help them select the model and plan they want, and provides appropriate answers and plan suggestions based on their input.

[1351] 3. The server saves the input data to the database:

[1352] The terminal transmits the collected customer information to a server, which stores the information in a database.

[1353] 4. The server completes the contract procedure:

[1354] The server automatically completes the contract process based on the stored information and sends the customer a message confirming the contract details.

[1355] Sales management system

[1356] 1. A user (sales representative) logs in to their work PC:

[1357] The sales representative logs in to their work PC and accesses the sales management screen.

[1358] 2. PC collects and displays data in real time:

[1359] After the PC confirms the login, it sends a request to the server, which then collects the latest sales performance data from the database.

[1360] 3. The server displays the data as a table or graph:

[1361] The server converts the collected data into tables and graphs and sends them to a PC, which displays them to the sales representative.

[1362] 4. Users develop sales strategies:

[1363] Sales representatives can develop sales strategies based on the displayed data and perform real-time data analysis.

[1364] Specific examples

[1365] Crew registration example

[1366] User (Crew): "I want to register a new staff member."

[1367] Terminal: "Hello! First, please tell me your name and employee ID."

[1368] User: "Yamada Taro, ID12345"

[1369] Terminal: "Next, please tell me your store ID."

[1370] User: "Store ID 1001"

[1371] Terminal: "Signed up. Let's check inventory information next."

[1372] Server: Links with the inventory management system and updates inventory information.

[1373] Example of customer registration

[1374] User (customer): "I want to sign up for a new smartphone contract."

[1375] Terminal: "Is there a model you would like?"

[1376] User: "iPhone14"

[1377] Device: "What plan would you like? You can choose your data volume and calling rates."

[1378] User: "I'd like an unlimited data and unlimited calling plan."

[1379] Device: "Thank you. This completes the registration process. Please confirm your details."

[1380] Server: Stores registration information and completes contract procedures.

[1381] Specific examples of sales management

[1382] User (Salesperson): "I want to check this month's sales performance."

[1383] PC: "Retrieving current performance data. Please wait."

[1384] Server: Collects performance data from the database, formats it, and sends it to the PC.

[1385] PC: "Below are this month's sales results." (Shows table and graph)

[1386] This will reduce crew registration training time, simplify customer registration procedures, and improve sales management efficiency.

[1387] The processing flow will be explained below.

[1388] Crew registration system

[1389] Step 1:

[1390] The user accesses the new registration screen. The device confirms the user's permission to access the device and displays the registration screen.

[1391] Step 2:

[1392] The device uses the generative AI model to prompt the user to enter their name and employee ID. Specifically, it displays the message "Please enter your name and employee ID" in chat format.

[1393] Step 3:

[1394] The user enters their name and employee ID and sends it to the terminal. For example, they enter "Yamada Taro, ID12345."

[1395] Step 4:

[1396] The device uses the generated AI model to ask the user for the next piece of information needed: the store ID. It displays the message, "Please enter your store ID."

[1397] Step 5:

[1398] The user enters the store ID and sends it to the terminal. For example, the user enters "Store ID 1001."

[1399] Step 6:

[1400] The terminal sends all collected input data to the server.

[1401] Step 7:

[1402] The server stores the received data in a database.

[1403] Step 8:

[1404] The server links with the inventory management system based on the stored information and updates the inventory information.

[1405] Step 9:

[1406] The server sends a message to the terminal indicating that registration and inventory information update is complete.

[1407] Step 10:

[1408] The terminal displays a completion message to the user: "Registration completed. Stock information has also been updated."

[1409] Customer registration system

[1410] Step 1:

[1411] The user accesses the registration site. The device confirms the user's permission to access the site and displays the registration screen.

[1412] Step 2:

[1413] The device uses the generated AI model to ask the user about their desired model, displaying the message, "Is there a model you would like?"

[1414] Step 3:

[1415] The user inputs the desired model and sends it to the device. For example, input "iPhone14."

[1416] Step 4:

[1417] The device then uses the generative AI model to ask the user about the next necessary information: the plan. It displays, "What plan would you like? You can choose your data volume and call charges."

[1418] Step 5:

[1419] The user inputs the desired plan and sends it to the device. For example, they might input "I'd like an unlimited data and unlimited calling plan."

[1420] Step 6:

[1421] The terminal sends all collected input data to the server.

[1422] Step 7:

[1423] The server stores the received data in a database.

[1424] Step 8:

[1425] The server automatically carries out contract procedures based on the stored information.

[1426] Step 9:

[1427] The server sends a message to the terminal indicating that the contract procedure has been completed.

[1428] Step 10:

[1429] The device displays a confirmation message to the user: "The procedure is complete. Please confirm your registration details."

[1430] Sales management system

[1431] Step 1:

[1432] A user (sales representative) logs in to a work PC. The PC requests the user's authentication information, and if authentication is successful, the management screen is displayed.

[1433] Step 2:

[1434] A user requests a confirmation of sales performance. Enters, "I would like to check this month's sales performance."

[1435] Step 3:

[1436] The PC sends a data request to the server. "Sales performance data requested" is sent to the server.

[1437] Step 4:

[1438] The server collects the latest sales performance data from the database.

[1439] Step 5:

[1440] The server formats the collected data into tables and graphs.

[1441] Step 6:

[1442] The server sends the formatted data to the PC.

[1443] Step 7:

[1444] The PC displays sales performance data to the user. It displays "This month's sales performance" and shows tables and graphs.

[1445] This will streamline all processes for crew registration, customer registration, and sales management.

[1446] Example 1

[1447] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1448] Conventional user information collection systems require manual data entry and management, which requires a great deal of time and human effort. Furthermore, the need to link with inventory management systems and contract procedure systems is cumbersome, making it inefficient for business personnel to check and analyze data in real time. Furthermore, there is a need for a method to quickly and accurately acquire and process information when registering users from remote locations.

[1449] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1450] In this invention, the server includes means for utilizing a generative AI model to collect input information from users in chat format, means for saving the input information in a database, means for linking with an inventory management system based on the saved information, means for analyzing and displaying data in real time, means for a terminal to collect information from users using a generative AI model and for the server to analyze the information, and means for linking with the inventory management system using the collected data. This makes information collection from users more efficient, reduces manual input work, enables smooth inventory management and contract procedures, and makes it possible to provide accurate data to business personnel in real time.

[1451] A "generative AI model" is an artificial intelligence system that collects and analyzes input information from users using technologies such as natural language processing, and responds in an interactive, conversational format.

[1452] A "terminal" is an electronic device that a user uses to input information and interact with a system, and refers to general devices such as PCs, tablets, and smartphones.

[1453] "Server" refers to a remotely located computer or system responsible for receiving and analyzing data collected from users and storing that information in a database.

[1454] A "database" is a collection of systems and software that store and manage collected information in an organized manner and quickly search and retrieve data as needed.

[1455] An "inventory management system" is a system for tracking and managing product inventory information in real time, maintaining data on product inventory and optimizing inventory.

[1456] The "chat format" refers to a method in which interaction with a user is conducted in a text-based conversational format, in which questions are presented to the user and information is collected by the user responding to the questions.

[1457] "Real-time" means that data is processed and displayed the moment it is generated, meaning that the latest information is available without delay.

[1458] "Analysis" refers to the means and process of converting collected data into an understandable form and extracting and utilizing the necessary information from it.

[1459] "Federation" refers to the means of connection and integration that allows different systems to share and utilize data and services.

[1460] "Interaction" refers to the interaction between a user and a system, and the process by which the system responds to user input.

[1461] "Business personnel" refers to personnel who are in charge of specific tasks within a company or organization and who carry out and manage those tasks.

[1462] MODE FOR CARRYING OUT THE INVENTION

[1463] This invention is a system that utilizes a generative AI model to improve the efficiency of crew registration, customer registration, and sales management. The main components of the system include a generative AI model, a terminal for collecting user information, a server, and a database. Specific examples will be provided below.

[1464] Crew registration system

[1465] First, a user accesses the registration page for a new crew member using a device such as a PC or tablet. The device sends a request to the web server, retrieves the registration page, and displays it.

[1466] The device then uses a generative AI model (e.g., ChatGPT) to prompt the user for necessary information such as name, employee ID, store ID, etc. in chat format using prompt sentences. This interaction allows the crew member to input information easily and intuitively.

[1467] The collected information is sent from the terminal to a server, which stores it in a database (e.g., MySQL). Based on the stored data, the server connects to an inventory management system and updates the inventory information for the new crew member's store.

[1468] Examples:

[1469] User (Crew): "I want to register a new staff member."

[1470] Terminal: "Hello! First, please tell me your name and employee ID."

[1471] User: "Yamada Taro, ID12345"

[1472] Terminal: "Next, please tell me your store ID."

[1473] User: "Store ID 1001"

[1474] Terminal: "Signed up. Let's check inventory information next."

[1475] Server: Links with the inventory management system and updates inventory information.

[1476] Customer registration system

[1477] Customers access the service's registration site using their smartphones or PCs. The device sends a request to the web server, which retrieves and displays the HTML page of the registration site.

[1478] The device launches the generative AI model within the page and begins a dialogue with the customer. The generative AI model asks questions about models and plans, and the customer responds via chat. The collected information is sent from the device to a server, which stores it in a database.

[1479] The server carries out the contract procedures based on the stored information and sends the customer a confirmation message of the contract contents.

[1480] Examples:

[1481] User (customer): "I want to sign up for a new smartphone contract."

[1482] Terminal: "Is there a model you would like?"

[1483] User: "iPhone14"

[1484] Device: "What plan would you like? You can choose your data volume and calling rates."

[1485] User: "I'd like an unlimited data and unlimited calling plan."

[1486] Device: "Thank you. This completes the registration process. Please confirm your details."

[1487] Server: Stores registration information and completes contract procedures.

[1488] Sales management system

[1489] The sales representative accesses the login screen of their work PC and enters their user ID and password. The terminal sends the authentication information to the server, which then authenticates them. If authentication is successful, the business sales management screen is displayed.

[1490] The PC sends a request to the server for the latest sales performance data. The server retrieves the sales performance data from the database, formats it, and sends it back to the PC. The PC displays the received data to the sales representative as a table or graph. The sales representative then uses this data to develop a sales strategy in real time.

[1491] Examples:

[1492] User (Salesperson): "I want to check this month's sales performance."

[1493] PC: "Retrieving current performance data. Please wait."

[1494] Server: Collects performance data from the database, formats it, and sends it to the PC.

[1495] PC: "Below are this month's sales results." (Shows table and graph)

[1496] The above system is expected to reduce the time required for crew registration training, simplify customer registration procedures, and improve the efficiency of sales management.

[1497] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1498] Crew registration system processing flow

[1499] Step 1:

[1500] The user accesses the new registration screen using a device such as a PC or tablet.

[1501] Input: User's access request

[1502] Output: Display of registration screen

[1503] Specific operation: The user opens a web browser and enters the registration URL. The device sends an HTTP request to the web server, retrieves the HTML of the registration screen, and displays it.

[1504] Step 2:

[1505] The device launches the generative AI model and collects necessary information from the user, such as name, employee ID, and store ID.

[1506] Input: User input information (e.g., name, employee ID, store ID)

[1507] Output: Collected data

[1508] Specific operation: The generative AI model starts up and displays prompts such as "Please enter your name" or "Please enter your employee ID." The user enters information into each field and presses the submit button. The device passes the user's input to the generative AI model and collects the information.

[1509] Step 3:

[1510] The device sends the collected information to a server, which stores it in a database.

[1511] Input: Collected user information

[1512] Output: Information stored in the database

[1513] Specific operation: The device sends the collected information as an HTTP request to the backend server, which parses the received information, generates an SQL query, and stores it in a database (e.g., MySQL).

[1514] Step 4:

[1515] The server connects to the inventory management system based on the stored data.

[1516] Input: Crew information stored in the database

[1517] Output: Information reflected in the inventory management system

[1518] Specific operation: The server calls the inventory management system's API based on the saved crew information and sends data about the new crew's affiliated store. The inventory management system reflects that information and responds to the server that the update is complete.

[1519] Processing flow of the customer registration system

[1520] Step 1:

[1521] The user (customer) accesses the registration site using a smartphone or PC.

[1522] Input: Customer Access Request

[1523] Output: Display of registration site

[1524] Specific operation: The customer opens a web browser and enters the URL of the registration site to access it. The device sends an HTTP request to the web server, retrieves the HTML of the registration site, and displays it.

[1525] Step 2:

[1526] The device uses the generated AI model to answer customer questions in chat format and collect the necessary information.

[1527] Input: Customer selection and registration information (e.g., model, plan)

[1528] Output: Collected data

[1529] How it works: The generative AI model launches and presents prompts such as "What model do you want?" or "Please select a plan." The customer enters information into the input field and presses the send button. The device passes that information to the generative AI model, which then generates the next prompt.

[1530] Step 3:

[1531] The terminal sends the collected customer information to a server, which stores it in a database.

[1532] Input: Collected customer information

[1533] Output: Information stored in the database

[1534] Specific operation: The device sends the collected information as an HTTP request to the backend server, which parses the received information, generates an SQL query, and stores it in the database.

[1535] Step 4:

[1536] The server carries out the contract procedures based on the stored information.

[1537] Input: Customer information stored in a database

[1538] Output: Contract procedure completion message

[1539] Specific operation: The server automatically performs contract procedures based on the stored customer information. Once the procedures are completed, the server sends a confirmation message of the contract details to the customer's device. The customer confirms the message and confirms that the procedures are complete.

[1540] Processing flow of the sales management system

[1541] Step 1:

[1542] A user (sales representative) logs in to a work PC.

[1543] Input: User ID, Password

[1544] Output: Authentication results, sales management screen display

[1545] Specific operation: A sales representative accesses the login screen of their work PC and enters their user ID and password. The terminal sends the authentication information to the server, and the server successfully authenticates. The business sales management screen is displayed.

[1546] Step 2:

[1547] The PC sends a request to the server, asking for the latest sales data.

[1548] Input: Request

[1549] Output: Sales performance data

[1550] Specific operation: After authentication, the PC sends a request for sales performance data to the server. The server retrieves the latest sales performance data from the database and returns it to the PC.

[1551] Step 3:

[1552] The sales performance data collected by the server is converted into tables and graphs, and sent to a PC for display.

[1553] Input: Sales performance data

[1554] Output: Data in tabular and graphical format

[1555] Specific operation: The server generates tables and graphs based on sales performance data using a graph generation library (e.g., D3.js), and sends the generated data to the PC, which then displays it visually.

[1556] Step 4:

[1557] The user creates a sales strategy based on the displayed data.

[1558] Input: Data for tables and graphs

[1559] Output: Sales Strategy

[1560] Specific actions: The sales representative analyzes the displayed data and formulates a specific action plan to create a new sales strategy.

[1561] (Application example 1)

[1562] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1563] The traditional crew and customer registration process in brick-and-mortar stores was highly manual, taking time and effort, and was prone to errors. Furthermore, there was a lack of efficient ways to visually grasp performance data in real time, making it difficult to quickly formulate operational strategies. This resulted in inefficient store operations, lower customer satisfaction, and delays in understanding performance.

[1564] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1565] In this invention, the server includes a means for utilizing a generative AI model to collect input data from users in chat format, a means for storing the collected input data in a database system, a means for linking with an asset management system based on the stored data, and a means for using a visual device to analyze and display data in real time, thereby making it possible to improve the efficiency of store operations, reduce errors in crew and customer registration, and grasp performance data in real time.

[1566] A "generative AI model" is a type of artificial intelligence system that uses natural language processing to understand user input data and generate appropriate questions and answers.

[1567] "Chat format" refers to an interface format in which a user interacts with a system, asking and answering questions using text or voice.

[1568] "Input data" refers to the information a user provides to the system, including their name, ID, and details of the product they want.

[1569] A "database system" is a system for storing, managing, and searching information in an organized manner, and is often operated using a language such as SQL.

[1570] An "asset management system" is a system for efficiently managing the goods and inventory information held by stores and companies.

[1571] "Analyzing data in real time" means processing newly collected data immediately and quickly deriving results.

[1572] A "visual device" is a device that allows a user to visually view information, including smart glasses and monitors.

[1573] "Customer interface" refers to the user interface through which customers input information and perform operations.

[1574] "Operations staff" refers to staff involved in the operation of a store or company, and are responsible for managing performance and formulating strategies.

[1575] "Performance data" refers to data that indicates the business results of a store or company, such as sales and sales performance.

[1576] "Interactive data analysis means" means that users can directly manipulate data and obtain analysis results in real time.

[1577] The following describes in detail the mode for carrying out the present invention. This invention is a system that utilizes a generative AI model to streamline the crew registration and customer registration processes in physical stores. The system collects input data from users in chat format and stores it in a database. Based on the stored data, the system also links with an asset management system and uses a visual device to analyze and display the data in real time.

[1578] Overall system configuration

[1579] Hardware and software used

[1580] Hardware: Smart glasses (e.g., Google Glass, HoloLens)

[1581] Software: Generative AI models (e.g., GPT-4, BERT), database systems (e.g., MySQL, PostgreSQL), and secure server environments (e.g., AWS, Microsoft Azure)

[1582] System processing flow

[1583] 1. Crew Registration

[1584] The server uses a generative AI model to collect input data from users in chat format, such as crew names, employee IDs, and store IDs.

[1585] The terminal (smart glasses) sends the collected input data to the server and stores it in a database system.

[1586] The server interacts with the asset management system based on the stored data.

[1587] 2. Customer Registration

[1588] The server uses generative AI models to provide a chat-style interface for customers to select and register their desired product and service options at home or in-store.

[1589] The terminal stores the customer's selection and registration information in a database.

[1590] The server completes the contract procedure based on the registered information and provides an interface for making corrections as necessary.

[1591] 3. Analysis and display of performance data

[1592] The server utilizes generative AI models to enable operations staff to view performance data in real time.

[1593] The server provides an interactive data analysis tool to format and display the collected performance data in visual formats (tables and graphs).

[1594] The terminal (smart glasses) provides an interface that allows operations personnel to analyze data in real time and develop operational strategies.

[1595] Specific examples

[1596] Crew registration example

[1597] User (Crew Member): "I want to register a new staff member."

[1598] Terminal (Smart Glasses): "Hello! First, please tell us your name and employee ID."

[1599] User: "Yamada Taro, ID12345"

[1600] Terminal: "Next, please tell me your store ID."

[1601] User: "Store ID 1001"

[1602] Device: "Registration complete. Thank you."

[1603] Example of customer registration

[1604] User (customer): "I want to sign up for a new smartphone contract."

[1605] Terminal: "Is there a model you would like?"

[1606] User: "iPhone14"

[1607] Device: "What plan would you like? Unlimited data and unlimited calling, please."

[1608] Terminal: "Thank you. This completes the procedure."

[1609] Examples of performance data analysis and display

[1610] User (Operations Manager): "I want to check this month's sales performance."

[1611] Terminal: "Retrieving current performance data. Please wait."

[1612] Server: Collects performance data from the database, formats it, and sends it to the terminal.

[1613] Device: "Below are this month's sales results." (displays table and graph)

[1614] Prompt Sentence Examples

[1615] When a user says, "I want to register a new staff member"

[1616] "Hello! First, please tell me your name and employee ID."

[1617] Next, please tell us your store ID.

[1618] When a user says, "I want to sign a new smartphone contract"

[1619] Is there a model you would like?

[1620] "Please select a plan. You can choose the amount of data and call charges."

[1621] In this way, it is possible to build a system that streamlines the crew and customer registration processes in physical stores and enables real-time performance data to be tracked.

[1622] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1623] Step 1:

[1624] The user (crew member) puts on the smart glasses and switches to new crew registration mode. Specifically, the user selects "crew registration" from the smart glasses menu. The input is the user's (crew member's) operation, and the output is "start crew registration mode."

[1625] Step 2:

[1626] The device (smart glasses) uses a generative AI model to collect the user's (crew member's) name, employee ID, and store ID by asking questions in a chat format. Specifically, it accepts input via voice or tap. The input for this step is voice or tap input from the user (crew member), and the output is the collected name, employee ID, and store ID data.

[1627] Step 3:

[1628] The terminal (smart glasses) transmits the collected data to the server. Specifically, the smart glasses transmit the data via the Internet. The input of this step is the collected user data, and the output is the completion of data transmission to the server.

[1629] Step 4:

[1630] The server stores the received data in the database system. Specifically, the server executes an SQL command to insert the data. The input of this step is the user data sent from the terminal, and the output is the successful storage in the database.

[1631] Step 5:

[1632] The server interacts with the asset management system based on the stored data. Specifically, the server calls the API to update inventory information. The input for this step is the user data stored in the database, and the output is the updated inventory information.

[1633] Step 6:

[1634] The user (customer) interacts with a crew member wearing smart glasses to select desired product or service options. Specifically, the crew member uses the smart glasses to present questions to the generative AI model. The input to this step is the user's (customer's) desired information, and the output is the selected and registered option information.

[1635] Step 7:

[1636] The terminal (smart glasses) sends the customer's selection information to the server and stores it in the database. Specifically, the smart glasses send data through the network. The input of this step is the customer's option selection information, and the output is the successful storage in the database.

[1637] Step 8:

[1638] The server completes the contract procedure based on the registered information and provides the customer with an interface for confirmation and modification. Specifically, the server generates a contract and displays a confirmation screen. The input for this step is the customer information stored in the database, and the output is the completion of the contract procedure and the display of a confirmation screen.

[1639] Step 9:

[1640] The user (operator) puts on the smart glasses and starts real-time analysis of performance data. Specifically, the operator selects "Performance Data Analysis." The input for this step is the operator's operation, and the output is the start of analysis mode.

[1641] Step 10:

[1642] The server uses a generative AI model to collect performance data and display the analysis results on a visual device. Specifically, the server retrieves data from a database, analyzes it, and generates it as graphs and tables. The input for this step is performance data from the database, and the output is the display results on the visual device.

[1643] Step 11:

[1644] The terminal (smart glasses) provides an interface for the operations manager to check the data analysis results in real time and formulate an operations strategy. Specifically, the smart glasses display the analysis results, and the operations manager operates based on them. The input for this step is the analysis results sent from the server, and the output is the analysis results for formulating an operations strategy.

[1645] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1646] The system of the present invention utilizes a generative AI model and combines it with an emotion engine that recognizes user emotions, thereby improving the efficiency of crew registration, customer registration, and sales management. With this system, users can input information in chat format, and the information and emotion data are stored in a database, which then processes the data in conjunction with related systems.

[1647] Crew registration system

[1648] 1. User (crew member) accesses the new registration screen:

[1649] A user accesses the registration screen for a new crew member using a device (such as a PC or tablet).

[1650] 2. The device uses the generative AI model to collect the necessary information from the user:

[1651] The device uses a generative AI model to ask the user necessary information, such as their name, employee ID, or store ID, via chat. It also uses an emotion engine to analyze the user's emotions in real time as they ask questions. This allows the crew member to input information easily and intuitively, and their emotions are also recorded.

[1652] 3. The server saves the input data to the database:

[1653] The device sends the collected information and emotional data to a server, which stores it in a database.

[1654] 4. The server interfaces with the inventory management system:

[1655] The server connects to the inventory management system based on the saved data and updates the inventory information for the store to which the new crew belongs.

[1656] 5. Improved user experience:

[1657] The emotion engine analyzes the emotional data and provides feedback to improve the user experience. For example, if the user feels anxious, the device will provide a more detailed explanation.

[1658] Customer registration system

[1659] 1. User (customer) visits the registration site:

[1660] Customers access the service's registration site using their smartphone or PC.

[1661] 2. The device uses generative AI models to answer customer questions via chat:

[1662] The device uses a generative AI model to ask questions to help customers select the model and plan they want, and an emotion engine to analyze customer sentiment in real time and dynamically change the questions and responses.

[1663] 3. The server stores the input data and emotion data in a database:

[1664] The terminal transmits the collected customer information and emotional data to a server, which stores it in a database.

[1665] 4. The server completes the contract procedure:

[1666] The server automatically completes the contract process based on the stored information and sends the customer a message confirming the contract details.

[1667] 5. Improved customer experience:

[1668] Based on emotional data analyzed by the emotion engine, feedback is provided to help customers proceed with the process smoothly and without stress.

[1669] Sales management system

[1670] 1. A user (sales representative) logs in to their work PC:

[1671] The sales representative logs in to their work PC and accesses the sales management screen.

[1672] 2. PC collects and displays data in real time:

[1673] After the PC confirms the login, it sends a request to the server, which collects the latest sales performance data and related emotion data from the database.

[1674] 3. The server displays the data as a table or graph:

[1675] The server converts the collected data into tables and graphs and sends them to a PC, which displays them to the sales representative.

[1676] 4. Sales strategy planning:

[1677] Sales representatives can develop sales strategies based on the displayed data and sentiment data, and perform real-time data analysis.

[1678] Specific examples

[1679] Crew registration example

[1680] User (Crew): "I want to register a new staff member."

[1681] Terminal: "Hello! First, please tell me your name and employee ID."

[1682] User: "Yamada Taro, ID12345"

[1683] Terminal: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[1684] User: "Store ID 1001"

[1685] Terminal: "Signed up. Let's check inventory information next."

[1686] Server: Links with the inventory management system and updates inventory information.

[1687] Example of customer registration

[1688] User (customer): "I want to sign up for a new smartphone contract."

[1689] Terminal: "Is there a model you would like?"

[1690] User: "iPhone14"

[1691] Device: The emotion engine detects excitement and displays, "What plan would you like? Choose your data and calling options. We also offer great savings!"

[1692] User: "I'd like an unlimited data and unlimited calling plan."

[1693] Device: "Thank you. This completes the registration process. Please confirm your details."

[1694] Server: Stores registration information and completes contract procedures.

[1695] Specific examples of sales management

[1696] User (Salesperson): "I want to check this month's sales performance."

[1697] PC: "Retrieving current performance data. Please wait."

[1698] Server: Collects performance data and emotion data from the database, formats them, and sends them to the PC.

[1699] PC: "Below are this month's sales results." (Shows table and graph)

[1700] Also includes emotional data: analysis results such as "when customers were excited" and "when crew members felt anxious."

[1701] This allows the system to recognize the emotions of crew members and customers in real time and provide appropriate feedback, thereby improving the user experience and significantly increasing operational efficiency.

[1702] The processing flow will be explained below.

[1703] Crew registration system

[1704] Step 1:

[1705] The user accesses the new registration screen. The terminal confirms the user's access and displays the registration screen.

[1706] Step 2:

[1707] The device uses the generative AI model to prompt the user to enter their name and employee ID. Specifically, it displays the message "Please enter your name and employee ID" in chat format.

[1708] Step 3:

[1709] The user enters their name and employee ID and sends it to the terminal. For example, they enter "Yamada Taro, ID12345."

[1710] Step 4:

[1711] The device then uses the generated AI model to ask for the next piece of information, the store ID, and displays the message, "Please enter your store ID."

[1712] Step 5:

[1713] The user enters the store ID and sends it to the terminal. For example, the user enters "Store ID 1001."

[1714] Step 6:

[1715] The device uses an emotion engine to analyze the user's emotions in real time. For example, if the user is feeling anxious, the device will analyze that information.

[1716] Step 7:

[1717] All input data and emotion data collected by the device are sent to the server.

[1718] Step 8:

[1719] The server stores the received data in a database, simultaneously storing user information and analyzed emotion data.

[1720] Step 9:

[1721] The server links with the inventory management system based on the stored information and updates the inventory information, keeping the inventory information of the new crew member's assigned store up to date.

[1722] Step 10:

[1723] The server sends a message to the terminal indicating that registration and inventory information update is complete.

[1724] Step 11:

[1725] The terminal displays a completion message to the user: "Registration is complete. Stock information has also been updated."

[1726] Customer registration system

[1727] Step 1:

[1728] The user accesses the registration site. The device confirms the user's access and displays the registration screen.

[1729] Step 2:

[1730] The device uses the generated AI model to ask the user about their desired model, displaying the message, "Is there a model you would like?"

[1731] Step 3:

[1732] The user inputs the desired model and sends it to the device. For example, input "iPhone14."

[1733] Step 4:

[1734] The device then uses the generative AI model to ask about the next necessary information, the plan, and displays the message, "What plan would you like? You can choose your data volume and call charges."

[1735] Step 5:

[1736] The user inputs the desired plan and sends it to the device. For example, they might input "I'd like an unlimited data and unlimited calling plan."

[1737] Step 6:

[1738] The device uses an emotion engine to analyze the user's emotions in real time. For example, if the user is feeling excited, the device will analyze that information.

[1739] Step 7:

[1740] All input data and emotion data collected by the device are sent to the server.

[1741] Step 8:

[1742] The server stores the received data in a database, simultaneously storing user information and analyzed emotion data.

[1743] Step 9:

[1744] The server automatically carries out contract procedures based on the stored information.

[1745] Step 10:

[1746] The server sends a message to the terminal indicating that the contract procedure has been completed.

[1747] Step 11:

[1748] The device displays a confirmation message to the user: "The procedure is complete. Please confirm your registration details."

[1749] Sales management system

[1750] Step 1:

[1751] A user (sales representative) logs in to a work PC. The PC checks the user's authentication information and displays the management screen if authentication is successful.

[1752] Step 2:

[1753] A user requests a confirmation of sales performance. Enters, "I would like to check this month's sales performance."

[1754] Step 3:

[1755] The PC sends a data request to the server, saying, "I would like to request sales performance data."

[1756] Step 4:

[1757] A server collects the latest sales performance data and associated sentiment data from a database.

[1758] Step 5:

[1759] The server formats the collected data into tables and graphs, including emotional data, so that it can be displayed visually.

[1760] Step 6:

[1761] The server sends the formatted data to the PC.

[1762] Step 7:

[1763] The PC displays sales performance data and emotion data to the user. It displays "This month's sales performance is as follows," and displays tables and graphs.

[1764] Step 8:

[1765] The user develops a sales strategy based on the displayed data and sentiment data, and adjusts the strategy based on customer and crew feedback indicated by the sentiment data.

[1766] This allows the system to recognize the emotions of crew members and customers in real time and provide appropriate feedback, thereby improving the user experience and significantly increasing operational efficiency.

[1767] Example 2

[1768] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1769] Existing systems have difficulty efficiently collecting and processing user input. They also lack the ability to recognize user emotions and provide appropriate feedback, resulting in a poor user experience. Furthermore, sales representatives have limited means to check sales performance in real time, making it difficult to develop effective sales strategies.

[1770] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1771] In this invention, the server includes means for utilizing a generative AI model to collect input information and emotional data from users in chat format, means for storing the collected input information and emotional data in a database, means for linking with other management systems based on the stored information, means for analyzing and displaying the collected data in real time, and means for providing feedback to improve the user experience based on the emotional data, thereby enabling a significant improvement in user experience and business efficiency.

[1772] A "generative AI model" is a type of artificial intelligence that learns from large amounts of data and performs natural language processing and question answering.

[1773] "Chat format" refers to a format in which a user and a system communicate through text messages.

[1774] "Information input from the user" refers to data such as name, ID, and store information that the user provides to the system.

[1775] "Emotion data" is data that indicates an emotional state analyzed from a user's text input.

[1776] A "database" is a system for efficiently storing, retrieving, and managing data.

[1777] A "management system" is a system for performing specific tasks such as inventory management and customer management.

[1778] The "means for analyzing and displaying collected data in real time" is a function for processing collected data in real time and visually presenting it to the user.

[1779] "Means for providing feedback to improve the user experience" refers to a function that provides appropriate responses and information based on the user's emotional data to enable the user to use the system more comfortably.

[1780] This invention is a system that utilizes a generative AI model and combines it with an emotion engine that recognizes user emotions to highly streamline crew registration, customer registration, and sales management. Specific embodiments are described below.

[1781] Hardware and software used

[1782] This system consists of devices such as PCs and tablets used by users, a central processing server, and a database for storing data. The main software used includes a generative AI model (e.g., GPT-4) for implementing chatbot functions, an emotion engine for analyzing emotional data, a relational database (e.g., MySQL, PostgreSQL) for data storage and retrieval, and other management systems (e.g., SAP or Oracle for inventory management systems).

[1783] An embodiment of a system dedicated to crew registration

[1784] 1. User (crew member) accesses the new registration screen:

[1785] When a user accesses the specified URL using a PC or tablet device, the registration screen will be displayed.

[1786] 2. The device uses the generative AI model to collect the necessary information from the user:

[1787] The device uses a generative AI model (e.g., GPT-4) to ask the user necessary information in the form of a chatbot, such as their name, employee ID, store ID, etc. At the same time, it uses an emotion engine to analyze the user's emotional data in real time.

[1788] Examples:

[1789] User (Crew): "I want to register a new staff member."

[1790] Terminal: "Hello! First, please tell me your name and employee ID."

[1791] User: "Yamada Taro, ID12345"

[1792] Terminal: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[1793] 3. The server saves the input data to the database:

[1794] The device sends the collected information and emotion data to a server, which stores them in a relational database (e.g., MySQL, PostgreSQL).

[1795] 4. The server interfaces with the inventory management system:

[1796] The server uses the stored data to link with other management systems (e.g., SAP or Oracle) and updates the inventory information for the store to which the new crew belongs.

[1797] 5. Improved user experience:

[1798] Based on the emotional data analyzed by the emotion engine, the device provides feedback to improve the user experience. For example, if the user is feeling anxious, the device will provide a more detailed explanation.

[1799] Embodiment of a system dedicated to customer registration

[1800] 1. User (customer) visits the registration site:

[1801] When customers access the designated service registration site using their smartphone or PC, the registration screen will be displayed.

[1802] 2. The device uses generative AI models to answer customer questions via chat:

[1803] The device uses a generative AI model (e.g., GPT-4) to ask customers questions about their desired model and plan in chatbot format, while simultaneously analyzing customer sentiment data in real time using an emotion engine.

[1804] Examples:

[1805] User (customer): "I want to sign up for a new smartphone contract."

[1806] Terminal: "Is there a model you would like?"

[1807] User: "iPhone14"

[1808] Device: The emotion engine detects excitement and displays, "What plan would you like? Choose your data and calling options. We also offer great savings!"

[1809] 3. The server stores the input data and emotion data in a database:

[1810] The device sends the collected information and emotion data to a server, which stores them in a relational database (e.g., MySQL, PostgreSQL).

[1811] 4. The server completes the contract procedure:

[1812] The server automatically processes the contract based on the stored information and sends the customer a message confirming the contract details.

[1813] 5. Improved customer experience:

[1814] Based on emotional data analyzed by the emotion engine, feedback is provided to customers to help them proceed with the process without stress.

[1815] Embodiment of a sales management system

[1816] 1. A user (sales representative) logs in to their work PC:

[1817] A sales representative logs in to their work PC and accesses the sales management screen. They enter their authentication information and complete the login.

[1818] 2. PC collects and displays data in real time:

[1819] The device confirms the login and sends a request to the server, which collects the latest sales performance data and related emotion data from the database and sends them to the device.

[1820] 3. The server displays the data as a table or graph:

[1821] The server formats the collected data, visualizes it using a chart conversion library (e.g., Chart.js or D3.js), and displays it on the device.

[1822] 4. Sales strategy planning:

[1823] Salespeople can devise sales strategies based on the displayed data and sentiment data, and perform real-time data analysis. By analyzing sentiment data, they can formulate effective countermeasures.

[1824] With the above-described configuration and procedures, the present invention is a system that performs advanced management and analysis based on the user's input information and emotion data, and realizes efficient registration and management operations.

[1825] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1826] Crew registration system processing flow

[1827] Step 1:

[1828] The user accesses the specified URL using a PC or tablet device and arrives at the new registration screen.

[1829] Input: URL accessed by user.

[1830] Output: Registration screen displayed.

[1831] Specific operation: The user opens a browser and enters the URL of the registration site. The server receives the request and returns the HTML of the registration screen to the user's device.

[1832] Step 2:

[1833] Using a generative AI model, the device asks the user for necessary information (name, employee ID, store ID) in chat format, while the emotion engine simultaneously analyzes the user's emotional data in real time.

[1834] Input: User's first access information.

[1835] Output: Collection of necessary information and analysis of emotion data.

[1836] How it works: The device uses a generative AI model (e.g., GPT-4) to prompt the user, asking, "What is your name and employee ID?", and upon receiving the user's response, the emotion engine analyzes the user's emotional state.

[1837] Step 3:

[1838] The terminal transmits the collected input information and emotion data to a server.

[1839] Input: User-entered information and emotional data.

[1840] Output: Transfer of input information and emotion data to the server.

[1841] Specific operation: A data packet containing the user's name, employee ID, store ID, and emotion data is sent from the device to the server. The server receives this data.

[1842] Step 4:

[1843] The server stores the received data in a database.

[1844] Input: User data and emotion data sent from the device.

[1845] Output: Information stored in a database.

[1846] What happens: The server runs an SQL query against the database and inserts the received information into a table, like this: INSERT INTO crew_data (name, employee_id, store_id, emotion) VALUES ('Yamada Taro', 'ID12345', '1001', 'Anxiety').

[1847] Step 5:

[1848] The server works in conjunction with the inventory management system based on the information in the database.

[1849] Input: User information stored in the database.

[1850] Output: An update request to the inventory management system.

[1851] Specific operation: The server sends a request to the inventory management system's API to update the inventory information for the new crew member's store. It sends the necessary data to the API endpoint, such as "POST / inventory / update."

[1852] Step 6:

[1853] Based on the analysis results of the emotion engine, feedback is provided to improve the user experience.

[1854] Input: Analysis results of the emotion engine.

[1855] Output: Feedback to the user.

[1856] Specific operation: If the user is feeling anxious, the device will provide a message to reassure the user, such as "Don't worry, you can fix it later."

[1857] Processing flow of the customer registration system

[1858] Step 1:

[1859] The user accesses the designated registration site using a smartphone or PC.

[1860] Input: URL accessed by user.

[1861] Output: Registration screen displayed.

[1862] Specific operation: The user enters the specified URL, the server receives the request, and returns the HTML of the registration site.

[1863] Step 2:

[1864] Using a generative AI model, the device asks customers via chat about their desired model and plan, while an emotion engine simultaneously analyzes the customer's emotional data in real time.

[1865] Input: Customer's first visit information.

[1866] Output: Collection of desired models and plans and analysis results of emotional data.

[1867] How it works: The device uses a generative AI model (e.g., GPT-4) to prompt, "What model do you want?" If the customer answers "iPhone 14," the emotion engine will detect excitement.

[1868] Step 3:

[1869] The terminal transmits the input information and emotion data collected from the customer to the server.

[1870] Input: Customer-entered information and sentiment data.

[1871] Output: Transfer of input information and emotion data to the server.

[1872] Specific operation: A data packet containing the customer's desired model, plan details, and emotional data is sent from the device to the server, which receives this data.

[1873] Step 4:

[1874] The server stores the received data in a database.

[1875] Input: Customer data and sentiment data sent from the device.

[1876] Output: Information stored in a database.

[1877] What happens: The server runs an SQL query against the database to insert the information you entered into a table. This is similar to the operation "INSERT INTO customer_data (device, plan, emotion) VALUES ('iPhone14', 'Unlimited Data, Unlimited Call Plan', 'Excitement')".

[1878] Step 5:

[1879] The server completes the contract procedure based on the stored information.

[1880] Input: Customer information stored in a database.

[1881] Output: Contract procedure completed and a confirmation message to the customer.

[1882] Specific operation: The server sends a contract processing request to the backend system, and after the procedure is completed, it sends a confirmation message to the customer.

[1883] Step 6:

[1884] Based on the analysis results of emotional data, we provide feedback to improve the customer experience.

[1885] Input: Analysis results of the emotion engine.

[1886] Output: Feedback to the customer.

[1887] What it does: If a customer is feeling stressed during the process, the device will provide a reassuring message by displaying "The process is almost complete. You're almost there."

[1888] Processing flow of the sales management system

[1889] Step 1:

[1890] The sales representative logs in to their work PC and accesses the sales management screen.

[1891] Input: Salesperson credentials.

[1892] Output: Display of sales management screen.

[1893] What happens: The sales rep enters their credentials, the server verifies the authentication, and the dashboard is displayed.

[1894] Step 2:

[1895] The PC collects data in real time and sends requests to the server for display.

[1896] Enter your login details.

[1897] Output: Display of requested data.

[1898] Specific operation: The PC sends a data collection request to the server, and the server retrieves the latest sales performance data and emotion data from the database.

[1899] Step 3:

[1900] The server formats the collected data and sends it back to the PC for display as tables and graphs.

[1901] Input: Performance and sentiment data retrieved from the database.

[1902] Output: Visualized data in the form of tables and graphs.

[1903] Specific operation: The server uses Chart.js or D3.js to convert the data into tables and graphs, and then sends the data to the PC.

[1904] Step 4:

[1905] Sales representatives develop sales strategies based on the displayed data and sentiment data.

[1906] Input: Performance and sentiment data converted into tables and graphs.

[1907] Output: Planning and implementation of sales strategies.

[1908] Specific actions: Salespeople analyze the data on the dashboard and decide on the next action. Taking sentiment data into account, they develop effective sales strategies.

[1909] (Application example 2)

[1910] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1911] In modern business activities, personnel registration, customer contract procedures, and sales activity management are extremely important. However, traditionally, these procedures have often been performed manually, making efficient operation difficult. In particular, input errors and the time and effort required to manage and verify data have become issues. Furthermore, one-way information collection and display that ignores the user's or customer's feelings can detract from the user experience. Therefore, there is a need for a system that streamlines these procedures and takes the user's or customer's feelings into consideration.

[1912] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for utilizing a generative AI model to collect input information from users in a chat format, means for saving the input information and emotion data in a database, means for linking with an inventory management system based on the saved information and emotion data, means for analyzing and displaying data in real time, means for the user to proceed with the registration process using a smart device, and means for providing feedback based on user emotion analysis. This enables efficient registration procedures, dynamic feedback based on emotions, and the development of data-driven sales strategies.

[1913] A "generative AI model" is an artificial intelligence technology that understands and generates human language in order to achieve natural interactions with users.

[1914] "Emotion data" is data that analyzes and records the user's emotional state in real time.

[1915] A "database" is a system for permanently storing and managing collected information and emotional data.

[1916] An "inventory management system" is a system for tracking and managing inventory status at stores and businesses in real time.

[1917] "Chat format" is an interface in which a user and a computer exchange information in an interactive format.

[1918] "Means for analyzing and displaying data in real time" refers to a function for instantly analyzing collected data and immediately visually displaying the results.

[1919] A "smart device" is an advanced digital device that users use to input information and receive feedback.

[1920] The "registration process" is the series of steps a new user or customer takes to provide their information to the system and become officially registered.

[1921] "Feedback" is a function in which a system dynamically provides responses and instructions based on a user's actions and emotions.

[1922] A "sales strategy" is a set of policies and techniques for planning and executing more effective sales methods based on collected data.

[1923] "Administrative personnel" is a person or position responsible for the operation and management of a store or an entire business.

[1924] The system of the present invention utilizes various smart devices (smart glasses, smartphones, etc.) to improve the efficiency of user information registration and data management. Specific embodiments of the system are described below.

[1925] Crew registration system

[1926] 1. New user (crew) registration

[1927] The crew puts on the smart glasses and accesses the registration screen. Utilizing a generative AI model, necessary information such as name, employee ID, and store ID is entered via chat. The emotion engine analyzes the user's emotions in real time. For example, if anxiety is detected, the system displays the message, "Next, please tell us your store ID. Don't worry, you can correct it later."

[1928] 2. Data storage

[1929] The crew's information and emotional data collected by the terminal is sent to a server and stored in a database, which is a system for permanently storing and managing the collected information and emotional data.

[1930] 3. Integration with inventory management systems

[1931] The server links with the inventory management system based on the saved data and updates the inventory information for the store to which the new crew member belongs.

[1932] Customer registration system

[1933] 1. Customer Registration Process

[1934] Customers use their smart devices in-store to register for a digital membership. A generative AI model asks the customer about their desired plan, and an emotion engine analyzes the customer's emotions in real time. For example, if excitement is detected, the message will appear: "What plan would you like? You can choose your data volume and calling rates. We also have great value options!"

[1935] 2. Data storage and contract procedures

[1936] The customer information and emotional data collected by the device are sent to a server and stored in a database. The server then automatically completes the contract based on the stored information and emotional data, and asks the customer to confirm the contract details.

[1937] Sales management system

[1938] 1. Check sales performance

[1939] When a manager logs in using a smart device, the server collects the latest sales performance data and related emotional data from the database and displays it to the manager in real time. This data also includes emotional analysis results such as "when customers were excited" and "when crew members felt anxious."

[1940] 2. Displaying data and developing strategies

[1941] The server converts the collected data into tables and graphs and sends them to the smart device, allowing the manager to develop sales strategies based on this data.

[1942] Examples of specific examples and prompts

[1943] Examples:

[1944] User (Crew): "I want to register a new staff member."

[1945] Smart Glasses Display: "Hello! First, please tell us your name and employee ID."

[1946] User: "Yamada Taro, ID12345"

[1947] Display: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[1948] User: "Store ID 1001"

[1949] Display: "Crew registration completed."

[1950] Example prompt for a generative AI model:

[1951] When a user puts on smart glasses and says, "I want to register a new staff member,"

[1952] View the following questions:

[1953] 1. What is your name?

[1954] 2. What is your employee ID?

[1955] 3. What is your store ID?

[1956] Analyze the user's responses to see if they are feeling anxious, and if so, display a message saying, "Don't worry, you can fix it later."

[1957] In this way, the present invention consists of a system that combines a generative AI model and an emotion engine to achieve efficient information collection and management while taking user emotions into consideration.

[1958] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1959] Step 1:

[1960] The user (crew member) wears a smart device and accesses the new registration screen. At this stage, the user indicates their intention to register a new staff member to the system. The input is the user's voice command, and the output is for the generative AI model to prepare to display the next question prompt.

[1961] Step 2:

[1962] The generative AI model asks the user for necessary information such as name, employee ID, and store ID in chat format. The input is the user's voice response, and the output is the response content and emotional analysis data generated by the emotion engine. When the user inputs information such as "Yamada Taro, ID 12345," the device simultaneously analyzes anxiety, excitement, etc. using the emotion engine.

[1963] Step 3:

[1964] The terminal sends the collected crew information and emotional data to the server. The input is the collected crew basic data and emotional analysis data, and the output is that it is accurately stored in a database. The server adds the information to the database for easy access later.

[1965] Step 4:

[1966] The server connects to the inventory management system based on the stored information and emotion data. The input is crew information and emotion data in the database, and the output is updates to related inventory information. The server updates the inventory status at the crew's assigned store in real time, instantly reflecting the necessary information.

[1967] Step 5:

[1968] To improve the user experience, the device provides feedback based on emotional data analyzed by the emotion engine. The input is the user's emotional data provided in real time by the emotion engine, and the output is dynamic feedback to the user. For example, when a user enters "Store ID 1001," if emotion analysis detects anxiety, the device displays the message, "Next, please enter your store ID. Don't worry, you can correct it later."

[1969] In this way, each processing step leverages generative AI models and emotion engines to streamline user information collection and associated data management, improving the user experience.

[1970] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1971] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1972] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1973] [Fourth embodiment]

[1974] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1975] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1976] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1977] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1978] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1979] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1980] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1981] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1982] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1983] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1984] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1985] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1986] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1987] The system of the present invention utilizes generative AI models to streamline crew registration, customer registration, and sales management. This system allows users to input information in chat format, which is then stored in a database and processed in conjunction with related systems.

[1988] Crew registration system

[1989] 1. User (crew member) accesses the new registration screen:

[1990] A user accesses the registration screen for a new crew member using a device (such as a PC or tablet).

[1991] 2. The device uses the generative AI model to collect the necessary information from the user:

[1992] The device uses a generative AI model to ask the user for necessary information such as name, employee ID, store ID, etc. in a chat format, allowing the crew to input the information easily and intuitively.

[1993] 3. The server saves the input data to the database:

[1994] The device sends the collected information to a server, which stores the information in a database.

[1995] 4. The server interfaces with the inventory management system:

[1996] The server connects to the inventory management system based on the saved data and updates the inventory information for the store to which the new crew belongs.

[1997] Customer registration system

[1998] 1. User (customer) visits the registration site:

[1999] Customers access the service's registration site using their smartphone or PC.

[2000] 2. The device uses generative AI models to answer customer questions via chat:

[2001] The device uses a generative AI model to ask customers questions to help them select the model and plan they want, and provides appropriate answers and plan suggestions based on their input.

[2002] 3. The server saves the input data to the database:

[2003] The terminal transmits the collected customer information to a server, which stores the information in a database.

[2004] 4. The server completes the contract procedure:

[2005] The server automatically completes the contract process based on the stored information and sends the customer a message confirming the contract details.

[2006] Sales management system

[2007] 1. A user (sales representative) logs in to their work PC:

[2008] The sales representative logs in to their work PC and accesses the sales management screen.

[2009] 2. PC collects and displays data in real time:

[2010] After the PC confirms the login, it sends a request to the server, which then collects the latest sales performance data from the database.

[2011] 3. The server displays the data as a table or graph:

[2012] The server converts the collected data into tables and graphs and sends them to a PC, which displays them to the sales representative.

[2013] 4. Users develop sales strategies:

[2014] Sales representatives can develop sales strategies based on the displayed data and perform real-time data analysis.

[2015] Specific examples

[2016] Crew registration example

[2017] User (Crew): "I want to register a new staff member."

[2018] Terminal: "Hello! First, please tell me your name and employee ID."

[2019] User: "Yamada Taro, ID12345"

[2020] Terminal: "Next, please tell me your store ID."

[2021] User: "Store ID 1001"

[2022] Terminal: "Signed up. Let's check inventory information next."

[2023] Server: Links with the inventory management system and updates inventory information.

[2024] Example of customer registration

[2025] User (customer): "I want to sign up for a new smartphone contract."

[2026] Terminal: "Is there a model you would like?"

[2027] User: "iPhone14"

[2028] Device: "What plan would you like? You can choose your data volume and calling rates."

[2029] User: "I'd like an unlimited data and unlimited calling plan."

[2030] Device: "Thank you. This completes the registration process. Please confirm your details."

[2031] Server: Stores registration information and completes contract procedures.

[2032] Specific examples of sales management

[2033] User (Salesperson): "I want to check this month's sales performance."

[2034] PC: "Retrieving current performance data. Please wait."

[2035] Server: Collects performance data from the database, formats it, and sends it to the PC.

[2036] PC: "Below are this month's sales results." (Shows table and graph)

[2037] This will reduce crew registration training time, simplify customer registration procedures, and improve sales management efficiency.

[2038] The processing flow will be explained below.

[2039] Crew registration system

[2040] Step 1:

[2041] The user accesses the new registration screen. The device confirms the user's permission to access the device and displays the registration screen.

[2042] Step 2:

[2043] The device uses the generative AI model to prompt the user to enter their name and employee ID. Specifically, it displays the message "Please enter your name and employee ID" in chat format.

[2044] Step 3:

[2045] The user enters their name and employee ID and sends it to the terminal. For example, they enter "Yamada Taro, ID12345."

[2046] Step 4:

[2047] The device uses the generated AI model to ask the user for the next piece of information needed: the store ID. It displays the message, "Please enter your store ID."

[2048] Step 5:

[2049] The user enters the store ID and sends it to the terminal. For example, the user enters "Store ID 1001."

[2050] Step 6:

[2051] The terminal sends all collected input data to the server.

[2052] Step 7:

[2053] The server stores the received data in a database.

[2054] Step 8:

[2055] The server links with the inventory management system based on the stored information and updates the inventory information.

[2056] Step 9:

[2057] The server sends a message to the terminal indicating that registration and inventory information update is complete.

[2058] Step 10:

[2059] The terminal displays a completion message to the user: "Registration completed. Stock information has also been updated."

[2060] Customer registration system

[2061] Step 1:

[2062] The user accesses the registration site. The device confirms the user's permission to access the site and displays the registration screen.

[2063] Step 2:

[2064] The device uses the generated AI model to ask the user about their desired model, displaying the message, "Is there a model you would like?"

[2065] Step 3:

[2066] The user inputs the desired model and sends it to the device. For example, input "iPhone14."

[2067] Step 4:

[2068] The device then uses the generative AI model to ask the user about the next necessary information: the plan. It displays, "What plan would you like? You can choose your data volume and call charges."

[2069] Step 5:

[2070] The user inputs the desired plan and sends it to the device. For example, they might input "I'd like an unlimited data and unlimited calling plan."

[2071] Step 6:

[2072] The terminal sends all collected input data to the server.

[2073] Step 7:

[2074] The server stores the received data in a database.

[2075] Step 8:

[2076] The server automatically carries out contract procedures based on the stored information.

[2077] Step 9:

[2078] The server sends a message to the terminal indicating that the contract procedure has been completed.

[2079] Step 10:

[2080] The device displays a confirmation message to the user: "The procedure is complete. Please confirm your registration details."

[2081] Sales management system

[2082] Step 1:

[2083] A user (sales representative) logs in to a work PC. The PC requests the user's authentication information, and if authentication is successful, the management screen is displayed.

[2084] Step 2:

[2085] A user requests a confirmation of sales performance. Enters, "I would like to check this month's sales performance."

[2086] Step 3:

[2087] The PC sends a data request to the server. "Sales performance data requested" is sent to the server.

[2088] Step 4:

[2089] The server collects the latest sales performance data from the database.

[2090] Step 5:

[2091] The server formats the collected data into tables and graphs.

[2092] Step 6:

[2093] The server sends the formatted data to the PC.

[2094] Step 7:

[2095] The PC displays sales performance data to the user. It displays "This month's sales performance" and shows tables and graphs.

[2096] This will streamline all processes for crew registration, customer registration, and sales management.

[2097] Example 1

[2098] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2099] Conventional user information collection systems require manual data entry and management, which requires a great deal of time and human effort. Furthermore, the need to link with inventory management systems and contract procedure systems is cumbersome, making it inefficient for business personnel to check and analyze data in real time. Furthermore, there is a need for a method to quickly and accurately acquire and process information when registering users from remote locations.

[2100] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2101] In this invention, the server includes means for utilizing a generative AI model to collect input information from users in chat format, means for saving the input information in a database, means for linking with an inventory management system based on the saved information, means for analyzing and displaying data in real time, means for a terminal to collect information from users using a generative AI model and for the server to analyze the information, and means for linking with the inventory management system using the collected data. This makes information collection from users more efficient, reduces manual input work, enables smooth inventory management and contract procedures, and makes it possible to provide accurate data to business personnel in real time.

[2102] A "generative AI model" is an artificial intelligence system that collects and analyzes input information from users using technologies such as natural language processing, and responds in an interactive, conversational format.

[2103] A "terminal" is an electronic device that a user uses to input information and interact with a system, and refers to general devices such as PCs, tablets, and smartphones.

[2104] "Server" refers to a remotely located computer or system responsible for receiving and analyzing data collected from users and storing that information in a database.

[2105] A "database" is a collection of systems and software that store and manage collected information in an organized manner and quickly search and retrieve data as needed.

[2106] An "inventory management system" is a system for tracking and managing product inventory information in real time, maintaining data on product inventory and optimizing inventory.

[2107] The "chat format" refers to a method in which interaction with a user is conducted in a text-based conversational format, in which questions are presented to the user and information is collected by the user responding to the questions.

[2108] "Real-time" means that data is processed and displayed the moment it is generated, meaning that the latest information is available without delay.

[2109] "Analysis" refers to the means and process of converting collected data into an understandable form and extracting and utilizing the necessary information from it.

[2110] "Federation" refers to the means of connection and integration that allows different systems to share and utilize data and services.

[2111] "Interaction" refers to the interaction between a user and a system, and the process by which the system responds to user input.

[2112] "Business personnel" refers to personnel who are in charge of specific tasks within a company or organization and who carry out and manage those tasks.

[2113] MODE FOR CARRYING OUT THE INVENTION

[2114] This invention is a system that utilizes a generative AI model to improve the efficiency of crew registration, customer registration, and sales management. The main components of the system include a generative AI model, a terminal for collecting user information, a server, and a database. Specific examples will be provided below.

[2115] Crew registration system

[2116] First, a user accesses the registration page for a new crew member using a device such as a PC or tablet. The device sends a request to the web server, retrieves the registration page, and displays it.

[2117] The device then uses a generative AI model (e.g., ChatGPT) to prompt the user for necessary information such as name, employee ID, store ID, etc. in chat format using prompt sentences. This interaction allows the crew member to input information easily and intuitively.

[2118] The collected information is sent from the terminal to a server, which stores it in a database (e.g., MySQL). Based on the stored data, the server connects to an inventory management system and updates the inventory information for the new crew member's store.

[2119] Examples:

[2120] User (Crew): "I want to register a new staff member."

[2121] Terminal: "Hello! First, please tell me your name and employee ID."

[2122] User: "Yamada Taro, ID12345"

[2123] Terminal: "Next, please tell me your store ID."

[2124] User: "Store ID 1001"

[2125] Terminal: "Signed up. Let's check inventory information next."

[2126] Server: Links with the inventory management system and updates inventory information.

[2127] Customer registration system

[2128] Customers access the service's registration site using their smartphones or PCs. The device sends a request to the web server, which retrieves and displays the HTML page of the registration site.

[2129] The device launches the generative AI model within the page and begins a dialogue with the customer. The generative AI model asks questions about models and plans, and the customer responds via chat. The collected information is sent from the device to a server, which stores it in a database.

[2130] The server carries out the contract procedures based on the stored information and sends the customer a confirmation message of the contract contents.

[2131] Examples:

[2132] User (customer): "I want to sign up for a new smartphone contract."

[2133] Terminal: "Is there a model you would like?"

[2134] User: "iPhone14"

[2135] Device: "What plan would you like? You can choose your data volume and calling rates."

[2136] User: "I'd like an unlimited data and unlimited calling plan."

[2137] Device: "Thank you. This completes the registration process. Please confirm your details."

[2138] Server: Stores registration information and completes contract procedures.

[2139] Sales management system

[2140] The sales representative accesses the login screen of their work PC and enters their user ID and password. The terminal sends the authentication information to the server, which then authenticates them. If authentication is successful, the business sales management screen is displayed.

[2141] The PC sends a request to the server for the latest sales performance data. The server retrieves the sales performance data from the database, formats it, and sends it back to the PC. The PC displays the received data to the sales representative as a table or graph. The sales representative then uses this data to develop a sales strategy in real time.

[2142] Examples:

[2143] User (Salesperson): "I want to check this month's sales performance."

[2144] PC: "Retrieving current performance data. Please wait."

[2145] Server: Collects performance data from the database, formats it, and sends it to the PC.

[2146] PC: "Below are this month's sales results." (Shows table and graph)

[2147] The above system is expected to reduce the time required for crew registration training, simplify customer registration procedures, and improve the efficiency of sales management.

[2148] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2149] Crew registration system processing flow

[2150] Step 1:

[2151] The user accesses the new registration screen using a device such as a PC or tablet.

[2152] Input: User's access request

[2153] Output: Display of registration screen

[2154] Specific operation: The user opens a web browser and enters the registration URL. The device sends an HTTP request to the web server, retrieves the HTML of the registration screen, and displays it.

[2155] Step 2:

[2156] The device launches the generative AI model and collects necessary information from the user, such as name, employee ID, and store ID.

[2157] Input: User input information (e.g., name, employee ID, store ID)

[2158] Output: Collected data

[2159] Specific operation: The generative AI model starts up and displays prompts such as "Please enter your name" or "Please enter your employee ID." The user enters information into each field and presses the submit button. The device passes the user's input to the generative AI model and collects the information.

[2160] Step 3:

[2161] The device sends the collected information to a server, which stores it in a database.

[2162] Input: Collected user information

[2163] Output: Information stored in the database

[2164] Specific operation: The device sends the collected information as an HTTP request to the backend server, which parses the received information, generates an SQL query, and stores it in a database (e.g., MySQL).

[2165] Step 4:

[2166] The server connects to the inventory management system based on the stored data.

[2167] Input: Crew information stored in the database

[2168] Output: Information reflected in the inventory management system

[2169] Specific operation: The server calls the inventory management system's API based on the saved crew information and sends data about the new crew's affiliated store. The inventory management system reflects that information and responds to the server that the update is complete.

[2170] Processing flow of the customer registration system

[2171] Step 1:

[2172] The user (customer) accesses the registration site using a smartphone or PC.

[2173] Input: Customer Access Request

[2174] Output: Display of registration site

[2175] Specific operation: The customer opens a web browser and enters the URL of the registration site to access it. The device sends an HTTP request to the web server, retrieves the HTML of the registration site, and displays it.

[2176] Step 2:

[2177] The device uses the generated AI model to answer customer questions in chat format and collect the necessary information.

[2178] Input: Customer selection and registration information (e.g., model, plan)

[2179] Output: Collected data

[2180] How it works: The generative AI model launches and presents prompts such as "What model do you want?" or "Please select a plan." The customer enters information into the input field and presses the send button. The device passes that information to the generative AI model, which then generates the next prompt.

[2181] Step 3:

[2182] The terminal sends the collected customer information to a server, which stores it in a database.

[2183] Input: Collected customer information

[2184] Output: Information stored in the database

[2185] Specific operation: The device sends the collected information as an HTTP request to the backend server, which parses the received information, generates an SQL query, and stores it in the database.

[2186] Step 4:

[2187] The server carries out the contract procedures based on the stored information.

[2188] Input: Customer information stored in a database

[2189] Output: Contract procedure completion message

[2190] Specific operation: The server automatically performs contract procedures based on the stored customer information. Once the procedures are completed, the server sends a confirmation message of the contract details to the customer's device. The customer confirms the message and confirms that the procedures are complete.

[2191] Processing flow of the sales management system

[2192] Step 1:

[2193] A user (sales representative) logs in to a work PC.

[2194] Input: User ID, Password

[2195] Output: Authentication results, sales management screen display

[2196] Specific operation: A sales representative accesses the login screen of their work PC and enters their user ID and password. The terminal sends the authentication information to the server, and the server successfully authenticates. The business sales management screen is displayed.

[2197] Step 2:

[2198] The PC sends a request to the server, asking for the latest sales data.

[2199] Input: Request

[2200] Output: Sales performance data

[2201] Specific operation: After authentication, the PC sends a request for sales performance data to the server. The server retrieves the latest sales performance data from the database and returns it to the PC.

[2202] Step 3:

[2203] The sales performance data collected by the server is converted into tables and graphs, and sent to a PC for display.

[2204] Input: Sales performance data

[2205] Output: Data in tabular and graphical format

[2206] Specific operation: The server generates tables and graphs based on sales performance data using a graph generation library (e.g., D3.js), and sends the generated data to the PC, which then displays it visually.

[2207] Step 4:

[2208] The user creates a sales strategy based on the displayed data.

[2209] Input: Data for tables and graphs

[2210] Output: Sales Strategy

[2211] Specific actions: The sales representative analyzes the displayed data and formulates a specific action plan to create a new sales strategy.

[2212] (Application example 1)

[2213] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2214] The traditional crew and customer registration process in brick-and-mortar stores was highly manual, taking time and effort, and was prone to errors. Furthermore, there was a lack of efficient ways to visually grasp performance data in real time, making it difficult to quickly formulate operational strategies. This resulted in inefficient store operations, lower customer satisfaction, and delays in understanding performance.

[2215] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2216] In this invention, the server includes a means for utilizing a generative AI model to collect input data from users in chat format, a means for storing the collected input data in a database system, a means for linking with an asset management system based on the stored data, and a means for using a visual device to analyze and display data in real time, thereby making it possible to improve the efficiency of store operations, reduce errors in crew and customer registration, and grasp performance data in real time.

[2217] A "generative AI model" is a type of artificial intelligence system that uses natural language processing to understand user input data and generate appropriate questions and answers.

[2218] "Chat format" refers to an interface format in which a user interacts with a system, asking and answering questions using text or voice.

[2219] "Input data" refers to the information a user provides to the system, including their name, ID, and details of the product they want.

[2220] A "database system" is a system for storing, managing, and searching information in an organized manner, and is often operated using a language such as SQL.

[2221] An "asset management system" is a system for efficiently managing the goods and inventory information held by stores and companies.

[2222] "Analyzing data in real time" means processing newly collected data immediately and quickly deriving results.

[2223] A "visual device" is a device that allows a user to visually view information, including smart glasses and monitors.

[2224] "Customer interface" refers to the user interface through which customers input information and perform operations.

[2225] "Operations staff" refers to staff involved in the operation of a store or company, and are responsible for managing performance and formulating strategies.

[2226] "Performance data" refers to data that indicates the business results of a store or company, such as sales and sales performance.

[2227] "Interactive data analysis means" means that users can directly manipulate data and obtain analysis results in real time.

[2228] The following describes in detail the mode for carrying out the present invention. This invention is a system that utilizes a generative AI model to streamline the crew registration and customer registration processes in physical stores. The system collects input data from users in chat format and stores it in a database. Based on the stored data, the system also links with an asset management system and uses a visual device to analyze and display the data in real time.

[2229] Overall system configuration

[2230] Hardware and software used

[2231] Hardware: Smart glasses (e.g., Google Glass, HoloLens)

[2232] Software: Generative AI models (e.g., GPT-4, BERT), database systems (e.g., MySQL, PostgreSQL), and secure server environments (e.g., AWS, Microsoft Azure)

[2233] System processing flow

[2234] 1. Crew Registration

[2235] The server uses a generative AI model to collect input data from users in chat format, such as crew names, employee IDs, and store IDs.

[2236] The terminal (smart glasses) sends the collected input data to the server and stores it in a database system.

[2237] The server interacts with the asset management system based on the stored data.

[2238] 2. Customer Registration

[2239] The server uses generative AI models to provide a chat-style interface for customers to select and register their desired product and service options at home or in-store.

[2240] The terminal stores the customer's selection and registration information in a database.

[2241] The server completes the contract procedure based on the registered information and provides an interface for making corrections as necessary.

[2242] 3. Analysis and display of performance data

[2243] The server utilizes generative AI models to enable operations staff to view performance data in real time.

[2244] The server provides an interactive data analysis tool to format and display the collected performance data in visual formats (tables and graphs).

[2245] The terminal (smart glasses) provides an interface that allows operations personnel to analyze data in real time and develop operational strategies.

[2246] Specific examples

[2247] Crew registration example

[2248] User (Crew Member): "I want to register a new staff member."

[2249] Terminal (Smart Glasses): "Hello! First, please tell us your name and employee ID."

[2250] User: "Yamada Taro, ID12345"

[2251] Terminal: "Next, please tell me your store ID."

[2252] User: "Store ID 1001"

[2253] Device: "Registration complete. Thank you."

[2254] Example of customer registration

[2255] User (customer): "I want to sign up for a new smartphone contract."

[2256] Terminal: "Is there a model you would like?"

[2257] User: "iPhone14"

[2258] Device: "What plan would you like? Unlimited data and unlimited calling, please."

[2259] Terminal: "Thank you. This completes the procedure."

[2260] Examples of performance data analysis and display

[2261] User (Operations Manager): "I want to check this month's sales performance."

[2262] Terminal: "Retrieving current performance data. Please wait."

[2263] Server: Collects performance data from the database, formats it, and sends it to the terminal.

[2264] Device: "Below are this month's sales results." (displays table and graph)

[2265] Prompt Sentence Examples

[2266] When a user says, "I want to register a new staff member"

[2267] "Hello! First, please tell me your name and employee ID."

[2268] Next, please tell us your store ID.

[2269] When a user says, "I want to sign a new smartphone contract"

[2270] Is there a model you would like?

[2271] "Please select a plan. You can choose the amount of data and call charges."

[2272] In this way, it is possible to build a system that streamlines the crew and customer registration processes in physical stores and enables real-time performance data to be tracked.

[2273] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2274] Step 1:

[2275] The user (crew member) puts on the smart glasses and switches to new crew registration mode. Specifically, the user selects "crew registration" from the smart glasses menu. The input is the user's (crew member's) operation, and the output is "start crew registration mode."

[2276] Step 2:

[2277] The device (smart glasses) uses a generative AI model to collect the user's (crew member's) name, employee ID, and store ID by asking questions in a chat format. Specifically, it accepts input via voice or tap. The input for this step is voice or tap input from the user (crew member), and the output is the collected name, employee ID, and store ID data.

[2278] Step 3:

[2279] The terminal (smart glasses) transmits the collected data to the server. Specifically, the smart glasses transmit the data via the Internet. The input of this step is the collected user data, and the output is the completion of data transmission to the server.

[2280] Step 4:

[2281] The server stores the received data in the database system. Specifically, the server executes an SQL command to insert the data. The input of this step is the user data sent from the terminal, and the output is the successful storage in the database.

[2282] Step 5:

[2283] The server interacts with the asset management system based on the stored data. Specifically, the server calls the API to update inventory information. The input for this step is the user data stored in the database, and the output is the updated inventory information.

[2284] Step 6:

[2285] The user (customer) interacts with a crew member wearing smart glasses to select desired product or service options. Specifically, the crew member uses the smart glasses to present questions to the generative AI model. The input to this step is the user's (customer's) desired information, and the output is the selected and registered option information.

[2286] Step 7:

[2287] The terminal (smart glasses) sends the customer's selection information to the server and stores it in the database. Specifically, the smart glasses send data through the network. The input of this step is the customer's option selection information, and the output is the successful storage in the database.

[2288] Step 8:

[2289] The server completes the contract procedure based on the registered information and provides the customer with an interface for confirmation and modification. Specifically, the server generates a contract and displays a confirmation screen. The input for this step is the customer information stored in the database, and the output is the completion of the contract procedure and the display of a confirmation screen.

[2290] Step 9:

[2291] The user (operator) puts on the smart glasses and starts real-time analysis of performance data. Specifically, the operator selects "Performance Data Analysis." The input for this step is the operator's operation, and the output is the start of analysis mode.

[2292] Step 10:

[2293] The server uses a generative AI model to collect performance data and display the analysis results on a visual device. Specifically, the server retrieves data from a database, analyzes it, and generates it as graphs and tables. The input for this step is performance data from the database, and the output is the display results on the visual device.

[2294] Step 11:

[2295] The terminal (smart glasses) provides an interface for the operations manager to check the data analysis results in real time and formulate an operations strategy. Specifically, the smart glasses display the analysis results, and the operations manager operates based on them. The input for this step is the analysis results sent from the server, and the output is the analysis results for formulating an operations strategy.

[2296] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2297] The system of the present invention utilizes a generative AI model and combines it with an emotion engine that recognizes user emotions, thereby improving the efficiency of crew registration, customer registration, and sales management. With this system, users can input information in chat format, and the information and emotion data are stored in a database, which then processes the data in conjunction with related systems.

[2298] Crew registration system

[2299] 1. User (crew member) accesses the new registration screen:

[2300] A user accesses the registration screen for a new crew member using a device (such as a PC or tablet).

[2301] 2. The device uses the generative AI model to collect the necessary information from the user:

[2302] The device uses a generative AI model to ask the user necessary information, such as their name, employee ID, or store ID, via chat. It also uses an emotion engine to analyze the user's emotions in real time as they ask questions. This allows the crew member to input information easily and intuitively, and their emotions are also recorded.

[2303] 3. The server saves the input data to the database:

[2304] The device sends the collected information and emotional data to a server, which stores it in a database.

[2305] 4. The server interfaces with the inventory management system:

[2306] The server connects to the inventory management system based on the saved data and updates the inventory information for the store to which the new crew belongs.

[2307] 5. Improved user experience:

[2308] The emotion engine analyzes the emotional data and provides feedback to improve the user experience. For example, if the user feels anxious, the device will provide a more detailed explanation.

[2309] Customer registration system

[2310] 1. User (customer) visits the registration site:

[2311] Customers access the service's registration site using their smartphone or PC.

[2312] 2. The device uses generative AI models to answer customer questions via chat:

[2313] The device uses a generative AI model to ask questions to help customers select the model and plan they want, and an emotion engine to analyze customer sentiment in real time and dynamically change the questions and responses.

[2314] 3. The server stores the input data and emotion data in a database:

[2315] The terminal transmits the collected customer information and emotional data to a server, which stores it in a database.

[2316] 4. The server completes the contract procedure:

[2317] The server automatically completes the contract process based on the stored information and sends the customer a message confirming the contract details.

[2318] 5. Improved customer experience:

[2319] Based on emotional data analyzed by the emotion engine, feedback is provided to help customers proceed with the process smoothly and without stress.

[2320] Sales management system

[2321] 1. A user (sales representative) logs in to their work PC:

[2322] The sales representative logs in to their work PC and accesses the sales management screen.

[2323] 2. PC collects and displays data in real time:

[2324] After the PC confirms the login, it sends a request to the server, which collects the latest sales performance data and related emotion data from the database.

[2325] 3. The server displays the data as a table or graph:

[2326] The server converts the collected data into tables and graphs and sends them to a PC, which displays them to the sales representative.

[2327] 4. Sales strategy planning:

[2328] Sales representatives can develop sales strategies based on the displayed data and sentiment data, and perform real-time data analysis.

[2329] Specific examples

[2330] Crew registration example

[2331] User (Crew): "I want to register a new staff member."

[2332] Terminal: "Hello! First, please tell me your name and employee ID."

[2333] User: "Yamada Taro, ID12345"

[2334] Terminal: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[2335] User: "Store ID 1001"

[2336] Terminal: "Signed up. Let's check inventory information next."

[2337] Server: Links with the inventory management system and updates inventory information.

[2338] Example of customer registration

[2339] User (customer): "I want to sign up for a new smartphone contract."

[2340] Terminal: "Is there a model you would like?"

[2341] User: "iPhone14"

[2342] Device: The emotion engine detects excitement and displays, "What plan would you like? Choose your data and calling options. We also offer great savings!"

[2343] User: "I'd like an unlimited data and unlimited calling plan."

[2344] Device: "Thank you. This completes the registration process. Please confirm your details."

[2345] Server: Stores registration information and completes contract procedures.

[2346] Specific examples of sales management

[2347] User (Salesperson): "I want to check this month's sales performance."

[2348] PC: "Retrieving current performance data. Please wait."

[2349] Server: Collects performance data and emotion data from the database, formats them, and sends them to the PC.

[2350] PC: "Below are this month's sales results." (Shows table and graph)

[2351] Also includes emotional data: analysis results such as "when customers were excited" and "when crew members felt anxious."

[2352] This allows the system to recognize the emotions of crew members and customers in real time and provide appropriate feedback, thereby improving the user experience and significantly increasing operational efficiency.

[2353] The processing flow will be explained below.

[2354] Crew registration system

[2355] Step 1:

[2356] The user accesses the new registration screen. The terminal confirms the user's access and displays the registration screen.

[2357] Step 2:

[2358] The device uses the generative AI model to prompt the user to enter their name and employee ID. Specifically, it displays the message "Please enter your name and employee ID" in chat format.

[2359] Step 3:

[2360] The user enters their name and employee ID and sends it to the terminal. For example, they enter "Yamada Taro, ID12345."

[2361] Step 4:

[2362] The device then uses the generated AI model to ask for the next piece of information, the store ID, and displays the message, "Please enter your store ID."

[2363] Step 5:

[2364] The user enters the store ID and sends it to the terminal. For example, the user enters "Store ID 1001."

[2365] Step 6:

[2366] The device uses an emotion engine to analyze the user's emotions in real time. For example, if the user is feeling anxious, the device will analyze that information.

[2367] Step 7:

[2368] All input data and emotion data collected by the device are sent to the server.

[2369] Step 8:

[2370] The server stores the received data in a database, simultaneously storing user information and analyzed emotion data.

[2371] Step 9:

[2372] The server links with the inventory management system based on the stored information and updates the inventory information, keeping the inventory information of the new crew member's assigned store up to date.

[2373] Step 10:

[2374] The server sends a message to the terminal indicating that registration and inventory information update is complete.

[2375] Step 11:

[2376] The terminal displays a completion message to the user: "Registration is complete. Stock information has also been updated."

[2377] Customer registration system

[2378] Step 1:

[2379] The user accesses the registration site. The device confirms the user's access and displays the registration screen.

[2380] Step 2:

[2381] The device uses the generated AI model to ask the user about their desired model, displaying the message, "Is there a model you would like?"

[2382] Step 3:

[2383] The user inputs the desired model and sends it to the device. For example, input "iPhone14."

[2384] Step 4:

[2385] The device then uses the generative AI model to ask about the next necessary information, the plan, and displays the message, "What plan would you like? You can choose your data volume and call charges."

[2386] Step 5:

[2387] The user inputs the desired plan and sends it to the device. For example, they might input "I'd like an unlimited data and unlimited calling plan."

[2388] Step 6:

[2389] The device uses an emotion engine to analyze the user's emotions in real time. For example, if the user is feeling excited, the device will analyze that information.

[2390] Step 7:

[2391] All input data and emotion data collected by the device are sent to the server.

[2392] Step 8:

[2393] The server stores the received data in a database, simultaneously storing user information and analyzed emotion data.

[2394] Step 9:

[2395] The server automatically carries out contract procedures based on the stored information.

[2396] Step 10:

[2397] The server sends a message to the terminal indicating that the contract procedure has been completed.

[2398] Step 11:

[2399] The device displays a confirmation message to the user: "The procedure is complete. Please confirm your registration details."

[2400] Sales management system

[2401] Step 1:

[2402] A user (sales representative) logs in to a work PC. The PC checks the user's authentication information and displays the management screen if authentication is successful.

[2403] Step 2:

[2404] A user requests a confirmation of sales performance. Enters, "I would like to check this month's sales performance."

[2405] Step 3:

[2406] The PC sends a data request to the server, saying, "I would like to request sales performance data."

[2407] Step 4:

[2408] A server collects the latest sales performance data and associated sentiment data from a database.

[2409] Step 5:

[2410] The server formats the collected data into tables and graphs, including emotional data, so that it can be displayed visually.

[2411] Step 6:

[2412] The server sends the formatted data to the PC.

[2413] Step 7:

[2414] The PC displays sales performance data and emotion data to the user. It displays "This month's sales performance is as follows," and displays tables and graphs.

[2415] Step 8:

[2416] The user develops a sales strategy based on the displayed data and sentiment data, and adjusts the strategy based on customer and crew feedback indicated by the sentiment data.

[2417] This allows the system to recognize the emotions of crew members and customers in real time and provide appropriate feedback, thereby improving the user experience and significantly increasing operational efficiency.

[2418] Example 2

[2419] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2420] Existing systems have difficulty efficiently collecting and processing user input. They also lack the ability to recognize user emotions and provide appropriate feedback, resulting in a poor user experience. Furthermore, sales representatives have limited means to check sales performance in real time, making it difficult to develop effective sales strategies.

[2421] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2422] In this invention, the server includes means for utilizing a generative AI model to collect input information and emotional data from users in chat format, means for storing the collected input information and emotional data in a database, means for linking with other management systems based on the stored information, means for analyzing and displaying the collected data in real time, and means for providing feedback to improve the user experience based on the emotional data, thereby enabling a significant improvement in user experience and business efficiency.

[2423] A "generative AI model" is a type of artificial intelligence that learns from large amounts of data and performs natural language processing and question answering.

[2424] "Chat format" refers to a format in which a user and a system communicate through text messages.

[2425] "Information input from the user" refers to data such as name, ID, and store information that the user provides to the system.

[2426] "Emotion data" is data that indicates an emotional state analyzed from a user's text input.

[2427] A "database" is a system for efficiently storing, retrieving, and managing data.

[2428] A "management system" is a system for performing specific tasks such as inventory management and customer management.

[2429] The "means for analyzing and displaying collected data in real time" is a function for processing collected data in real time and visually presenting it to the user.

[2430] "Means for providing feedback to improve the user experience" refers to a function that provides appropriate responses and information based on the user's emotional data to enable the user to use the system more comfortably.

[2431] This invention is a system that utilizes a generative AI model and combines it with an emotion engine that recognizes user emotions to highly streamline crew registration, customer registration, and sales management. Specific embodiments are described below.

[2432] Hardware and software used

[2433] This system consists of devices such as PCs and tablets used by users, a central processing server, and a database for storing data. The main software used includes a generative AI model (e.g., GPT-4) for implementing chatbot functions, an emotion engine for analyzing emotional data, a relational database (e.g., MySQL, PostgreSQL) for data storage and retrieval, and other management systems (e.g., SAP or Oracle for inventory management systems).

[2434] An embodiment of a system dedicated to crew registration

[2435] 1. User (crew member) accesses the new registration screen:

[2436] When a user accesses the specified URL using a PC or tablet device, the registration screen will be displayed.

[2437] 2. The device uses the generative AI model to collect the necessary information from the user:

[2438] The device uses a generative AI model (e.g., GPT-4) to ask the user necessary information in the form of a chatbot, such as their name, employee ID, store ID, etc. At the same time, it uses an emotion engine to analyze the user's emotional data in real time.

[2439] Examples:

[2440] User (Crew): "I want to register a new staff member."

[2441] Terminal: "Hello! First, please tell me your name and employee ID."

[2442] User: "Yamada Taro, ID12345"

[2443] Terminal: The emotion engine detects the user's anxiety and displays the message, "Next, please tell us your store ID. Don't worry, you can fix it later."

[2444] 3. The server saves the input data to the database:

[2445] The device sends the collected information and emotion data to a server, which stores them in a relational database (e.g., MySQL, PostgreSQL).

[2446] 4. The server interfaces with the inventory management system:

[2447] The server uses the stored data to link with other management systems (e.g., SAP or Oracle) and updates the inventory information for the store to which the new crew belongs.

[2448] 5. Improved user experience:

[2449] Based on the emotional data analyzed by the emotion engine, the device provides feedback to improve the user experience. For example, if the user is feeling anxious, the device will provide a more detailed explanation.

[2450] Embodiment of a system dedicated to customer registration

[2451] 1. User (customer) visits the registration site:

[2452] When customers access the designated service registration site using their smartphone or PC, the registration screen will be displayed.

[2453] 2. The device uses generative AI models to answer customer questions via chat:

[2454] The device uses a generative AI model (e.g., GPT-4) to ask customers questions about their desired model and plan in chatbot format, while simultaneously analyzing customer sentiment data in real time using an emotion engine.

[2455] Examples:

[2456] User (customer): "I want to sign up for a new smartphone contract."

[2457] Terminal: "Is there a model you would like?"

[2458] User: "iPhone14"

[2459] Device: The emotion engine detects excitement and displays, "What plan would you like? Choose your data and calling options. We also offer great savings!"

[2460] 3. The server stores the input data and emotion data in a database:

[2461] The device sends the collected information and emotion data to a server, which stores them in a relational database (e.g., MySQL, PostgreSQL).

[2462] 4. The server completes the contract procedure:

[2463] The server automatically processes the contract based on the stored information and sends the customer a message confirming the contract details.

[2464] 5. Improved customer experience:

[2465] Based on emotional data analyzed by the emotion engine, feedback is provided to customers to help them proceed with the process without stress.

[2466] Embodiment of a sales management system

[2467] 1. A user (sales representative) logs in to their work PC:

[2468] A sales representative logs in to their work PC and accesses the sales management screen. They enter their authentication information and complete the login.

[2469] 2. PC collects and displays data in real time:

[2470] The device confirms the login and sends a request to the server, which collects the latest sales performance data and related emotion data from the database and sends them to the device.

[2471] 3. The server displays the data as a...

Claims

1. A means of collecting input information from users in chat format using generative AI models, and a means for storing the input information in a database; means for interfacing with an inventory management system based on the stored information; A system that includes a means for analyzing and displaying data in real time.

2. Using generative AI models, customers can select and register models and plans at home, and A means for storing the selected and registered information in a database; A means for completing contract procedures based on the registered information; 10. The system of claim 1, further comprising means for verifying and amending contract procedures.

3. Using generative AI models, salespeople can view sales performance in real time, A means of collecting performance data and displaying it in tables and graphs; 2. The system according to claim 1, further comprising means for formulating a sales strategy based on the collected data.

Images