system

Abstract

Provide a system. A means for receiving user authentication information via a communication means and authenticating a user; means for analyzing messages from authenticated users and understanding their content using natural language processing; means for generating a reply message based on the analyzed content and sending it to the user; A means for receiving consulting requests from users and matching them with appropriate experts; means for generating and providing a communication link between the user and the expert for conducting a remote consultation; A means to record the content of remote consultations and store them in a database for future reference; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] This invention addresses issues related to digital transformation (DX) and IT adoption in small and medium-sized enterprises (SMEs). Specifically, the challenge is to provide a simple consulting method for SMEs that recognize the importance of IT and DX but do not know how to proceed or that lack specialized personnel. Furthermore, by utilizing messaging apps used by many SMEs, the invention aims to create an environment where anyone can easily receive specialized support. [Means for solving the problem]

[0005] The present invention is a system including the following means. First, a means is provided for receiving user authentication information via a communication means and authenticating the user. Next, a means is used for analyzing a message from the authenticated user and understanding the content using natural language processing. A means is provided for generating a reply message based on the analyzed content and sending it to the user. The system also includes a means for receiving a consulting request from the user and matching the request with an appropriate expert. The system also includes a means for generating a communication link for conducting a remote consultation and providing it to the user and the expert. The system further includes a means for recording the content of the remote consultation and saving it in a database for later reference. Such a system can effectively support digital transformation and IT adoption in small and medium-sized enterprises.

[0006] "User authentication information" is information for identifying a user and verifying their legitimacy.

[0007] "Communication means" refers to means for sending and receiving information, and includes networks and protocols.

[0008] "Natural language processing" is a technology that allows computers to understand and analyze human language.

[0009] A "reply message" is a message that the system sends in response to a message from a user.

[0010] A "consulting request" is a request by a User for professional assistance.

[0011] An "expert" is an individual or organization with advanced knowledge and experience in a particular field.

[0012] "Remote consultation" refers to a consultation conducted online from a physically distant location.

[0013] A "communication link" is a pathway that connects other devices or systems for sending and receiving information.

[0014] A "database" is a system for systematically storing and retrieving information. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. The service is primarily provided via a common messaging app such as LINE. Specific embodiments for implementing this system are described below.

[0037] Enforcing user authentication

[0038] User

[0039] You will need to launch the LINE app and add the official account of the DX consulting service for businesses as a friend. When using it for the first time, you will need to enter your company information and personal authentication information and submit it to the system.

[0040] Terminal

[0041] The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person's name, contact information, etc.

[0042] server

[0043] The received user authentication information is analyzed and stored in a database. An authentication token is then generated and sent to the user. By retaining the authentication token, the user can be identified in subsequent communications.

[0044] Sending and replying to messages

[0045] User

[0046] Once authentication is complete, you can send a question or request for advice via LINE. For example, you can send a message saying, "I want to create a website, but where should I start?"

[0047] Terminal

[0048] Sends the user's message to the server. The message is properly formatted via the LINE API and passed to the server.

[0049] server

[0050] The server that receives the message uses a natural language processing (NLP) engine to understand the content. Based on the content of the message, it generates an appropriate reply message. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[0051] Consulting Requests and Remote Consultations

[0052] User

[0053] If you need consulting, tap the "Get a Free Consultation" button. This will create a consulting request.

[0054] Terminal

[0055] When the "Get a Free Consultation" button is tapped, the event is sent to the server, and the request information is passed to the server.

[0056] server

[0057] It analyzes incoming consultation requests and runs an algorithm to match them with the appropriate experts. Once matching is complete, it sends a remote consultation date and communication link to the user and the expert.

[0058] Remote consultations

[0059] User

[0060] On the designated remote consultation date, you will begin a conversation with a specialist via LINE, using video calls or chat as needed.

[0061] Terminal

[0062] It displays the communication links and chat windows necessary for remote consultations, allowing users and experts to smoothly proceed with the consultation.

[0063] server

[0064] The content of the remote consultation will be recorded and stored in a database for future reference. This data will be used to improve the service and for future reference.

[0065] Guidance and next steps

[0066] User

[0067] You will be provided with specific guides for creating your website and digital transformation, with links to find more information. You will also be able to track your progress as you go through each step.

[0068] server

[0069] Based on user behavior, send them additional information or guidelines for next steps.

[0070] In this way, a system is realized that allows users (small and medium-sized enterprises) to easily receive professional support for DX and IT. At each step, servers, terminals, and users cooperate to provide services smoothly.

[0071] The processing flow will be explained below.

[0072] Step 1:

[0073] User: Launch the LINE app and add the official account of the corporate DX consulting service as a friend.

[0074] Step 2:

[0075] User: When using for the first time, enter company information and personal authentication information and send it to the system.

[0076] Step 3:

[0077] Device: The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person name, and contact information.

[0078] Step 4:

[0079] Server: Parses the received user authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[0080] Step 5:

[0081] User: After authentication is complete, send a question or inquiry via LINE message. For example, send a message saying, "I want to create a homepage, but where should I start?"

[0082] Step 6:

[0083] Device: Sends the user's message to the server via the LINE API.

[0084] Step 7:

[0085] Server: Receives the message and uses a natural language processing (NLP) engine to understand its content. Based on the content of the message, it generates an appropriate reply message. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[0086] Step 8:

[0087] Server: Sends the generated reply message to the user.

[0088] Step 9:

[0089] User: Check the returned message and ask further questions or ask for advice as necessary.

[0090] Step 10:

[0091] User: If you need consulting, tap the "Get a Free Consultation" button.

[0092] Step 11:

[0093] Device: When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[0094] Step 12:

[0095] Server: Analyzes the received consulting request and runs an algorithm to match the appropriate expert. Once matching is complete, it sends the remote consultation schedule and communication link to the user and the expert.

[0096] Step 13:

[0097] User: According to the designated remote consultation date, the user starts a conversation with the specialist via LINE.

[0098] Step 14:

[0099] Terminal: Displays the communication links and chat window necessary for remote consultation, allowing the user and expert to proceed with the consultation without any problems.

[0100] Step 15:

[0101] Server: Records the details of the remote consultation and stores them in a database for future reference.

[0102] Step 16:

[0103] Users are provided with specific guides for creating a website and digital transformation, with links to find more information. They can track their progress as they go through each step.

[0104] Step 17:

[0105] Server: Based on the user's actions, sends additional information or guidelines for next steps.

[0106] Step 18:

[0107] Users: Send feedback and rate the service, which the system uses to improve the service.

[0108] Example 1

[0109] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0110] For small and medium-sized enterprises seeking support for digital transformation (DX) and IT adoption, the procedures are complicated and specialized knowledge and resources are limited, making it difficult to receive expert support easily and efficiently. There is also a need for a system that can efficiently communicate with users and provide them with the necessary information in a timely manner.

[0111] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0112] In this invention, the server includes: [means for receiving user authentication information via communication means and authenticating the user; [means for analyzing messages from the authenticated user and understanding the content using natural language processing; [means for generating a reply message based on the analyzed content and sending it to the user;] [means for receiving consulting requests from users and matching them with appropriate experts;] [means for generating a communication link for conducting remote consultations and providing it to the user and the expert;] [means for recording the content of the remote consultation and saving it in a database for later reference;] [means for generating an authentication token so that the user can be identified in subsequent communications; and [means for monitoring the user's progress and sending guidelines for proceeding to the next step.] This makes it possible [for small and medium-sized enterprises to easily receive consulting on digital transformation and IT adoption].

[0113] "User authentication information" refers to the information provided by the user for authentication, including the company name, the name of the person in charge, and contact information.

[0114] "Communication means" refers to the technologies and protocols for sending and receiving data, including the Internet and APIs.

[0115] "Natural language processing" is a technology that allows computers to understand and analyze human language.

[0116] "Message" refers to text, questions, inquiries, etc. sent by users.

[0117] "Reply message" refers to the response that the server generates to the parsed message.

[0118] "Consulting Request" means a request by a User for expert consultation.

[0119] An "expert" is an individual with advanced knowledge or experience in a particular field.

[0120] "Remote consultation" refers to consultation conducted from a physically distant location using online communication means.

[0121] "Communication link" refers to connection information for remote consultation, including URLs and application links.

[0122] An "authentication token" refers to an electronic key or identification information that uniquely identifies a user.

[0123] A "database" is a system for efficiently storing, searching, and managing large amounts of data.

[0124] "Guidelines" refers to instructions and reference information to help users take the next step.

[0125] "Progress" refers to the work and achievements that a user has made.

[0126] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. The service is primarily provided via a common messaging app that is easy for users to use. Specific embodiments for implementing this system are described below.

[0127] Enforcing user authentication

[0128] User

[0129] Users launch a messaging app on their smartphone or computer and add the official account of this system as a friend. When using the system for the first time, they enter company information (company name, person in charge, etc.) and personal authentication information (contact information, etc.) and send it to the system. This allows user authentication information to be collected.

[0130] Terminal

[0131] The device sends the authentication information entered by the user to the server via a messaging API (e.g., LINE API), including information such as the company name, person in charge, and contact information.

[0132] server

[0133] The server analyzes the received user authentication information and stores it in a database. It then generates an authentication token and sends it to the user. By retaining this authentication token, the server can identify the user in future communications.

[0134] Sending and replying to messages

[0135] User

[0136] After the user is authenticated, they can use the messaging app to send a question or request for advice, such as, "I want to create a website, where do I start?"

[0137] Terminal

[0138] The device sends the user's message to the server via the messaging API, which formats the message appropriately and passes it to the server.

[0139] server

[0140] The server analyzes the received message using a natural language processing (NLP) engine (e.g., Google® Cloud NLP or IBM Watson®) to understand its content. Based on the analysis results, it generates an appropriate reply message and sends it to the user. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[0141] Consulting Requests and Remote Consultations

[0142] User

[0143] If the user wishes to receive consulting, they tap the "Get a Free Consultation" button, which will send a consulting request.

[0144] Terminal

[0145] The device sends this request event to the server via the messaging API, and the request information is passed to the server.

[0146] server

[0147] The server analyzes the received consultation request and runs an algorithm to match the request with an appropriate expert. Once matching is complete, the server sends the user and the expert a remote consultation schedule and a communication link, including a link to an online meeting tool (e.g., a Zoom link).

[0148] Remote consultations

[0149] User

[0150] The user will then schedule a remote consultation and begin a conversation with the specialist via a messaging app, using video calls or chats as needed.

[0151] Terminal

[0152] The terminal displays the necessary communication links and chat windows for remote consultation, allowing the user and the expert to smoothly proceed with the consultation.

[0153] server

[0154] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve the service and as a reference for future use.

[0155] Guidance and next steps

[0156] User

[0157] Users receive specific guidance on creating a website and digital transformation, click on the provided links to find more information, and track their progress as they go through each step.

[0158] server

[0159] The server monitors the user's behavior and progress and sends them additional information and guidelines for next steps, such as "Next, let's focus on SEO. Click the link below for more information."

[0160] Specific examples

[0161] Enforcing user authentication

[0162] Example sentence: "Hello, our company name is ABC Corporation, and our representative is Taro Yamada. We would like to use your DX consulting services."

[0163] Sending and replying to messages

[0164] Example message: "I want to create a website, where do I start?"

[0165] Example response: "First get your domain, then choose a template."

[0166] Consulting Requests and Remote Consultations

[0167] Event example: Tap "Get a free consultation"

[0168] Example of a remote consultation schedule notification: "The remote consultation will be held on October 15th at 3:00 PM. Please join us using the link below."

[0169] In this way, a system is realized that allows users to easily receive professional support for DX and IT. Servers, terminals, and users can fulfill their respective roles, enabling services to be provided smoothly.

[0170] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0171] Step 1: Add the official account as a friend

[0172] The user launches a messaging app on their smartphone or computer and adds the system's official account as a friend.

[0173] Input: QR code (registered trademark) or link of official account

[0174] Output: Notification that official account has been added

[0175] Step 2: Enter and submit your credentials

[0176] The user enters company information (company name, contact name, etc.) and personal authentication information (contact information, etc.) into a messaging app and sends the message.

[0177] The device sends the entered authentication information to the server via the LINE API.

[0178] Input: Company name, contact name, contact details, and other authentication information

[0179] Output: Notification of completion of authentication information transmission

[0180] Step 3: Parse and store credentials

[0181] The server parses the received authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[0182] Input: Credentials

[0183] Output: Authentication token and authentication completion notification

[0184] Step 4: Submit your question or request

[0185] A user sends a question or request for advice via LINE message. For example, "I want to create a homepage, but where should I start?"

[0186] The device sends the user's message to the server via the LINE API.

[0187] Input: User questions and inquiries

[0188] Output: Message sent notification

[0189] Step 5: Parsing the message and generating a response

[0190] The server analyzes the received message using a natural language processing (NLP) engine to understand its content, and based on the analysis results, generates an appropriate reply message and sends it to the user.

[0191] Input: User's message

[0192] Output: Reply message

[0193] Step 6: Submit a Consulting Request

[0194] A user submits a consultation request by tapping the "Get a Free Consultation" button in a messaging app.

[0195] The device sends the event to the server via the LINE API.

[0196] Input: Consulting request event

[0197] Output: Request sent notification

[0198] Step 7: Analyzing and matching consulting requests

[0199] The server analyzes the received consultation request and runs an algorithm to match the request with a suitable expert. After matching is complete, it sends a remote consultation date and a communication link to the user and the expert.

[0200] Input: Consulting Request

[0201] Output: Remote consultation schedule and communication link

[0202] Step 8: Start the consultation according to the remote consultation schedule

[0203] The user will initiate a conversation with the specialist via LINE on the designated remote consultation date, using video calls and chats as needed.

[0204] The terminal displays the communication links and chat windows necessary for remote consultation.

[0205] Input: Remote consultation date

[0206] Output: Remote consultation started

[0207] Step 9: Record the remote consultation

[0208] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve the service and as a reference for future use.

[0209] Input: Remote consultation details

[0210] Output: Recorded consultation content

[0211] Step 10: Providing guidance and next steps

[0212] The server monitors the user's progress and sends additional information or guidelines for next steps.

[0213] Users receive specific guides on creating a homepage and digital transformation, and can click on the provided links to find out more information.

[0214] Input: User progress information

[0215] Output: Additional information or guidelines for next steps

[0216] Through these steps, this system enables small and medium-sized enterprises to easily receive consulting on digital transformation and IT implementation.

[0217] (Application example 1)

[0218] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0219] When operators of small and medium-sized enterprises and individual stores receive consulting for digital transformation (DX) or IT implementation, they face problems such as complicated procedures, the need for specialized knowledge, and difficulty in accessing appropriate experts. The present invention solves these problems by providing a system that allows these operators to easily receive support for DX and IT implementation.

[0220] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0221] In this invention, the server includes means for receiving user authentication information via a communication means and authenticating the user, means for analyzing a message from the authenticated user and understanding the content using natural language processing, and means for generating a reply message based on the analyzed content and sending it to the user, thereby enabling operators of small and medium-sized enterprises and individual stores to easily receive professional support.

[0222] "Communication means" refers to the interface and protocol for sending and receiving authentication information and messages between the user and the server.

[0223] "User authentication information" refers to information for identifying a specific user, such as the company name, the name of the person in charge, and contact information.

[0224] An "authentication token" is a unique identifier issued by a server to a user to indicate that the user has been authenticated.

[0225] "Natural language processing" is a technology that analyzes the content of text messages sent by users and converts them into a format that a program can understand.

[0226] A "reply message" is a response message generated by the server based on the analyzed content of the user's message.

[0227] A "consulting request" is a request sent by a User to a Server for professional advice or assistance.

[0228] "Expert matching" refers to the process of selecting the person with the most appropriate expertise based on the user's consulting request.

[0229] "Remote consultation" is a form of consultation in which a user and an expert communicate with each other while physically separated from each other.

[0230] "Communication Link" means the connection link over the Internet shared by the User and the Expert for conducting the Remote Consultation.

[0231] "Database" refers to data storage for recording and managing the content of remote consultations, user authentication information, etc.

[0232] The "analyzed content" refers to the content resulting from analyzing the user's message using natural language processing.

[0233] A "question about store management" is a question that a user sends to the server to ask for advice on store management and operation methods.

[0234] The "Store Management Consulting Guide" is a guideline that provides specific steps and advice aimed at improving store management.

[0235] This invention provides a system that allows operators of small and medium-sized enterprises and individual stores to easily receive consulting on digital transformation (DX) and IT. The system includes a communication means, a user authentication function, a message analysis function, a reply message generation function, an expert matching function, a remote consultation function, and a database storage function.

[0236] The server receives the user authentication information sent by the user through the LINE app or a similar messaging app, and authenticates the user based on that information. Authentication uses identification information such as the company name, person in charge, and contact information. Once authentication is complete, the server generates an authentication token and sends it to the user. This makes it possible to identify the user in future communications.

[0237] When an authenticated user sends a LINE message with a question or request for advice, the server analyzes the message using a natural language processing (NLP) engine. This analysis allows the content of the message to be understood and an appropriate reply message to be generated. For example, if a user sends a message saying, "I would like to install a new cash register system," the server will generate a reply based on the analysis results, such as, "We will provide you with information about installing a cash register system. First, please list your budget and required features," and send it to the user.

[0238] When a user wants to consult, they tap a specific button to generate a consultation request. The request is forwarded to the server, which runs an algorithm to match the user with a suitable expert. Once the expert is identified, the server creates a communication link for the remote consultation and provides it to both the user and the expert.

[0239] When a remote consultation is conducted, the server records the details and stores them in a database for future reference. This allows past consultation details to be used to improve future consulting and services.

[0240] For this system to function effectively, the following hardware and software are used:

[0241] Hardware: Cloud-based servers (e.g., AWS, Google Cloud), users' smartphones

[0242] Software: LINE API, Google Cloud Natural Language API, Flask

[0243] As an example of a specific prompt sentence, if a user wants to consult about the implementation of a new cash register system, the prompt sentence is as follows.

[0244] I'd like to install a new cash register system. Which one would you recommend?

[0245] This invention will enable small and medium-sized enterprises and individual store operators to easily receive support for DX and IT adoption without specialized knowledge, thereby realizing more efficient and advanced store operations.

[0246] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0247] Step 1:

[0248] A user launches the LINE app and adds the official account as a friend. They then enter the company information and personal authentication information required for authentication and submit it to the system. This information includes the company name, contact person's name, contact information, etc.

[0249] Input: Company information, personal authentication information

[0250] Output: Authentication information sent to the server

[0251] Step 2:

[0252] The device sends user authentication information to the server via the LINE API. The server analyzes the received user authentication information and stores it in a database. It then generates an authentication token and sends it to the user.

[0253] Input: User credentials

[0254] Output: Authentication token

[0255] Step 3:

[0256] After the user is authenticated, they can send a question or inquiry to the server using a LINE message. For example, they can send a message such as, "I want to create a homepage, but where should I start?"

[0257] Input: User questions and inquiries

[0258] Output: A message is sent to the server

[0259] Step 4:

[0260] The device sends a message from the user to the server via the LINE API, and the server receives the message and analyzes its content using a natural language processing (NLP) engine.

[0261] Input: User's message

[0262] Output: Analysis results

[0263] Step 5:

[0264] The server generates a reply message based on the parsed content and sends it to the user via the LINE API. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[0265] Input: Analysis results

[0266] Output: Reply message

[0267] Step 6:

[0268] A user taps a specific button to generate a consulting request, for example, by tapping the "Get a Free Consult" button.

[0269] Input: User button tap action

[0270] Output: Consulting Request

[0271] Step 7:

[0272] The device sends a consultation request to the server via the LINE API, which receives the request and runs an algorithm to match the appropriate expert.

[0273] Input: Consulting Request

[0274] Output: Matching results with experts

[0275] Step 8:

[0276] The server generates a communication link for remote consultation and sends it to the user and the expert, so that the user and the expert can start the remote consultation without any problems.

[0277] Input: Expert matching results

[0278] Output: Communication link

[0279] Step 9:

[0280] The user will follow the designated remote consultation date and begin a conversation with the specialist via LINE, using video calls and chat as needed.

[0281] Input: Communication link, remote consultation available

[0282] Output: Conducting a remote consultation

[0283] Step 10:

[0284] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve future consultations and services.

[0285] Input: Remote consultation details

[0286] Output: Recorded remote consultation data

[0287] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0288] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. In particular, by combining it with an emotion engine that recognizes the user's emotions, it provides more user-friendly support. The service is mainly provided via a general messaging app. Specific embodiments for implementing this system are described below.

[0289] Enforcing user authentication

[0290] User

[0291] Launch the LINE app and add the official account of the enterprise DX consulting service as a friend. When using for the first time, enter your company information and personal authentication information and submit it to the system.

[0292] Terminal

[0293] The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person's name, contact information, etc.

[0294] server

[0295] The received user authentication information is analyzed and stored in a database. An authentication token is then generated and sent to the user. By retaining the authentication token, the user can be identified in subsequent communications.

[0296] Sending and replying to messages

[0297] User

[0298] Once authentication is complete, you can send a question or request for advice via LINE. For example, you can send a message saying, "I want to create a website, but where should I start?"

[0299] Terminal

[0300] Sends the user's message to the server. The message is properly formatted via the LINE API and passed to the server.

[0301] server

[0302] The server that receives the message uses a natural language processing (NLP) engine to understand its content. Based on the content of the message, it generates an appropriate reply message. It also uses an emotion engine to recognize the user's emotions and adjusts the reply message accordingly. For example, if the server recognizes that the user is "in trouble," it will respond with more helpful and specific guidance.

[0303] Use of emotion engine

[0304] server

[0305] Using an emotion engine, the system analyzes the emotions in the user's message and adjusts the system's response. For example, if the user uses words that indicate "anxiety," the server will send an encouraging message such as, "Don't worry. Try these steps first."

[0306] Consulting Requests and Remote Consultations

[0307] User

[0308] If you need consulting, tap the "Get a Free Consultation" button. This will create a consulting request.

[0309] Terminal

[0310] When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[0311] server

[0312] The system analyzes incoming consultation requests and runs an algorithm to match them with the appropriate experts. Once matching is complete, it sends a remote consultation date and communication link to the user and the expert. The emotion engine also works here, informing the expert of the user's emotional state.

[0313] Remote consultations

[0314] User

[0315] On the designated remote consultation date, you will begin a conversation with a specialist via LINE, using video calls or chat as needed.

[0316] Terminal

[0317] It displays the communication links and chat windows necessary for remote consultations, allowing users and experts to smoothly proceed with the consultation.

[0318] server

[0319] The content of the remote consultation is recorded and saved in a database for future reference. The emotion engine runs during the remote consultation, recording changes in the user's emotions in real time and saving them in a database.

[0320] Guidance and next steps

[0321] User

[0322] You will be provided with specific guides for creating your website and digital transformation, with links to find more information. You will also be able to track your progress as you go through each step.

[0323] server

[0324] Based on the user's behavior, it sends additional information or guidelines for next steps. It uses an emotion engine to provide supplemental information or additional support if the user is experiencing difficulties.

[0325] In this way, a system will be realized that allows users (small and medium-sized enterprises) to easily receive professional support for digital transformation and IT. The introduction of the emotion engine is expected to further improve the user experience and provide more effective support.

[0326] The processing flow will be explained below.

[0327] Step 1:

[0328] User: Launch the LINE app and add the official account of the corporate DX consulting service as a friend.

[0329] Step 2:

[0330] User: When using for the first time, enter company information and personal authentication information and send it to the system.

[0331] Step 3:

[0332] Device: The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person name, and contact information.

[0333] Step 4:

[0334] Server: Parses the received user authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[0335] Step 5:

[0336] User: After authentication is complete, send a question or inquiry via LINE message. For example, send a message saying, "I want to create a homepage, but where should I start?"

[0337] Step 6:

[0338] Device: Sends the user's message to the server via the LINE API.

[0339] Step 7:

[0340] Server: Receives the message, understands its content using a natural language processing (NLP) engine, and generates an appropriate reply message based on the message content.

[0341] Step 8:

[0342] Server: Analyzes the user's emotions using an emotion engine. For example, if the user's message indicates an "anxious" emotion, adjust the response.

[0343] Step 9:

[0344] Server: Sends a tailored response message to the user, such as "We'll guide you through the steps to create your homepage. Don't worry, first get a domain, then choose a template."

[0345] Step 10:

[0346] User: Check the reply message and send the next question or inquiry by message.

[0347] Step 11:

[0348] User: If you need consulting, tap the "Get a Free Consultation" button.

[0349] Step 12:

[0350] Device: When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[0351] Step 13:

[0352] Server: Analyzes incoming consulting requests and runs algorithms to match them with the appropriate experts.

[0353] Step 14:

[0354] Server: Once matching is complete, it sends the remote consultation schedule and communication link to the user and the expert.

[0355] Step 15:

[0356] Server: Using the emotion engine, informs the expert of the user's emotional state before the remote consultation.

[0357] Step 16:

[0358] User: According to the designated remote consultation date, the user starts a conversation with the specialist via LINE.

[0359] Step 17:

[0360] Terminal: Displays the communication links and chat window necessary for remote consultation, allowing the user and expert to proceed with the consultation without any problems.

[0361] Step 18:

[0362] Server: Runs the emotion engine during remote consultations, records changes in the user's emotions in real time, and notifies the expert.

[0363] Step 19:

[0364] Server: Records the details of the remote consultation and stores them in a database for future reference.

[0365] Step 20:

[0366] Users are provided with a guide to creating a website or digital transformation, and can click on links to learn more. They can follow their progress as they go through each step.

[0367] Step 21:

[0368] Server: Based on the user's behavior and emotions, sends additional information or guidelines for next steps.

[0369] Step 22:

[0370] Users: Send feedback and rate the service, which the system uses to improve the service.

[0371] Example 2

[0372] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0373] Small and medium-sized enterprises (SMEs) face a wide range of challenges when implementing digital transformation (DX) and IT adoption. They often lack specialized knowledge and experience, and sometimes have difficulty accessing appropriate experts. For this reason, there is a need for support to efficiently and effectively advance DX and IT adoption. Another major issue is the lack of systems that can respond while taking user emotions into consideration.

[0374] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving user authentication information via a communication means and authenticating the user, a means for analyzing a message from the authenticated user and understanding the content using natural language processing, and a means for generating a reply message based on the analyzed content and sending it to the user. This enables small and medium-sized enterprises (SMEs) to receive effective DX and IT support even if they do not have specialized knowledge. Furthermore, the introduction of an emotion engine enables recognition of user emotions and more user-friendly responses.

[0375] "Means of communication" refers to the technologies and protocols used to send and receive data over the Internet, primarily HTTP and HTTPS.

[0376] "User authentication information" is information for verifying the identity of a user, and includes the company name, the name of the person in charge, contact information, and the like.

[0377] "Natural language processing" is a technology that allows machines to understand human language, and refers to technologies that perform text analysis and context understanding.

[0378] A "reply message" refers to a message generated by a server in response to a message from a user.

[0379] An "emotion engine" refers to technology that analyzes emotions from a user's message and adjusts responses based on the results.

[0380] "Consulting Request" means a request submitted by a User for professional assistance or advice.

[0381] An "expert" is someone who has advanced knowledge and experience in a particular field.

[0382] "Remote consultation" refers to the exchange of advice and consultation with experts in remote locations via the Internet.

[0383] "Communication link" refers to the URL and connection information required to conduct a remote consultation, and is the means of connecting the user and the expert.

[0384] "Database" means an electronic repository for storing data collected by the System.

[0385] This invention is a system that allows small and medium-sized enterprises to easily receive consulting on digital transformation (DX) and IT implementation, and is combined with an emotion engine that recognizes user emotions. This system provides services mainly via general messaging apps. Specific embodiments for implementing this system are described below.

[0386] Enforcing user authentication

[0387] First, the user launches the LINE app and adds the official account of the enterprise digital transformation consulting service as a friend. When using the service for the first time, the user enters company information such as the company name, person in charge, and contact information, as well as personal authentication information, and sends it to the system. This information is sent to the server via the LINE API from the device. The server analyzes the received authentication information and stores it in a database. Next, an authentication token is generated and sent to the user, making it possible to identify the user in future communications.

[0388] Sending and replying to messages

[0389] Once authenticated, users can send questions or inquiries via LINE chat. For example, they can send a message like, "I want to create a homepage, but where do I start?" This message is sent to the server via the LINE API from the device. The server analyzes the received message using a natural language processing (NLP) engine and generates an appropriate reply message. It also uses an emotion engine to recognize the user's emotions and adjusts the reply message based on the results. For example, if the user is "in trouble," the response will be more helpful and provide more specific guidance.

[0390] Use of emotion engine

[0391] The emotion engine analyzes the emotions in the user's message and adjusts the system's response. For example, if the user uses words that indicate "anxiety," the server will send an encouraging message such as "Don't worry. Try these steps first." This makes support for the user more personalized and user-friendly.

[0392] Consulting Requests and Remote Consultations

[0393] A user initiates a consultation request by tapping the "Get a Free Consultation" button. This request is sent from the device to the server via the LINE API. The server analyzes the received consultation request and runs an algorithm to match an appropriate expert. Once matching is complete, a remote consultation date and communication link are sent to the user and the expert. The emotion engine also works here, notifying the expert of the user's emotional state.

[0394] Remote consultations

[0395] The user begins a conversation with the expert via LINE according to the designated remote consultation date. Video calls and chat can be used as needed. The device displays a communication link and chat window for the remote consultation, allowing the user and expert to smoothly proceed with the consultation. The server records the content of the remote consultation and saves it in a database for future reference. The emotion engine continues to operate during the remote consultation, recording changes in the user's emotions in real time and saving them in a database.

[0396] Guidance and next steps

[0397] Users click on provided guides and links for more information and progress as they perform each step. Based on the user's actions, the server sends additional information and guidelines for the next step. It also uses an emotion engine to provide supplemental information and additional support if the user is experiencing difficulty.

[0398] This allows users (small and medium-sized enterprises) to easily receive professional support for DX and IT. The introduction of an emotion engine in this system is expected to further improve the user experience and provide more effective support.

[0399] Prompt Sentence Examples

[0400] For example, by inputting a prompt such as, "When supporting digital transformation in small and medium-sized enterprises, please tell us an example of a response when recognizing a user's anxiety using an emotion engine," into the generative AI model, it is possible to obtain a specific example response.

[0401] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0402] Step 1:

[0403] Users launch the LINE app and add the official account of the enterprise DX consulting service as a friend. Next, when using the service for the first time, they enter authentication information such as the company name, person in charge, and contact information, and send this information to the system. The input data is entered via the LINE app's UI and sent to the device as transmission data.

[0404] Step 2:

[0405] The device sends the authentication information entered by the user to the server via the LINE API. The device converts this data into packets using a secure protocol (e.g., HTTPS) and transmits them to the server over the network. The input is the user's authentication information, and the output is an HTTP request to the server.

[0406] Step 3:

[0407] The server analyzes the received authentication information and saves the user's company information and personal authentication information in a database. At this time, it stores the data in the database using an SQL query. Next, the server generates an authentication token and sends it to the user. The input is the authentication information, and the output is the database storage result and the authentication token.

[0408] Step 4:

[0409] Once authentication is complete, the user can use LINE's chat function to send a question or request for advice. For example, they can send a message like, "I want to create a homepage, but where do I start?" The input is the user's text message, and the output is the expected sending status of the message as it arrives at the device via the LINE API.

[0410] Step 5:

[0411] The device sends messages from the user to the server via the LINE API. At this time, the messages are formatted in JSON and transmitted to the server over a secure communication channel. The input is the message sent by the user, and the output is an HTTP request to the server.

[0412] Step 6:

[0413] The server analyzes the received message using a natural language processing (NLP) engine. This analysis identifies the user's intent and question. It then runs an algorithm to generate a reply message. It also uses an emotion engine to recognize the user's emotion and adjust the reply message accordingly. The input is the user's message, and the output is the analysis result and the reply message.

[0414] Step 7:

[0415] The emotion engine analyzes the emotions from the user's message. For example, if the user uses words indicating "anxiety," the server uses the emotion data to send an encouraging message such as "Don't worry. Try these steps first." The input is the user's emotion level, and the output is a tailored reply message.

[0416] Step 8:

[0417] The user taps the "Get a Free Consultation" button to request a consultation. This event is transmitted to the device via the LINE app UI. The input is the user's button click event, and the output is a notification to the device.

[0418] Step 9:

[0419] The device sends a message to the server via the LINE API that the "Get a Free Consultation" button has been tapped. This message contains event data in JSON format and is transmitted to the server via secure communication. The input is a button click event, and the output is an HTTP request to the server.

[0420] Step 10:

[0421] The server analyzes the received consulting request and runs an algorithm to match the appropriate expert. Once matching is complete, it sends a remote consultation schedule and a communication link to the user and the expert. The emotion engine also works here to inform the expert of the user's emotional state. The input is the consulting request, and the output is the matching result and the communication link.

[0422] Step 11:

[0423] The user starts a conversation with the specialist via LINE according to the specified remote consultation date. Video calls and chats can be used as needed. The input is a notification of the remote consultation date, and the output is the start of a video call or chat.

[0424] Step 12:

[0425] The terminal displays the communication links and chat windows necessary for remote consultation, allowing the user and the expert to proceed with the consultation without any problems. The input is the communication link, and the output is the displayed chat window or video call link.

[0426] Step 13:

[0427] The server records the content of the remote consultation and saves it in a database. This data is saved for future reference. The emotion engine also runs during the consultation, recording the user's emotional changes in real time and saving them in the database. The input is the content of the remote consultation, and the output is the recorded consultation data and emotion data.

[0428] Step 14:

[0429] The user clicks on the provided guides and links to find out more information and see their progress as they perform each step. The input is the guide links and the output is the display of detailed information.

[0430] Step 15:

[0431] Based on the user's behavior, the server sends additional information and guidelines for the next step. It uses an emotion engine to provide supplementary information and additional support if the user is experiencing difficulty. The input is the user's behavior data, and the output is information about the next step and additional support.

[0432] (Application example 2)

[0433] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0434] The purpose of this invention is to make it easier for small and medium-sized enterprises to receive digital transformation (DX) and IT consulting. However, the emotional state of users is often ignored during this process. Furthermore, in workplaces where factory robots are used, robot maintenance and troubleshooting are often inefficient. This leads to problems that reduce business efficiency in small and medium-sized enterprises.

[0435] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0436] In this invention, the server includes: [means for receiving user authentication information via communication means and authenticating the user;] means for analyzing a message from the authenticated user and understanding the content using natural language processing; [means for generating a reply message based on the analyzed content and sending it to the user;] means for analyzing the user's emotional state and generating an appropriate reply message according to the emotion; [means for receiving a consulting request from the user and matching with an appropriate expert;] means for generating a communication link for conducting a remote consultation and providing it to the user and the expert; [means for recording the content of the remote consultation and saving it in a database for later reference;] means for continuously monitoring the user's emotional state and saving the analysis results in a database in real time; and [means for monitoring the status of factory robots and supporting maintenance and troubleshooting as needed.] This makes it possible to provide digital transformation support while taking the user's emotional state into consideration, and further realizes efficient management and maintenance of factory robots.

[0437] A "communication means" is an intermediary device for transmitting data from a user to a server and for transmitting data from the server to a user.

[0438] "User authentication information" is a general term for data used to identify a user and verify their identity, and includes the company name, the name of the person in charge, contact information, etc.

[0439] "Natural language processing" is a technology for analyzing text entered by a user and understanding its content.

[0440] A "reply message" is a message that is generated based on the user's message analyzed by the server and sent to the user.

[0441] "Emotional state" refers to a psychological state that can be recognized from the user's input message, and includes anxiety, confusion, relief, and the like.

[0442] A "consulting request" is a request submitted by a User for professional advice or assistance.

[0443] An "expert" is someone with advanced knowledge and skills in a particular field, and is matched with a user's specific needs.

[0444] A "communication link" is a digital connection for conducting a remote consultation, and can take the form of chat, video call, or other similar means.

[0445] A "database" is a system that stores information systematically and allows it to be retrieved as needed.

[0446] "Monitoring" is the act of continuously observing and recording the condition of a specific object.

[0447] "Maintenance" refers to the maintenance work carried out to keep equipment and systems in good operating condition.

[0448] "Troubleshooting" is the process of identifying the cause and finding a solution when a malfunction or problem occurs.

[0449] This invention is a system that allows small and medium-sized enterprises to easily receive digital transformation (DX) and IT consulting. This system provides a user-friendly experience by analyzing the user's emotional state and providing support accordingly. It also supports efficient management and maintenance of factory robots.

[0450] System Overview

[0451] The main components are the server, terminal, and user, each of which plays a specific role. The server uses communication means, a natural language processing (NLP) engine, an emotion engine, an expert matching algorithm, and a database. The terminal is a medium for receiving input information from the user and sending it to the server. The user is the entity that uses each function of the system.

[0452] Specific processing explanation of the program

[0453] The server receives user authentication information via communications means and authenticates the user. Next, it analyzes the message from the authenticated user and understands the content using an NLP engine. A reply message is generated based on the analyzed content and sent to the user. During this process, an emotion engine analyzes the user's emotional state and generates a reply message accordingly. Furthermore, it receives a consulting request from the user and selects the most suitable expert using an expert matching algorithm. A communication link for the remote consultation is generated and provided to the user and the expert. The content of the remote consultation is also recorded and saved in a database for future reference. To perform these processes, generative AI models such as an NLP engine, emotion engine, and expert matching algorithm are used.

[0454] The specific hardware and software used are as follows:

[0455] LINE Messaging API: A means of communication with users.

[0456] EmotionEngine API: An engine for emotion analysis.

[0457] Robot Management API: Health monitoring and troubleshooting of factory robots.

[0458] Flask: A lightweight web framework.

[0459] Specific examples

[0460] When a factory robot operator sends a LINE message saying, "The robot is experiencing an error, please help!", the system detects the user's anxiety with its emotion engine and checks the robot's status. The system then sends a reply message saying, "Error code 12345 has been detected. The solution is to restart the robot's power. Please stay calm, I'll support you."

[0461] Example of a generative AI model prompt:

[0462] Message text: "Robot is having an error, please help!"

[0463] Prompt: "Have your emotion engine analyze the emotion of this message, and if anxiety is detected, provide an error code, a suggested solution, and add a reassuring message to the user."

[0464] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0465] Step 1:

[0466] The device receives the authentication information sent by the user via the LINE app, including the company name, contact name, contact information, etc. The device then formats this information appropriately and sends it to the server via the LINE API.

[0467] Input: Authentication information entered by the user into the LINE app

[0468] Output: Authentication information sent to the server via the LINE API

[0469] Step 2:

[0470] The server analyzes the authentication information received via the communication means, generates an authentication token for authenticating the user, and sends the authentication token to the user. The token is used in subsequent communications to identify the user.

[0471] Input: User authentication information sent from the device

[0472] Output: Authentication token and the user who holds it

[0473] Step 3:

[0474] After completing authentication, the user can send a message to the robot with their concerns, such as "The robot is showing an error, please help!"

[0475] Input: Consultation message sent by the user

[0476] Output: Message sent to the server via the LINE API

[0477] Step 4:

[0478] The server analyzes the received message using a natural language processing (NLP) engine to understand its content, and simultaneously analyzes the user's emotional state using an emotion engine.

[0479] Input: Message sent by the user

[0480] Output: Parsed message content and emotional state

[0481] Step 5:

[0482] The server generates an appropriate reply message based on the analyzed message content and the user's emotional state. For example, if anxiety is detected, it generates a message containing encouraging words. The reply message is then sent to the user via the LINE API.

[0483] Input: Parsed message content and emotional state

[0484] Output: Reply message sent to the user

[0485] Step 6:

[0486] The user generates a consulting request by tapping the "Get a Free Consultation" button provided by the system.

[0487] Input: User taps a button

[0488] Output: Consulting request sent to the server via the LINE API

[0489] Step 7:

[0490] The server analyzes the received consultation request and executes an algorithm to match the expert. Once a suitable expert is selected, the server creates a communication link for the remote consultation and provides it to the user and the expert.

[0491] Input: Consulting request submitted by user

[0492] Output: Communication link for remote consultation

[0493] Step 8:

[0494] When a remote consultation begins, the server records the content of the remote consultation and stores it in a database. It also analyzes the user's emotional state in real time and records any changes in that state in the database.

[0495] Input: Conversation content and emotion data during remote consultation

[0496] Output: Remote consultation content and emotion data stored in a database

[0497] Step 9:

[0498] The server monitors the status of the factory robots and generates messages to support appropriate maintenance and troubleshooting in the event of a problem, including the ability to interpret robot error codes and provide solutions.

[0499] Input: Factory robot status data

[0500] Output: Reply messages regarding robot maintenance and troubleshooting

[0501] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0502] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0503] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0504] [Second embodiment]

[0505] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0506] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0507] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0508] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0509] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0510] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0511] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0512] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0513] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0514] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0515] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0516] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0517] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. The service is primarily provided via a common messaging app such as LINE. Specific embodiments for implementing this system are described below.

[0518] Enforcing user authentication

[0519] User

[0520] You will need to launch the LINE app and add the official account of the DX consulting service for businesses as a friend. When using it for the first time, you will need to enter your company information and personal authentication information and submit it to the system.

[0521] Terminal

[0522] The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person's name, contact information, etc.

[0523] server

[0524] The received user authentication information is analyzed and stored in a database. An authentication token is then generated and sent to the user. By retaining the authentication token, the user can be identified in subsequent communications.

[0525] Sending and replying to messages

[0526] User

[0527] Once authentication is complete, you can send a question or request for advice via LINE. For example, you can send a message saying, "I want to create a website, but where should I start?"

[0528] Terminal

[0529] Sends the user's message to the server. The message is properly formatted via the LINE API and passed to the server.

[0530] server

[0531] The server that receives the message uses a natural language processing (NLP) engine to understand the content. Based on the content of the message, it generates an appropriate reply message. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[0532] Consulting Requests and Remote Consultations

[0533] User

[0534] If you need consulting, tap the "Get a Free Consultation" button. This will create a consulting request.

[0535] Terminal

[0536] When the "Get a Free Consultation" button is tapped, the event is sent to the server, and the request information is passed to the server.

[0537] server

[0538] It analyzes incoming consultation requests and runs an algorithm to match them with the appropriate experts. Once matching is complete, it sends a remote consultation date and communication link to the user and the expert.

[0539] Remote consultations

[0540] User

[0541] On the designated remote consultation date, you will begin a conversation with a specialist via LINE, using video calls or chat as needed.

[0542] Terminal

[0543] It displays the communication links and chat windows necessary for remote consultations, allowing users and experts to smoothly proceed with the consultation.

[0544] server

[0545] The content of the remote consultation will be recorded and stored in a database for future reference. This data will be used to improve the service and for future reference.

[0546] Guidance and next steps

[0547] User

[0548] You will be provided with specific guides for creating your website and digital transformation, with links to find more information. You will also be able to track your progress as you go through each step.

[0549] server

[0550] Based on user behavior, send them additional information or guidelines for next steps.

[0551] In this way, a system is realized that allows users (small and medium-sized enterprises) to easily receive professional support for DX and IT. At each step, servers, terminals, and users cooperate to provide services smoothly.

[0552] The processing flow will be explained below.

[0553] Step 1:

[0554] User: Launch the LINE app and add the official account of the corporate DX consulting service as a friend.

[0555] Step 2:

[0556] User: When using for the first time, enter company information and personal authentication information and send it to the system.

[0557] Step 3:

[0558] Device: The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person name, and contact information.

[0559] Step 4:

[0560] Server: Parses the received user authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[0561] Step 5:

[0562] User: After authentication is complete, send a question or inquiry via LINE message. For example, send a message saying, "I want to create a homepage, but where should I start?"

[0563] Step 6:

[0564] Device: Sends the user's message to the server via the LINE API.

[0565] Step 7:

[0566] Server: Receives the message and uses a natural language processing (NLP) engine to understand its content. Based on the content of the message, it generates an appropriate reply message. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[0567] Step 8:

[0568] Server: Sends the generated reply message to the user.

[0569] Step 9:

[0570] User: Check the returned message and ask further questions or ask for advice as necessary.

[0571] Step 10:

[0572] User: If you need consulting, tap the "Get a Free Consultation" button.

[0573] Step 11:

[0574] Device: When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[0575] Step 12:

[0576] Server: Analyzes the received consulting request and runs an algorithm to match the appropriate expert. Once matching is complete, it sends the remote consultation schedule and communication link to the user and the expert.

[0577] Step 13:

[0578] User: According to the designated remote consultation date, the user starts a conversation with the specialist via LINE.

[0579] Step 14:

[0580] Terminal: Displays the communication links and chat window necessary for remote consultation, allowing the user and expert to proceed with the consultation without any problems.

[0581] Step 15:

[0582] Server: Records the details of the remote consultation and stores them in a database for future reference.

[0583] Step 16:

[0584] Users are provided with specific guides for creating a website and digital transformation, with links to find more information. They can track their progress as they go through each step.

[0585] Step 17:

[0586] Server: Based on the user's actions, sends additional information or guidelines for next steps.

[0587] Step 18:

[0588] Users: Send feedback and rate the service, which the system uses to improve the service.

[0589] Example 1

[0590] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0591] For small and medium-sized enterprises seeking support for digital transformation (DX) and IT adoption, the procedures are complicated and specialized knowledge and resources are limited, making it difficult to receive expert support easily and efficiently. There is also a need for a system that can efficiently communicate with users and provide them with the necessary information in a timely manner.

[0592] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0593] In this invention, the server includes: [means for receiving user authentication information via communication means and authenticating the user; [means for analyzing messages from the authenticated user and understanding the content using natural language processing; [means for generating a reply message based on the analyzed content and sending it to the user;] [means for receiving consulting requests from users and matching them with appropriate experts;] [means for generating a communication link for conducting remote consultations and providing it to the user and the expert;] [means for recording the content of the remote consultation and saving it in a database for later reference;] [means for generating an authentication token so that the user can be identified in subsequent communications; and [means for monitoring the user's progress and sending guidelines for proceeding to the next step.] This makes it possible [for small and medium-sized enterprises to easily receive consulting on digital transformation and IT adoption].

[0594] "User authentication information" refers to the information provided by the user for authentication, including the company name, the name of the person in charge, and contact information.

[0595] "Communication means" refers to the technologies and protocols for sending and receiving data, including the Internet and APIs.

[0596] "Natural language processing" is a technology that allows computers to understand and analyze human language.

[0597] "Message" refers to text, questions, inquiries, etc. sent by users.

[0598] "Reply message" refers to the response that the server generates to the parsed message.

[0599] "Consulting Request" means a request by a User for expert consultation.

[0600] An "expert" is an individual with advanced knowledge or experience in a particular field.

[0601] "Remote consultation" refers to consultation conducted from a physically distant location using online communication means.

[0602] "Communication link" refers to connection information for remote consultation, including URLs and application links.

[0603] An "authentication token" refers to an electronic key or identification information that uniquely identifies a user.

[0604] A "database" is a system for efficiently storing, searching, and managing large amounts of data.

[0605] "Guidelines" refers to instructions and reference information to help users take the next step.

[0606] "Progress" refers to the work and achievements that a user has made.

[0607] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. The service is primarily provided via a common messaging app that is easy for users to use. Specific embodiments for implementing this system are described below.

[0608] Enforcing user authentication

[0609] User

[0610] Users launch a messaging app on their smartphone or computer and add the official account of this system as a friend. When using the system for the first time, they enter company information (company name, person in charge, etc.) and personal authentication information (contact information, etc.) and send it to the system. This allows user authentication information to be collected.

[0611] Terminal

[0612] The device sends the authentication information entered by the user to the server via a messaging API (e.g., LINE API), including information such as the company name, person in charge, and contact information.

[0613] server

[0614] The server analyzes the received user authentication information and stores it in a database. It then generates an authentication token and sends it to the user. By retaining this authentication token, the server can identify the user in future communications.

[0615] Sending and replying to messages

[0616] User

[0617] After the user is authenticated, they can use the messaging app to send a question or request for advice, such as, "I want to create a website, where do I start?"

[0618] Terminal

[0619] The device sends the user's message to the server via the messaging API, which formats the message appropriately and passes it to the server.

[0620] server

[0621] The server analyzes the received message using a natural language processing (NLP) engine (for example, Google Cloud NLP or IBM Watson) to understand its content. Based on the analysis results, it generates an appropriate reply message and sends it to the user. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[0622] Consulting Requests and Remote Consultations

[0623] User

[0624] If the user wishes to receive consulting, they tap the "Get a Free Consultation" button, which will send a consulting request.

[0625] Terminal

[0626] The device sends this request event to the server via the messaging API, and the request information is passed to the server.

[0627] server

[0628] The server analyzes the received consultation request and runs an algorithm to match the request with an appropriate expert. Once matching is complete, the server sends the user and the expert a remote consultation schedule and a communication link, including a link to an online meeting tool (e.g., a Zoom link).

[0629] Remote consultations

[0630] User

[0631] The user will then schedule a remote consultation and begin a conversation with the specialist via a messaging app, using video calls or chats as needed.

[0632] Terminal

[0633] The terminal displays the necessary communication links and chat windows for remote consultation, allowing the user and the expert to smoothly proceed with the consultation.

[0634] server

[0635] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve the service and as a reference for future use.

[0636] Guidance and next steps

[0637] User

[0638] Users receive specific guidance on creating a website and digital transformation, click on the provided links to find more information, and track their progress as they go through each step.

[0639] server

[0640] The server monitors the user's behavior and progress and sends them additional information and guidelines for next steps, such as "Next, let's focus on SEO. Click the link below for more information."

[0641] Specific examples

[0642] Enforcing user authentication

[0643] Example sentence: "Hello, our company name is ABC Corporation, and our representative is Taro Yamada. We would like to use your DX consulting services."

[0644] Sending and replying to messages

[0645] Example message: "I want to create a website, where do I start?"

[0646] Example response: "First get your domain, then choose a template."

[0647] Consulting Requests and Remote Consultations

[0648] Event example: Tap "Get a free consultation"

[0649] Example of a remote consultation schedule notification: "The remote consultation will be held on October 15th at 3:00 PM. Please join us using the link below."

[0650] In this way, a system is realized that allows users to easily receive professional support for DX and IT. Servers, terminals, and users can fulfill their respective roles, enabling services to be provided smoothly.

[0651] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0652] Step 1: Add the official account as a friend

[0653] The user launches a messaging app on their smartphone or computer and adds the system's official account as a friend.

[0654] Input: QR code or link of official account

[0655] Output: Notification that official account has been added

[0656] Step 2: Enter and submit your credentials

[0657] The user enters company information (company name, contact name, etc.) and personal authentication information (contact information, etc.) into a messaging app and sends the message.

[0658] The device sends the entered authentication information to the server via the LINE API.

[0659] Input: Company name, contact name, contact details, and other authentication information

[0660] Output: Notification of completion of authentication information transmission

[0661] Step 3: Parse and store credentials

[0662] The server parses the received authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[0663] Input: Credentials

[0664] Output: Authentication token and authentication completion notification

[0665] Step 4: Submit your question or request

[0666] A user sends a question or request for advice via LINE message. For example, "I want to create a homepage, but where should I start?"

[0667] The device sends the user's message to the server via the LINE API.

[0668] Input: User questions and inquiries

[0669] Output: Message sent notification

[0670] Step 5: Parsing the message and generating a response

[0671] The server analyzes the received message using a natural language processing (NLP) engine to understand its content, and based on the analysis results, generates an appropriate reply message and sends it to the user.

[0672] Input: User's message

[0673] Output: Reply message

[0674] Step 6: Submit a Consulting Request

[0675] A user submits a consultation request by tapping the "Get a Free Consultation" button in a messaging app.

[0676] The device sends the event to the server via the LINE API.

[0677] Input: Consulting request event

[0678] Output: Request sent notification

[0679] Step 7: Analyzing and matching consulting requests

[0680] The server analyzes the received consultation request and runs an algorithm to match the request with a suitable expert. After matching is complete, it sends a remote consultation date and a communication link to the user and the expert.

[0681] Input: Consulting Request

[0682] Output: Remote consultation schedule and communication link

[0683] Step 8: Start the consultation according to the remote consultation schedule

[0684] The user will initiate a conversation with the specialist via LINE on the designated remote consultation date, using video calls and chats as needed.

[0685] The terminal displays the communication links and chat windows necessary for remote consultation.

[0686] Input: Remote consultation date

[0687] Output: Remote consultation started

[0688] Step 9: Record the remote consultation

[0689] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve the service and as a reference for future use.

[0690] Input: Remote consultation details

[0691] Output: Recorded consultation content

[0692] Step 10: Providing guidance and next steps

[0693] The server monitors the user's progress and sends additional information or guidelines for next steps.

[0694] Users receive specific guides on creating a homepage and digital transformation, and can click on the provided links to find out more information.

[0695] Input: User progress information

[0696] Output: Additional information or guidelines for next steps

[0697] Through these steps, this system enables small and medium-sized enterprises to easily receive consulting on digital transformation and IT implementation.

[0698] (Application example 1)

[0699] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0700] When operators of small and medium-sized enterprises and individual stores receive consulting for digital transformation (DX) or IT implementation, they face problems such as complicated procedures, the need for specialized knowledge, and difficulty in accessing appropriate experts. The present invention solves these problems by providing a system that allows these operators to easily receive support for DX and IT implementation.

[0701] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0702] In this invention, the server includes means for receiving user authentication information via a communication means and authenticating the user, means for analyzing a message from the authenticated user and understanding the content using natural language processing, and means for generating a reply message based on the analyzed content and sending it to the user, thereby enabling operators of small and medium-sized enterprises and individual stores to easily receive professional support.

[0703] "Communication means" refers to the interface and protocol for sending and receiving authentication information and messages between the user and the server.

[0704] "User authentication information" refers to information for identifying a specific user, such as the company name, the name of the person in charge, and contact information.

[0705] An "authentication token" is a unique identifier issued by a server to a user to indicate that the user has been authenticated.

[0706] "Natural language processing" is a technology that analyzes the content of text messages sent by users and converts them into a format that a program can understand.

[0707] A "reply message" is a response message generated by the server based on the analyzed content of the user's message.

[0708] A "consulting request" is a request sent by a User to a Server for professional advice or assistance.

[0709] "Expert matching" refers to the process of selecting the person with the most appropriate expertise based on the user's consulting request.

[0710] "Remote consultation" is a form of consultation in which a user and an expert communicate with each other while physically separated from each other.

[0711] "Communication Link" means the connection link over the Internet shared by the User and the Expert for conducting the Remote Consultation.

[0712] "Database" refers to data storage for recording and managing the content of remote consultations, user authentication information, etc.

[0713] The "analyzed content" refers to the content resulting from analyzing the user's message using natural language processing.

[0714] A "question about store management" is a question that a user sends to the server to ask for advice on store management and operation methods.

[0715] The "Store Management Consulting Guide" is a guideline that provides specific steps and advice aimed at improving store management.

[0716] This invention provides a system that allows operators of small and medium-sized enterprises and individual stores to easily receive consulting on digital transformation (DX) and IT. The system includes a communication means, a user authentication function, a message analysis function, a reply message generation function, an expert matching function, a remote consultation function, and a database storage function.

[0717] The server receives the user authentication information sent by the user through the LINE app or a similar messaging app, and authenticates the user based on that information. Authentication uses identification information such as the company name, person in charge, and contact information. Once authentication is complete, the server generates an authentication token and sends it to the user. This makes it possible to identify the user in future communications.

[0718] When an authenticated user sends a LINE message with a question or request for advice, the server analyzes the message using a natural language processing (NLP) engine. This analysis allows the content of the message to be understood and an appropriate reply message to be generated. For example, if a user sends a message saying, "I would like to install a new cash register system," the server will generate a reply based on the analysis results, such as, "We will provide you with information about installing a cash register system. First, please list your budget and required features," and send it to the user.

[0719] When a user wants to consult, they tap a specific button to generate a consultation request. The request is forwarded to the server, which runs an algorithm to match the user with a suitable expert. Once the expert is identified, the server creates a communication link for the remote consultation and provides it to both the user and the expert.

[0720] When a remote consultation is conducted, the server records the details and stores them in a database for future reference. This allows past consultation details to be used to improve future consulting and services.

[0721] For this system to function effectively, the following hardware and software are used:

[0722] Hardware: Cloud-based servers (e.g., AWS, Google Cloud), users' smartphones

[0723] Software: LINE API, Google Cloud Natural Language API, Flask

[0724] As an example of a specific prompt sentence, if a user wants to consult about the implementation of a new cash register system, the prompt sentence is as follows.

[0725] I'd like to install a new cash register system. Which one would you recommend?

[0726] This invention will enable small and medium-sized enterprises and individual store operators to easily receive support for DX and IT adoption without specialized knowledge, thereby realizing more efficient and advanced store operations.

[0727] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0728] Step 1:

[0729] A user launches the LINE app and adds the official account as a friend. They then enter the company information and personal authentication information required for authentication and submit it to the system. This information includes the company name, contact person's name, contact information, etc.

[0730] Input: Company information, personal authentication information

[0731] Output: Authentication information sent to the server

[0732] Step 2:

[0733] The device sends user authentication information to the server via the LINE API. The server analyzes the received user authentication information and stores it in a database. It then generates an authentication token and sends it to the user.

[0734] Input: User credentials

[0735] Output: Authentication token

[0736] Step 3:

[0737] After the user is authenticated, they can send a question or inquiry to the server using a LINE message. For example, they can send a message such as, "I want to create a homepage, but where should I start?"

[0738] Input: User questions and inquiries

[0739] Output: A message is sent to the server

[0740] Step 4:

[0741] The device sends a message from the user to the server via the LINE API, and the server receives the message and analyzes its content using a natural language processing (NLP) engine.

[0742] Input: User's message

[0743] Output: Analysis results

[0744] Step 5:

[0745] The server generates a reply message based on the parsed content and sends it to the user via the LINE API. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[0746] Input: Analysis results

[0747] Output: Reply message

[0748] Step 6:

[0749] A user taps a specific button to generate a consulting request, for example, by tapping the "Get a Free Consult" button.

[0750] Input: User button tap action

[0751] Output: Consulting Request

[0752] Step 7:

[0753] The device sends a consultation request to the server via the LINE API, which receives the request and runs an algorithm to match the appropriate expert.

[0754] Input: Consulting Request

[0755] Output: Matching results with experts

[0756] Step 8:

[0757] The server generates a communication link for remote consultation and sends it to the user and the expert, so that the user and the expert can start the remote consultation without any problems.

[0758] Input: Expert matching results

[0759] Output: Communication link

[0760] Step 9:

[0761] The user will follow the designated remote consultation date and begin a conversation with the specialist via LINE, using video calls and chat as needed.

[0762] Input: Communication link, remote consultation available

[0763] Output: Conducting a remote consultation

[0764] Step 10:

[0765] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve future consultations and services.

[0766] Input: Remote consultation details

[0767] Output: Recorded remote consultation data

[0768] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0769] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. In particular, by combining it with an emotion engine that recognizes the user's emotions, it provides more user-friendly support. The service is mainly provided via a general messaging app. Specific embodiments for implementing this system are described below.

[0770] Enforcing user authentication

[0771] User

[0772] Launch the LINE app and add the official account of the enterprise DX consulting service as a friend. When using for the first time, enter your company information and personal authentication information and submit it to the system.

[0773] Terminal

[0774] The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person's name, contact information, etc.

[0775] server

[0776] The received user authentication information is analyzed and stored in a database. An authentication token is then generated and sent to the user. By retaining the authentication token, the user can be identified in subsequent communications.

[0777] Sending and replying to messages

[0778] User

[0779] Once authentication is complete, you can send a question or request for advice via LINE. For example, you can send a message saying, "I want to create a website, but where should I start?"

[0780] Terminal

[0781] Sends the user's message to the server. The message is properly formatted via the LINE API and passed to the server.

[0782] server

[0783] The server that receives the message uses a natural language processing (NLP) engine to understand its content. Based on the content of the message, it generates an appropriate reply message. It also uses an emotion engine to recognize the user's emotions and adjusts the reply message accordingly. For example, if the server recognizes that the user is "in trouble," it will respond with more helpful and specific guidance.

[0784] Use of emotion engine

[0785] server

[0786] Using an emotion engine, the system analyzes the emotions in the user's message and adjusts the system's response. For example, if the user uses words that indicate "anxiety," the server will send an encouraging message such as, "Don't worry. Try these steps first."

[0787] Consulting Requests and Remote Consultations

[0788] User

[0789] If you need consulting, tap the "Get a Free Consultation" button. This will create a consulting request.

[0790] Terminal

[0791] When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[0792] server

[0793] The system analyzes incoming consultation requests and runs an algorithm to match them with the appropriate experts. Once matching is complete, it sends a remote consultation date and communication link to the user and the expert. The emotion engine also works here, informing the expert of the user's emotional state.

[0794] Remote consultations

[0795] User

[0796] On the designated remote consultation date, you will begin a conversation with a specialist via LINE, using video calls or chat as needed.

[0797] Terminal

[0798] It displays the communication links and chat windows necessary for remote consultations, allowing users and experts to smoothly proceed with the consultation.

[0799] server

[0800] The content of the remote consultation is recorded and saved in a database for future reference. The emotion engine runs during the remote consultation, recording changes in the user's emotions in real time and saving them in a database.

[0801] Guidance and next steps

[0802] User

[0803] You will be provided with specific guides for creating your website and digital transformation, with links to find more information. You will also be able to track your progress as you go through each step.

[0804] server

[0805] Based on the user's behavior, it sends additional information or guidelines for next steps. It uses an emotion engine to provide supplemental information or additional support if the user is experiencing difficulties.

[0806] In this way, a system will be realized that allows users (small and medium-sized enterprises) to easily receive professional support for digital transformation and IT. The introduction of the emotion engine is expected to further improve the user experience and provide more effective support.

[0807] The processing flow will be explained below.

[0808] Step 1:

[0809] User: Launch the LINE app and add the official account of the corporate DX consulting service as a friend.

[0810] Step 2:

[0811] User: When using for the first time, enter company information and personal authentication information and send it to the system.

[0812] Step 3:

[0813] Device: The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person name, and contact information.

[0814] Step 4:

[0815] Server: Parses the received user authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[0816] Step 5:

[0817] User: After authentication is complete, send a question or inquiry via LINE message. For example, send a message saying, "I want to create a homepage, but where should I start?"

[0818] Step 6:

[0819] Device: Sends the user's message to the server via the LINE API.

[0820] Step 7:

[0821] Server: Receives the message, understands its content using a natural language processing (NLP) engine, and generates an appropriate reply message based on the message content.

[0822] Step 8:

[0823] Server: Analyzes the user's emotions using an emotion engine. For example, if the user's message indicates an "anxious" emotion, adjust the response.

[0824] Step 9:

[0825] Server: Sends a tailored response message to the user, such as "We'll guide you through the steps to create your homepage. Don't worry, first get a domain, then choose a template."

[0826] Step 10:

[0827] User: Check the reply message and send the next question or inquiry by message.

[0828] Step 11:

[0829] User: If you need consulting, tap the "Get a Free Consultation" button.

[0830] Step 12:

[0831] Device: When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[0832] Step 13:

[0833] Server: Analyzes incoming consulting requests and runs algorithms to match them with the appropriate experts.

[0834] Step 14:

[0835] Server: Once matching is complete, it sends the remote consultation schedule and communication link to the user and the expert.

[0836] Step 15:

[0837] Server: Using the emotion engine, informs the expert of the user's emotional state before the remote consultation.

[0838] Step 16:

[0839] User: According to the designated remote consultation date, the user starts a conversation with the specialist via LINE.

[0840] Step 17:

[0841] Terminal: Displays the communication links and chat window necessary for remote consultation, allowing the user and expert to proceed with the consultation without any problems.

[0842] Step 18:

[0843] Server: Runs the emotion engine during remote consultations, records changes in the user's emotions in real time, and notifies the expert.

[0844] Step 19:

[0845] Server: Records the details of the remote consultation and stores them in a database for future reference.

[0846] Step 20:

[0847] Users are provided with a guide to creating a website or digital transformation, and can click on links to learn more. They can follow their progress as they go through each step.

[0848] Step 21:

[0849] Server: Based on the user's behavior and emotions, sends additional information or guidelines for next steps.

[0850] Step 22:

[0851] Users: Send feedback and rate the service, which the system uses to improve the service.

[0852] Example 2

[0853] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0854] Small and medium-sized enterprises (SMEs) face a wide range of challenges when implementing digital transformation (DX) and IT adoption. They often lack specialized knowledge and experience, and sometimes have difficulty accessing appropriate experts. For this reason, there is a need for support to efficiently and effectively advance DX and IT adoption. Another major issue is the lack of systems that can respond while taking user emotions into consideration.

[0855] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving user authentication information via a communication means and authenticating the user, a means for analyzing a message from the authenticated user and understanding the content using natural language processing, and a means for generating a reply message based on the analyzed content and sending it to the user. This enables small and medium-sized enterprises (SMEs) to receive effective DX and IT support even if they do not have specialized knowledge. Furthermore, the introduction of an emotion engine enables recognition of user emotions and more user-friendly responses.

[0856] "Means of communication" refers to the technologies and protocols used to send and receive data over the Internet, primarily HTTP and HTTPS.

[0857] "User authentication information" is information for verifying the identity of a user, and includes the company name, the name of the person in charge, contact information, and the like.

[0858] "Natural language processing" is a technology that allows machines to understand human language, and refers to technologies that perform text analysis and context understanding.

[0859] A "reply message" refers to a message generated by a server in response to a message from a user.

[0860] An "emotion engine" refers to technology that analyzes emotions from a user's message and adjusts responses based on the results.

[0861] "Consulting Request" means a request submitted by a User for professional assistance or advice.

[0862] An "expert" is someone who has advanced knowledge and experience in a particular field.

[0863] "Remote consultation" refers to the exchange of advice and consultation with experts in remote locations via the Internet.

[0864] "Communication link" refers to the URL and connection information required to conduct a remote consultation, and is the means of connecting the user and the expert.

[0865] "Database" means an electronic repository for storing data collected by the System.

[0866] This invention is a system that allows small and medium-sized enterprises to easily receive consulting on digital transformation (DX) and IT implementation, and is combined with an emotion engine that recognizes user emotions. This system provides services mainly via general messaging apps. Specific embodiments for implementing this system are described below.

[0867] Enforcing user authentication

[0868] First, the user launches the LINE app and adds the official account of the enterprise digital transformation consulting service as a friend. When using the service for the first time, the user enters company information such as the company name, person in charge, and contact information, as well as personal authentication information, and sends it to the system. This information is sent to the server via the LINE API from the device. The server analyzes the received authentication information and stores it in a database. Next, an authentication token is generated and sent to the user, making it possible to identify the user in future communications.

[0869] Sending and replying to messages

[0870] Once authenticated, users can send questions or inquiries via LINE chat. For example, they can send a message like, "I want to create a homepage, but where do I start?" This message is sent to the server via the LINE API from the device. The server analyzes the received message using a natural language processing (NLP) engine and generates an appropriate reply message. It also uses an emotion engine to recognize the user's emotions and adjusts the reply message based on the results. For example, if the user is "in trouble," the response will be more helpful and provide more specific guidance.

[0871] Use of emotion engine

[0872] The emotion engine analyzes the emotions in the user's message and adjusts the system's response. For example, if the user uses words that indicate "anxiety," the server will send an encouraging message such as "Don't worry. Try these steps first." This makes support for the user more personalized and user-friendly.

[0873] Consulting Requests and Remote Consultations

[0874] A user initiates a consultation request by tapping the "Get a Free Consultation" button. This request is sent from the device to the server via the LINE API. The server analyzes the received consultation request and runs an algorithm to match an appropriate expert. Once matching is complete, a remote consultation date and communication link are sent to the user and the expert. The emotion engine also works here, notifying the expert of the user's emotional state.

[0875] Remote consultations

[0876] The user begins a conversation with the expert via LINE according to the designated remote consultation date. Video calls and chat can be used as needed. The device displays a communication link and chat window for the remote consultation, allowing the user and expert to smoothly proceed with the consultation. The server records the content of the remote consultation and saves it in a database for future reference. The emotion engine continues to operate during the remote consultation, recording changes in the user's emotions in real time and saving them in a database.

[0877] Guidance and next steps

[0878] Users click on provided guides and links for more information and progress as they perform each step. Based on the user's actions, the server sends additional information and guidelines for the next step. It also uses an emotion engine to provide supplemental information and additional support if the user is experiencing difficulty.

[0879] This allows users (small and medium-sized enterprises) to easily receive professional support for DX and IT. The introduction of an emotion engine in this system is expected to further improve the user experience and provide more effective support.

[0880] Prompt Sentence Examples

[0881] For example, by inputting a prompt such as, "When supporting digital transformation in small and medium-sized enterprises, please tell us an example of a response when recognizing a user's anxiety using an emotion engine," into the generative AI model, it is possible to obtain a specific example response.

[0882] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0883] Step 1:

[0884] Users launch the LINE app and add the official account of the enterprise DX consulting service as a friend. Next, when using the service for the first time, they enter authentication information such as the company name, person in charge, and contact information, and send this information to the system. The input data is entered via the LINE app's UI and sent to the device as transmission data.

[0885] Step 2:

[0886] The device sends the authentication information entered by the user to the server via the LINE API. The device converts this data into packets using a secure protocol (e.g., HTTPS) and transmits them to the server over the network. The input is the user's authentication information, and the output is an HTTP request to the server.

[0887] Step 3:

[0888] The server analyzes the received authentication information and saves the user's company information and personal authentication information in a database. At this time, it stores the data in the database using an SQL query. Next, the server generates an authentication token and sends it to the user. The input is the authentication information, and the output is the database storage result and the authentication token.

[0889] Step 4:

[0890] Once authentication is complete, the user can use LINE's chat function to send a question or request for advice. For example, they can send a message like, "I want to create a homepage, but where do I start?" The input is the user's text message, and the output is the expected sending status of the message as it arrives at the device via the LINE API.

[0891] Step 5:

[0892] The device sends messages from the user to the server via the LINE API. At this time, the messages are formatted in JSON and transmitted to the server over a secure communication channel. The input is the message sent by the user, and the output is an HTTP request to the server.

[0893] Step 6:

[0894] The server analyzes the received message using a natural language processing (NLP) engine. This analysis identifies the user's intent and question. It then runs an algorithm to generate a reply message. It also uses an emotion engine to recognize the user's emotion and adjust the reply message accordingly. The input is the user's message, and the output is the analysis result and the reply message.

[0895] Step 7:

[0896] The emotion engine analyzes the emotions from the user's message. For example, if the user uses words indicating "anxiety," the server uses the emotion data to send an encouraging message such as "Don't worry. Try these steps first." The input is the user's emotion level, and the output is a tailored reply message.

[0897] Step 8:

[0898] The user taps the "Get a Free Consultation" button to request a consultation. This event is transmitted to the device via the LINE app UI. The input is the user's button click event, and the output is a notification to the device.

[0899] Step 9:

[0900] The device sends a message to the server via the LINE API that the "Get a Free Consultation" button has been tapped. This message contains event data in JSON format and is transmitted to the server via secure communication. The input is a button click event, and the output is an HTTP request to the server.

[0901] Step 10:

[0902] The server analyzes the received consulting request and runs an algorithm to match the appropriate expert. Once matching is complete, it sends a remote consultation schedule and a communication link to the user and the expert. The emotion engine also works here to inform the expert of the user's emotional state. The input is the consulting request, and the output is the matching result and the communication link.

[0903] Step 11:

[0904] The user starts a conversation with the specialist via LINE according to the specified remote consultation date. Video calls and chats can be used as needed. The input is a notification of the remote consultation date, and the output is the start of a video call or chat.

[0905] Step 12:

[0906] The terminal displays the communication links and chat windows necessary for remote consultation, allowing the user and the expert to proceed with the consultation without any problems. The input is the communication link, and the output is the displayed chat window or video call link.

[0907] Step 13:

[0908] The server records the content of the remote consultation and saves it in a database. This data is saved for future reference. The emotion engine also runs during the consultation, recording the user's emotional changes in real time and saving them in the database. The input is the content of the remote consultation, and the output is the recorded consultation data and emotion data.

[0909] Step 14:

[0910] The user clicks on the provided guides and links to find out more information and see their progress as they perform each step. The input is the guide links and the output is the display of detailed information.

[0911] Step 15:

[0912] Based on the user's behavior, the server sends additional information and guidelines for the next step. It uses an emotion engine to provide supplementary information and additional support if the user is experiencing difficulty. The input is the user's behavior data, and the output is information about the next step and additional support.

[0913] (Application example 2)

[0914] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0915] The purpose of this invention is to make it easier for small and medium-sized enterprises to receive digital transformation (DX) and IT consulting. However, the emotional state of users is often ignored during this process. Furthermore, in workplaces where factory robots are used, robot maintenance and troubleshooting are often inefficient. This leads to problems that reduce business efficiency in small and medium-sized enterprises.

[0916] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0917] In this invention, the server includes: [means for receiving user authentication information via communication means and authenticating the user;] means for analyzing a message from the authenticated user and understanding the content using natural language processing; [means for generating a reply message based on the analyzed content and sending it to the user;] means for analyzing the user's emotional state and generating an appropriate reply message according to the emotion; [means for receiving a consulting request from the user and matching with an appropriate expert;] means for generating a communication link for conducting a remote consultation and providing it to the user and the expert; [means for recording the content of the remote consultation and saving it in a database for later reference;] means for continuously monitoring the user's emotional state and saving the analysis results in a database in real time; and [means for monitoring the status of factory robots and supporting maintenance and troubleshooting as needed.] This makes it possible to provide digital transformation support while taking the user's emotional state into consideration, and further realizes efficient management and maintenance of factory robots.

[0918] A "communication means" is an intermediary device for transmitting data from a user to a server and for transmitting data from the server to a user.

[0919] "User authentication information" is a general term for data used to identify a user and verify their identity, and includes the company name, the name of the person in charge, contact information, etc.

[0920] "Natural language processing" is a technology for analyzing text entered by a user and understanding its content.

[0921] A "reply message" is a message that is generated based on the user's message analyzed by the server and sent to the user.

[0922] "Emotional state" refers to a psychological state that can be recognized from the user's input message, and includes anxiety, confusion, relief, and the like.

[0923] A "consulting request" is a request submitted by a User for professional advice or assistance.

[0924] An "expert" is someone with advanced knowledge and skills in a particular field, and is matched with a user's specific needs.

[0925] A "communication link" is a digital connection for conducting a remote consultation, and can take the form of chat, video call, or other similar means.

[0926] A "database" is a system that stores information systematically and allows it to be retrieved as needed.

[0927] "Monitoring" is the act of continuously observing and recording the condition of a specific object.

[0928] "Maintenance" refers to the maintenance work carried out to keep equipment and systems in good operating condition.

[0929] "Troubleshooting" is the process of identifying the cause and finding a solution when a malfunction or problem occurs.

[0930] This invention is a system that allows small and medium-sized enterprises to easily receive digital transformation (DX) and IT consulting. This system provides a user-friendly experience by analyzing the user's emotional state and providing support accordingly. It also supports efficient management and maintenance of factory robots.

[0931] System Overview

[0932] The main components are the server, terminal, and user, each of which plays a specific role. The server uses communication means, a natural language processing (NLP) engine, an emotion engine, an expert matching algorithm, and a database. The terminal is a medium for receiving input information from the user and sending it to the server. The user is the entity that uses each function of the system.

[0933] Specific processing explanation of the program

[0934] The server receives user authentication information via communications means and authenticates the user. Next, it analyzes the message from the authenticated user and understands the content using an NLP engine. A reply message is generated based on the analyzed content and sent to the user. During this process, an emotion engine analyzes the user's emotional state and generates a reply message accordingly. Furthermore, it receives a consulting request from the user and selects the most suitable expert using an expert matching algorithm. A communication link for the remote consultation is generated and provided to the user and the expert. The content of the remote consultation is also recorded and saved in a database for future reference. To perform these processes, generative AI models such as an NLP engine, emotion engine, and expert matching algorithm are used.

[0935] The specific hardware and software used are as follows:

[0936] LINE Messaging API: A means of communication with users.

[0937] EmotionEngine API: An engine for emotion analysis.

[0938] Robot Management API: Health monitoring and troubleshooting of factory robots.

[0939] Flask: A lightweight web framework.

[0940] Specific examples

[0941] When a factory robot operator sends a LINE message saying, "The robot is experiencing an error, please help!", the system detects the user's anxiety with its emotion engine and checks the robot's status. The system then sends a reply message saying, "Error code 12345 has been detected. The solution is to restart the robot's power. Please stay calm, I'll support you."

[0942] Example of a generative AI model prompt:

[0943] Message text: "Robot is having an error, please help!"

[0944] Prompt: "Have your emotion engine analyze the emotion of this message, and if anxiety is detected, provide an error code, a suggested solution, and add a reassuring message to the user."

[0945] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0946] Step 1:

[0947] The device receives the authentication information sent by the user via the LINE app, including the company name, contact name, contact information, etc. The device then formats this information appropriately and sends it to the server via the LINE API.

[0948] Input: Authentication information entered by the user into the LINE app

[0949] Output: Authentication information sent to the server via the LINE API

[0950] Step 2:

[0951] The server analyzes the authentication information received via the communication means, generates an authentication token for authenticating the user, and sends the authentication token to the user. The token is used in subsequent communications to identify the user.

[0952] Input: User authentication information sent from the device

[0953] Output: Authentication token and the user who holds it

[0954] Step 3:

[0955] After completing authentication, the user can send a message to the robot with their concerns, such as "The robot is showing an error, please help!"

[0956] Input: Consultation message sent by the user

[0957] Output: Message sent to the server via the LINE API

[0958] Step 4:

[0959] The server analyzes the received message using a natural language processing (NLP) engine to understand its content, and simultaneously analyzes the user's emotional state using an emotion engine.

[0960] Input: Message sent by the user

[0961] Output: Parsed message content and emotional state

[0962] Step 5:

[0963] The server generates an appropriate reply message based on the analyzed message content and the user's emotional state. For example, if anxiety is detected, it generates a message containing encouraging words. The reply message is then sent to the user via the LINE API.

[0964] Input: Parsed message content and emotional state

[0965] Output: Reply message sent to the user

[0966] Step 6:

[0967] The user generates a consulting request by tapping the "Get a Free Consultation" button provided by the system.

[0968] Input: User taps a button

[0969] Output: Consulting request sent to the server via the LINE API

[0970] Step 7:

[0971] The server analyzes the received consultation request and executes an algorithm to match the expert. Once a suitable expert is selected, the server creates a communication link for the remote consultation and provides it to the user and the expert.

[0972] Input: Consulting request submitted by user

[0973] Output: Communication link for remote consultation

[0974] Step 8:

[0975] When a remote consultation begins, the server records the content of the remote consultation and stores it in a database. It also analyzes the user's emotional state in real time and records any changes in that state in the database.

[0976] Input: Conversation content and emotion data during remote consultation

[0977] Output: Remote consultation content and emotion data stored in a database

[0978] Step 9:

[0979] The server monitors the status of the factory robots and generates messages to support appropriate maintenance and troubleshooting in the event of a problem, including the ability to interpret robot error codes and provide solutions.

[0980] Input: Factory robot status data

[0981] Output: Reply messages regarding robot maintenance and troubleshooting

[0982] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0983] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0984] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0985] [Third embodiment]

[0986] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0987] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0988] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0989] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0990] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0991] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0992] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0993] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0994] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0995] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0996] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0997] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0998] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. The service is primarily provided via a common messaging app such as LINE. Specific embodiments for implementing this system are described below.

[0999] Enforcing user authentication

[1000] User

[1001] You will need to launch the LINE app and add the official account of the DX consulting service for businesses as a friend. When using it for the first time, you will need to enter your company information and personal authentication information and submit it to the system.

[1002] Terminal

[1003] The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person's name, contact information, etc.

[1004] server

[1005] The received user authentication information is analyzed and stored in a database. An authentication token is then generated and sent to the user. By retaining the authentication token, the user can be identified in subsequent communications.

[1006] Sending and replying to messages

[1007] User

[1008] Once authentication is complete, you can send a question or request for advice via LINE. For example, you can send a message saying, "I want to create a website, but where should I start?"

[1009] Terminal

[1010] Sends the user's message to the server. The message is properly formatted via the LINE API and passed to the server.

[1011] server

[1012] The server that receives the message uses a natural language processing (NLP) engine to understand the content. Based on the content of the message, it generates an appropriate reply message. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[1013] Consulting Requests and Remote Consultations

[1014] User

[1015] If you need consulting, tap the "Get a Free Consultation" button. This will create a consulting request.

[1016] Terminal

[1017] When the "Get a Free Consultation" button is tapped, the event is sent to the server, and the request information is passed to the server.

[1018] server

[1019] It analyzes incoming consultation requests and runs an algorithm to match them with the appropriate experts. Once matching is complete, it sends a remote consultation date and communication link to the user and the expert.

[1020] Remote consultations

[1021] User

[1022] On the designated remote consultation date, you will begin a conversation with a specialist via LINE, using video calls or chat as needed.

[1023] Terminal

[1024] It displays the communication links and chat windows necessary for remote consultations, allowing users and experts to smoothly proceed with the consultation.

[1025] server

[1026] The content of the remote consultation will be recorded and stored in a database for future reference. This data will be used to improve the service and for future reference.

[1027] Guidance and next steps

[1028] User

[1029] You will be provided with specific guides for creating your website and digital transformation, with links to find more information. You will also be able to track your progress as you go through each step.

[1030] server

[1031] Based on user behavior, send them additional information or guidelines for next steps.

[1032] In this way, a system is realized that allows users (small and medium-sized enterprises) to easily receive professional support for DX and IT. At each step, servers, terminals, and users cooperate to provide services smoothly.

[1033] The processing flow will be explained below.

[1034] Step 1:

[1035] User: Launch the LINE app and add the official account of the corporate DX consulting service as a friend.

[1036] Step 2:

[1037] User: When using for the first time, enter company information and personal authentication information and send it to the system.

[1038] Step 3:

[1039] Device: The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person name, and contact information.

[1040] Step 4:

[1041] Server: Parses the received user authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[1042] Step 5:

[1043] User: After authentication is complete, send a question or inquiry via LINE message. For example, send a message saying, "I want to create a homepage, but where should I start?"

[1044] Step 6:

[1045] Device: Sends the user's message to the server via the LINE API.

[1046] Step 7:

[1047] Server: Receives the message and uses a natural language processing (NLP) engine to understand its content. Based on the content of the message, it generates an appropriate reply message. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[1048] Step 8:

[1049] Server: Sends the generated reply message to the user.

[1050] Step 9:

[1051] User: Check the returned message and ask further questions or ask for advice as necessary.

[1052] Step 10:

[1053] User: If you need consulting, tap the "Get a Free Consultation" button.

[1054] Step 11:

[1055] Device: When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[1056] Step 12:

[1057] Server: Analyzes the received consulting request and runs an algorithm to match the appropriate expert. Once matching is complete, it sends the remote consultation schedule and communication link to the user and the expert.

[1058] Step 13:

[1059] User: According to the designated remote consultation date, the user starts a conversation with the specialist via LINE.

[1060] Step 14:

[1061] Terminal: Displays the communication links and chat window necessary for remote consultation, allowing the user and expert to proceed with the consultation without any problems.

[1062] Step 15:

[1063] Server: Records the details of the remote consultation and stores them in a database for future reference.

[1064] Step 16:

[1065] Users are provided with specific guides for creating a website and digital transformation, with links to find more information. They can track their progress as they go through each step.

[1066] Step 17:

[1067] Server: Based on the user's actions, sends additional information or guidelines for next steps.

[1068] Step 18:

[1069] Users: Send feedback and rate the service, which the system uses to improve the service.

[1070] Example 1

[1071] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1072] For small and medium-sized enterprises seeking support for digital transformation (DX) and IT adoption, the procedures are complicated and specialized knowledge and resources are limited, making it difficult to receive expert support easily and efficiently. There is also a need for a system that can efficiently communicate with users and provide them with the necessary information in a timely manner.

[1073] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1074] In this invention, the server includes: [means for receiving user authentication information via communication means and authenticating the user; [means for analyzing messages from the authenticated user and understanding the content using natural language processing; [means for generating a reply message based on the analyzed content and sending it to the user;] [means for receiving consulting requests from users and matching them with appropriate experts;] [means for generating a communication link for conducting remote consultations and providing it to the user and the expert;] [means for recording the content of the remote consultation and saving it in a database for later reference;] [means for generating an authentication token so that the user can be identified in subsequent communications; and [means for monitoring the user's progress and sending guidelines for proceeding to the next step.] This makes it possible [for small and medium-sized enterprises to easily receive consulting on digital transformation and IT adoption].

[1075] "User authentication information" refers to the information provided by the user for authentication, including the company name, the name of the person in charge, and contact information.

[1076] "Communication means" refers to the technologies and protocols for sending and receiving data, including the Internet and APIs.

[1077] "Natural language processing" is a technology that allows computers to understand and analyze human language.

[1078] "Message" refers to text, questions, inquiries, etc. sent by users.

[1079] "Reply message" refers to the response that the server generates to the parsed message.

[1080] "Consulting Request" means a request by a User for expert consultation.

[1081] An "expert" is an individual with advanced knowledge or experience in a particular field.

[1082] "Remote consultation" refers to consultation conducted from a physically distant location using online communication means.

[1083] "Communication link" refers to connection information for remote consultation, including URLs and application links.

[1084] An "authentication token" refers to an electronic key or identification information that uniquely identifies a user.

[1085] A "database" is a system for efficiently storing, searching, and managing large amounts of data.

[1086] "Guidelines" refers to instructions and reference information to help users take the next step.

[1087] "Progress" refers to the work and achievements that a user has made.

[1088] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. The service is primarily provided via a common messaging app that is easy for users to use. Specific embodiments for implementing this system are described below.

[1089] Enforcing user authentication

[1090] User

[1091] Users launch a messaging app on their smartphone or computer and add the official account of this system as a friend. When using the system for the first time, they enter company information (company name, person in charge, etc.) and personal authentication information (contact information, etc.) and send it to the system. This allows user authentication information to be collected.

[1092] Terminal

[1093] The device sends the authentication information entered by the user to the server via a messaging API (e.g., LINE API), including information such as the company name, person in charge, and contact information.

[1094] server

[1095] The server analyzes the received user authentication information and stores it in a database. It then generates an authentication token and sends it to the user. By retaining this authentication token, the server can identify the user in future communications.

[1096] Sending and replying to messages

[1097] User

[1098] After the user is authenticated, they can use the messaging app to send a question or request for advice, such as, "I want to create a website, where do I start?"

[1099] Terminal

[1100] The device sends the user's message to the server via the messaging API, which formats the message appropriately and passes it to the server.

[1101] server

[1102] The server analyzes the received message using a natural language processing (NLP) engine (for example, Google Cloud NLP or IBM Watson) to understand its content. Based on the analysis results, it generates an appropriate reply message and sends it to the user. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[1103] Consulting Requests and Remote Consultations

[1104] User

[1105] If the user wishes to receive consulting, they tap the "Get a Free Consultation" button, which will send a consulting request.

[1106] Terminal

[1107] The device sends this request event to the server via the messaging API, and the request information is passed to the server.

[1108] server

[1109] The server analyzes the received consultation request and runs an algorithm to match the request with an appropriate expert. Once matching is complete, the server sends the user and the expert a remote consultation schedule and a communication link, including a link to an online meeting tool (e.g., a Zoom link).

[1110] Remote consultations

[1111] User

[1112] The user will then schedule a remote consultation and begin a conversation with the specialist via a messaging app, using video calls or chats as needed.

[1113] Terminal

[1114] The terminal displays the necessary communication links and chat windows for remote consultation, allowing the user and the expert to smoothly proceed with the consultation.

[1115] server

[1116] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve the service and as a reference for future use.

[1117] Guidance and next steps

[1118] User

[1119] Users receive specific guidance on creating a website and digital transformation, click on the provided links to find more information, and track their progress as they go through each step.

[1120] server

[1121] The server monitors the user's behavior and progress and sends them additional information and guidelines for next steps, such as "Next, let's focus on SEO. Click the link below for more information."

[1122] Specific examples

[1123] Enforcing user authentication

[1124] Example sentence: "Hello, our company name is ABC Corporation, and our representative is Taro Yamada. We would like to use your DX consulting services."

[1125] Sending and replying to messages

[1126] Example message: "I want to create a website, where do I start?"

[1127] Example response: "First get your domain, then choose a template."

[1128] Consulting Requests and Remote Consultations

[1129] Event example: Tap "Get a free consultation"

[1130] Example of a remote consultation schedule notification: "The remote consultation will be held on October 15th at 3:00 PM. Please join us using the link below."

[1131] In this way, a system is realized that allows users to easily receive professional support for DX and IT. Servers, terminals, and users can fulfill their respective roles, enabling services to be provided smoothly.

[1132] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1133] Step 1: Add the official account as a friend

[1134] The user launches a messaging app on their smartphone or computer and adds the system's official account as a friend.

[1135] Input: QR code or link of official account

[1136] Output: Notification that official account has been added

[1137] Step 2: Enter and submit your credentials

[1138] The user enters company information (company name, contact name, etc.) and personal authentication information (contact information, etc.) into a messaging app and sends the message.

[1139] The device sends the entered authentication information to the server via the LINE API.

[1140] Input: Company name, contact name, contact details, and other authentication information

[1141] Output: Notification of completion of authentication information transmission

[1142] Step 3: Parse and store credentials

[1143] The server parses the received authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[1144] Input: Credentials

[1145] Output: Authentication token and authentication completion notification

[1146] Step 4: Submit your question or request

[1147] A user sends a question or request for advice via LINE message. For example, "I want to create a homepage, but where should I start?"

[1148] The device sends the user's message to the server via the LINE API.

[1149] Input: User questions and inquiries

[1150] Output: Message sent notification

[1151] Step 5: Parsing the message and generating a response

[1152] The server analyzes the received message using a natural language processing (NLP) engine to understand its content, and based on the analysis results, generates an appropriate reply message and sends it to the user.

[1153] Input: User's message

[1154] Output: Reply message

[1155] Step 6: Submit a Consulting Request

[1156] A user submits a consultation request by tapping the "Get a Free Consultation" button in a messaging app.

[1157] The device sends the event to the server via the LINE API.

[1158] Input: Consulting request event

[1159] Output: Request sent notification

[1160] Step 7: Analyzing and matching consulting requests

[1161] The server analyzes the received consultation request and runs an algorithm to match the request with a suitable expert. After matching is complete, it sends a remote consultation date and a communication link to the user and the expert.

[1162] Input: Consulting Request

[1163] Output: Remote consultation schedule and communication link

[1164] Step 8: Start the consultation according to the remote consultation schedule

[1165] The user will initiate a conversation with the specialist via LINE on the designated remote consultation date, using video calls and chats as needed.

[1166] The terminal displays the communication links and chat windows necessary for remote consultation.

[1167] Input: Remote consultation date

[1168] Output: Remote consultation started

[1169] Step 9: Record the remote consultation

[1170] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve the service and as a reference for future use.

[1171] Input: Remote consultation details

[1172] Output: Recorded consultation content

[1173] Step 10: Providing guidance and next steps

[1174] The server monitors the user's progress and sends additional information or guidelines for next steps.

[1175] Users receive specific guides on creating a homepage and digital transformation, and can click on the provided links to find out more information.

[1176] Input: User progress information

[1177] Output: Additional information or guidelines for next steps

[1178] Through these steps, this system enables small and medium-sized enterprises to easily receive consulting on digital transformation and IT implementation.

[1179] (Application example 1)

[1180] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1181] When operators of small and medium-sized enterprises and individual stores receive consulting for digital transformation (DX) or IT implementation, they face problems such as complicated procedures, the need for specialized knowledge, and difficulty in accessing appropriate experts. The present invention solves these problems by providing a system that allows these operators to easily receive support for DX and IT implementation.

[1182] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1183] In this invention, the server includes means for receiving user authentication information via a communication means and authenticating the user, means for analyzing a message from the authenticated user and understanding the content using natural language processing, and means for generating a reply message based on the analyzed content and sending it to the user, thereby enabling operators of small and medium-sized enterprises and individual stores to easily receive professional support.

[1184] "Communication means" refers to the interface and protocol for sending and receiving authentication information and messages between the user and the server.

[1185] "User authentication information" refers to information for identifying a specific user, such as the company name, the name of the person in charge, and contact information.

[1186] An "authentication token" is a unique identifier issued by a server to a user to indicate that the user has been authenticated.

[1187] "Natural language processing" is a technology that analyzes the content of text messages sent by users and converts them into a format that a program can understand.

[1188] A "reply message" is a response message generated by the server based on the analyzed content of the user's message.

[1189] A "consulting request" is a request sent by a User to a Server for professional advice or assistance.

[1190] "Expert matching" refers to the process of selecting the person with the most appropriate expertise based on the user's consulting request.

[1191] "Remote consultation" is a form of consultation in which a user and an expert communicate with each other while physically separated from each other.

[1192] "Communication Link" means the connection link over the Internet shared by the User and the Expert for conducting the Remote Consultation.

[1193] "Database" refers to data storage for recording and managing the content of remote consultations, user authentication information, etc.

[1194] The "analyzed content" refers to the content resulting from analyzing the user's message using natural language processing.

[1195] A "question about store management" is a question that a user sends to the server to ask for advice on store management and operation methods.

[1196] The "Store Management Consulting Guide" is a guideline that provides specific steps and advice aimed at improving store management.

[1197] This invention provides a system that allows operators of small and medium-sized enterprises and individual stores to easily receive consulting on digital transformation (DX) and IT. The system includes a communication means, a user authentication function, a message analysis function, a reply message generation function, an expert matching function, a remote consultation function, and a database storage function.

[1198] The server receives the user authentication information sent by the user through the LINE app or a similar messaging app, and authenticates the user based on that information. Authentication uses identification information such as the company name, person in charge, and contact information. Once authentication is complete, the server generates an authentication token and sends it to the user. This makes it possible to identify the user in future communications.

[1199] When an authenticated user sends a LINE message with a question or request for advice, the server analyzes the message using a natural language processing (NLP) engine. This analysis allows the content of the message to be understood and an appropriate reply message to be generated. For example, if a user sends a message saying, "I would like to install a new cash register system," the server will generate a reply based on the analysis results, such as, "We will provide you with information about installing a cash register system. First, please list your budget and required features," and send it to the user.

[1200] When a user wants to consult, they tap a specific button to generate a consultation request. The request is forwarded to the server, which runs an algorithm to match the user with a suitable expert. Once the expert is identified, the server creates a communication link for the remote consultation and provides it to both the user and the expert.

[1201] When a remote consultation is conducted, the server records the details and stores them in a database for future reference. This allows past consultation details to be used to improve future consulting and services.

[1202] For this system to function effectively, the following hardware and software are used:

[1203] Hardware: Cloud-based servers (e.g., AWS, Google Cloud), users' smartphones

[1204] Software: LINE API, Google Cloud Natural Language API, Flask

[1205] As an example of a specific prompt sentence, if a user wants to consult about the implementation of a new cash register system, the prompt sentence is as follows.

[1206] I'd like to install a new cash register system. Which one would you recommend?

[1207] This invention will enable small and medium-sized enterprises and individual store operators to easily receive support for DX and IT adoption without specialized knowledge, thereby realizing more efficient and advanced store operations.

[1208] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1209] Step 1:

[1210] A user launches the LINE app and adds the official account as a friend. They then enter the company information and personal authentication information required for authentication and submit it to the system. This information includes the company name, contact person's name, contact information, etc.

[1211] Input: Company information, personal authentication information

[1212] Output: Authentication information sent to the server

[1213] Step 2:

[1214] The device sends user authentication information to the server via the LINE API. The server analyzes the received user authentication information and stores it in a database. It then generates an authentication token and sends it to the user.

[1215] Input: User credentials

[1216] Output: Authentication token

[1217] Step 3:

[1218] After the user is authenticated, they can send a question or inquiry to the server using a LINE message. For example, they can send a message such as, "I want to create a homepage, but where should I start?"

[1219] Input: User questions and inquiries

[1220] Output: A message is sent to the server

[1221] Step 4:

[1222] The device sends a message from the user to the server via the LINE API, and the server receives the message and analyzes its content using a natural language processing (NLP) engine.

[1223] Input: User's message

[1224] Output: Analysis results

[1225] Step 5:

[1226] The server generates a reply message based on the parsed content and sends it to the user via the LINE API. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[1227] Input: Analysis results

[1228] Output: Reply message

[1229] Step 6:

[1230] A user taps a specific button to generate a consulting request, for example, by tapping the "Get a Free Consult" button.

[1231] Input: User button tap action

[1232] Output: Consulting Request

[1233] Step 7:

[1234] The device sends a consultation request to the server via the LINE API, which receives the request and runs an algorithm to match the appropriate expert.

[1235] Input: Consulting Request

[1236] Output: Matching results with experts

[1237] Step 8:

[1238] The server generates a communication link for remote consultation and sends it to the user and the expert, so that the user and the expert can start the remote consultation without any problems.

[1239] Input: Expert matching results

[1240] Output: Communication link

[1241] Step 9:

[1242] The user will follow the designated remote consultation date and begin a conversation with the specialist via LINE, using video calls and chat as needed.

[1243] Input: Communication link, remote consultation available

[1244] Output: Conducting a remote consultation

[1245] Step 10:

[1246] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve future consultations and services.

[1247] Input: Remote consultation details

[1248] Output: Recorded remote consultation data

[1249] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1250] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. In particular, by combining it with an emotion engine that recognizes the user's emotions, it provides more user-friendly support. The service is mainly provided via a general messaging app. Specific embodiments for implementing this system are described below.

[1251] Enforcing user authentication

[1252] User

[1253] Launch the LINE app and add the official account of the enterprise DX consulting service as a friend. When using for the first time, enter your company information and personal authentication information and submit it to the system.

[1254] Terminal

[1255] The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person's name, contact information, etc.

[1256] server

[1257] The received user authentication information is analyzed and stored in a database. An authentication token is then generated and sent to the user. By retaining the authentication token, the user can be identified in subsequent communications.

[1258] Sending and replying to messages

[1259] User

[1260] Once authentication is complete, you can send a question or request for advice via LINE. For example, you can send a message saying, "I want to create a website, but where should I start?"

[1261] Terminal

[1262] Sends the user's message to the server. The message is properly formatted via the LINE API and passed to the server.

[1263] server

[1264] The server that receives the message uses a natural language processing (NLP) engine to understand its content. Based on the content of the message, it generates an appropriate reply message. It also uses an emotion engine to recognize the user's emotions and adjusts the reply message accordingly. For example, if the server recognizes that the user is "in trouble," it will respond with more helpful and specific guidance.

[1265] Use of emotion engine

[1266] server

[1267] Using an emotion engine, the system analyzes the emotions in the user's message and adjusts the system's response. For example, if the user uses words that indicate "anxiety," the server will send an encouraging message such as, "Don't worry. Try these steps first."

[1268] Consulting Requests and Remote Consultations

[1269] User

[1270] If you need consulting, tap the "Get a Free Consultation" button. This will create a consulting request.

[1271] Terminal

[1272] When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[1273] server

[1274] The system analyzes incoming consultation requests and runs an algorithm to match them with the appropriate experts. Once matching is complete, it sends a remote consultation date and communication link to the user and the expert. The emotion engine also works here, informing the expert of the user's emotional state.

[1275] Remote consultations

[1276] User

[1277] On the designated remote consultation date, you will begin a conversation with a specialist via LINE, using video calls or chat as needed.

[1278] Terminal

[1279] It displays the communication links and chat windows necessary for remote consultations, allowing users and experts to smoothly proceed with the consultation.

[1280] server

[1281] The content of the remote consultation is recorded and saved in a database for future reference. The emotion engine runs during the remote consultation, recording changes in the user's emotions in real time and saving them in a database.

[1282] Guidance and next steps

[1283] User

[1284] You will be provided with specific guides for creating your website and digital transformation, with links to find more information. You will also be able to track your progress as you go through each step.

[1285] server

[1286] Based on the user's behavior, it sends additional information or guidelines for next steps. It uses an emotion engine to provide supplemental information or additional support if the user is experiencing difficulties.

[1287] In this way, a system will be realized that allows users (small and medium-sized enterprises) to easily receive professional support for digital transformation and IT. The introduction of the emotion engine is expected to further improve the user experience and provide more effective support.

[1288] The processing flow will be explained below.

[1289] Step 1:

[1290] User: Launch the LINE app and add the official account of the corporate DX consulting service as a friend.

[1291] Step 2:

[1292] User: When using for the first time, enter company information and personal authentication information and send it to the system.

[1293] Step 3:

[1294] Device: The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person name, and contact information.

[1295] Step 4:

[1296] Server: Parses the received user authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[1297] Step 5:

[1298] User: After authentication is complete, send a question or inquiry via LINE message. For example, send a message saying, "I want to create a homepage, but where should I start?"

[1299] Step 6:

[1300] Device: Sends the user's message to the server via the LINE API.

[1301] Step 7:

[1302] Server: Receives the message, understands its content using a natural language processing (NLP) engine, and generates an appropriate reply message based on the message content.

[1303] Step 8:

[1304] Server: Analyzes the user's emotions using an emotion engine. For example, if the user's message indicates an "anxious" emotion, adjust the response.

[1305] Step 9:

[1306] Server: Sends a tailored response message to the user, such as "We'll guide you through the steps to create your homepage. Don't worry, first get a domain, then choose a template."

[1307] Step 10:

[1308] User: Check the reply message and send the next question or inquiry by message.

[1309] Step 11:

[1310] User: If you need consulting, tap the "Get a Free Consultation" button.

[1311] Step 12:

[1312] Device: When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[1313] Step 13:

[1314] Server: Analyzes incoming consulting requests and runs algorithms to match them with the appropriate experts.

[1315] Step 14:

[1316] Server: Once matching is complete, it sends the remote consultation schedule and communication link to the user and the expert.

[1317] Step 15:

[1318] Server: Using the emotion engine, informs the expert of the user's emotional state before the remote consultation.

[1319] Step 16:

[1320] User: According to the designated remote consultation date, the user starts a conversation with the specialist via LINE.

[1321] Step 17:

[1322] Terminal: Displays the communication links and chat window necessary for remote consultation, allowing the user and expert to proceed with the consultation without any problems.

[1323] Step 18:

[1324] Server: Runs the emotion engine during remote consultations, records changes in the user's emotions in real time, and notifies the expert.

[1325] Step 19:

[1326] Server: Records the details of the remote consultation and stores them in a database for future reference.

[1327] Step 20:

[1328] Users are provided with a guide to creating a website or digital transformation, and can click on links to learn more. They can follow their progress as they go through each step.

[1329] Step 21:

[1330] Server: Based on the user's behavior and emotions, sends additional information or guidelines for next steps.

[1331] Step 22:

[1332] Users: Send feedback and rate the service, which the system uses to improve the service.

[1333] Example 2

[1334] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1335] Small and medium-sized enterprises (SMEs) face a wide range of challenges when implementing digital transformation (DX) and IT adoption. They often lack specialized knowledge and experience, and sometimes have difficulty accessing appropriate experts. For this reason, there is a need for support to efficiently and effectively advance DX and IT adoption. Another major issue is the lack of systems that can respond while taking user emotions into consideration.

[1336] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving user authentication information via a communication means and authenticating the user, a means for analyzing a message from the authenticated user and understanding the content using natural language processing, and a means for generating a reply message based on the analyzed content and sending it to the user. This enables small and medium-sized enterprises (SMEs) to receive effective DX and IT support even if they do not have specialized knowledge. Furthermore, the introduction of an emotion engine enables recognition of user emotions and more user-friendly responses.

[1337] "Means of communication" refers to the technologies and protocols used to send and receive data over the Internet, primarily HTTP and HTTPS.

[1338] "User authentication information" is information for verifying the identity of a user, and includes the company name, the name of the person in charge, contact information, and the like.

[1339] "Natural language processing" is a technology that allows machines to understand human language, and refers to technologies that perform text analysis and context understanding.

[1340] A "reply message" refers to a message generated by a server in response to a message from a user.

[1341] An "emotion engine" refers to technology that analyzes emotions from a user's message and adjusts responses based on the results.

[1342] "Consulting Request" means a request submitted by a User for professional assistance or advice.

[1343] An "expert" is someone who has advanced knowledge and experience in a particular field.

[1344] "Remote consultation" refers to the exchange of advice and consultation with experts in remote locations via the Internet.

[1345] "Communication link" refers to the URL and connection information required to conduct a remote consultation, and is the means of connecting the user and the expert.

[1346] "Database" means an electronic repository for storing data collected by the System.

[1347] This invention is a system that allows small and medium-sized enterprises to easily receive consulting on digital transformation (DX) and IT implementation, and is combined with an emotion engine that recognizes user emotions. This system provides services mainly via general messaging apps. Specific embodiments for implementing this system are described below.

[1348] Enforcing user authentication

[1349] First, the user launches the LINE app and adds the official account of the enterprise digital transformation consulting service as a friend. When using the service for the first time, the user enters company information such as the company name, person in charge, and contact information, as well as personal authentication information, and sends it to the system. This information is sent to the server via the LINE API from the device. The server analyzes the received authentication information and stores it in a database. Next, an authentication token is generated and sent to the user, making it possible to identify the user in future communications.

[1350] Sending and replying to messages

[1351] Once authenticated, users can send questions or inquiries via LINE chat. For example, they can send a message like, "I want to create a homepage, but where do I start?" This message is sent to the server via the LINE API from the device. The server analyzes the received message using a natural language processing (NLP) engine and generates an appropriate reply message. It also uses an emotion engine to recognize the user's emotions and adjusts the reply message based on the results. For example, if the user is "in trouble," the response will be more helpful and provide more specific guidance.

[1352] Use of emotion engine

[1353] The emotion engine analyzes the emotions in the user's message and adjusts the system's response. For example, if the user uses words that indicate "anxiety," the server will send an encouraging message such as "Don't worry. Try these steps first." This makes support for the user more personalized and user-friendly.

[1354] Consulting Requests and Remote Consultations

[1355] A user initiates a consultation request by tapping the "Get a Free Consultation" button. This request is sent from the device to the server via the LINE API. The server analyzes the received consultation request and runs an algorithm to match an appropriate expert. Once matching is complete, a remote consultation date and communication link are sent to the user and the expert. The emotion engine also works here, notifying the expert of the user's emotional state.

[1356] Remote consultations

[1357] The user begins a conversation with the expert via LINE according to the designated remote consultation date. Video calls and chat can be used as needed. The device displays a communication link and chat window for the remote consultation, allowing the user and expert to smoothly proceed with the consultation. The server records the content of the remote consultation and saves it in a database for future reference. The emotion engine continues to operate during the remote consultation, recording changes in the user's emotions in real time and saving them in a database.

[1358] Guidance and next steps

[1359] Users click on provided guides and links for more information and progress as they perform each step. Based on the user's actions, the server sends additional information and guidelines for the next step. It also uses an emotion engine to provide supplemental information and additional support if the user is experiencing difficulty.

[1360] This allows users (small and medium-sized enterprises) to easily receive professional support for DX and IT. The introduction of an emotion engine in this system is expected to further improve the user experience and provide more effective support.

[1361] Prompt Sentence Examples

[1362] For example, by inputting a prompt such as, "When supporting digital transformation in small and medium-sized enterprises, please tell us an example of a response when recognizing a user's anxiety using an emotion engine," into the generative AI model, it is possible to obtain a specific example response.

[1363] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1364] Step 1:

[1365] Users launch the LINE app and add the official account of the enterprise DX consulting service as a friend. Next, when using the service for the first time, they enter authentication information such as the company name, person in charge, and contact information, and send this information to the system. The input data is entered via the LINE app's UI and sent to the device as transmission data.

[1366] Step 2:

[1367] The device sends the authentication information entered by the user to the server via the LINE API. The device converts this data into packets using a secure protocol (e.g., HTTPS) and transmits them to the server over the network. The input is the user's authentication information, and the output is an HTTP request to the server.

[1368] Step 3:

[1369] The server analyzes the received authentication information and saves the user's company information and personal authentication information in a database. At this time, it stores the data in the database using an SQL query. Next, the server generates an authentication token and sends it to the user. The input is the authentication information, and the output is the database storage result and the authentication token.

[1370] Step 4:

[1371] Once authentication is complete, the user can use LINE's chat function to send a question or request for advice. For example, they can send a message like, "I want to create a homepage, but where do I start?" The input is the user's text message, and the output is the expected sending status of the message as it arrives at the device via the LINE API.

[1372] Step 5:

[1373] The device sends messages from the user to the server via the LINE API. At this time, the messages are formatted in JSON and transmitted to the server over a secure communication channel. The input is the message sent by the user, and the output is an HTTP request to the server.

[1374] Step 6:

[1375] The server analyzes the received message using a natural language processing (NLP) engine. This analysis identifies the user's intent and question. It then runs an algorithm to generate a reply message. It also uses an emotion engine to recognize the user's emotion and adjust the reply message accordingly. The input is the user's message, and the output is the analysis result and the reply message.

[1376] Step 7:

[1377] The emotion engine analyzes the emotions from the user's message. For example, if the user uses words indicating "anxiety," the server uses the emotion data to send an encouraging message such as "Don't worry. Try these steps first." The input is the user's emotion level, and the output is a tailored reply message.

[1378] Step 8:

[1379] The user taps the "Get a Free Consultation" button to request a consultation. This event is transmitted to the device via the LINE app UI. The input is the user's button click event, and the output is a notification to the device.

[1380] Step 9:

[1381] The device sends a message to the server via the LINE API that the "Get a Free Consultation" button has been tapped. This message contains event data in JSON format and is transmitted to the server via secure communication. The input is a button click event, and the output is an HTTP request to the server.

[1382] Step 10:

[1383] The server analyzes the received consulting request and runs an algorithm to match the appropriate expert. Once matching is complete, it sends a remote consultation schedule and a communication link to the user and the expert. The emotion engine also works here to inform the expert of the user's emotional state. The input is the consulting request, and the output is the matching result and the communication link.

[1384] Step 11:

[1385] The user starts a conversation with the specialist via LINE according to the specified remote consultation date. Video calls and chats can be used as needed. The input is a notification of the remote consultation date, and the output is the start of a video call or chat.

[1386] Step 12:

[1387] The terminal displays the communication links and chat windows necessary for remote consultation, allowing the user and the expert to proceed with the consultation without any problems. The input is the communication link, and the output is the displayed chat window or video call link.

[1388] Step 13:

[1389] The server records the content of the remote consultation and saves it in a database. This data is saved for future reference. The emotion engine also runs during the consultation, recording the user's emotional changes in real time and saving them in the database. The input is the content of the remote consultation, and the output is the recorded consultation data and emotion data.

[1390] Step 14:

[1391] The user clicks on the provided guides and links to find out more information and see their progress as they perform each step. The input is the guide links and the output is the display of detailed information.

[1392] Step 15:

[1393] Based on the user's behavior, the server sends additional information and guidelines for the next step. It uses an emotion engine to provide supplementary information and additional support if the user is experiencing difficulty. The input is the user's behavior data, and the output is information about the next step and additional support.

[1394] (Application example 2)

[1395] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1396] The purpose of this invention is to make it easier for small and medium-sized enterprises to receive digital transformation (DX) and IT consulting. However, the emotional state of users is often ignored during this process. Furthermore, in workplaces where factory robots are used, robot maintenance and troubleshooting are often inefficient. This leads to problems that reduce business efficiency in small and medium-sized enterprises.

[1397] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1398] In this invention, the server includes: [means for receiving user authentication information via communication means and authenticating the user;] means for analyzing a message from the authenticated user and understanding the content using natural language processing; [means for generating a reply message based on the analyzed content and sending it to the user;] means for analyzing the user's emotional state and generating an appropriate reply message according to the emotion; [means for receiving a consulting request from the user and matching with an appropriate expert;] means for generating a communication link for conducting a remote consultation and providing it to the user and the expert; [means for recording the content of the remote consultation and saving it in a database for later reference;] means for continuously monitoring the user's emotional state and saving the analysis results in a database in real time; and [means for monitoring the status of factory robots and supporting maintenance and troubleshooting as needed.] This makes it possible to provide digital transformation support while taking the user's emotional state into consideration, and further realizes efficient management and maintenance of factory robots.

[1399] A "communication means" is an intermediary device for transmitting data from a user to a server and for transmitting data from the server to a user.

[1400] "User authentication information" is a general term for data used to identify a user and verify their identity, and includes the company name, the name of the person in charge, contact information, etc.

[1401] "Natural language processing" is a technology for analyzing text entered by a user and understanding its content.

[1402] A "reply message" is a message that is generated based on the user's message analyzed by the server and sent to the user.

[1403] "Emotional state" refers to a psychological state that can be recognized from the user's input message, and includes anxiety, confusion, relief, and the like.

[1404] A "consulting request" is a request submitted by a User for professional advice or assistance.

[1405] An "expert" is someone with advanced knowledge and skills in a particular field, and is matched with a user's specific needs.

[1406] A "communication link" is a digital connection for conducting a remote consultation, and can take the form of chat, video call, or other similar means.

[1407] A "database" is a system that stores information systematically and allows it to be retrieved as needed.

[1408] "Monitoring" is the act of continuously observing and recording the condition of a specific object.

[1409] "Maintenance" refers to the maintenance work carried out to keep equipment and systems in good operating condition.

[1410] "Troubleshooting" is the process of identifying the cause and finding a solution when a malfunction or problem occurs.

[1411] This invention is a system that allows small and medium-sized enterprises to easily receive digital transformation (DX) and IT consulting. This system provides a user-friendly experience by analyzing the user's emotional state and providing support accordingly. It also supports efficient management and maintenance of factory robots.

[1412] System Overview

[1413] The main components are the server, terminal, and user, each of which plays a specific role. The server uses communication means, a natural language processing (NLP) engine, an emotion engine, an expert matching algorithm, and a database. The terminal is a medium for receiving input information from the user and sending it to the server. The user is the entity that uses each function of the system.

[1414] Specific processing explanation of the program

[1415] The server receives user authentication information via communications means and authenticates the user. Next, it analyzes the message from the authenticated user and understands the content using an NLP engine. A reply message is generated based on the analyzed content and sent to the user. During this process, an emotion engine analyzes the user's emotional state and generates a reply message accordingly. Furthermore, it receives a consulting request from the user and selects the most suitable expert using an expert matching algorithm. A communication link for the remote consultation is generated and provided to the user and the expert. The content of the remote consultation is also recorded and saved in a database for future reference. To perform these processes, generative AI models such as an NLP engine, emotion engine, and expert matching algorithm are used.

[1416] The specific hardware and software used are as follows:

[1417] LINE Messaging API: A means of communication with users.

[1418] EmotionEngine API: An engine for emotion analysis.

[1419] Robot Management API: Health monitoring and troubleshooting of factory robots.

[1420] Flask: A lightweight web framework.

[1421] Specific examples

[1422] When a factory robot operator sends a LINE message saying, "The robot is experiencing an error, please help!", the system detects the user's anxiety with its emotion engine and checks the robot's status. The system then sends a reply message saying, "Error code 12345 has been detected. The solution is to restart the robot's power. Please stay calm, I'll support you."

[1423] Example of a generative AI model prompt:

[1424] Message text: "Robot is having an error, please help!"

[1425] Prompt: "Have your emotion engine analyze the emotion of this message, and if anxiety is detected, provide an error code, a suggested solution, and add a reassuring message to the user."

[1426] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1427] Step 1:

[1428] The device receives the authentication information sent by the user via the LINE app, including the company name, contact name, contact information, etc. The device then formats this information appropriately and sends it to the server via the LINE API.

[1429] Input: Authentication information entered by the user into the LINE app

[1430] Output: Authentication information sent to the server via the LINE API

[1431] Step 2:

[1432] The server analyzes the authentication information received via the communication means, generates an authentication token for authenticating the user, and sends the authentication token to the user. The token is used in subsequent communications to identify the user.

[1433] Input: User authentication information sent from the device

[1434] Output: Authentication token and the user who holds it

[1435] Step 3:

[1436] After completing authentication, the user can send a message to the robot with their concerns, such as "The robot is showing an error, please help!"

[1437] Input: Consultation message sent by the user

[1438] Output: Message sent to the server via the LINE API

[1439] Step 4:

[1440] The server analyzes the received message using a natural language processing (NLP) engine to understand its content, and simultaneously analyzes the user's emotional state using an emotion engine.

[1441] Input: Message sent by the user

[1442] Output: Parsed message content and emotional state

[1443] Step 5:

[1444] The server generates an appropriate reply message based on the analyzed message content and the user's emotional state. For example, if anxiety is detected, it generates a message containing encouraging words. The reply message is then sent to the user via the LINE API.

[1445] Input: Parsed message content and emotional state

[1446] Output: Reply message sent to the user

[1447] Step 6:

[1448] The user generates a consulting request by tapping the "Get a Free Consultation" button provided by the system.

[1449] Input: User taps a button

[1450] Output: Consulting request sent to the server via the LINE API

[1451] Step 7:

[1452] The server analyzes the received consultation request and executes an algorithm to match the expert. Once a suitable expert is selected, the server creates a communication link for the remote consultation and provides it to the user and the expert.

[1453] Input: Consulting request submitted by user

[1454] Output: Communication link for remote consultation

[1455] Step 8:

[1456] When a remote consultation begins, the server records the content of the remote consultation and stores it in a database. It also analyzes the user's emotional state in real time and records any changes in that state in the database.

[1457] Input: Conversation content and emotion data during remote consultation

[1458] Output: Remote consultation content and emotion data stored in a database

[1459] Step 9:

[1460] The server monitors the status of the factory robots and generates messages to support appropriate maintenance and troubleshooting in the event of a problem, including the ability to interpret robot error codes and provide solutions.

[1461] Input: Factory robot status data

[1462] Output: Reply messages regarding robot maintenance and troubleshooting

[1463] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1464] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1465] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1466] [Fourth embodiment]

[1467] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1468] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1469] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1470] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1471] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1472] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1473] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1474] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1475] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1476] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1477] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1478] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1479] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1480] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. The service is primarily provided via a common messaging app such as LINE. Specific embodiments for implementing this system are described below.

[1481] Enforcing user authentication

[1482] User

[1483] You will need to launch the LINE app and add the official account of the DX consulting service for businesses as a friend. When using it for the first time, you will need to enter your company information and personal authentication information and submit it to the system.

[1484] Terminal

[1485] The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person's name, contact information, etc.

[1486] server

[1487] The received user authentication information is analyzed and stored in a database. An authentication token is then generated and sent to the user. By retaining the authentication token, the user can be identified in subsequent communications.

[1488] Sending and replying to messages

[1489] User

[1490] Once authentication is complete, you can send a question or request for advice via LINE. For example, you can send a message saying, "I want to create a website, but where should I start?"

[1491] Terminal

[1492] Sends the user's message to the server. The message is properly formatted via the LINE API and passed to the server.

[1493] server

[1494] The server that receives the message uses a natural language processing (NLP) engine to understand the content. Based on the content of the message, it generates an appropriate reply message. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[1495] Consulting Requests and Remote Consultations

[1496] User

[1497] If you need consulting, tap the "Get a Free Consultation" button. This will create a consulting request.

[1498] Terminal

[1499] When the "Get a Free Consultation" button is tapped, the event is sent to the server, and the request information is passed to the server.

[1500] server

[1501] It analyzes incoming consultation requests and runs an algorithm to match them with the appropriate experts. Once matching is complete, it sends a remote consultation date and communication link to the user and the expert.

[1502] Remote consultations

[1503] User

[1504] On the designated remote consultation date, you will begin a conversation with a specialist via LINE, using video calls or chat as needed.

[1505] Terminal

[1506] It displays the communication links and chat windows necessary for remote consultations, allowing users and experts to smoothly proceed with the consultation.

[1507] server

[1508] The content of the remote consultation will be recorded and stored in a database for future reference. This data will be used to improve the service and for future reference.

[1509] Guidance and next steps

[1510] User

[1511] You will be provided with specific guides for creating your website and digital transformation, with links to find more information. You will also be able to track your progress as you go through each step.

[1512] server

[1513] Based on user behavior, send them additional information or guidelines for next steps.

[1514] In this way, a system is realized that allows users (small and medium-sized enterprises) to easily receive professional support for DX and IT. At each step, servers, terminals, and users cooperate to provide services smoothly.

[1515] The processing flow will be explained below.

[1516] Step 1:

[1517] User: Launch the LINE app and add the official account of the corporate DX consulting service as a friend.

[1518] Step 2:

[1519] User: When using for the first time, enter company information and personal authentication information and send it to the system.

[1520] Step 3:

[1521] Device: The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person name, and contact information.

[1522] Step 4:

[1523] Server: Parses the received user authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[1524] Step 5:

[1525] User: After authentication is complete, send a question or inquiry via LINE message. For example, send a message saying, "I want to create a homepage, but where should I start?"

[1526] Step 6:

[1527] Device: Sends the user's message to the server via the LINE API.

[1528] Step 7:

[1529] Server: Receives the message and uses a natural language processing (NLP) engine to understand its content. Based on the content of the message, it generates an appropriate reply message. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[1530] Step 8:

[1531] Server: Sends the generated reply message to the user.

[1532] Step 9:

[1533] User: Check the returned message and ask further questions or ask for advice as necessary.

[1534] Step 10:

[1535] User: If you need consulting, tap the "Get a Free Consultation" button.

[1536] Step 11:

[1537] Device: When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[1538] Step 12:

[1539] Server: Analyzes the received consulting request and runs an algorithm to match the appropriate expert. Once matching is complete, it sends the remote consultation schedule and communication link to the user and the expert.

[1540] Step 13:

[1541] User: According to the designated remote consultation date, the user starts a conversation with the specialist via LINE.

[1542] Step 14:

[1543] Terminal: Displays the communication links and chat window necessary for remote consultation, allowing the user and expert to proceed with the consultation without any problems.

[1544] Step 15:

[1545] Server: Records the details of the remote consultation and stores them in a database for future reference.

[1546] Step 16:

[1547] Users are provided with specific guides for creating a website and digital transformation, with links to find more information. They can track their progress as they go through each step.

[1548] Step 17:

[1549] Server: Based on the user's actions, sends additional information or guidelines for next steps.

[1550] Step 18:

[1551] Users: Send feedback and rate the service, which the system uses to improve the service.

[1552] Example 1

[1553] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1554] For small and medium-sized enterprises seeking support for digital transformation (DX) and IT adoption, the procedures are complicated and specialized knowledge and resources are limited, making it difficult to receive expert support easily and efficiently. There is also a need for a system that can efficiently communicate with users and provide them with the necessary information in a timely manner.

[1555] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1556] In this invention, the server includes: [means for receiving user authentication information via communication means and authenticating the user; [means for analyzing messages from the authenticated user and understanding the content using natural language processing; [means for generating a reply message based on the analyzed content and sending it to the user;] [means for receiving consulting requests from users and matching them with appropriate experts;] [means for generating a communication link for conducting remote consultations and providing it to the user and the expert;] [means for recording the content of the remote consultation and saving it in a database for later reference;] [means for generating an authentication token so that the user can be identified in subsequent communications; and [means for monitoring the user's progress and sending guidelines for proceeding to the next step.] This makes it possible [for small and medium-sized enterprises to easily receive consulting on digital transformation and IT adoption].

[1557] "User authentication information" refers to the information provided by the user for authentication, including the company name, the name of the person in charge, and contact information.

[1558] "Communication means" refers to the technologies and protocols for sending and receiving data, including the Internet and APIs.

[1559] "Natural language processing" is a technology that allows computers to understand and analyze human language.

[1560] "Message" refers to text, questions, inquiries, etc. sent by users.

[1561] "Reply message" refers to the response that the server generates to the parsed message.

[1562] "Consulting Request" means a request by a User for expert consultation.

[1563] An "expert" is an individual with advanced knowledge or experience in a particular field.

[1564] "Remote consultation" refers to consultation conducted from a physically distant location using online communication means.

[1565] "Communication link" refers to connection information for remote consultation, including URLs and application links.

[1566] An "authentication token" refers to an electronic key or identification information that uniquely identifies a user.

[1567] A "database" is a system for efficiently storing, searching, and managing large amounts of data.

[1568] "Guidelines" refers to instructions and reference information to help users take the next step.

[1569] "Progress" refers to the work and achievements that a user has made.

[1570] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. The service is primarily provided via a common messaging app that is easy for users to use. Specific embodiments for implementing this system are described below.

[1571] Enforcing user authentication

[1572] User

[1573] Users launch a messaging app on their smartphone or computer and add the official account of this system as a friend. When using the system for the first time, they enter company information (company name, person in charge, etc.) and personal authentication information (contact information, etc.) and send it to the system. This allows user authentication information to be collected.

[1574] Terminal

[1575] The device sends the authentication information entered by the user to the server via a messaging API (e.g., LINE API), including information such as the company name, person in charge, and contact information.

[1576] server

[1577] The server analyzes the received user authentication information and stores it in a database. It then generates an authentication token and sends it to the user. By retaining this authentication token, the server can identify the user in future communications.

[1578] Sending and replying to messages

[1579] User

[1580] After the user is authenticated, they can use the messaging app to send a question or request for advice, such as, "I want to create a website, where do I start?"

[1581] Terminal

[1582] The device sends the user's message to the server via the messaging API, which formats the message appropriately and passes it to the server.

[1583] server

[1584] The server analyzes the received message using a natural language processing (NLP) engine (for example, Google Cloud NLP or IBM Watson) to understand its content. Based on the analysis results, it generates an appropriate reply message and sends it to the user. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[1585] Consulting Requests and Remote Consultations

[1586] User

[1587] If the user wishes to receive consulting, they tap the "Get a Free Consultation" button, which will send a consulting request.

[1588] Terminal

[1589] The device sends this request event to the server via the messaging API, and the request information is passed to the server.

[1590] server

[1591] The server analyzes the received consultation request and runs an algorithm to match the request with an appropriate expert. Once matching is complete, the server sends the user and the expert a remote consultation schedule and a communication link, including a link to an online meeting tool (e.g., a Zoom link).

[1592] Remote consultations

[1593] User

[1594] The user will then schedule a remote consultation and begin a conversation with the specialist via a messaging app, using video calls or chats as needed.

[1595] Terminal

[1596] The terminal displays the necessary communication links and chat windows for remote consultation, allowing the user and the expert to smoothly proceed with the consultation.

[1597] server

[1598] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve the service and as a reference for future use.

[1599] Guidance and next steps

[1600] User

[1601] Users receive specific guidance on creating a website and digital transformation, click on the provided links to find more information, and track their progress as they go through each step.

[1602] server

[1603] The server monitors the user's behavior and progress and sends them additional information and guidelines for next steps, such as "Next, let's focus on SEO. Click the link below for more information."

[1604] Specific examples

[1605] Enforcing user authentication

[1606] Example sentence: "Hello, our company name is ABC Corporation, and our representative is Taro Yamada. We would like to use your DX consulting services."

[1607] Sending and replying to messages

[1608] Example message: "I want to create a website, where do I start?"

[1609] Example response: "First get your domain, then choose a template."

[1610] Consulting Requests and Remote Consultations

[1611] Event example: Tap "Get a free consultation"

[1612] Example of a remote consultation schedule notification: "The remote consultation will be held on October 15th at 3:00 PM. Please join us using the link below."

[1613] In this way, a system is realized that allows users to easily receive professional support for DX and IT. Servers, terminals, and users can fulfill their respective roles, enabling services to be provided smoothly.

[1614] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1615] Step 1: Add the official account as a friend

[1616] The user launches a messaging app on their smartphone or computer and adds the system's official account as a friend.

[1617] Input: QR code or link of official account

[1618] Output: Notification that official account has been added

[1619] Step 2: Enter and submit your credentials

[1620] The user enters company information (company name, contact name, etc.) and personal authentication information (contact information, etc.) into a messaging app and sends the message.

[1621] The device sends the entered authentication information to the server via the LINE API.

[1622] Input: Company name, contact name, contact details, and other authentication information

[1623] Output: Notification of completion of authentication information transmission

[1624] Step 3: Parse and store credentials

[1625] The server parses the received authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[1626] Input: Credentials

[1627] Output: Authentication token and authentication completion notification

[1628] Step 4: Submit your question or request

[1629] A user sends a question or request for advice via LINE message. For example, "I want to create a homepage, but where should I start?"

[1630] The device sends the user's message to the server via the LINE API.

[1631] Input: User questions and inquiries

[1632] Output: Message sent notification

[1633] Step 5: Parsing the message and generating a response

[1634] The server analyzes the received message using a natural language processing (NLP) engine to understand its content, and based on the analysis results, generates an appropriate reply message and sends it to the user.

[1635] Input: User's message

[1636] Output: Reply message

[1637] Step 6: Submit a Consulting Request

[1638] A user submits a consultation request by tapping the "Get a Free Consultation" button in a messaging app.

[1639] The device sends the event to the server via the LINE API.

[1640] Input: Consulting request event

[1641] Output: Request sent notification

[1642] Step 7: Analyzing and matching consulting requests

[1643] The server analyzes the received consultation request and runs an algorithm to match the request with a suitable expert. After matching is complete, it sends a remote consultation date and a communication link to the user and the expert.

[1644] Input: Consulting Request

[1645] Output: Remote consultation schedule and communication link

[1646] Step 8: Start the consultation according to the remote consultation schedule

[1647] The user will initiate a conversation with the specialist via LINE on the designated remote consultation date, using video calls and chats as needed.

[1648] The terminal displays the communication links and chat windows necessary for remote consultation.

[1649] Input: Remote consultation date

[1650] Output: Remote consultation started

[1651] Step 9: Record the remote consultation

[1652] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve the service and as a reference for future use.

[1653] Input: Remote consultation details

[1654] Output: Recorded consultation content

[1655] Step 10: Providing guidance and next steps

[1656] The server monitors the user's progress and sends additional information or guidelines for next steps.

[1657] Users receive specific guides on creating a homepage and digital transformation, and can click on the provided links to find out more information.

[1658] Input: User progress information

[1659] Output: Additional information or guidelines for next steps

[1660] Through these steps, this system enables small and medium-sized enterprises to easily receive consulting on digital transformation and IT implementation.

[1661] (Application example 1)

[1662] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1663] When operators of small and medium-sized enterprises and individual stores receive consulting for digital transformation (DX) or IT implementation, they face problems such as complicated procedures, the need for specialized knowledge, and difficulty in accessing appropriate experts. The present invention solves these problems by providing a system that allows these operators to easily receive support for DX and IT implementation.

[1664] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1665] In this invention, the server includes means for receiving user authentication information via a communication means and authenticating the user, means for analyzing a message from the authenticated user and understanding the content using natural language processing, and means for generating a reply message based on the analyzed content and sending it to the user, thereby enabling operators of small and medium-sized enterprises and individual stores to easily receive professional support.

[1666] "Communication means" refers to the interface and protocol for sending and receiving authentication information and messages between the user and the server.

[1667] "User authentication information" refers to information for identifying a specific user, such as the company name, the name of the person in charge, and contact information.

[1668] An "authentication token" is a unique identifier issued by a server to a user to indicate that the user has been authenticated.

[1669] "Natural language processing" is a technology that analyzes the content of text messages sent by users and converts them into a format that a program can understand.

[1670] A "reply message" is a response message generated by the server based on the analyzed content of the user's message.

[1671] A "consulting request" is a request sent by a User to a Server for professional advice or assistance.

[1672] "Expert matching" refers to the process of selecting the person with the most appropriate expertise based on the user's consulting request.

[1673] "Remote consultation" is a form of consultation in which a user and an expert communicate with each other while physically separated from each other.

[1674] "Communication Link" means the connection link over the Internet shared by the User and the Expert for conducting the Remote Consultation.

[1675] "Database" refers to data storage for recording and managing the content of remote consultations, user authentication information, etc.

[1676] The "analyzed content" refers to the content resulting from analyzing the user's message using natural language processing.

[1677] A "question about store management" is a question that a user sends to the server to ask for advice on store management and operation methods.

[1678] The "Store Management Consulting Guide" is a guideline that provides specific steps and advice aimed at improving store management.

[1679] This invention provides a system that allows operators of small and medium-sized enterprises and individual stores to easily receive consulting on digital transformation (DX) and IT. The system includes a communication means, a user authentication function, a message analysis function, a reply message generation function, an expert matching function, a remote consultation function, and a database storage function.

[1680] The server receives the user authentication information sent by the user through the LINE app or a similar messaging app, and authenticates the user based on that information. Authentication uses identification information such as the company name, person in charge, and contact information. Once authentication is complete, the server generates an authentication token and sends it to the user. This makes it possible to identify the user in future communications.

[1681] When an authenticated user sends a LINE message with a question or request for advice, the server analyzes the message using a natural language processing (NLP) engine. This analysis allows the content of the message to be understood and an appropriate reply message to be generated. For example, if a user sends a message saying, "I would like to install a new cash register system," the server will generate a reply based on the analysis results, such as, "We will provide you with information about installing a cash register system. First, please list your budget and required features," and send it to the user.

[1682] When a user wants to consult, they tap a specific button to generate a consultation request. The request is forwarded to the server, which runs an algorithm to match the user with a suitable expert. Once the expert is identified, the server creates a communication link for the remote consultation and provides it to both the user and the expert.

[1683] When a remote consultation is conducted, the server records the details and stores them in a database for future reference. This allows past consultation details to be used to improve future consulting and services.

[1684] For this system to function effectively, the following hardware and software are used:

[1685] Hardware: Cloud-based servers (e.g., AWS, Google Cloud), users' smartphones

[1686] Software: LINE API, Google Cloud Natural Language API, Flask

[1687] As an example of a specific prompt sentence, if a user wants to consult about the implementation of a new cash register system, the prompt sentence is as follows.

[1688] I'd like to install a new cash register system. Which one would you recommend?

[1689] This invention will enable small and medium-sized enterprises and individual store operators to easily receive support for DX and IT adoption without specialized knowledge, thereby realizing more efficient and advanced store operations.

[1690] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1691] Step 1:

[1692] A user launches the LINE app and adds the official account as a friend. They then enter the company information and personal authentication information required for authentication and submit it to the system. This information includes the company name, contact person's name, contact information, etc.

[1693] Input: Company information, personal authentication information

[1694] Output: Authentication information sent to the server

[1695] Step 2:

[1696] The device sends user authentication information to the server via the LINE API. The server analyzes the received user authentication information and stores it in a database. It then generates an authentication token and sends it to the user.

[1697] Input: User credentials

[1698] Output: Authentication token

[1699] Step 3:

[1700] After the user is authenticated, they can send a question or inquiry to the server using a LINE message. For example, they can send a message such as, "I want to create a homepage, but where should I start?"

[1701] Input: User questions and inquiries

[1702] Output: A message is sent to the server

[1703] Step 4:

[1704] The device sends a message from the user to the server via the LINE API, and the server receives the message and analyzes its content using a natural language processing (NLP) engine.

[1705] Input: User's message

[1706] Output: Analysis results

[1707] Step 5:

[1708] The server generates a reply message based on the parsed content and sends it to the user via the LINE API. For example, it might say, "We'll guide you through the steps to create your homepage. First, get a domain, then choose a template."

[1709] Input: Analysis results

[1710] Output: Reply message

[1711] Step 6:

[1712] A user taps a specific button to generate a consulting request, for example, by tapping the "Get a Free Consult" button.

[1713] Input: User button tap action

[1714] Output: Consulting Request

[1715] Step 7:

[1716] The device sends a consultation request to the server via the LINE API, which receives the request and runs an algorithm to match the appropriate expert.

[1717] Input: Consulting Request

[1718] Output: Matching results with experts

[1719] Step 8:

[1720] The server generates a communication link for remote consultation and sends it to the user and the expert, so that the user and the expert can start the remote consultation without any problems.

[1721] Input: Expert matching results

[1722] Output: Communication link

[1723] Step 9:

[1724] The user will follow the designated remote consultation date and begin a conversation with the specialist via LINE, using video calls and chat as needed.

[1725] Input: Communication link, remote consultation available

[1726] Output: Conducting a remote consultation

[1727] Step 10:

[1728] The server records the details of the remote consultation and stores them in a database for future reference. This data is used to improve future consultations and services.

[1729] Input: Remote consultation details

[1730] Output: Recorded remote consultation data

[1731] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1732] This invention is a system that allows small and medium-sized enterprises to easily receive consulting services for digital transformation (DX) and IT implementation. In particular, by combining it with an emotion engine that recognizes the user's emotions, it provides more user-friendly support. The service is mainly provided via a general messaging app. Specific embodiments for implementing this system are described below.

[1733] Enforcing user authentication

[1734] User

[1735] Launch the LINE app and add the official account of the enterprise DX consulting service as a friend. When using for the first time, enter your company information and personal authentication information and submit it to the system.

[1736] Terminal

[1737] The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person's name, contact information, etc.

[1738] server

[1739] The received user authentication information is analyzed and stored in a database. An authentication token is then generated and sent to the user. By retaining the authentication token, the user can be identified in subsequent communications.

[1740] Sending and replying to messages

[1741] User

[1742] Once authentication is complete, you can send a question or request for advice via LINE. For example, you can send a message saying, "I want to create a website, but where should I start?"

[1743] Terminal

[1744] Sends the user's message to the server. The message is properly formatted via the LINE API and passed to the server.

[1745] server

[1746] The server that receives the message uses a natural language processing (NLP) engine to understand its content. Based on the content of the message, it generates an appropriate reply message. It also uses an emotion engine to recognize the user's emotions and adjusts the reply message accordingly. For example, if the server recognizes that the user is "in trouble," it will respond with more helpful and specific guidance.

[1747] Use of emotion engine

[1748] server

[1749] Using an emotion engine, the system analyzes the emotions in the user's message and adjusts the system's response. For example, if the user uses words that indicate "anxiety," the server will send an encouraging message such as, "Don't worry. Try these steps first."

[1750] Consulting Requests and Remote Consultations

[1751] User

[1752] If you need consulting, tap the "Get a Free Consultation" button. This will create a consulting request.

[1753] Terminal

[1754] When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[1755] server

[1756] The system analyzes incoming consultation requests and runs an algorithm to match them with the appropriate experts. Once matching is complete, it sends a remote consultation date and communication link to the user and the expert. The emotion engine also works here, informing the expert of the user's emotional state.

[1757] Remote consultations

[1758] User

[1759] On the designated remote consultation date, you will begin a conversation with a specialist via LINE, using video calls or chat as needed.

[1760] Terminal

[1761] It displays the communication links and chat windows necessary for remote consultations, allowing users and experts to smoothly proceed with the consultation.

[1762] server

[1763] The content of the remote consultation is recorded and saved in a database for future reference. The emotion engine runs during the remote consultation, recording changes in the user's emotions in real time and saving them in a database.

[1764] Guidance and next steps

[1765] User

[1766] You will be provided with specific guides for creating your website and digital transformation, with links to find more information. You will also be able to track your progress as you go through each step.

[1767] server

[1768] Based on the user's behavior, it sends additional information or guidelines for next steps. It uses an emotion engine to provide supplemental information or additional support if the user is experiencing difficulties.

[1769] In this way, a system will be realized that allows users (small and medium-sized enterprises) to easily receive professional support for digital transformation and IT. The introduction of the emotion engine is expected to further improve the user experience and provide more effective support.

[1770] The processing flow will be explained below.

[1771] Step 1:

[1772] User: Launch the LINE app and add the official account of the corporate DX consulting service as a friend.

[1773] Step 2:

[1774] User: When using for the first time, enter company information and personal authentication information and send it to the system.

[1775] Step 3:

[1776] Device: The entered authentication information is sent to the server via the LINE API. This information includes the company name, contact person name, and contact information.

[1777] Step 4:

[1778] Server: Parses the received user authentication information, stores it in a database, then generates an authentication token and sends it to the user.

[1779] Step 5:

[1780] User: After authentication is complete, send a question or inquiry via LINE message. For example, send a message saying, "I want to create a homepage, but where should I start?"

[1781] Step 6:

[1782] Device: Sends the user's message to the server via the LINE API.

[1783] Step 7:

[1784] Server: Receives the message, understands its content using a natural language processing (NLP) engine, and generates an appropriate reply message based on the message content.

[1785] Step 8:

[1786] Server: Analyzes the user's emotions using an emotion engine. For example, if the user's message indicates an "anxious" emotion, adjust the response.

[1787] Step 9:

[1788] Server: Sends a tailored response message to the user, such as "We'll guide you through the steps to create your homepage. Don't worry, first get a domain, then choose a template."

[1789] Step 10:

[1790] User: Check the reply message and send the next question or inquiry by message.

[1791] Step 11:

[1792] User: If you need consulting, tap the "Get a Free Consultation" button.

[1793] Step 12:

[1794] Device: When the "Get a Free Consultation" button is tapped, the event is sent to the server via the LINE API.

[1795] Step 13:

[1796] Server: Analyzes incoming consulting requests and runs algorithms to match them with the appropriate experts.

[1797] Step 14:

[1798] Server: Once matching is complete, it sends the remote consultation schedule and communication link to the user and the expert.

[1799] Step 15:

[1800] Server: Using the emotion engine, informs the expert of the user's emotional state before the remote consultation.

[1801] Step 16:

[1802] User: According to the designated remote consultation date, the user starts a conversation with the specialist via LINE.

[1803] Step 17:

[1804] Terminal: Displays the communication links and chat window necessary for remote consultation, allowing the user and expert to proceed with the consultation without any problems.

[1805] Step 18:

[1806] Server: Runs the emotion engine during remote consultations, records changes in the user's emotions in real time, and notifies the expert.

[1807] Step 19:

[1808] Server: Records the details of the remote consultation and stores them in a database for future reference.

[1809] Step 20:

[1810] Users are provided with a guide to creating a website or digital transformation, and can click on links to learn more. They can follow their progress as they go through each step.

[1811] Step 21:

[1812] Server: Based on the user's behavior and emotions, sends additional information or guidelines for next steps.

[1813] Step 22:

[1814] Users: Send feedback and rate the service, which the system uses to improve the service.

[1815] Example 2

[1816] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1817] Small and medium-sized enterprises (SMEs) face a wide range of challenges when implementing digital transformation (DX) and IT adoption. They often lack specialized knowledge and experience, and sometimes have difficulty accessing appropriate experts. For this reason, there is a need for support to efficiently and effectively advance DX and IT adoption. Another major issue is the lack of systems that can respond while taking user emotions into consideration.

[1818] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving user authentication information via a communication means and authenticating the user, a means for analyzing a message from the authenticated user and understanding the content using natural language processing, and a means for generating a reply message based on the analyzed content and sending it to the user. This enables small and medium-sized enterprises (SMEs) to receive effective DX and IT support even if they do not have specialized knowledge. Furthermore, the introduction of an emotion engine enables recognition of user emotions and more user-friendly responses.

[1819] "Means of communication" refers to the technologies and protocols used to send and receive data over the Internet, primarily HTTP and HTTPS.

[1820] "User authentication information" is information for verifying the identity of a user, and includes the company name, the name of the person in charge, contact information, and the like.

[1821] "Natural language processing" is a technology that allows machines to understand human language, and refers to technologies that perform text analysis and context understanding.

[1822] A "reply message" refers to a message generated by a server in response to a message from a user.

[1823] An "emotion engine" refers to technology that analyzes emotions from a user's message and adjusts responses based on the results.

[1824] "Consulting Request" means a request submitted by a User for professional assistance or advice.

[1825] An "expert" is someone who has advanced knowledge and experience in a particular field.

[1826] "Remote consultation" refers to the exchange of advice and consultation with experts in remote locations via the Internet.

[1827] "Communication link" refers to the URL and connection information required to conduct a remote consultation, and is the means of connecting the user and the expert.

[1828] "Database" means an electronic repository for storing data collected by the System.

[1829] This invention is a system that allows small and medium-sized enterprises to easily receive consulting on digital transformation (DX) and IT implementation, and is combined with an emotion engine that recognizes user emotions. This system provides services mainly via general messaging apps. Specific embodiments for implementing this system are described below.

[1830] Enforcing user authentication

[1831] First, the user launches the LINE app and adds the official account of the enterprise digital transformation consulting service as a friend. When using the service for the first time, the user enters company information such as the company name, person in charge, and contact information, as well as personal authentication information, and sends it to the system. This information is sent to the server via the LINE API from the device. The server analyzes the received authentication information and stores it in a database. Next, an authentication token is generated and sent to the user, making it possible to identify the user in future communications.

[1832] Sending and replying to messages

[1833] Once authenticated, users can send questions or inquiries via LINE chat. For example, they can send a message like, "I want to create a homepage, but where do I start?" This message is sent to the server via the LINE API from the device. The server analyzes the received message using a natural language processing (NLP) engine and generates an appropriate reply message. It also uses an emotion engine to recognize the user's emotions and adjusts the reply message based on the results. For example, if the user is "in trouble," the response will be more helpful and provide more specific guidance.

[1834] Use of emotion engine

[1835] The emotion engine analyzes the emotions in the user's message and adjusts the system's response. For example, if the user uses words that indicate "anxiety," the server will send an encouraging message such as "Don't worry. Try these steps first." This makes support for the user more personalized and user-friendly.

[1836] Consulting Requests and Remote Consultations

[1837] A user initiates a consultation request by tapping the "Get a Free Consultation" button. This request is sent from the device to the server via the LINE API. The server analyzes the received consultation request and runs an algorithm to match an appropriate expert. Once matching is complete, a remote consultation date and communication link are sent to the user and the expert. The emotion engine also works here, notifying the expert of the user's emotional state.

[1838] Remote consultations

[1839] The user begins a conversation with the expert via LINE according to the designated remote consultation date. Video calls and chat can be used as needed. The device displays a communication link and chat window for the remote consultation, allowing the user and expert to smoothly proceed with the consultation. The server records the content of the remote consultation and saves it in a database for future reference. The emotion engine continues to operate during the remote consultation, recording changes in the user's emotions in real time and saving them in a database.

[1840] Guidance and next steps

[1841] Users click on provided guides and links for more information and progress as they perform each step. Based on the user's actions, the server sends additional information and guidelines for the next step. It also uses an emotion engine to provide supplemental information and additional support if the user is experiencing difficulty.

[1842] This allows users (small and medium-sized enterprises) to easily receive professional support for DX and IT. The introduction of an emotion engine in this system is expected to further improve the user experience and provide more effective support.

[1843] Prompt Sentence Examples

[1844] For example, by inputting a prompt such as, "When supporting digital transformation in small and medium-sized enterprises, please tell us an example of a response when recognizing a user's anxiety using an emotion engine," into the generative AI model, it is possible to obtain a specific example response.

[1845] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1846] Step 1:

[1847] Users launch the LINE app and add the official account of the enterprise DX consulting service as a friend. Next, when using the service for the first time, they enter authentication information such as the company name, person in charge, and contact information, and send this information to the system. The input data is entered via the LINE app's UI and sent to the device as transmission data.

[1848] Step 2:

[1849] The device sends the authentication information entered by the user to the server via the LINE API. The device converts this data into packets using a secure protocol (e.g., HTTPS) and transmits them to the server over the network. The input is the user's authentication information, and the output is an HTTP request to the server.

[1850] Step 3:

[1851] The server analyzes the received authentication information and saves the user's company information and personal authentication information in a database. At this time, it stores the data in the database using an SQL query. Next, the server generates an authentication token and sends it to the user. The input is the authentication information, and the output is the database storage result and the authentication token.

[1852] Step 4:

[1853] Once authentication is complete, the user can use LINE's chat function to send a question or request for advice. For example, they can send a message like, "I want to create a homepage, but where do I start?" The input is the user's text message, and the output is the expected sending status of the message as it arrives at the device via the LINE API.

[1854] Step 5:

[1855] The device sends messages from the user to the server via the LINE API. At this time, the messages are formatted in JSON and transmitted to the server over a secure communication channel. The input is the message sent by the user, and the output is an HTTP request to the server.

[1856] Step 6:

[1857] The server analyzes the received message using a natural language processing (NLP) engine. This analysis identifies the user's intent and question. It then runs an algorithm to generate a reply message. It also uses an emotion engine to recognize the user's emotion and adjust the reply message accordingly. The input is the user's message, and the output is the analysis result and the reply message.

[1858] Step 7:

[1859] The emotion engine analyzes the emotions from the user's message. For example, if the user uses words indicating "anxiety," the server uses the emotion data to send an encouraging message such as "Don't worry. Try these steps first." The input is the user's emotion level, and the output is a tailored reply message.

[1860] Step 8:

[1861] The user taps the "Get a Free Consultation" button to request a consultation. This event is transmitted to the device via the LINE app UI. The input is the user's button click event, and the output is a notification to the device.

[1862] Step 9:

[1863] The device sends a message to the server via the LINE API that the "Get a Free Consultation" button has been tapped. This message contains event data in JSON format and is transmitted to the server via secure communication. The input is a button click event, and the output is an HTTP request to the server.

[1864] Step 10:

[1865] The server analyzes the received consulting request and runs an algorithm to match the appropriate expert. Once matching is complete, it sends a remote consultation schedule and a communication link to the user and the expert. The emotion engine also works here to inform the expert of the user's emotional state. The input is the consulting request, and the output is the matching result and the communication link.

[1866] Step 11:

[1867] The user starts a conversation with the specialist via LINE according to the specified remote consultation date. Video calls and chats can be used as needed. The input is a notification of the remote consultation date, and the output is the start of a video call or chat.

[1868] Step 12:

[1869] The terminal displays the communication links and chat windows necessary for remote consultation, allowing the user and the expert to proceed with the consultation without any problems. The input is the communication link, and the output is the displayed chat window or video call link.

[1870] Step 13:

[1871] The server records the content of the remote consultation and saves it in a database. This data is saved for future reference. The emotion engine also runs during the consultation, recording the user's emotional changes in real time and saving them in the database. The input is the content of the remote consultation, and the output is the recorded consultation data and emotion data.

[1872] Step 14:

[1873] The user clicks on the provided guides and links to find out more information and see their progress as they perform each step. The input is the guide links and the output is the display of detailed information.

[1874] Step 15:

[1875] Based on the user's behavior, the server sends additional information and guidelines for the next step. It uses an emotion engine to provide supplementary information and additional support if the user is experiencing difficulty. The input is the user's behavior data, and the output is information about the next step and additional support.

[1876] (Application example 2)

[1877] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1878] The purpose of this invention is to make it easier for small and medium-sized enterprises to receive digital transformation (DX) and IT consulting. However, the emotional state of users is often ignored during this process. Furthermore, in workplaces where factory robots are used, robot maintenance and troubleshooting are often inefficient. This leads to problems that reduce business efficiency in small and medium-sized enterprises.

[1879] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1880] In this invention, the server includes: [means for receiving user authentication information via communication means and authenticating the user;] means for analyzing a message from the authenticated user and understanding the content using natural language processing; [means for generating a reply message based on the analyzed content and sending it to the user;] means for analyzing the user's emotional state and generating an appropriate reply message according to the emotion; [means for receiving a consulting request from the user and matching with an appropriate expert;] means for generating a communication link for conducting a remote consultation and providing it to the user and the expert; [means for recording the content of the remote consultation and saving it in a database for later reference;] means for continuously monitoring the user's emotional state and saving the analysis results in a database in real time; and [means for monitoring the status of factory robots and supporting maintenance and troubleshooting as needed.] This makes it possible to provide digital transformation support while taking the user's emotional state into consideration, and further realizes efficient management and maintenance of factory robots.

[1881] A "communication means" is an intermediary device for transmitting data from a user to a server and for transmitting data from the server to a user.

[1882] "User authentication information" is a general term for data used to identify a user and verify their identity, and includes the company name, the name of the person in charge, contact information, etc.

[1883] "Natural language processing" is a technology for analyzing text entered by a user and understanding its content.

[1884] A "reply message" is a message that is generated based on the user's message analyzed by the server and sent to the user.

[1885] "Emotional state" refers to a psychological state that can be recognized from the user's input message, and includes anxiety, confusion, relief, and the like.

[1886] A "consulting request" is a request submitted by a User for professional advice or assistance.

[1887] An "expert" is someone with advanced knowledge and skills in a particular field, and is matched with a user's specific needs.

[1888] A "communication link" is a digital connection for conducting a remote consultation, and can take the form of chat, video call, or other similar means.

[1889] A "database" is a system that stores information systematically and allows it to be retrieved as needed.

[1890] "Monitoring" is the act of continuously observing and recording the condition of a specific object.

[1891] "Maintenance" refers to the maintenance work carried out to keep equipment and systems in good operating condition.

[1892] "Troubleshooting" is the process of identifying the cause and finding a solution when a malfunction or problem occurs.

[1893] This invention is a system that allows small and medium-sized enterprises to easily receive digital transformation (DX) and IT consulting. This system provides a user-friendly experience by analyzing the user's emotional state and providing support accordingly. It also supports efficient management and maintenance of factory robots.

[1894] System Overview

[1895] The main components are the server, terminal, and user, each of which plays a specific role. The server uses communication means, a natural language processing (NLP) engine, an emotion engine, an expert matching algorithm, and a database. The terminal is a medium for receiving input information from the user and sending it to the server. The user is the entity that uses each function of the system.

[1896] Specific processing explanation of the program

[1897] The server receives user authentication information via communications means and authenticates the user. Next, it analyzes the message from the authenticated user and understands the content using an NLP engine. A reply message is generated based on the analyzed content and sent to the user. During this process, an emotion engine analyzes the user's emotional state and generates a reply message accordingly. Furthermore, it receives a consulting request from the user and selects the most suitable expert using an expert matching algorithm. A communication link for the remote consultation is generated and provided to the user and the expert. The content of the remote consultation is also recorded and saved in a database for future reference. To perform these processes, generative AI models such as an NLP engine, emotion engine, and expert matching algorithm are used.

[1898] The specific hardware and software used are as follows:

[1899] LINE Messaging API: A means of communication with users.

[1900] EmotionEngine API: An engine for emotion analysis.

[1901] Robot Management API: Health monitoring and troubleshooting of factory robots.

[1902] Flask: A lightweight web framework.

[1903] Specific examples

[1904] When a factory robot operator sends a LINE message saying, "The robot is experiencing an error, please help!", the system detects the user's anxiety with its emotion engine and checks the robot's status. The system then sends a reply message saying, "Error code 12345 has been detected. The solution is to restart the robot's power. Please stay calm, I'll support you."

[1905] Example of a generative AI model prompt:

[1906] Message text: "Robot is having an error, please help!"

[1907] Prompt: "Have your emotion engine analyze the emotion of this message, and if anxiety is detected, provide an error code, a suggested solution, and add a reassuring message to the user."

[1908] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1909] Step 1:

[1910] The device receives the authentication information sent by the user via the LINE app, including the company name, contact name, contact information, etc. The device then formats this information appropriately and sends it to the server via the LINE API.

[1911] Input: Authentication information entered by the user into the LINE app

[1912] Output: Authentication information sent to the server via the LINE API

[1913] Step 2:

[1914] The server analyzes the authentication information received via the communication means, generates an authentication token for authenticating the user, and sends the authentication token to the user. The token is used in subsequent communications to identify the user.

[1915] Input: User authentication information sent from the device

[1916] Output: Authentication token and the user who holds it

[1917] Step 3:

[1918] After completing authentication, the user can send a message to the robot with their concerns, such as "The robot is showing an error, please help!"

[1919] Input: Consultation message sent by the user

[1920] Output: Message sent to the server via the LINE API

[1921] Step 4:

[1922] The server analyzes the received message using a natural language processing (NLP) engine to understand its content, and simultaneously analyzes the user's emotional state using an emotion engine.

[1923] Input: Message sent by the user

[1924] Output: Parsed message content and emotional state

[1925] Step 5:

[1926] The server generates an appropriate reply message based on the analyzed message content and the user's emotional state. For example, if anxiety is detected, it generates a message containing encouraging words. The reply message is then sent to the user via the LINE API.

[1927] Input: Parsed message content and emotional state

[1928] Output: Reply message sent to the user

[1929] Step 6:

[1930] The user generates a consulting request by tapping the "Get a Free Consultation" button provided by the system.

[1931] Input: User taps a button

[1932] Output: Consulting request sent to the server via the LINE API

[1933] Step 7:

[1934] The server analyzes the received consultation request and executes an algorithm to match the expert. Once a suitable expert is selected, the server creates a communication link for the remote consultation and provides it to the user and the expert.

[1935] Input: Consulting request submitted by user

[1936] Output: Communication link for remote consultation

[1937] Step 8:

[1938] When a remote consultation begins, the server records the content of the remote consultation and stores it in a database. It also analyzes the user's emotional state in real time and records any changes in that state in the database.

[1939] Input: Conversation content and emotion data during remote consultation

[1940] Output: Remote consultation content and emotion data stored in a database

[1941] Step 9:

[1942] The server monitors the status of the factory robots and generates messages to support appropriate maintenance and troubleshooting in the event of a problem, including the ability to interpret robot error codes and provide solutions.

[1943] Input: Factory robot status data

[1944] Output: Reply messages regarding robot maintenance and troubleshooting

[1945] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1946] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1947] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1948] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1949] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1950] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1951] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1952] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1953] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1954] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1955] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1956] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1957] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1958] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1959] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1960] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1961] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1962] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1963] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1964] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1965] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1966] The following is further disclosed regarding the above embodiment.

[1967] (Claim 1)

[1968] [Means for receiving user authentication information via a communication means and authenticating a user;

[1969] [Means for analyzing messages from authenticated users and understanding their content using natural language processing;

[1970] [means for generating and sending a reply message to the user based on the parsed content;

[1971] [Means for receiving consulting requests from users and matching them with appropriate experts;

[1972] [means for generating and providing a communication link to a user and an expert for conducting a remote consultation;

[1973] [Means of recording the content of remote consultations and storing them in a database for future reference;

[1974] A system including:

[1975] (Claim 2)

[1976] The system of claim 1, wherein the user generates a consulting request by tapping a specific button.

[1977] (Claim 3)

[1978] [The system of claim 1 provides guides and corresponding links based on information input by the user, and provides assistance with homepage creation and digital transformation.

[1979] "Example 1"

[1980] (Claim 1)

[1981] [Means for receiving user authentication information via a communication means and authenticating a user;

[1982] [Means for analyzing messages from authenticated users and understanding their contents using natural language processing;

[1983] [means for generating a reply message based on the analyzed content and sending it to the user;

[1984] [Means for receiving consulting requests from users and matching them with appropriate experts;

[1985] [means for generating and providing a communication link for conducting a remote consultation to a user and an expert;

[1986] [Means of recording the content of remote consultations and storing them in a database for future reference;

[1987] [means for generating an authentication token to identify the user in subsequent communications; and

[1988] [Means of monitoring the user's progress and sending guidelines for next steps; and

[1989] A system including:

[1990] (Claim 2)

[1991] [The system according to claim 1, wherein a user generates a consulting request by tapping a specific button.

[1992] (Claim 3)

[1993] [The system of claim 1 provides guides and corresponding links based on information input by users to assist with website creation and digital transformation.

[1994] "Application Example 1"

[1995] (Claim 1)

[1996] [Means for receiving user authentication information via a communication means and authenticating a user;

[1997] [Means for analyzing messages from authenticated users and understanding their content using natural language processing;

[1998] [means for generating and sending a reply message to the user based on the parsed content;

[1999] [Means for receiving consulting requests from users and matching them with appropriate experts;

[2000] [means for generating and providing a communication link to a user and an expert for conducting a remote consultation;

[2001] [Means of recording the content of remote consultations and storing them in a database for future reference;

[2002] [Means for analyzing questions about store management from users using natural language processing and generating consulting guides about store management;

[2003] A system including:

[2004] (Claim 2)

[2005] The system of claim 1, wherein the user generates a consulting request by tapping a specific button.

[2006] (Claim 3)

[2007] [The system of claim 1 provides guides and corresponding links based on information input by the user, and provides assistance with homepage creation and digital transformation.

[2008] "Example 2: Combining Emotion Engines"

[2009] (Claim 1)

[2010] [Means for receiving user authentication information via a communication means and authenticating a user;

[2011] [Means for analyzing messages from authenticated users and understanding their content using natural language processing;

[2012] [means for generating and sending a reply message to the user based on the parsed content;

[2013] [An emotion engine means for analyzing emotions from a user's message and adjusting a reply message;

[2014] [Means for receiving consulting requests from users and matching them with appropriate experts;

[2015] [means for generating and providing a communication link to a user and an expert for conducting a remote consultation;

[2016] [Means of recording the content of remote consultations and storing them in a database for future reference;

[2017] A system including:

[2018] (Claim 2)

[2019] The system of claim 1, wherein the user generates a consulting request by tapping a specific button.

[2020] (Claim 3)

[2021] [The system of claim 1 provides guides and corresponding links based on information input by the user, and provides assistance with homepage creation and digital transformation.

[2022] "Application example 2 when combining emotion engines"

[2023] (Claim 1)

[2024] [Means for receiving user authentication information via a communication means and authenticating a user;

[2025] [Means for analyzing messages from authenticated users and understanding their content using natural language processing;

[2026] [means for generating and sending a reply message to the user based on the parsed content;

[2027] [Means for analyzing the emotional state of a user and generating an appropriate reply message according to the emotional state;

[2028] [Means for receiving consulting requests from users and matching them with appropriate experts;

[2029] [means for generating and providing a communication link to a user and an expert for conducting a remote consultation;

[2030] [Means of recording the content of remote consultations and storing them in a database for future reference;

[2031] [Means for continuously monitoring the user's emotional state and storing the analysis results in a database in real time;

[2032] [Means to monitor the status of factory robots and support maintenance and troubleshooting as needed;

[2033] A system including:

[2034] (Claim 2)

[2035] The system of claim 1, wherein the user generates a consulting request by tapping a specific button.

[2036] (Claim 3)

[2037] [The system of claim 1 provides guides and corresponding links based on information input by the user, and provides assistance with homepage creation and digital transformation. [Explanation of symbols]

[2038] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for receiving user authentication information via a communication means and authenticating a user; means for analyzing messages from authenticated users and understanding their content using natural language processing; means for generating a reply message based on the analyzed content and sending it to the user; A means for receiving consulting requests from users and matching them with appropriate experts; means for generating and providing a communication link between the user and the expert for conducting a remote consultation; A means to record the content of remote consultations and store them in a database for future reference; A system including:

2. The system of claim 1 , wherein a user generates a consulting request by tapping a specific button.

3. The system according to claim 1, which provides guides and corresponding links based on information input by a user, and provides support for homepage creation and digital transformation.

Images