system

Abstract

We provide the system. [Solution] A means for users to input information about the tools and services they have started using, Means for storing the information of the input tools and services in a database, A means for users to search for information about specific tools or services, A means for obtaining information on tools and services that match specified conditions from the aforementioned database, Means for displaying the acquired information to the user, A means for users to contact other users based on the information they have selected, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventionally, when introducing new tools or services within an organization, it has been difficult to grasp information of other departments or users who are already using the same tools or services. As a result, effective knowledge sharing could not be achieved, and it took a long time from introduction to actual use. In addition, there was a problem that time and labor were wasted by each conducting individual investigations. The present invention aims to solve these problems and provide a system that can efficiently share information on tools and services and enable users to quickly communicate with each other.

Means for Solving the Problems

[0005] The present invention is a system that includes means for inputting information about tools and services that a user has started using, means for storing the inputted information about tools and services in a database, means for the user to search for information about specific tools and services, means for obtaining information about tools and services that match specified conditions from the database, means for displaying the obtained information to the user, and means for the user to contact other users based on the information selected by the user. This system enables efficient sharing of information related to the introduction of new tools and services within an organization and facilitates rapid communication.

[0006] A "user" refers to an individual or group that uses the system to register, search for, and communicate information about tools and services.

[0007] "Tools and services" refers to software, hardware, platforms, or professional services used within an organization.

[0008] "Means of inputting information" refers to devices or software that provide an interface or function for users to register data about tools and services (such as name, version, and start date of use) in a system.

[0009] A "database" refers to a system or device that structurally stores information about registered tools and services so that it can be searched and referenced later.

[0010] "Search methods" refer to the functions or interfaces that users use to find specific tools or service information within a database.

[0011] "Means of acquisition" refers to functions or software that retrieve information matching specified conditions from a database and provide it to the user.

[0012] "Means of display" refers to devices or interfaces that visually present acquired information on the user's device.

[0013] "Means of contact" refers to functions or software that allow a user to send notifications to other users of their choice and initiate communication. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiments for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention provides a system for users to connect with other users or departments already using the same tools or services when using new tools or services, allowing for the sharing of knowledge and experience. This system is expected to reduce research time and enable more efficient work execution.

[0036] 1. System Overview

[0037] This system allows users to input information about tools and services they start using and save it in a database. Other users can then search for information about the same tools and services, and based on the search results, connect with and contact users who are already using them.

[0038] 2. User Information Registration

[0039] Information input and saving

[0040] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, its version, the date it was started, and the department using it.

[0041] The terminal generates and sends a request to the server to send the entered information.

[0042] The server analyzes the received information and stores it in the database.

[0043] For example, if member A of the design team starts using "design tool X," member A will input information about "design tool X" and save it to the database.

[0044] 3. Searching for and obtaining information

[0045] Execute search

[0046] Users enter the name of a specific tool or service into the search form to find information about it.

[0047] The terminal generates a search query and sends it to the server.

[0048] The server searches the database based on the received query and retrieves matching information.

[0049] Displaying search results

[0050] The server sends the search results to the terminal.

[0051] The device displays search results to the user.

[0052] For example, if member B searches for information about "design tool X," member A's information will be found in the database and displayed on member B's terminal.

[0053] 4. Notifications and Communications

[0054] Selection of communication method

[0055] The user selects a user they want to contact from the search results.

[0056] The terminal sends a request to the server containing information about the selected user.

[0057] Execute notification

[0058] The server sends a notification to the selected user and a message to the specified contact (email or chat).

[0059] Presentation of notification results

[0060] The server returns the notification transmission result to the terminal, informing the user that the notification was successful.

[0061] The device displays a message to the user indicating that a notification has been sent.

[0062] For example, if member B wants to contact member A, member B can send a notification to member A through the system and make contact.

[0063] 5. System Advantages

[0064] This system allows users to quickly understand the tools and services being used by other users and departments within their organization, and to communicate efficiently. As a result, research time is reduced, knowledge and experience are shared throughout the organization, and work efficiency is improved.

[0065] This invention significantly simplifies the process of introducing new tools and services, reducing the time and effort required for research and communication.

[0066] The following describes the processing flow.

[0067] Information Registration

[0068] Step 1:

[0069] The user logs into the system.

[0070] Step 2:

[0071] The user opens the "Register for a new tool or service" form.

[0072] Step 3:

[0073] The user enters information about the tool or service (name, version, start date, department using it) into the form.

[0074] Step 4:

[0075] The user presses the "Register" button.

[0076] Step 5:

[0077] The terminal generates an HTTP request based on the information entered and sends it to the server.

[0078] Step 6:

[0079] The server parses the received request and saves the information to the database.

[0080] Step 7:

[0081] The server generates a response indicating successful registration and sends it to the terminal.

[0082] Step 8:

[0083] The device receives a response and displays a message to the user indicating that registration was successful.

[0084] Searching for and retrieving information

[0085] Step 1:

[0086] The user logs into the system.

[0087] Step 2:

[0088] The user opens the "Information Search" form.

[0089] Step 3:

[0090] Enter the name of the tool or service you want to search for.

[0091] Step 4:

[0092] The user presses the "search" button.

[0093] Step 5:

[0094] The terminal generates an HTTP request based on the entered keyword and sends it to the server.

[0095] Step 6:

[0096] The server searches the database based on the received request and retrieves matching information.

[0097] Step 7:

[0098] The server generates a response based on the search results and sends it to the terminal.

[0099] Step 8:

[0100] The device receives the response and displays the search results to the user.

[0101] Notifications and Contacts

[0102] Step 1:

[0103] The user selects the user they want to contact from the search results.

[0104] Step 2:

[0105] The device generates an HTTP request based on the selected user's information and sends it to the server.

[0106] Step 3:

[0107] The server parses the received request and retrieves the contact information of the selected user.

[0108] Step 4:

[0109] The server generates a notification message and sends it to the specified contact.

[0110] Step 5:

[0111] The server generates a response based on the notification transmission result and sends it to the terminal.

[0112] Step 6:

[0113] The device receives a response and displays to the user that the notification was successful.

[0114] This will enable users to efficiently connect with other users who are using existing tools and services, and to share knowledge and experience.

[0115] (Example 1)

[0116] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0117] When users begin using new tools or services, they often face difficulties sharing information with other users or departments already using the same tools or services, leading to lengthy research times and decreased work efficiency. This invention aims to solve these problems and enable rapid information sharing and efficient work execution within organizations.

[0118] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0119] In this invention, the server includes means for inputting information about tools and services that a user has started using, means for storing the inputted information about tools and services in a database, means for the user to search for information about specific tools and services, means for obtaining information about tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for the user to contact other users based on the information selected by the user, a terminal for transmitting the information input by the user to the server, means for the server to analyze the information received, and means for the server to send a message to a specified contact. This enables users to quickly share information with other users within the organization and communicate efficiently.

[0120] A "user" is an individual or entity that uses the system to perform actions such as entering, searching for, viewing, and communicating information about the tools and services.

[0121] "Tools and services" refers to the software, applications, platforms, or entire services that users utilize for their work or activities.

[0122] "Information" refers to data that includes data items such as the name, version, start date of use, and department that uses the tool or service.

[0123] "Means of input" refers to the interface or form that users use to input information about tools or services into a system.

[0124] "Means of saving to a database" refers to the functions and processes for storing information about entered tools and services in a database.

[0125] "Means of searching" refers to the functions or interfaces that allow users to search for information about specific tools or services.

[0126] "Means of acquisition" refers to the functions and processes used to search and retrieve information about tools and services that match specified criteria from a database.

[0127] "Means of display" refers to functions or interfaces that visually present acquired information to the user.

[0128] "Means of communication" refers to the means or interfaces that users use to communicate with other users.

[0129] A "terminal" refers to a device used by a user to access a system and perform operations such as entering information, searching, and making communications.

[0130] A "server" refers to a central system that manages the entire system and handles data storage, retrieval, analysis, and transmission.

[0131] "Means of analysis" refers to the functions and processes that allow a server to understand the user information it receives and take appropriate action.

[0132] "Means of sending messages to specified contacts" refers to the functions and methods that allow users to send messages to people they wish to contact.

[0133] This invention provides a system for users to connect with other users or departments already using the same tools or services when starting to use new tools or services, allowing for the sharing of knowledge and experience. This system is expected to reduce research time and enable more efficient work execution.

[0134] System Overview

[0135] The system inputs information about tools and services that users start using and stores it in a database. Users can search for information about specific tools and services, retrieve matching information from the database, and use that information to contact other users.

[0136] Hardware and software to be used

[0137] Hardware: Server, client terminals (PC, tablet, smartphone)

[0138] Software: Database management systems (e.g., MySQL®, PostgreSQL), communication protocols (e.g., HTTP / HTTPS), notification systems (e.g., mail servers, chat APIs)

[0139] User Information Registration

[0140] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, version, start date, and department using it. The terminal generates and sends a request to the server to send the entered information. The server parses the received information and stores it in a database.

[0141] Searching for and retrieving information

[0142] The user enters the name of a specific tool or service into a search form to find information about it. The device generates a search query and sends it to the server. The server searches its database based on the received query and retrieves matching information. The retrieved information is sent from the server to the device and displayed to the user.

[0143] Notifications and Contacts

[0144] The user selects a user they want to contact from the search results. The device sends a request to the server containing the selected user's information. The server sends a notification to the selected user and a message to the specified contact (email or chat). It then returns the notification sending result to the device, informing the user that the notification was successful.

[0145] Specific example

[0146] For example, if member A of the design team starts using "Design Tool X," member A enters information about "Design Tool X" and saves it in the database. Later, when member B searches for information about "Design Tool X," member A's information is found in the database and displayed on member B's terminal. Member B can then contact member A through the system to learn more about "Design Tool X."

[0147] Example of a prompt

[0148] The following are specific examples of prompt statements to be input to a generative AI model:

[0149] Please explain the procedures and benefits of a system that allows users to register their information when they start using new tools or services, and enables other users to search for and contact that information.

[0150] This clarifies the specific operating procedures and benefits of the system, allowing users to utilize it smoothly.

[0151] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0152] Processing steps

[0153] Step 1: Enter user information

[0154] The user enters information about the new tool or service. For example, they might fill in details such as "Tool Name: Design Tool X", "Version: 1.0", "Date Started: 2023-01-01", and "Department Using: Design Team" in the input form.

[0155] Input: User-provided details about tools and services

[0156] Output: Information input request sent to the terminal

[0157] Step 2: Generate and submit information input request

[0158] The terminal generates a request to send the information entered by the user to the server. This request includes information such as the tool name, version, start date of use, and department using the tool.

[0159] The terminal sends the generated request to the server.

[0160] Input: Detailed information about the tools or services entered by the user.

[0161] Output: Information input request sent to the server

[0162] Step 3: Analyze the information and save it to the database.

[0163] The server parses the received request and extracts detailed information about the tools and services.

[0164] The server saves the extracted information to a database. For example, it uses an SQL INSERT statement to record information about "Design Tool X" into the database.

[0165] Input: Information input request sent from the terminal

[0166] Output: Detailed information about tools and services stored in the database

[0167] Step 4: Enter your search query

[0168] To search for information about a specific tool or service, the user enters its name into the search form. For example, they might enter "Design Tool X".

[0169] Input: User's search query (name of tool or service)

[0170] Output: Search query sent to the terminal

[0171] Step 5: Generate and submit search queries

[0172] The terminal generates a search query based on the name entered in the search form. Specifically, it sends "Tool Name: Design Tool X" to the server as an HTTP request.

[0173] The terminal sends the generated search query to the server.

[0174] Input: Search query entered by the user

[0175] Output: Search queries sent to the server

[0176] Step 6: Search the database

[0177] The server searches the database based on the received search query. For example, it might use an SQL SELECT statement to retrieve records related to "Design Tool X".

[0178] Input: Search query sent from the device

[0179] Output: Matching information retrieved from the database

[0180] Step 7: Submit search results

[0181] The server sends the search results to the terminal. For example, it might return a list of other users using "Design Tool X".

[0182] Input: Matching information retrieved from the database

[0183] Output: Search results sent to the device

[0184] Step 8: Displaying search results

[0185] The terminal displays search results received from the server to the user. For example, information about users using "Design Tool X" may be displayed in a table or card format.

[0186] Input: Search results sent from the server

[0187] Output: Search results displayed to the user

[0188] Step 9: Select contacts and generate requests

[0189] The user selects other users they want to contact from the search results. For example, they might click on a user's name.

[0190] The device generates a request to contact the selected user. This request includes contact information and message content.

[0191] Input: User selects contact information

[0192] Output: Contact request to send to server

[0193] Step 10: Send contact request and perform notification

[0194] The terminal sends the generated contact request to the server.

[0195] The server parses the received contact request and sends a message through the appropriate notification method. For example, it might use a mail server to send a notification message.

[0196] Input: Contact request sent from the device

[0197] Output: Notification message sent to other users

[0198] Step 11: Sending and displaying notification results

[0199] The server receives the notification transmission result and sends it to the requesting terminal.

[0200] The device displays the transmission result to the user. For example, it might display a message such as, "A notification has been sent to contact A."

[0201] Input: Notification sent from the server

[0202] Output: Notification sent to the user

[0203] The above outlines the specific processing steps of this system.

[0204] (Application Example 1)

[0205] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0206] In recent years, manufacturing sites such as factories have been improving work efficiency by introducing various equipment and work procedures. However, when introducing new equipment or work procedures, problems arise such as a lack of information and the inability to effectively share existing knowledge. On the other hand, if there are users or departments that are already using the same equipment or work procedures, coordination and information sharing with them can greatly improve the efficiency of the introduction. However, current systems do not have a mechanism for sharing such information quickly and accurately, resulting in increased research time, duplicated work, and decreased work efficiency.

[0207] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0208] In this invention, the server includes means for inputting information on equipment and work procedures that a user has started using; means for storing the inputted information on equipment and work procedures in a database; means for the user to search for information on specific equipment and work procedures; means for obtaining information on equipment and work procedures that match specified conditions from the database; means for displaying the obtained information to the user; means for generating a notification message from the obtained information for the user to contact a specific other user and sending it to a specified contact; and means for generating and displaying a prompt using a generative AI model to promote additional knowledge sharing based on the obtained information. As a result, when introducing new equipment or work procedures, users can quickly obtain knowledge and experience from users who have already introduced them, thereby reducing investigation time and improving work efficiency.

[0209] "Equipment and operational procedures" is a general term referring to the devices, robots, tools, and methods and procedures for using them that are used in factories and manufacturing sites.

[0210] A "database" is a system that systematically stores and manages information, making it searchable and retrievable as needed.

[0211] A "notification message" is a message sent by one user to another user to contact them, and it is sent to their contacts.

[0212] A "generative AI model" refers to an algorithm or system that uses artificial intelligence technology to generate prompts based on specific conditions.

[0213] A "prompt" is text generated by a generative AI model and used as instructions or questions for users to share additional knowledge.

[0214] A "server" is a computer system used for storing, managing, and processing information, and its role is to provide data in response to user requests.

[0215] This invention is a system for quickly and efficiently sharing new equipment and work procedures used in factories and manufacturing sites with other users and departments. This system can reduce the time required for implementation surveys and improve operational efficiency.

[0216] 1. System Overview

[0217] This system allows users to input information about equipment and work procedures they have started using, and saves this information in a database. Other users can then search for information about the same equipment and procedures, and based on the search results, connect with and communicate with other users who are already using them. Furthermore, it uses a generative AI model to generate prompts, facilitating additional knowledge sharing.

[0218] 2. User Information Registration

[0219] Information input and saving

[0220] When a user begins using new equipment or a new work procedure, they input that information into the system via a terminal. This input includes the name, manufacturer, model, and start date of use of the equipment or procedure. The terminal generates and sends a request to the server to receive the input information. The server analyzes the received information and stores it in a database. For example, user A inputs information about the newly introduced robot "XYZ-123" into the system, and this information is stored in the database.

[0221] 3. Searching for and obtaining information

[0222] Execute search

[0223] The user enters the name of a specific piece of equipment or work procedure into a search form on their terminal to find information about it. The terminal generates a search query and sends it to the server. The server searches its database based on the received query and retrieves matching information.

[0224] Displaying search results

[0225] The server sends the search results to the terminal. The terminal displays the search results to the user. For example, if user B searches for information about the same robot "XYZ-123", user A's information will be found in the database and displayed on user B's terminal.

[0226] 4. Notifications and Communications

[0227] Selection of communication method

[0228] The user selects a user they wish to contact from the search results. The device then sends a request to the server containing the selected user's information.

[0229] Execute notification

[0230] The server sends a notification to the selected user and a message to the specified contact (email or chat). As proof of the notification's success, the server returns the notification's delivery status to the device, informing the user that the notification was successful. For example, if user B wants to contact user A, user B can send a notification to user A through the system and initiate contact.

[0231] 5. Prompt generation using generative AI models

[0232] The server uses a generative AI model to generate prompts based on the acquired information to facilitate additional knowledge sharing. The generated prompts are displayed to the user and used for specific advice and gathering additional information. An example of a prompt is: "Please register information about the newly introduced robot XYZ-123 and receive advice from users who are already using it regarding its specific usage and problem-solving methods."

[0233] This system allows users to quickly access information about equipment and work procedures used by other users and departments within the organization, and to communicate efficiently. As a result, research time is reduced, knowledge and experience are shared across the organization, and work efficiency is improved. This significantly simplifies the process of introducing new equipment and work procedures, and reduces the time and effort required for research and communication.

[0234] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0235] Step 1:

[0236] The user inputs information about the equipment and work procedures they have started using. Specifically, the user uses a terminal to input information such as the name, manufacturer, model, and start date of use of the equipment or work procedure. The input data is formatted by the terminal, and a request is generated to send to the server. The input data is sent to the server in JSON format.

[0237] Step 2:

[0238] The server analyzes the information received from the terminal and stores it in the database. Upon receiving the information, the server validates the input data to check for any invalid data. Data that passes validation is converted to an appropriate format so that it can be correctly stored in the database. This may include operations such as trimming strings and standardizing date formats.

[0239] Step 3:

[0240] A user searches for information on specific equipment or work procedures. The user enters the name of the equipment or work procedure and other criteria into the search form on the terminal. The terminal generates a search query based on this information and sends it to the server. The search criteria are sent in JSON format.

[0241] Step 4:

[0242] The server searches the database based on the received search query. The server retrieves data that matches the specified criteria. In this process, indexes are often used to improve search efficiency. The retrieved data is then formatted into an appropriate format.

[0243] Step 5:

[0244] The server sends the retrieved search results to the device. The server converts the search results into JSON format and sends it back to the device. The device receives this data.

[0245] Step 6:

[0246] The device displays the acquired information to the user. The device analyzes the received search results and displays them in a format that is easy for the user to understand. This includes displaying the information in table or list format.

[0247] Step 7:

[0248] The system connects users with other users based on the information selected by the user. The user selects the user they wish to contact from the displayed information and specifies their contact details (email or chat). The device then generates a notification message based on this information and sends it to the server.

[0249] Step 8:

[0250] The server sends a notification message to the specified contact. The server generates a notification message and sends it to the specified contact using the API of an email or chat service. The sending result is returned to the device and notified to the user.

[0251] Step 9:

[0252] The server generates and displays prompts using a generative AI model to facilitate additional knowledge sharing based on the acquired information. The server uses the generative AI model to generate useful prompt sentences based on the aforementioned information. The generated prompt sentences are sent to the terminal and displayed to the user. For example, a sentence such as "I would like to register information about the newly introduced robot XYZ-123 and receive advice from users who are already using it regarding specific usage and problem-solving methods" might be generated.

[0253] Through this series of processing steps, the system of the present invention facilitates rapid knowledge sharing among other users when introducing new equipment or work procedures in factories and manufacturing sites, enabling efficient work execution.

[0254] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0255] This invention combines a system that connects users with other users or departments already using the same tools or services to share knowledge and experience when users encounter new tools or services, with an emotion engine that recognizes the user's emotions. This system enables appropriate responses based on emotions, and is expected to reduce investigation time and improve work efficiency.

[0256] 1. System Overview

[0257] This system allows users to input information about tools and services they start using and saves it in a database. Furthermore, other users can search for information about the same tools and services, and connect with and communicate with users who are already using them based on the search results. In addition, an emotion engine analyzes the user's emotions and provides the most appropriate response based on those emotions.

[0258] 2. User Information Registration

[0259] Information input and saving

[0260] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, its version, the date it was started, and the department using it.

[0261] The terminal generates an HTTP request based on the entered information and sends it to the server.

[0262] The server analyzes the received information and stores it in the database.

[0263] For example, if member A of the design team starts using "design tool X," member A will input information about "design tool X" and save it to the database.

[0264] 3. Searching for and obtaining information

[0265] Execute search

[0266] Users enter the name of a specific tool or service into the search form to find information about it.

[0267] The terminal generates a search query and sends it to the server.

[0268] The server searches the database based on the received query and retrieves matching information.

[0269] Displaying search results

[0270] The server sends the search results to the terminal.

[0271] The device displays search results to the user.

[0272] For example, if member B searches for information about "design tool X," member A's information will be found in the database and displayed on member B's terminal.

[0273] 4. Notifications and Communications

[0274] Selection of communication method

[0275] The user selects a user they want to contact from the search results.

[0276] The terminal generates an HTTP request based on the selected user's information and sends it to the server.

[0277] Execute notification

[0278] The server analyzes the received request and obtains the contact information of the selected user.

[0279] The server generates a notification message and sends it to the specified contact.

[0280] Presentation of notification results

[0281] The server generates a response based on the notification sending result and sends it to the terminal.

[0282] The terminal receives the response and displays to the user that the notification was successful.

[0283] As a specific example, when member B wants to contact member A, member B can send a notification to member A through the system to make contact.

[0284] 5. Functions of the emotion engine

[0285] Recognition of emotions

[0286] When the user inputs information or conducts a search in the system, the emotion engine analyzes the user's input content and voice to identify emotions.

[0287] The server saves the user's emotions in the database based on the analysis results.

[0288] Presentation of optimal responses

[0289] The server generates response measures according to the identified emotions and presents them to the user through the emotion engine.

[0290] The terminal displays the presented response measures to the user.

[0291] As a specific example, when member B is experiencing difficulties with "design tool X", the emotion engine can identify that emotion and propose appropriate support and guidance.

[0292] 6. System Advantages

[0293] This system allows users to quickly understand the tools and services being used by other users and departments within their organization, and to communicate efficiently. Furthermore, the emotion engine provides appropriate responses based on the user's emotional state, improving the user experience. As a result, it is expected to reduce research time and improve work efficiency.

[0294] The following describes the processing flow.

[0295] Information Registration

[0296] Step 1:

[0297] The user logs into the system.

[0298] Step 2:

[0299] The user opens the "Register for a new tool or service" form.

[0300] Step 3:

[0301] The user enters information about the tool or service (name, version, start date, department using it) into the form.

[0302] Step 4:

[0303] While the user is typing, the emotion engine analyzes the input, the user's facial expressions, and voice to identify their emotions.

[0304] Step 5:

[0305] The emotion engine identifies an emotion and sends it to the server.

[0306] Step 6:

[0307] The server analyzes the received emotion data and saves it in the database.

[0308] Step 7:

[0309] The user presses the "Register" button.

[0310] Step 8:

[0311] Based on the information input by the terminal, an HTTP request is generated and sent to the server.

[0312] Step 9:

[0313] The server analyzes the received request and saves the information in the database.

[0314] Step 10:

[0315] The server generates a response indicating the success of registration and sends it to the terminal.

[0316] Step 11:

[0317] The terminal receives the response and displays to the user that the registration is successful.

[0318] Search and acquisition of information

[0319] Step 1:

[0320] The user logs in to the system.

[0321] Step 2:

[0322] The user opens the "Information Search" form.

[0323] Step 3:

[0324] The user enters the name of the tool or service to be searched.

[0325] Step 4:

[0326] The emotion engine analyzes the user's input and voice to identify their emotions.

[0327] Step 5:

[0328] The emotion engine identifies an emotion and sends it to the server.

[0329] Step 6:

[0330] The server analyzes the received emotion data and stores it in a database.

[0331] Step 7:

[0332] The user presses the "search" button.

[0333] Step 8:

[0334] The terminal generates an HTTP request based on the entered keyword and sends it to the server.

[0335] Step 9:

[0336] The server searches the database based on the received request and retrieves matching information.

[0337] Step 10:

[0338] The server generates a response based on the search results and sends it to the terminal.

[0339] Step 11:

[0340] The device receives the response and displays the search results to the user.

[0341] Notifications and Contacts

[0342] Step 1:

[0343] The user selects the user they want to contact from the search results.

[0344] Step 2:

[0345] The device generates an HTTP request based on the selected user's information and sends it to the server.

[0346] Step 3:

[0347] The server parses the received request and retrieves the contact information of the selected user.

[0348] Step 4:

[0349] The server generates a notification message and sends it to the specified contact.

[0350] Step 5:

[0351] The server generates a response based on the notification transmission result and sends it to the terminal.

[0352] Step 6:

[0353] The device receives a response and displays to the user that the notification was successful.

[0354] Step 7:

[0355] The emotion engine provides feedback and suggests the next action based on the user's emotional state.

[0356] In this way, users can efficiently connect with other users and receive appropriate responses based on their emotions. For example, if member B is experiencing difficulties with "design tool X," the emotion engine can identify that emotion and provide support by suggesting solutions.

[0357] (Example 2)

[0358] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0359] There has been a problem in understanding the usage status of existing corporate tools and services and in efficiently communicating with users. Furthermore, there is a problem in that the user experience deteriorates because there is no appropriate response to the anxiety and difficulties that users feel when using new tools and services. This invention aims to solve these problems.

[0360] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting information on tools and services that a user has started using, means for storing the inputted information on tools and services in a database, means for the user to search for information on specific tools and services, means for obtaining information on tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for contacting other users based on the information selected by the user, means for analyzing the user's input content and voice to identify emotions, and means for generating and presenting countermeasures based on the emotions. As a result, the user can quickly and efficiently share information and contact other users and departments, and can also receive appropriate support according to their emotions.

[0361] A "user" is an individual who uses the system to input information, search for information, or communicate.

[0362] "Tool and service information" refers to specific data regarding the tools and services that a user has started using, such as their name, version, start date, and department in which they are used.

[0363] A "database" is a collection of information and the system that manages it, used to store and manage information and analysis results from tools and services entered by users.

[0364] A "search method" refers to the function or interface that a user uses to search for information about a particular tool or service.

[0365] "Means for obtaining information that matches the conditions" refers to a system component that has the function of extracting information about tools and services that match the conditions specified by the user from a database.

[0366] "Means of displaying information" refers to screen display devices or interfaces that visually present acquired information to the user.

[0367] "Communication methods" refer to message generation and sending functions used to contact other users based on information selected by the user.

[0368] "Means for identifying emotions" refers to an analysis engine and functions that analyze user input and voice to recognize the user's emotions.

[0369] "Means for generating and presenting countermeasures" refers to a function that presents appropriate countermeasures and support to the user based on the results of identifying their emotions.

[0370] This invention is a system that allows users to input information about new tools and services and save it in a database. It also allows other users to search for information about the same tools and services and communicate with each other. Furthermore, this invention is a system that uses an emotion engine to recognize the user's emotions and suggests appropriate responses based on those emotions.

[0371] System Configuration

[0372] This system mainly consists of the following components:

[0373] A terminal for users to input information.

[0374] A function that sends information entered by the terminal to the server as an HTTP request.

[0375] A function that allows a server to receive information and save it to a database.

[0376] A feature that allows the device to send the user's search queries to the server.

[0377] A function that allows the server to retrieve search results from the database and send them to the terminal.

[0378] The emotion engine analyzes user input and voice to recognize emotions.

[0379] Interfaces and APIs for connecting each component.

[0380] Hardware and software to be used

[0381] The main hardware and software used in this system include the following:

[0382] Server: Web server software such as Apache® or NGINX.

[0383] Database: A database management system such as MySQL or PostgreSQL.

[0384] Device: A user interface device such as a smartphone or PC.

[0385] Emotion engine: Sentiment analysis engines such as Google® Cloud Natural Language API and IBM Watson®.

[0386] Specific examples of operating procedures

[0387] Enter and save new tool information.

[0388] When a user starts using a new tool or service, they enter the information into their terminal. For example, if they start using "Design Tool X," they would enter its name, version, start date, and department using it.

[0389] The terminal generates an HTTP POST request based on the entered information and sends it to the server.

[0390] The server analyzes the received information and inserts records into the appropriate database tables. This stores information about new tools and services in the database.

[0391] Searching for and retrieving information

[0392] To search for information about a specific tool or service, the user enters the name into the search form. For example, they might enter "Design Tool X".

[0393] The terminal generates a GET request based on the search query entered by the user and sends it to the server.

[0394] The server searches the database based on the received query, retrieves matching information, and sends it to the terminal in JSON format.

[0395] The terminal displays the retrieved search results to the user. This allows the user to see information about "Design Tool X" entered by other users.

[0396] Notifications and Contacts

[0397] The user selects the user they want to contact from the search results. For example, if they want to contact a user who is knowledgeable about design tool X.

[0398] The device generates an HTTP POST request containing the user's ID and sends it to the server.

[0399] The server parses the received request, retrieves the contact information of the specified user, and generates and sends a notification message.

[0400] The device will display a notification to the user indicating that the notification was successful. For example, it might display "Notification successful."

[0401] Using an Emotion Engine

[0402] When a user enters information or searches for something, the emotion engine analyzes the user's input and voice to identify their emotion. For example, if a user enters "troubled," the emotion engine identifies it as "confused."

[0403] The server stores the identified emotion information in a database and generates countermeasures based on that emotion.

[0404] The device then presents the generated solutions to the user. For example, it might display, "Here are the guidelines to resolve this issue."

[0405] Example of a prompt

[0406] "I've started using the new design tool X, but I'm having trouble understanding many things. I'd like to get in touch with members of other departments who are using the same tool."

[0407] This allows users to connect with other users using the same tools and services, efficiently solve problems, and receive appropriate support tailored to their needs.

[0408] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0409] Step 1:

[0410] The user enters information about the new tool or service. For example, they might enter information such as "Tool Name: Design Tool X", "Version: 1.0", "Date Started: 2023-10-01", and "Department: Design" into a form. The system also checks the input data and displays error messages to the user as needed.

[0411] Input: Information about tools and services entered by the user.

[0412] Output: HTTP POST request generated by the terminal.

[0413] Step 2:

[0414] The device generates an HTTP POST request based on the information entered by the user and sends it to the server. Specifically, it packages the data in JSON format and sends it to the specified API endpoint.

[0415] Input: Information entered by the user.

[0416] Output: HTTP POST request sent to the server.

[0417] Step 3:

[0418] The server parses the HTTP POST request it receives and saves it to the database. First, it extracts data from the request body and saves it to the database table using an SQL INSERT statement.

[0419] Input: HTTP POST request sent from the terminal.

[0420] Output: Information about tools and services stored in the database.

[0421] Step 4:

[0422] To search for information about a specific tool or service, the user enters the name into the search form and clicks the "Search" button. For example, they might enter "Design Tool X".

[0423] Input: The search query entered by the user in the search form.

[0424] Output: Expectations regarding the search results displayed on the device.

[0425] Step 5:

[0426] The device generates a GET request based on the user's search query and sends it to the server. Query parameters are added to the URL, and the request is sent to the specified API endpoint.

[0427] Input: The search query entered by the user.

[0428] Output: HTTP GET request sent to the server.

[0429] Step 6:

[0430] The server parses the received GET request and searches the database. It then uses an SQL SELECT statement to retrieve matching information from the database.

[0431] Input: HTTP GET request sent from the terminal.

[0432] Output: Search results retrieved by the server.

[0433] Step 7:

[0434] The server sends the retrieved search results to the terminal in JSON format. The result data is converted to an appropriate format and returned as an HTTP response.

[0435] Input: Search results retrieved from the database.

[0436] Output: The HTTP response sent to the terminal.

[0437] Step 8:

[0438] The device displays the search results it has received to the user. A list of search results is displayed on the screen, allowing the user to select from them.

[0439] Input: HTTP response received from the server.

[0440] Output: Search results displayed to the user.

[0441] Step 9:

[0442] The user selects a user they want to contact from the search results. For example, they click on a specific user from the list.

[0443] Input: User information selected by the user.

[0444] Output: Contact expected from the selected user.

[0445] Step 10:

[0446] The terminal generates an HTTP POST request based on the selected user's information and sends it to the server. It then packages and sends data including the selected user's ID.

[0447] Input: User information selected by the user.

[0448] Output: HTTP POST request sent to the server.

[0449] Step 11:

[0450] The server parses the received request and retrieves the contact information of the specified user. Then, it generates and sends a notification message. It uses an SQL SELECT statement to retrieve the contact information and uses it to send the notification message.

[0451] Input: HTTP POST request sent from the terminal.

[0452] Output: A notification message sent to the specified contact.

[0453] Step 12:

[0454] The server generates a response based on the notification transmission results and sends it to the terminal. The response includes the success or failure status in JSON format.

[0455] Input: Result of notification transmission.

[0456] Output: The HTTP response sent back to the terminal.

[0457] Step 13:

[0458] The device receives a response and displays a message to the user indicating that the notification was successful. For example, it might display "Notification successful."

[0459] Input: HTTP response received from the server.

[0460] Output: The notification result displayed to the user.

[0461] Step 14:

[0462] When a user enters information or performs a search, the emotion engine analyzes the user's input and voice to identify their emotions. For example, if the user enters "troubled," the engine recognizes that emotion as "confused."

[0463] Input: User input or voice information.

[0464] Output: Identified sentiment information.

[0465] Step 15:

[0466] The server saves the sentiment data to the database based on the analysis results. The sentiment data is saved using an SQL INSERT statement.

[0467] Input: Emotional data sent from the emotion engine.

[0468] Output: Emotional information stored in the database.

[0469] Step 16:

[0470] The server generates emotion-based responses and sends them to the device. For example, it generates support guidelines for the emotion "confused" and sends them to the device in JSON format.

[0471] Input: Identified sentiment information.

[0472] Output: The countermeasures sent to the terminal.

[0473] Step 17:

[0474] The device displays suggested solutions to the user. For example, it might display, "Here are the guidelines to resolve this issue."

[0475] Input: Countermeasures sent from the server.

[0476] Output: The countermeasures presented to the user.

[0477] (Application Example 2)

[0478] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0479] Currently, when introducing new machinery and tools in factories, the means of sharing information regarding operation methods, settings, and troubleshooting are sometimes inefficient. This results in operators taking a long time to become proficient in using new tools, potentially leading to operational errors and malfunctions, and ultimately reducing work efficiency. Furthermore, a challenge remains in providing appropriate support when operators experience stress or confusion.

[0480] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information on tools and services that a user has started using, means for storing the inputted tool and service information in a database, means for the user to search for information on specific tools and services, means for obtaining information on tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for contacting other users based on the information selected by the user, emotion engine means for recognizing the user's emotions, and means for generating and displaying appropriate responses based on the emotions recognized by the emotion engine means. As a result, operators can not only quickly become proficient in new tools and services, but also reduce operational errors and improve work efficiency by providing appropriate support according to their emotional state.

[0481] "User information" refers to information about the users who use the system.

[0482] "Tool and service information" refers to information such as the name, version, start date of use, and department that uses the tools and services that the user utilizes.

[0483] A "database" is a structured collection of records that stores information about the aforementioned tools and services, and allows it to be searched and retrieved when needed.

[0484] A "search method" refers to the interface and process that allows a user to find information about a specific tool or service.

[0485] "Communication methods" refer to features that allow users to exchange information and communicate with other users.

[0486] An "emotion engine" is a technology that recognizes a user's emotions and provides appropriate responses based on those emotions.

[0487] "Means for generating and displaying appropriate responses" refers to a process for providing responses and support in accordance with the user's emotions recognized by the emotion engine.

[0488] A "generative AI model" is an artificial intelligence algorithm used to generate the optimal result based on input data.

[0489] A "prompt sentence" is an input sentence that a generative AI model uses to generate an appropriate response.

[0490] This invention is a system that integrates an emotion engine to facilitate the smooth introduction and daily use of new machinery and tools within a factory. This system can recognize the user's emotions in real time and provide appropriate support.

[0491] System Configuration

[0492] hardware

[0493] Smart glasses (e.g., Microsoft HoloLens®)

[0494] Servers (cloud-based, e.g., AWS® EC2)

[0495] Database (e.g., MySQL)

[0496] software

[0497] Emotion engine (e.g., Affectiva SDK)

[0498] Real-time information sharing system (e.g., WebSocket)

[0499] User interface (UI) frameworks (e.g., Unity)

[0500] System operation

[0501] 1. User information registration

[0502] Users enter information about new machines and tools using an app installed on their smart glasses. This includes the tool's name, version, start date, and department of use.

[0503] The terminal sends the entered information to the server as an HTTP request.

[0504] The server stores the received information in a database.

[0505] 2. Searching for and obtaining information

[0506] Users use smart glasses to search for information about specific tools or services using voice input.

[0507] The terminal sends the search query to the server via WebSocket.

[0508] The server searches the database for information, retrieves matching items, and sends the results back to the terminal.

[0509] The device displays search results to the user.

[0510] 3. Recognition of emotions and presentation of responses

[0511] The emotion engine analyzes the user's facial expressions through the smart glasses' camera and recognizes their emotional state.

[0512] The server generates appropriate countermeasures based on the analysis results received from the emotion engine.

[0513] The server displays the generated solutions (e.g., video tutorials, guides) on the smart glasses' display.

[0514] Specific example

[0515] Imagine an operator wearing smart glasses while using a newly introduced automated welding machine. When the operator asks a voice question like, "How do I set up the welding?", the application displays the appropriate setup procedure on the screen. Meanwhile, an emotion engine analyzes the operator's facial expressions, and if stress or confusion is detected, it suggests additional support (for example, detailed troubleshooting instructions or options to contact the help desk).

[0516] Example of a prompt

[0517] "I want to learn how to set up the newly installed automatic welding machine. Please provide a video tutorial on operation, monitor the operator's stress level with an emotion engine, and suggest appropriate support."

[0518] This system not only allows operators to quickly become proficient in using new equipment, but also provides appropriate support tailored to their emotional state, thereby reducing operational errors and improving work efficiency.

[0519] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0520] Step 1:

[0521] Enter and submit user information.

[0522] Users input information about new machines and tools through smart glasses.

[0523] The input includes the tool's name, version, start date, and department using it.

[0524] The terminal generates this input information as an HTTP request and sends it to the server.

[0525] (Input) Information about tools and services provided by the user.

[0526] (Output) Information formed as an HTTP request.

[0527] Step 2:

[0528] Storing information in a database

[0529] The server parses the received HTTP request, breaks down the input information, and stores it in the database.

[0530] When saving, the files are sorted into save fields based on the tool name, version, start date, and department using the tool.

[0531] (Input) Received HTTP request.

[0532] (Output) Information about tools and services stored in the database.

[0533] Step 3:

[0534] Searching for and retrieving information

[0535] Users can use smart glasses to search for information about specific tools or services by voice. For example, "I'm looking for information about a new automatic welding machine."

[0536] The terminal converts the voice data into text and generates a search query. This is then sent to the server via WebSocket.

[0537] The server searches the database, retrieves information on matching tools and services, and sends the results back to the terminal.

[0538] (Input) Voice command from the user (search query).

[0539] (Output) Information retrieved from the database and displayed to the user.

[0540] Step 4:

[0541] Emotion recognition and data transmission

[0542] The emotion engine analyzes the user's facial expressions and voice through the smart glasses' camera to recognize their emotional state.

[0543] The server receives the analysis results sent from the emotion engine and performs data calculations to generate appropriate countermeasures.

[0544] (Input) User's facial expressions and voice data.

[0545] (Output) Analyzed emotional status.

[0546] Step 5:

[0547] Generating appropriate countermeasures

[0548] Based on the received emotional state, the server uses a generative AI model to generate prompt sentences, and then generates appropriate countermeasures (such as video tutorials or guides) based on those prompts.

[0549] The generated countermeasures are prepared as data to be displayed to the user.

[0550] (Input) Analyzed emotion status.

[0551] (Output) Generated countermeasures (responses and guides based on prompt statements).

[0552] Step 6:

[0553] Display of optimal countermeasures

[0554] The device receives the appropriate countermeasure sent from the server and displays it on the smart glasses' display.

[0555] The user reviews the displayed information and continues with the task or operation.

[0556] (Input) Countermeasure data generated from the server.

[0557] (Output) Appropriate countermeasures displayed on the smart glasses' screen.

[0558] Through the above processing steps, users can quickly and efficiently learn how to operate new machines and tools, and with appropriate support tailored to their needs, it is expected that work errors will be reduced and work efficiency will be improved.

[0559] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0560] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0561] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0562] [Second Embodiment]

[0563] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0564] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0565] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0566] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0567] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0568] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0569] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0570] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0571] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0572] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0573] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0574] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0575] This invention provides a system for users to connect with other users or departments already using the same tools or services when using new tools or services, allowing for the sharing of knowledge and experience. This system is expected to reduce research time and enable more efficient work execution.

[0576] 1. System Overview

[0577] This system allows users to input information about tools and services they start using and save it in a database. Other users can then search for information about the same tools and services, and based on the search results, connect with and contact users who are already using them.

[0578] 2. User Information Registration

[0579] Information input and saving

[0580] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, its version, the date it was started, and the department using it.

[0581] The terminal generates and sends a request to the server to send the entered information.

[0582] The server analyzes the received information and stores it in the database.

[0583] For example, if member A of the design team starts using "design tool X," member A will input information about "design tool X" and save it to the database.

[0584] 3. Searching for and obtaining information

[0585] Execute search

[0586] Users enter the name of a specific tool or service into the search form to find information about it.

[0587] The terminal generates a search query and sends it to the server.

[0588] The server searches the database based on the received query and retrieves matching information.

[0589] Displaying search results

[0590] The server sends the search results to the terminal.

[0591] The device displays search results to the user.

[0592] For example, if member B searches for information about "design tool X," member A's information will be found in the database and displayed on member B's terminal.

[0593] 4. Notifications and Communications

[0594] Selection of communication method

[0595] The user selects a user they want to contact from the search results.

[0596] The terminal sends a request to the server containing information about the selected user.

[0597] Execute notification

[0598] The server sends a notification to the selected user and a message to the specified contact (email or chat).

[0599] Presentation of notification results

[0600] The server returns the notification transmission result to the terminal, informing the user that the notification was successful.

[0601] The device displays a message to the user indicating that a notification has been sent.

[0602] For example, if member B wants to contact member A, member B can send a notification to member A through the system and make contact.

[0603] 5. System Advantages

[0604] This system allows users to quickly understand the tools and services being used by other users and departments within their organization, and to communicate efficiently. As a result, research time is reduced, knowledge and experience are shared throughout the organization, and work efficiency is improved.

[0605] This invention significantly simplifies the process of introducing new tools and services, reducing the time and effort required for research and communication.

[0606] The following describes the processing flow.

[0607] Information Registration

[0608] Step 1:

[0609] The user logs into the system.

[0610] Step 2:

[0611] The user opens the "Register for a new tool or service" form.

[0612] Step 3:

[0613] The user enters information about the tool or service (name, version, start date, department using it) into the form.

[0614] Step 4:

[0615] The user presses the "Register" button.

[0616] Step 5:

[0617] The terminal generates an HTTP request based on the information entered and sends it to the server.

[0618] Step 6:

[0619] The server parses the received request and saves the information to the database.

[0620] Step 7:

[0621] The server generates a response indicating successful registration and sends it to the terminal.

[0622] Step 8:

[0623] The device receives a response and displays a message to the user indicating that registration was successful.

[0624] Searching for and retrieving information

[0625] Step 1:

[0626] The user logs into the system.

[0627] Step 2:

[0628] The user opens the "Information Search" form.

[0629] Step 3:

[0630] Enter the name of the tool or service you want to search for.

[0631] Step 4:

[0632] The user presses the "search" button.

[0633] Step 5:

[0634] The terminal generates an HTTP request based on the entered keyword and sends it to the server.

[0635] Step 6:

[0636] The server searches the database based on the received request and retrieves matching information.

[0637] Step 7:

[0638] The server generates a response based on the search results and sends it to the terminal.

[0639] Step 8:

[0640] The device receives the response and displays the search results to the user.

[0641] Notifications and Contacts

[0642] Step 1:

[0643] The user selects the user they want to contact from the search results.

[0644] Step 2:

[0645] The device generates an HTTP request based on the selected user's information and sends it to the server.

[0646] Step 3:

[0647] The server parses the received request and retrieves the contact information of the selected user.

[0648] Step 4:

[0649] The server generates a notification message and sends it to the specified contact.

[0650] Step 5:

[0651] The server generates a response based on the notification transmission result and sends it to the terminal.

[0652] Step 6:

[0653] The device receives a response and displays to the user that the notification was successful.

[0654] This will enable users to efficiently connect with other users who are using existing tools and services, and to share knowledge and experience.

[0655] (Example 1)

[0656] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0657] When users begin using new tools or services, they often face difficulties sharing information with other users or departments already using the same tools or services, leading to lengthy research times and decreased work efficiency. This invention aims to solve these problems and enable rapid information sharing and efficient work execution within organizations.

[0658] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0659] In this invention, the server includes means for inputting information about tools and services that a user has started using, means for storing the inputted information about tools and services in a database, means for the user to search for information about specific tools and services, means for obtaining information about tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for the user to contact other users based on the information selected by the user, a terminal for transmitting the information input by the user to the server, means for the server to analyze the information received, and means for the server to send a message to a specified contact. This enables users to quickly share information with other users within the organization and communicate efficiently.

[0660] A "user" is an individual or entity that uses the system to perform actions such as entering, searching for, viewing, and communicating information about the tools and services.

[0661] "Tools and services" refers to the software, applications, platforms, or entire services that users utilize for their work or activities.

[0662] "Information" refers to data that includes data items such as the name, version, start date of use, and department that uses the tool or service.

[0663] "Means of input" refers to the interface or form that users use to input information about tools or services into a system.

[0664] "Means of saving to a database" refers to the functions and processes for storing information about entered tools and services in a database.

[0665] "Means of searching" refers to the functions or interfaces that allow users to search for information about specific tools or services.

[0666] "Means of acquisition" refers to the functions and processes used to search and retrieve information about tools and services that match specified criteria from a database.

[0667] "Means of display" refers to functions or interfaces that visually present acquired information to the user.

[0668] "Means of communication" refers to the means or interfaces that users use to communicate with other users.

[0669] A "terminal" refers to a device used by a user to access a system and perform operations such as entering information, searching, and making communications.

[0670] A "server" refers to a central system that manages the entire system and handles data storage, retrieval, analysis, and transmission.

[0671] "Means of analysis" refers to the functions and processes that allow a server to understand the user information it receives and take appropriate action.

[0672] "Means of sending messages to specified contacts" refers to the functions and methods that allow users to send messages to people they wish to contact.

[0673] This invention provides a system for users to connect with other users or departments already using the same tools or services when starting to use new tools or services, allowing for the sharing of knowledge and experience. This system is expected to reduce research time and enable more efficient work execution.

[0674] System Overview

[0675] The system inputs information about tools and services that users start using and stores it in a database. Users can search for information about specific tools and services, retrieve matching information from the database, and use that information to contact other users.

[0676] Hardware and software to be used

[0677] Hardware: Server, client terminals (PC, tablet, smartphone)

[0678] Software: Database management systems (e.g., MySQL, PostgreSQL), communication protocols (e.g., HTTP / HTTPS), notification systems (e.g., mail servers, chat APIs)

[0679] User Information Registration

[0680] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, version, start date, and department using it. The terminal generates and sends a request to the server to send the entered information. The server parses the received information and stores it in a database.

[0681] Searching for and retrieving information

[0682] The user enters the name of a specific tool or service into a search form to find information about it. The device generates a search query and sends it to the server. The server searches its database based on the received query and retrieves matching information. The retrieved information is sent from the server to the device and displayed to the user.

[0683] Notifications and Contacts

[0684] The user selects a user they want to contact from the search results. The device sends a request to the server containing the selected user's information. The server sends a notification to the selected user and a message to the specified contact (email or chat). It then returns the notification sending result to the device, informing the user that the notification was successful.

[0685] Specific example

[0686] For example, if member A of the design team starts using "Design Tool X," member A enters information about "Design Tool X" and saves it in the database. Later, when member B searches for information about "Design Tool X," member A's information is found in the database and displayed on member B's terminal. Member B can then contact member A through the system to learn more about "Design Tool X."

[0687] Example of a prompt

[0688] The following are specific examples of prompt statements to be input to a generative AI model:

[0689] Please explain the procedures and benefits of a system that allows users to register their information when they start using new tools or services, and enables other users to search for and contact that information.

[0690] This clarifies the specific operating procedures and benefits of the system, allowing users to utilize it smoothly.

[0691] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0692] Processing steps

[0693] Step 1: Enter user information

[0694] The user enters information about the new tool or service. For example, they might fill in details such as "Tool Name: Design Tool X", "Version: 1.0", "Date Started: 2023-01-01", and "Department Using: Design Team" in the input form.

[0695] Input: User-provided details about tools and services

[0696] Output: Information input request sent to the terminal

[0697] Step 2: Generate and submit information input request

[0698] The terminal generates a request to send the information entered by the user to the server. This request includes information such as the tool name, version, start date of use, and department using the tool.

[0699] The terminal sends the generated request to the server.

[0700] Input: Detailed information about the tools or services entered by the user.

[0701] Output: Information input request sent to the server

[0702] Step 3: Analyze the information and save it to the database.

[0703] The server parses the received request and extracts detailed information about the tools and services.

[0704] The server saves the extracted information to a database. For example, it uses an SQL INSERT statement to record information about "Design Tool X" into the database.

[0705] Input: Information input request sent from the terminal

[0706] Output: Detailed information about tools and services stored in the database

[0707] Step 4: Enter your search query

[0708] To search for information about a specific tool or service, the user enters its name into the search form. For example, they might enter "Design Tool X".

[0709] Input: User's search query (name of tool or service)

[0710] Output: Search query sent to the terminal

[0711] Step 5: Generate and submit search queries

[0712] The terminal generates a search query based on the name entered in the search form. Specifically, it sends "Tool Name: Design Tool X" to the server as an HTTP request.

[0713] The terminal sends the generated search query to the server.

[0714] Input: Search query entered by the user

[0715] Output: Search queries sent to the server

[0716] Step 6: Search the database

[0717] The server searches the database based on the received search query. For example, it might use an SQL SELECT statement to retrieve records related to "Design Tool X".

[0718] Input: Search query sent from the device

[0719] Output: Matching information retrieved from the database

[0720] Step 7: Submit search results

[0721] The server sends the search results to the terminal. For example, it might return a list of other users using "Design Tool X".

[0722] Input: Matching information retrieved from the database

[0723] Output: Search results sent to the device

[0724] Step 8: Displaying search results

[0725] The terminal displays search results received from the server to the user. For example, information about users using "Design Tool X" may be displayed in a table or card format.

[0726] Input: Search results sent from the server

[0727] Output: Search results displayed to the user

[0728] Step 9: Select contacts and generate requests

[0729] The user selects other users they want to contact from the search results. For example, they might click on a user's name.

[0730] The device generates a request to contact the selected user. This request includes contact information and message content.

[0731] Input: User selects contact information

[0732] Output: Contact request to send to server

[0733] Step 10: Send contact request and perform notification

[0734] The terminal sends the generated contact request to the server.

[0735] The server parses the received contact request and sends a message through the appropriate notification method. For example, it might use a mail server to send a notification message.

[0736] Input: Contact request sent from the device

[0737] Output: Notification message sent to other users

[0738] Step 11: Sending and displaying notification results

[0739] The server receives the notification transmission result and sends it to the requesting terminal.

[0740] The device displays the transmission result to the user. For example, it might display a message such as, "A notification has been sent to contact A."

[0741] Input: Notification sent from the server

[0742] Output: Notification sent to the user

[0743] The above outlines the specific processing steps of this system.

[0744] (Application Example 1)

[0745] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0746] In recent years, manufacturing sites such as factories have been improving work efficiency by introducing various equipment and work procedures. However, when introducing new equipment or work procedures, problems arise such as a lack of information and the inability to effectively share existing knowledge. On the other hand, if there are users or departments that are already using the same equipment or work procedures, coordination and information sharing with them can greatly improve the efficiency of the introduction. However, current systems do not have a mechanism for sharing such information quickly and accurately, resulting in increased research time, duplicated work, and decreased work efficiency.

[0747] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0748] In this invention, the server includes means for inputting information on equipment and work procedures that a user has started using; means for storing the inputted information on equipment and work procedures in a database; means for the user to search for information on specific equipment and work procedures; means for obtaining information on equipment and work procedures that match specified conditions from the database; means for displaying the obtained information to the user; means for generating a notification message from the obtained information for the user to contact a specific other user and sending it to a specified contact; and means for generating and displaying a prompt using a generative AI model to promote additional knowledge sharing based on the obtained information. As a result, when introducing new equipment or work procedures, users can quickly obtain knowledge and experience from users who have already introduced them, thereby reducing investigation time and improving work efficiency.

[0749] "Equipment and operational procedures" is a general term referring to the devices, robots, tools, and methods and procedures for using them that are used in factories and manufacturing sites.

[0750] A "database" is a system that systematically stores and manages information, making it searchable and retrievable as needed.

[0751] A "notification message" is a message sent by one user to another user to contact them, and it is sent to their contacts.

[0752] A "generative AI model" refers to an algorithm or system that uses artificial intelligence technology to generate prompts based on specific conditions.

[0753] A "prompt" is text generated by a generative AI model and used as instructions or questions for users to share additional knowledge.

[0754] A "server" is a computer system used for storing, managing, and processing information, and its role is to provide data in response to user requests.

[0755] This invention is a system for quickly and efficiently sharing new equipment and work procedures used in factories and manufacturing sites with other users and departments. This system can reduce the time required for implementation surveys and improve operational efficiency.

[0756] 1. System Overview

[0757] This system allows users to input information about equipment and work procedures they have started using, and saves this information in a database. Other users can then search for information about the same equipment and procedures, and based on the search results, connect with and communicate with other users who are already using them. Furthermore, it uses a generative AI model to generate prompts, facilitating additional knowledge sharing.

[0758] 2. User Information Registration

[0759] Information input and saving

[0760] When a user begins using new equipment or a new work procedure, they input that information into the system via a terminal. This input includes the name, manufacturer, model, and start date of use of the equipment or procedure. The terminal generates and sends a request to the server to receive the input information. The server analyzes the received information and stores it in a database. For example, user A inputs information about the newly introduced robot "XYZ-123" into the system, and this information is stored in the database.

[0761] 3. Searching for and obtaining information

[0762] Execute search

[0763] The user enters the name of a specific piece of equipment or work procedure into a search form on their terminal to find information about it. The terminal generates a search query and sends it to the server. The server searches its database based on the received query and retrieves matching information.

[0764] Displaying search results

[0765] The server sends the search results to the terminal. The terminal displays the search results to the user. For example, if user B searches for information about the same robot "XYZ-123", user A's information will be found in the database and displayed on user B's terminal.

[0766] 4. Notifications and Communications

[0767] Selection of communication method

[0768] The user selects a user they wish to contact from the search results. The device then sends a request to the server containing the selected user's information.

[0769] Execute notification

[0770] The server sends a notification to the selected user and a message to the specified contact (email or chat). As proof of the notification's success, the server returns the notification's delivery status to the device, informing the user that the notification was successful. For example, if user B wants to contact user A, user B can send a notification to user A through the system and initiate contact.

[0771] 5. Prompt generation using generative AI models

[0772] The server uses a generative AI model to generate prompts based on the acquired information to facilitate additional knowledge sharing. The generated prompts are displayed to the user and used for specific advice and gathering additional information. An example of a prompt is: "Please register information about the newly introduced robot XYZ-123 and receive advice from users who are already using it regarding its specific usage and problem-solving methods."

[0773] This system allows users to quickly access information about equipment and work procedures used by other users and departments within the organization, and to communicate efficiently. As a result, research time is reduced, knowledge and experience are shared across the organization, and work efficiency is improved. This significantly simplifies the process of introducing new equipment and work procedures, and reduces the time and effort required for research and communication.

[0774] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0775] Step 1:

[0776] The user inputs information about the equipment and work procedures they have started using. Specifically, the user uses a terminal to input information such as the name, manufacturer, model, and start date of use of the equipment or work procedure. The input data is formatted by the terminal, and a request is generated to send to the server. The input data is sent to the server in JSON format.

[0777] Step 2:

[0778] The server analyzes the information received from the terminal and stores it in the database. Upon receiving the information, the server validates the input data to check for any invalid data. Data that passes validation is converted to an appropriate format so that it can be correctly stored in the database. This may include operations such as trimming strings and standardizing date formats.

[0779] Step 3:

[0780] A user searches for information on specific equipment or work procedures. The user enters the name of the equipment or work procedure and other criteria into the search form on the terminal. The terminal generates a search query based on this information and sends it to the server. The search criteria are sent in JSON format.

[0781] Step 4:

[0782] The server searches the database based on the received search query. The server retrieves data that matches the specified criteria. In this process, indexes are often used to improve search efficiency. The retrieved data is then formatted into an appropriate format.

[0783] Step 5:

[0784] The server sends the retrieved search results to the device. The server converts the search results into JSON format and sends it back to the device. The device receives this data.

[0785] Step 6:

[0786] The device displays the acquired information to the user. The device analyzes the received search results and displays them in a format that is easy for the user to understand. This includes displaying the information in table or list format.

[0787] Step 7:

[0788] The system connects users with other users based on the information selected by the user. The user selects the user they wish to contact from the displayed information and specifies their contact details (email or chat). The device then generates a notification message based on this information and sends it to the server.

[0789] Step 8:

[0790] The server sends a notification message to the specified contact. The server generates a notification message and sends it to the specified contact using the API of an email or chat service. The sending result is returned to the device and notified to the user.

[0791] Step 9:

[0792] The server generates and displays prompts using a generative AI model to facilitate additional knowledge sharing based on the acquired information. The server uses the generative AI model to generate useful prompt sentences based on the aforementioned information. The generated prompt sentences are sent to the terminal and displayed to the user. For example, a sentence such as "I would like to register information about the newly introduced robot XYZ-123 and receive advice from users who are already using it regarding specific usage and problem-solving methods" might be generated.

[0793] Through this series of processing steps, the system of the present invention facilitates rapid knowledge sharing among other users when introducing new equipment or work procedures in factories and manufacturing sites, enabling efficient work execution.

[0794] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0795] This invention combines a system that connects users with other users or departments already using the same tools or services to share knowledge and experience when users encounter new tools or services, with an emotion engine that recognizes the user's emotions. This system enables appropriate responses based on emotions, and is expected to reduce investigation time and improve work efficiency.

[0796] 1. System Overview

[0797] This system allows users to input information about tools and services they start using and saves it in a database. Furthermore, other users can search for information about the same tools and services, and connect with and communicate with users who are already using them based on the search results. In addition, an emotion engine analyzes the user's emotions and provides the most appropriate response based on those emotions.

[0798] 2. User Information Registration

[0799] Information input and saving

[0800] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, its version, the date it was started, and the department using it.

[0801] The terminal generates an HTTP request based on the entered information and sends it to the server.

[0802] The server analyzes the received information and stores it in the database.

[0803] For example, if member A of the design team starts using "design tool X," member A will input information about "design tool X" and save it to the database.

[0804] 3. Searching for and obtaining information

[0805] Execute search

[0806] Users enter the name of a specific tool or service into the search form to find information about it.

[0807] The terminal generates a search query and sends it to the server.

[0808] The server searches the database based on the received query and retrieves matching information.

[0809] Displaying search results

[0810] The server sends the search results to the terminal.

[0811] The device displays search results to the user.

[0812] For example, if member B searches for information about "design tool X," member A's information will be found in the database and displayed on member B's terminal.

[0813] 4. Notifications and Communications

[0814] Selection of communication method

[0815] The user selects a user they want to contact from the search results.

[0816] The terminal generates an HTTP request based on the selected user's information and sends it to the server.

[0817] Execute notification

[0818] The server parses the received request and retrieves the contact information of the selected user.

[0819] The server generates a notification message and sends it to the specified contact.

[0820] Presentation of notification results

[0821] The server generates a response based on the notification transmission results and sends it to the terminal.

[0822] The device receives the response and displays to the user that the notification was successful.

[0823] For example, if member B wants to contact member A, member B can send a notification to member A through the system and make contact.

[0824] 5. Function of the Emotion Engine

[0825] Recognition of emotions

[0826] When a user enters information into the system or performs a search, the emotion engine analyzes the user's input and voice to identify their emotions.

[0827] The server saves the user's emotions to a database based on the analysis results.

[0828] Providing the optimal solution

[0829] The server generates responses based on the identified emotions and presents them to the user through the emotion engine.

[0830] The device displays the suggested solutions to the user.

[0831] For example, if member B is experiencing difficulties with "design tool X," the emotion engine can identify that emotion and suggest appropriate support and guidance.

[0832] 6. System Advantages

[0833] This system allows users to quickly understand the tools and services being used by other users and departments within their organization, and to communicate efficiently. Furthermore, the emotion engine provides appropriate responses based on the user's emotional state, improving the user experience. As a result, it is expected to reduce research time and improve work efficiency.

[0834] The following describes the processing flow.

[0835] Information Registration

[0836] Step 1:

[0837] The user logs into the system.

[0838] Step 2:

[0839] The user opens the "Register for a new tool or service" form.

[0840] Step 3:

[0841] The user enters information about the tool or service (name, version, start date, department using it) into the form.

[0842] Step 4:

[0843] While the user is typing, the emotion engine analyzes the input, the user's facial expressions, and voice to identify their emotions.

[0844] Step 5:

[0845] The emotion engine identifies an emotion and sends it to the server.

[0846] Step 6:

[0847] The server analyzes the received emotion data and stores it in a database.

[0848] Step 7:

[0849] The user presses the "Register" button.

[0850] Step 8:

[0851] The terminal generates an HTTP request based on the information entered and sends it to the server.

[0852] Step 9:

[0853] The server parses the received request and saves the information to the database.

[0854] Step 10:

[0855] The server generates a response indicating successful registration and sends it to the terminal.

[0856] Step 11:

[0857] The device receives a response and displays a message to the user indicating that registration was successful.

[0858] Searching for and retrieving information

[0859] Step 1:

[0860] The user logs into the system.

[0861] Step 2:

[0862] The user opens the "Information Search" form.

[0863] Step 3:

[0864] Enter the name of the tool or service you want to search for.

[0865] Step 4:

[0866] The emotion engine analyzes the user's input and voice to identify their emotions.

[0867] Step 5:

[0868] The emotion engine identifies an emotion and sends it to the server.

[0869] Step 6:

[0870] The server analyzes the received emotion data and stores it in a database.

[0871] Step 7:

[0872] The user presses the "search" button.

[0873] Step 8:

[0874] The terminal generates an HTTP request based on the entered keyword and sends it to the server.

[0875] Step 9:

[0876] The server searches the database based on the received request and retrieves matching information.

[0877] Step 10:

[0878] The server generates a response based on the search results and sends it to the terminal.

[0879] Step 11:

[0880] The device receives the response and displays the search results to the user.

[0881] Notifications and Contacts

[0882] Step 1:

[0883] The user selects the user they want to contact from the search results.

[0884] Step 2:

[0885] The device generates an HTTP request based on the selected user's information and sends it to the server.

[0886] Step 3:

[0887] The server parses the received request and retrieves the contact information of the selected user.

[0888] Step 4:

[0889] The server generates a notification message and sends it to the specified contact.

[0890] Step 5:

[0891] The server generates a response based on the notification transmission result and sends it to the terminal.

[0892] Step 6:

[0893] The device receives a response and displays to the user that the notification was successful.

[0894] Step 7:

[0895] The emotion engine provides feedback and suggests the next action based on the user's emotional state.

[0896] In this way, users can efficiently connect with other users and receive appropriate responses based on their emotions. For example, if member B is experiencing difficulties with "design tool X," the emotion engine can identify that emotion and provide support by suggesting solutions.

[0897] (Example 2)

[0898] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0899] There has been a problem in understanding the usage status of existing corporate tools and services and in efficiently communicating with users. Furthermore, there is a problem in that the user experience deteriorates because there is no appropriate response to the anxiety and difficulties that users feel when using new tools and services. This invention aims to solve these problems.

[0900] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting information on tools and services that a user has started using, means for storing the inputted information on tools and services in a database, means for the user to search for information on specific tools and services, means for obtaining information on tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for contacting other users based on the information selected by the user, means for analyzing the user's input content and voice to identify emotions, and means for generating and presenting countermeasures based on the emotions. As a result, the user can quickly and efficiently share information and contact other users and departments, and can also receive appropriate support according to their emotions.

[0901] A "user" is an individual who uses the system to input information, search for information, or communicate.

[0902] "Tool and service information" refers to specific data regarding the tools and services that a user has started using, such as their name, version, start date, and department in which they are used.

[0903] A "database" is a collection of information and the system that manages it, used to store and manage information and analysis results from tools and services entered by users.

[0904] A "search method" refers to the function or interface that a user uses to search for information about a particular tool or service.

[0905] "Means for obtaining information that matches the conditions" refers to a system component that has the function of extracting information about tools and services that match the conditions specified by the user from a database.

[0906] "Means of displaying information" refers to screen display devices or interfaces that visually present acquired information to the user.

[0907] "Communication methods" refer to message generation and sending functions used to contact other users based on information selected by the user.

[0908] "Means for identifying emotions" refers to an analysis engine and functions that analyze user input and voice to recognize the user's emotions.

[0909] "Means for generating and presenting countermeasures" refers to a function that presents appropriate countermeasures and support to the user based on the results of identifying their emotions.

[0910] This invention is a system that allows users to input information about new tools and services and save it in a database. It also allows other users to search for information about the same tools and services and communicate with each other. Furthermore, this invention is a system that uses an emotion engine to recognize the user's emotions and suggests appropriate responses based on those emotions.

[0911] System Configuration

[0912] This system mainly consists of the following components:

[0913] A terminal for users to input information.

[0914] A function that sends information entered by the terminal to the server as an HTTP request.

[0915] A function that allows a server to receive information and save it to a database.

[0916] A feature that allows the device to send the user's search queries to the server.

[0917] A function that allows the server to retrieve search results from the database and send them to the terminal.

[0918] The emotion engine analyzes user input and voice to recognize emotions.

[0919] Interfaces and APIs for connecting each component.

[0920] Hardware and software to be used

[0921] The main hardware and software used in this system include the following:

[0922] Server: Web server software such as Apache or NGINX.

[0923] Database: A database management system such as MySQL or PostgreSQL.

[0924] Device: A user interface device such as a smartphone or PC.

[0925] Emotion engine: Sentiment analysis engines such as Google Cloud Natural Language API and IBM Watson.

[0926] Specific examples of operating procedures

[0927] Enter and save new tool information.

[0928] When a user starts using a new tool or service, they enter the information into their terminal. For example, if they start using "Design Tool X," they would enter its name, version, start date, and department using it.

[0929] The terminal generates an HTTP POST request based on the entered information and sends it to the server.

[0930] The server analyzes the received information and inserts records into the appropriate database tables. This stores information about new tools and services in the database.

[0931] Searching for and retrieving information

[0932] To search for information about a specific tool or service, the user enters the name into the search form. For example, they might enter "Design Tool X".

[0933] The terminal generates a GET request based on the search query entered by the user and sends it to the server.

[0934] The server searches the database based on the received query, retrieves matching information, and sends it to the terminal in JSON format.

[0935] The terminal displays the retrieved search results to the user. This allows the user to see information about "Design Tool X" entered by other users.

[0936] Notifications and Contacts

[0937] The user selects the user they want to contact from the search results. For example, if they want to contact a user who is knowledgeable about design tool X.

[0938] The device generates an HTTP POST request containing the user's ID and sends it to the server.

[0939] The server parses the received request, retrieves the contact information of the specified user, and generates and sends a notification message.

[0940] The device will display a notification to the user indicating that the notification was successful. For example, it might display "Notification successful."

[0941] Using an Emotion Engine

[0942] When a user enters information or searches for something, the emotion engine analyzes the user's input and voice to identify their emotion. For example, if a user enters "troubled," the emotion engine identifies it as "confused."

[0943] The server stores the identified emotion information in a database and generates countermeasures based on that emotion.

[0944] The device then presents the generated solutions to the user. For example, it might display, "Here are the guidelines to resolve this issue."

[0945] Example of a prompt

[0946] "I've started using the new design tool X, but I'm having trouble understanding many things. I'd like to get in touch with members of other departments who are using the same tool."

[0947] This allows users to connect with other users using the same tools and services, efficiently solve problems, and receive appropriate support tailored to their needs.

[0948] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0949] Step 1:

[0950] The user enters information about the new tool or service. For example, they might enter information such as "Tool Name: Design Tool X", "Version: 1.0", "Date Started: 2023-10-01", and "Department: Design" into a form. The system also checks the input data and displays error messages to the user as needed.

[0951] Input: Information about tools and services entered by the user.

[0952] Output: HTTP POST request generated by the terminal.

[0953] Step 2:

[0954] The device generates an HTTP POST request based on the information entered by the user and sends it to the server. Specifically, it packages the data in JSON format and sends it to the specified API endpoint.

[0955] Input: Information entered by the user.

[0956] Output: HTTP POST request sent to the server.

[0957] Step 3:

[0958] The server parses the HTTP POST request it receives and saves it to the database. First, it extracts data from the request body and saves it to the database table using an SQL INSERT statement.

[0959] Input: HTTP POST request sent from the terminal.

[0960] Output: Information about tools and services stored in the database.

[0961] Step 4:

[0962] To search for information about a specific tool or service, the user enters the name into the search form and clicks the "Search" button. For example, they might enter "Design Tool X".

[0963] Input: The search query entered by the user in the search form.

[0964] Output: Expectations regarding the search results displayed on the device.

[0965] Step 5:

[0966] The device generates a GET request based on the user's search query and sends it to the server. Query parameters are added to the URL, and the request is sent to the specified API endpoint.

[0967] Input: The search query entered by the user.

[0968] Output: HTTP GET request sent to the server.

[0969] Step 6:

[0970] The server parses the received GET request and searches the database. It then uses an SQL SELECT statement to retrieve matching information from the database.

[0971] Input: HTTP GET request sent from the terminal.

[0972] Output: Search results retrieved by the server.

[0973] Step 7:

[0974] The server sends the retrieved search results to the terminal in JSON format. The result data is converted to an appropriate format and returned as an HTTP response.

[0975] Input: Search results retrieved from the database.

[0976] Output: The HTTP response sent to the terminal.

[0977] Step 8:

[0978] The device displays the search results it has received to the user. A list of search results is displayed on the screen, allowing the user to select from them.

[0979] Input: HTTP response received from the server.

[0980] Output: Search results displayed to the user.

[0981] Step 9:

[0982] The user selects a user they want to contact from the search results. For example, they click on a specific user from the list.

[0983] Input: User information selected by the user.

[0984] Output: Contact expected from the selected user.

[0985] Step 10:

[0986] The terminal generates an HTTP POST request based on the selected user's information and sends it to the server. It then packages and sends data including the selected user's ID.

[0987] Input: User information selected by the user.

[0988] Output: HTTP POST request sent to the server.

[0989] Step 11:

[0990] The server parses the received request and retrieves the contact information of the specified user. Then, it generates and sends a notification message. It uses an SQL SELECT statement to retrieve the contact information and uses it to send the notification message.

[0991] Input: HTTP POST request sent from the terminal.

[0992] Output: A notification message sent to the specified contact.

[0993] Step 12:

[0994] The server generates a response based on the notification transmission results and sends it to the terminal. The response includes the success or failure status in JSON format.

[0995] Input: Result of notification transmission.

[0996] Output: The HTTP response sent back to the terminal.

[0997] Step 13:

[0998] The device receives a response and displays a message to the user indicating that the notification was successful. For example, it might display "Notification successful."

[0999] Input: HTTP response received from the server.

[1000] Output: The notification result displayed to the user.

[1001] Step 14:

[1002] When a user enters information or performs a search, the emotion engine analyzes the user's input and voice to identify their emotions. For example, if the user enters "troubled," the engine recognizes that emotion as "confused."

[1003] Input: User input or voice information.

[1004] Output: Identified sentiment information.

[1005] Step 15:

[1006] The server saves the sentiment data to the database based on the analysis results. The sentiment data is saved using an SQL INSERT statement.

[1007] Input: Emotional data sent from the emotion engine.

[1008] Output: Emotional information stored in the database.

[1009] Step 16:

[1010] The server generates emotion-based responses and sends them to the device. For example, it generates support guidelines for the emotion "confused" and sends them to the device in JSON format.

[1011] Input: Identified sentiment information.

[1012] Output: The countermeasures sent to the terminal.

[1013] Step 17:

[1014] The device displays suggested solutions to the user. For example, it might display, "Here are the guidelines to resolve this issue."

[1015] Input: Countermeasures sent from the server.

[1016] Output: The countermeasures presented to the user.

[1017] (Application Example 2)

[1018] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1019] Currently, when introducing new machinery and tools in factories, the means of sharing information regarding operation methods, settings, and troubleshooting are sometimes inefficient. This results in operators taking a long time to become proficient in using new tools, potentially leading to operational errors and malfunctions, and ultimately reducing work efficiency. Furthermore, a challenge remains in providing appropriate support when operators experience stress or confusion.

[1020] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information on tools and services that a user has started using, means for storing the inputted tool and service information in a database, means for the user to search for information on specific tools and services, means for obtaining information on tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for contacting other users based on the information selected by the user, emotion engine means for recognizing the user's emotions, and means for generating and displaying appropriate responses based on the emotions recognized by the emotion engine means. As a result, operators can not only quickly become proficient in new tools and services, but also reduce operational errors and improve work efficiency by providing appropriate support according to their emotional state.

[1021] "User information" refers to information about the users who use the system.

[1022] "Tool and service information" refers to information such as the name, version, start date of use, and department that uses the tools and services that the user utilizes.

[1023] A "database" is a structured collection of records that stores information about the aforementioned tools and services, and allows it to be searched and retrieved when needed.

[1024] A "search method" refers to the interface and process that allows a user to find information about a specific tool or service.

[1025] "Communication methods" refer to features that allow users to exchange information and communicate with other users.

[1026] An "emotion engine" is a technology that recognizes a user's emotions and provides appropriate responses based on those emotions.

[1027] "Means for generating and displaying appropriate responses" refers to a process for providing responses and support in accordance with the user's emotions recognized by the emotion engine.

[1028] A "generative AI model" is an artificial intelligence algorithm used to generate the optimal result based on input data.

[1029] A "prompt sentence" is an input sentence that a generative AI model uses to generate an appropriate response.

[1030] This invention is a system that integrates an emotion engine to facilitate the smooth introduction and daily use of new machinery and tools within a factory. This system can recognize the user's emotions in real time and provide appropriate support.

[1031] System Configuration

[1032] hardware

[1033] Smart glasses (e.g., Microsoft HoloLens)

[1034] Server (cloud-based, e.g., AWS EC2)

[1035] Database (e.g., MySQL)

[1036] software

[1037] Emotion engine (e.g., Affectiva SDK)

[1038] Real-time information sharing system (e.g., WebSocket)

[1039] User interface (UI) frameworks (e.g., Unity)

[1040] System operation

[1041] 1. User information registration

[1042] Users enter information about new machines and tools using an app installed on their smart glasses. This includes the tool's name, version, start date, and department of use.

[1043] The terminal sends the entered information to the server as an HTTP request.

[1044] The server stores the received information in a database.

[1045] 2. Searching for and obtaining information

[1046] Users use smart glasses to search for information about specific tools or services using voice input.

[1047] The terminal sends the search query to the server via WebSocket.

[1048] The server searches the database for information, retrieves matching items, and sends the results back to the terminal.

[1049] The device displays search results to the user.

[1050] 3. Recognition of emotions and presentation of responses

[1051] The emotion engine analyzes the user's facial expressions through the smart glasses' camera and recognizes their emotional state.

[1052] The server generates appropriate countermeasures based on the analysis results received from the emotion engine.

[1053] The server displays the generated solutions (e.g., video tutorials, guides) on the smart glasses' display.

[1054] Specific example

[1055] Imagine an operator wearing smart glasses while using a newly introduced automated welding machine. When the operator asks a voice question like, "How do I set up the welding?", the application displays the appropriate setup procedure on the screen. Meanwhile, an emotion engine analyzes the operator's facial expressions, and if stress or confusion is detected, it suggests additional support (for example, detailed troubleshooting instructions or options to contact the help desk).

[1056] Example of a prompt

[1057] "I want to learn how to set up the newly installed automatic welding machine. Please provide a video tutorial on operation, monitor the operator's stress level with an emotion engine, and suggest appropriate support."

[1058] This system not only allows operators to quickly become proficient in using new equipment, but also provides appropriate support tailored to their emotional state, thereby reducing operational errors and improving work efficiency.

[1059] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1060] Step 1:

[1061] Enter and submit user information.

[1062] Users input information about new machines and tools through smart glasses.

[1063] The input includes the tool's name, version, start date, and department using it.

[1064] The terminal generates this input information as an HTTP request and sends it to the server.

[1065] (Input) Information about tools and services provided by the user.

[1066] (Output) Information formed as an HTTP request.

[1067] Step 2:

[1068] Storing information in a database

[1069] The server parses the received HTTP request, breaks down the input information, and stores it in the database.

[1070] When saving, the files are sorted into save fields based on the tool name, version, start date, and department using the tool.

[1071] (Input) Received HTTP request.

[1072] (Output) Information about tools and services stored in the database.

[1073] Step 3:

[1074] Searching for and retrieving information

[1075] Users can use smart glasses to search for information about specific tools or services by voice. For example, "I'm looking for information about a new automatic welding machine."

[1076] The terminal converts the voice data into text and generates a search query. This is then sent to the server via WebSocket.

[1077] The server searches the database, retrieves information on matching tools and services, and sends the results back to the terminal.

[1078] (Input) Voice command from the user (search query).

[1079] (Output) Information retrieved from the database and displayed to the user.

[1080] Step 4:

[1081] Emotion recognition and data transmission

[1082] The emotion engine analyzes the user's facial expressions and voice through the smart glasses' camera to recognize their emotional state.

[1083] The server receives the analysis results sent from the emotion engine and performs data calculations to generate appropriate countermeasures.

[1084] (Input) User's facial expressions and voice data.

[1085] (Output) Analyzed emotional status.

[1086] Step 5:

[1087] Generating appropriate countermeasures

[1088] Based on the received emotional state, the server uses a generative AI model to generate prompt sentences, and then generates appropriate countermeasures (such as video tutorials or guides) based on those prompts.

[1089] The generated countermeasures are prepared as data to be displayed to the user.

[1090] (Input) Analyzed emotion status.

[1091] (Output) Generated countermeasures (responses and guides based on prompt statements).

[1092] Step 6:

[1093] Display of optimal countermeasures

[1094] The device receives the appropriate countermeasure sent from the server and displays it on the smart glasses' display.

[1095] The user reviews the displayed information and continues with the task or operation.

[1096] (Input) Countermeasure data generated from the server.

[1097] (Output) Appropriate countermeasures displayed on the smart glasses' screen.

[1098] Through the above processing steps, users can quickly and efficiently learn how to operate new machines and tools, and with appropriate support tailored to their needs, it is expected that work errors will be reduced and work efficiency will be improved.

[1099] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1100] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1101] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1102] [Third Embodiment]

[1103] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1104] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1105] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1106] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1107] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1108] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1109] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1110] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1111] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1112] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1113] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1114] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1115] This invention provides a system for users to connect with other users or departments already using the same tools or services when using new tools or services, allowing for the sharing of knowledge and experience. This system is expected to reduce research time and enable more efficient work execution.

[1116] 1. System Overview

[1117] This system allows users to input information about tools and services they start using and save it in a database. Other users can then search for information about the same tools and services, and based on the search results, connect with and contact users who are already using them.

[1118] 2. User Information Registration

[1119] Information input and saving

[1120] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, its version, the date it was started, and the department using it.

[1121] The terminal generates and sends a request to the server to send the entered information.

[1122] The server analyzes the received information and stores it in the database.

[1123] For example, if member A of the design team starts using "design tool X," member A will input information about "design tool X" and save it to the database.

[1124] 3. Searching for and obtaining information

[1125] Execute search

[1126] Users enter the name of a specific tool or service into the search form to find information about it.

[1127] The terminal generates a search query and sends it to the server.

[1128] The server searches the database based on the received query and retrieves matching information.

[1129] Displaying search results

[1130] The server sends the search results to the terminal.

[1131] The device displays search results to the user.

[1132] For example, if member B searches for information about "design tool X," member A's information will be found in the database and displayed on member B's terminal.

[1133] 4. Notifications and Communications

[1134] Selection of communication method

[1135] The user selects a user they want to contact from the search results.

[1136] The terminal sends a request to the server containing information about the selected user.

[1137] Execute notification

[1138] The server sends a notification to the selected user and a message to the specified contact (email or chat).

[1139] Presentation of notification results

[1140] The server returns the notification transmission result to the terminal, informing the user that the notification was successful.

[1141] The device displays a message to the user indicating that a notification has been sent.

[1142] For example, if member B wants to contact member A, member B can send a notification to member A through the system and make contact.

[1143] 5. System Advantages

[1144] This system allows users to quickly understand the tools and services being used by other users and departments within their organization, and to communicate efficiently. As a result, research time is reduced, knowledge and experience are shared throughout the organization, and work efficiency is improved.

[1145] This invention significantly simplifies the process of introducing new tools and services, reducing the time and effort required for research and communication.

[1146] The following describes the processing flow.

[1147] Information Registration

[1148] Step 1:

[1149] The user logs into the system.

[1150] Step 2:

[1151] The user opens the "Register for a new tool or service" form.

[1152] Step 3:

[1153] The user enters information about the tool or service (name, version, start date, department using it) into the form.

[1154] Step 4:

[1155] The user presses the "Register" button.

[1156] Step 5:

[1157] The terminal generates an HTTP request based on the information entered and sends it to the server.

[1158] Step 6:

[1159] The server parses the received request and saves the information to the database.

[1160] Step 7:

[1161] The server generates a response indicating successful registration and sends it to the terminal.

[1162] Step 8:

[1163] The device receives a response and displays a message to the user indicating that registration was successful.

[1164] Searching for and retrieving information

[1165] Step 1:

[1166] The user logs into the system.

[1167] Step 2:

[1168] The user opens the "Information Search" form.

[1169] Step 3:

[1170] Enter the name of the tool or service you want to search for.

[1171] Step 4:

[1172] The user presses the "search" button.

[1173] Step 5:

[1174] The terminal generates an HTTP request based on the entered keyword and sends it to the server.

[1175] Step 6:

[1176] The server searches the database based on the received request and retrieves matching information.

[1177] Step 7:

[1178] The server generates a response based on the search results and sends it to the terminal.

[1179] Step 8:

[1180] The device receives the response and displays the search results to the user.

[1181] Notifications and Contacts

[1182] Step 1:

[1183] The user selects the user they want to contact from the search results.

[1184] Step 2:

[1185] The device generates an HTTP request based on the selected user's information and sends it to the server.

[1186] Step 3:

[1187] The server parses the received request and retrieves the contact information of the selected user.

[1188] Step 4:

[1189] The server generates a notification message and sends it to the specified contact.

[1190] Step 5:

[1191] The server generates a response based on the notification transmission result and sends it to the terminal.

[1192] Step 6:

[1193] The device receives a response and displays to the user that the notification was successful.

[1194] This will enable users to efficiently connect with other users who are using existing tools and services, and to share knowledge and experience.

[1195] (Example 1)

[1196] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1197] When users begin using new tools or services, they often face difficulties sharing information with other users or departments already using the same tools or services, leading to lengthy research times and decreased work efficiency. This invention aims to solve these problems and enable rapid information sharing and efficient work execution within organizations.

[1198] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1199] In this invention, the server includes means for inputting information about tools and services that a user has started using, means for storing the inputted information about tools and services in a database, means for the user to search for information about specific tools and services, means for obtaining information about tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for the user to contact other users based on the information selected by the user, a terminal for transmitting the information input by the user to the server, means for the server to analyze the information received, and means for the server to send a message to a specified contact. This enables users to quickly share information with other users within the organization and communicate efficiently.

[1200] A "user" is an individual or entity that uses the system to perform actions such as entering, searching for, viewing, and communicating information about the tools and services.

[1201] "Tools and services" refers to the software, applications, platforms, or entire services that users utilize for their work or activities.

[1202] "Information" refers to data that includes data items such as the name, version, start date of use, and department that uses the tool or service.

[1203] "Means of input" refers to the interface or form that users use to input information about tools or services into a system.

[1204] "Means of saving to a database" refers to the functions and processes for storing information about entered tools and services in a database.

[1205] "Means of searching" refers to the functions or interfaces that allow users to search for information about specific tools or services.

[1206] "Means of acquisition" refers to the functions and processes used to search and retrieve information about tools and services that match specified criteria from a database.

[1207] "Means of display" refers to functions or interfaces that visually present acquired information to the user.

[1208] "Means of communication" refers to the means or interfaces that users use to communicate with other users.

[1209] A "terminal" refers to a device used by a user to access a system and perform operations such as entering information, searching, and making communications.

[1210] A "server" refers to a central system that manages the entire system and handles data storage, retrieval, analysis, and transmission.

[1211] "Means of analysis" refers to the functions and processes that allow a server to understand the user information it receives and take appropriate action.

[1212] "Means of sending messages to specified contacts" refers to the functions and methods that allow users to send messages to people they wish to contact.

[1213] This invention provides a system for users to connect with other users or departments already using the same tools or services when starting to use new tools or services, allowing for the sharing of knowledge and experience. This system is expected to reduce research time and enable more efficient work execution.

[1214] System Overview

[1215] The system inputs information about tools and services that users start using and stores it in a database. Users can search for information about specific tools and services, retrieve matching information from the database, and use that information to contact other users.

[1216] Hardware and software to be used

[1217] Hardware: Server, client terminals (PC, tablet, smartphone)

[1218] Software: Database management systems (e.g., MySQL, PostgreSQL), communication protocols (e.g., HTTP / HTTPS), notification systems (e.g., mail servers, chat APIs)

[1219] User Information Registration

[1220] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, version, start date, and department using it. The terminal generates and sends a request to the server to send the entered information. The server parses the received information and stores it in a database.

[1221] Searching for and retrieving information

[1222] The user enters the name of a specific tool or service into a search form to find information about it. The device generates a search query and sends it to the server. The server searches its database based on the received query and retrieves matching information. The retrieved information is sent from the server to the device and displayed to the user.

[1223] Notifications and Contacts

[1224] The user selects a user they want to contact from the search results. The device sends a request to the server containing the selected user's information. The server sends a notification to the selected user and a message to the specified contact (email or chat). It then returns the notification sending result to the device, informing the user that the notification was successful.

[1225] Specific example

[1226] For example, if member A of the design team starts using "Design Tool X," member A enters information about "Design Tool X" and saves it in the database. Later, when member B searches for information about "Design Tool X," member A's information is found in the database and displayed on member B's terminal. Member B can then contact member A through the system to learn more about "Design Tool X."

[1227] Example of a prompt

[1228] The following are specific examples of prompt statements to be input to a generative AI model:

[1229] Please explain the procedures and benefits of a system that allows users to register their information when they start using new tools or services, and enables other users to search for and contact that information.

[1230] This clarifies the specific operating procedures and benefits of the system, allowing users to utilize it smoothly.

[1231] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1232] Processing steps

[1233] Step 1: Enter user information

[1234] The user enters information about the new tool or service. For example, they might fill in details such as "Tool Name: Design Tool X", "Version: 1.0", "Date Started: 2023-01-01", and "Department Using: Design Team" in the input form.

[1235] Input: User-provided details about tools and services

[1236] Output: Information input request sent to the terminal

[1237] Step 2: Generate and submit information input request

[1238] The terminal generates a request to send the information entered by the user to the server. This request includes information such as the tool name, version, start date of use, and department using the tool.

[1239] The terminal sends the generated request to the server.

[1240] Input: Detailed information about the tools or services entered by the user.

[1241] Output: Information input request sent to the server

[1242] Step 3: Analyze the information and save it to the database.

[1243] The server parses the received request and extracts detailed information about the tools and services.

[1244] The server saves the extracted information to a database. For example, it uses an SQL INSERT statement to record information about "Design Tool X" into the database.

[1245] Input: Information input request sent from the terminal

[1246] Output: Detailed information about tools and services stored in the database

[1247] Step 4: Enter your search query

[1248] To search for information about a specific tool or service, the user enters its name into the search form. For example, they might enter "Design Tool X".

[1249] Input: User's search query (name of tool or service)

[1250] Output: Search query sent to the terminal

[1251] Step 5: Generate and submit search queries

[1252] The terminal generates a search query based on the name entered in the search form. Specifically, it sends "Tool Name: Design Tool X" to the server as an HTTP request.

[1253] The terminal sends the generated search query to the server.

[1254] Input: Search query entered by the user

[1255] Output: Search queries sent to the server

[1256] Step 6: Search the database

[1257] The server searches the database based on the received search query. For example, it might use an SQL SELECT statement to retrieve records related to "Design Tool X".

[1258] Input: Search query sent from the device

[1259] Output: Matching information retrieved from the database

[1260] Step 7: Submit search results

[1261] The server sends the search results to the terminal. For example, it might return a list of other users using "Design Tool X".

[1262] Input: Matching information retrieved from the database

[1263] Output: Search results sent to the device

[1264] Step 8: Displaying search results

[1265] The terminal displays search results received from the server to the user. For example, information about users using "Design Tool X" may be displayed in a table or card format.

[1266] Input: Search results sent from the server

[1267] Output: Search results displayed to the user

[1268] Step 9: Select contacts and generate requests

[1269] The user selects other users they want to contact from the search results. For example, they might click on a user's name.

[1270] The device generates a request to contact the selected user. This request includes contact information and message content.

[1271] Input: User selects contact information

[1272] Output: Contact request to send to server

[1273] Step 10: Send contact request and perform notification

[1274] The terminal sends the generated contact request to the server.

[1275] The server parses the received contact request and sends a message through the appropriate notification method. For example, it might use a mail server to send a notification message.

[1276] Input: Contact request sent from the device

[1277] Output: Notification message sent to other users

[1278] Step 11: Sending and displaying notification results

[1279] The server receives the notification transmission result and sends it to the requesting terminal.

[1280] The device displays the transmission result to the user. For example, it might display a message such as, "A notification has been sent to contact A."

[1281] Input: Notification sent from the server

[1282] Output: Notification sent to the user

[1283] The above outlines the specific processing steps of this system.

[1284] (Application Example 1)

[1285] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1286] In recent years, manufacturing sites such as factories have been improving work efficiency by introducing various equipment and work procedures. However, when introducing new equipment or work procedures, problems arise such as a lack of information and the inability to effectively share existing knowledge. On the other hand, if there are users or departments that are already using the same equipment or work procedures, coordination and information sharing with them can greatly improve the efficiency of the introduction. However, current systems do not have a mechanism for sharing such information quickly and accurately, resulting in increased research time, duplicated work, and decreased work efficiency.

[1287] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1288] In this invention, the server includes means for inputting information on equipment and work procedures that a user has started using; means for storing the inputted information on equipment and work procedures in a database; means for the user to search for information on specific equipment and work procedures; means for obtaining information on equipment and work procedures that match specified conditions from the database; means for displaying the obtained information to the user; means for generating a notification message from the obtained information for the user to contact a specific other user and sending it to a specified contact; and means for generating and displaying a prompt using a generative AI model to promote additional knowledge sharing based on the obtained information. As a result, when introducing new equipment or work procedures, users can quickly obtain knowledge and experience from users who have already introduced them, thereby reducing investigation time and improving work efficiency.

[1289] "Equipment and operational procedures" is a general term referring to the devices, robots, tools, and methods and procedures for using them that are used in factories and manufacturing sites.

[1290] A "database" is a system that systematically stores and manages information, making it searchable and retrievable as needed.

[1291] A "notification message" is a message sent by one user to another user to contact them, and it is sent to their contacts.

[1292] A "generative AI model" refers to an algorithm or system that uses artificial intelligence technology to generate prompts based on specific conditions.

[1293] A "prompt" is text generated by a generative AI model and used as instructions or questions for users to share additional knowledge.

[1294] A "server" is a computer system used for storing, managing, and processing information, and its role is to provide data in response to user requests.

[1295] This invention is a system for quickly and efficiently sharing new equipment and work procedures used in factories and manufacturing sites with other users and departments. This system can reduce the time required for implementation surveys and improve operational efficiency.

[1296] 1. System Overview

[1297] This system allows users to input information about equipment and work procedures they have started using, and saves this information in a database. Other users can then search for information about the same equipment and procedures, and based on the search results, connect with and communicate with other users who are already using them. Furthermore, it uses a generative AI model to generate prompts, facilitating additional knowledge sharing.

[1298] 2. User Information Registration

[1299] Information input and saving

[1300] When a user begins using new equipment or a new work procedure, they input that information into the system via a terminal. This input includes the name, manufacturer, model, and start date of use of the equipment or procedure. The terminal generates and sends a request to the server to receive the input information. The server analyzes the received information and stores it in a database. For example, user A inputs information about the newly introduced robot "XYZ-123" into the system, and this information is stored in the database.

[1301] 3. Searching for and obtaining information

[1302] Execute search

[1303] The user enters the name of a specific piece of equipment or work procedure into a search form on their terminal to find information about it. The terminal generates a search query and sends it to the server. The server searches its database based on the received query and retrieves matching information.

[1304] Displaying search results

[1305] The server sends the search results to the terminal. The terminal displays the search results to the user. For example, if user B searches for information about the same robot "XYZ-123", user A's information will be found in the database and displayed on user B's terminal.

[1306] 4. Notifications and Communications

[1307] Selection of communication method

[1308] The user selects a user they wish to contact from the search results. The device then sends a request to the server containing the selected user's information.

[1309] Execute notification

[1310] The server sends a notification to the selected user and a message to the specified contact (email or chat). As proof of the notification's success, the server returns the notification's delivery status to the device, informing the user that the notification was successful. For example, if user B wants to contact user A, user B can send a notification to user A through the system and initiate contact.

[1311] 5. Prompt generation using generative AI models

[1312] The server uses a generative AI model to generate prompts based on the acquired information to facilitate additional knowledge sharing. The generated prompts are displayed to the user and used for specific advice and gathering additional information. An example of a prompt is: "Please register information about the newly introduced robot XYZ-123 and receive advice from users who are already using it regarding its specific usage and problem-solving methods."

[1313] This system allows users to quickly access information about equipment and work procedures used by other users and departments within the organization, and to communicate efficiently. As a result, research time is reduced, knowledge and experience are shared across the organization, and work efficiency is improved. This significantly simplifies the process of introducing new equipment and work procedures, and reduces the time and effort required for research and communication.

[1314] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1315] Step 1:

[1316] The user inputs information about the equipment and work procedures they have started using. Specifically, the user uses a terminal to input information such as the name, manufacturer, model, and start date of use of the equipment or work procedure. The input data is formatted by the terminal, and a request is generated to send to the server. The input data is sent to the server in JSON format.

[1317] Step 2:

[1318] The server analyzes the information received from the terminal and stores it in the database. Upon receiving the information, the server validates the input data to check for any invalid data. Data that passes validation is converted to an appropriate format so that it can be correctly stored in the database. This may include operations such as trimming strings and standardizing date formats.

[1319] Step 3:

[1320] A user searches for information on specific equipment or work procedures. The user enters the name of the equipment or work procedure and other criteria into the search form on the terminal. The terminal generates a search query based on this information and sends it to the server. The search criteria are sent in JSON format.

[1321] Step 4:

[1322] The server searches the database based on the received search query. The server retrieves data that matches the specified criteria. In this process, indexes are often used to improve search efficiency. The retrieved data is then formatted into an appropriate format.

[1323] Step 5:

[1324] The server sends the retrieved search results to the device. The server converts the search results into JSON format and sends it back to the device. The device receives this data.

[1325] Step 6:

[1326] The device displays the acquired information to the user. The device analyzes the received search results and displays them in a format that is easy for the user to understand. This includes displaying the information in table or list format.

[1327] Step 7:

[1328] The system connects users with other users based on the information selected by the user. The user selects the user they wish to contact from the displayed information and specifies their contact details (email or chat). The device then generates a notification message based on this information and sends it to the server.

[1329] Step 8:

[1330] The server sends a notification message to the specified contact. The server generates a notification message and sends it to the specified contact using the API of an email or chat service. The sending result is returned to the device and notified to the user.

[1331] Step 9:

[1332] The server generates and displays prompts using a generative AI model to facilitate additional knowledge sharing based on the acquired information. The server uses the generative AI model to generate useful prompt sentences based on the aforementioned information. The generated prompt sentences are sent to the terminal and displayed to the user. For example, a sentence such as "I would like to register information about the newly introduced robot XYZ-123 and receive advice from users who are already using it regarding specific usage and problem-solving methods" might be generated.

[1333] Through this series of processing steps, the system of the present invention facilitates rapid knowledge sharing among other users when introducing new equipment or work procedures in factories and manufacturing sites, enabling efficient work execution.

[1334] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1335] This invention combines a system that connects users with other users or departments already using the same tools or services to share knowledge and experience when users encounter new tools or services, with an emotion engine that recognizes the user's emotions. This system enables appropriate responses based on emotions, and is expected to reduce investigation time and improve work efficiency.

[1336] 1. System Overview

[1337] This system allows users to input information about tools and services they start using and saves it in a database. Furthermore, other users can search for information about the same tools and services, and connect with and communicate with users who are already using them based on the search results. In addition, an emotion engine analyzes the user's emotions and provides the most appropriate response based on those emotions.

[1338] 2. User Information Registration

[1339] Information input and saving

[1340] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, its version, the date it was started, and the department using it.

[1341] The terminal generates an HTTP request based on the entered information and sends it to the server.

[1342] The server analyzes the received information and stores it in the database.

[1343] For example, if member A of the design team starts using "design tool X," member A will input information about "design tool X" and save it to the database.

[1344] 3. Searching for and obtaining information

[1345] Execute search

[1346] Users enter the name of a specific tool or service into the search form to find information about it.

[1347] The terminal generates a search query and sends it to the server.

[1348] The server searches the database based on the received query and retrieves matching information.

[1349] Displaying search results

[1350] The server sends the search results to the terminal.

[1351] The device displays search results to the user.

[1352] For example, if member B searches for information about "design tool X," member A's information will be found in the database and displayed on member B's terminal.

[1353] 4. Notifications and Communications

[1354] Selection of communication method

[1355] The user selects a user they want to contact from the search results.

[1356] The terminal generates an HTTP request based on the selected user's information and sends it to the server.

[1357] Execute notification

[1358] The server parses the received request and retrieves the contact information of the selected user.

[1359] The server generates a notification message and sends it to the specified contact.

[1360] Presentation of notification results

[1361] The server generates a response based on the notification transmission results and sends it to the terminal.

[1362] The device receives the response and displays to the user that the notification was successful.

[1363] For example, if member B wants to contact member A, member B can send a notification to member A through the system and make contact.

[1364] 5. Function of the Emotion Engine

[1365] Recognition of emotions

[1366] When a user enters information into the system or performs a search, the emotion engine analyzes the user's input and voice to identify their emotions.

[1367] The server saves the user's emotions to a database based on the analysis results.

[1368] Providing the optimal solution

[1369] The server generates responses based on the identified emotions and presents them to the user through the emotion engine.

[1370] The device displays the suggested solutions to the user.

[1371] For example, if member B is experiencing difficulties with "design tool X," the emotion engine can identify that emotion and suggest appropriate support and guidance.

[1372] 6. System Advantages

[1373] This system allows users to quickly understand the tools and services being used by other users and departments within their organization, and to communicate efficiently. Furthermore, the emotion engine provides appropriate responses based on the user's emotional state, improving the user experience. As a result, it is expected to reduce research time and improve work efficiency.

[1374] The following describes the processing flow.

[1375] Information Registration

[1376] Step 1:

[1377] The user logs into the system.

[1378] Step 2:

[1379] The user opens the "Register for a new tool or service" form.

[1380] Step 3:

[1381] The user enters information about the tool or service (name, version, start date, department using it) into the form.

[1382] Step 4:

[1383] While the user is typing, the emotion engine analyzes the input, the user's facial expressions, and voice to identify their emotions.

[1384] Step 5:

[1385] The emotion engine identifies an emotion and sends it to the server.

[1386] Step 6:

[1387] The server analyzes the received emotion data and stores it in a database.

[1388] Step 7:

[1389] The user presses the "Register" button.

[1390] Step 8:

[1391] The terminal generates an HTTP request based on the information entered and sends it to the server.

[1392] Step 9:

[1393] The server parses the received request and saves the information to the database.

[1394] Step 10:

[1395] The server generates a response indicating successful registration and sends it to the terminal.

[1396] Step 11:

[1397] The device receives a response and displays a message to the user indicating that registration was successful.

[1398] Searching for and retrieving information

[1399] Step 1:

[1400] The user logs into the system.

[1401] Step 2:

[1402] The user opens the "Information Search" form.

[1403] Step 3:

[1404] Enter the name of the tool or service you want to search for.

[1405] Step 4:

[1406] The emotion engine analyzes the user's input and voice to identify their emotions.

[1407] Step 5:

[1408] The emotion engine identifies an emotion and sends it to the server.

[1409] Step 6:

[1410] The server analyzes the received emotion data and stores it in a database.

[1411] Step 7:

[1412] The user presses the "search" button.

[1413] Step 8:

[1414] The terminal generates an HTTP request based on the entered keyword and sends it to the server.

[1415] Step 9:

[1416] The server searches the database based on the received request and retrieves matching information.

[1417] Step 10:

[1418] The server generates a response based on the search results and sends it to the terminal.

[1419] Step 11:

[1420] The device receives the response and displays the search results to the user.

[1421] Notifications and Contacts

[1422] Step 1:

[1423] The user selects the user they want to contact from the search results.

[1424] Step 2:

[1425] The device generates an HTTP request based on the selected user's information and sends it to the server.

[1426] Step 3:

[1427] The server parses the received request and retrieves the contact information of the selected user.

[1428] Step 4:

[1429] The server generates a notification message and sends it to the specified contact.

[1430] Step 5:

[1431] The server generates a response based on the notification transmission result and sends it to the terminal.

[1432] Step 6:

[1433] The device receives a response and displays to the user that the notification was successful.

[1434] Step 7:

[1435] The emotion engine provides feedback and suggests the next action based on the user's emotional state.

[1436] In this way, users can efficiently connect with other users and receive appropriate responses based on their emotions. For example, if member B is experiencing difficulties with "design tool X," the emotion engine can identify that emotion and provide support by suggesting solutions.

[1437] (Example 2)

[1438] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1439] There has been a problem in understanding the usage status of existing corporate tools and services and in efficiently communicating with users. Furthermore, there is a problem in that the user experience deteriorates because there is no appropriate response to the anxiety and difficulties that users feel when using new tools and services. This invention aims to solve these problems.

[1440] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting information on tools and services that a user has started using, means for storing the inputted information on tools and services in a database, means for the user to search for information on specific tools and services, means for obtaining information on tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for contacting other users based on the information selected by the user, means for analyzing the user's input content and voice to identify emotions, and means for generating and presenting countermeasures based on the emotions. As a result, the user can quickly and efficiently share information and contact other users and departments, and can also receive appropriate support according to their emotions.

[1441] A "user" is an individual who uses the system to input information, search for information, or communicate.

[1442] "Tool and service information" refers to specific data regarding the tools and services that a user has started using, such as their name, version, start date, and department in which they are used.

[1443] A "database" is a collection of information and the system that manages it, used to store and manage information and analysis results from tools and services entered by users.

[1444] A "search method" refers to the function or interface that a user uses to search for information about a particular tool or service.

[1445] "Means for obtaining information that matches the conditions" refers to a system component that has the function of extracting information about tools and services that match the conditions specified by the user from a database.

[1446] "Means of displaying information" refers to screen display devices or interfaces that visually present acquired information to the user.

[1447] "Communication methods" refer to message generation and sending functions used to contact other users based on information selected by the user.

[1448] "Means for identifying emotions" refers to an analysis engine and functions that analyze user input and voice to recognize the user's emotions.

[1449] "Means for generating and presenting countermeasures" refers to a function that presents appropriate countermeasures and support to the user based on the results of identifying their emotions.

[1450] This invention is a system that allows users to input information about new tools and services and save it in a database. It also allows other users to search for information about the same tools and services and communicate with each other. Furthermore, this invention is a system that uses an emotion engine to recognize the user's emotions and suggests appropriate responses based on those emotions.

[1451] System Configuration

[1452] This system mainly consists of the following components:

[1453] A terminal for users to input information.

[1454] A function that sends information entered by the terminal to the server as an HTTP request.

[1455] A function that allows a server to receive information and save it to a database.

[1456] A feature that allows the device to send the user's search queries to the server.

[1457] A function that allows the server to retrieve search results from the database and send them to the terminal.

[1458] The emotion engine analyzes user input and voice to recognize emotions.

[1459] Interfaces and APIs for connecting each component.

[1460] Hardware and software to be used

[1461] The main hardware and software used in this system include the following:

[1462] Server: Web server software such as Apache or NGINX.

[1463] Database: A database management system such as MySQL or PostgreSQL.

[1464] Device: A user interface device such as a smartphone or PC.

[1465] Emotion engine: Sentiment analysis engines such as Google Cloud Natural Language API and IBM Watson.

[1466] Specific examples of operating procedures

[1467] Enter and save new tool information.

[1468] When a user starts using a new tool or service, they enter the information into their terminal. For example, if they start using "Design Tool X," they would enter its name, version, start date, and department using it.

[1469] The terminal generates an HTTP POST request based on the entered information and sends it to the server.

[1470] The server analyzes the received information and inserts records into the appropriate database tables. This stores information about new tools and services in the database.

[1471] Searching for and retrieving information

[1472] To search for information about a specific tool or service, the user enters the name into the search form. For example, they might enter "Design Tool X".

[1473] The terminal generates a GET request based on the search query entered by the user and sends it to the server.

[1474] The server searches the database based on the received query, retrieves matching information, and sends it to the terminal in JSON format.

[1475] The terminal displays the retrieved search results to the user. This allows the user to see information about "Design Tool X" entered by other users.

[1476] Notifications and Contacts

[1477] The user selects the user they want to contact from the search results. For example, if they want to contact a user who is knowledgeable about design tool X.

[1478] The device generates an HTTP POST request containing the user's ID and sends it to the server.

[1479] The server parses the received request, retrieves the contact information of the specified user, and generates and sends a notification message.

[1480] The device will display a notification to the user indicating that the notification was successful. For example, it might display "Notification successful."

[1481] Using an Emotion Engine

[1482] When a user enters information or searches for something, the emotion engine analyzes the user's input and voice to identify their emotion. For example, if a user enters "troubled," the emotion engine identifies it as "confused."

[1483] The server stores the identified emotion information in a database and generates countermeasures based on that emotion.

[1484] The device then presents the generated solutions to the user. For example, it might display, "Here are the guidelines to resolve this issue."

[1485] Example of a prompt

[1486] "I've started using the new design tool X, but I'm having trouble understanding many things. I'd like to get in touch with members of other departments who are using the same tool."

[1487] This allows users to connect with other users using the same tools and services, efficiently solve problems, and receive appropriate support tailored to their needs.

[1488] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1489] Step 1:

[1490] The user enters information about the new tool or service. For example, they might enter information such as "Tool Name: Design Tool X", "Version: 1.0", "Date Started: 2023-10-01", and "Department: Design" into a form. The system also checks the input data and displays error messages to the user as needed.

[1491] Input: Information about tools and services entered by the user.

[1492] Output: HTTP POST request generated by the terminal.

[1493] Step 2:

[1494] The device generates an HTTP POST request based on the information entered by the user and sends it to the server. Specifically, it packages the data in JSON format and sends it to the specified API endpoint.

[1495] Input: Information entered by the user.

[1496] Output: HTTP POST request sent to the server.

[1497] Step 3:

[1498] The server parses the HTTP POST request it receives and saves it to the database. First, it extracts data from the request body and saves it to the database table using an SQL INSERT statement.

[1499] Input: HTTP POST request sent from the terminal.

[1500] Output: Information about tools and services stored in the database.

[1501] Step 4:

[1502] To search for information about a specific tool or service, the user enters the name into the search form and clicks the "Search" button. For example, they might enter "Design Tool X".

[1503] Input: The search query entered by the user in the search form.

[1504] Output: Expectations regarding the search results displayed on the device.

[1505] Step 5:

[1506] The device generates a GET request based on the user's search query and sends it to the server. Query parameters are added to the URL, and the request is sent to the specified API endpoint.

[1507] Input: The search query entered by the user.

[1508] Output: HTTP GET request sent to the server.

[1509] Step 6:

[1510] The server parses the received GET request and searches the database. It then uses an SQL SELECT statement to retrieve matching information from the database.

[1511] Input: HTTP GET request sent from the terminal.

[1512] Output: Search results retrieved by the server.

[1513] Step 7:

[1514] The server sends the retrieved search results to the terminal in JSON format. The result data is converted to an appropriate format and returned as an HTTP response.

[1515] Input: Search results retrieved from the database.

[1516] Output: The HTTP response sent to the terminal.

[1517] Step 8:

[1518] The device displays the search results it has received to the user. A list of search results is displayed on the screen, allowing the user to select from them.

[1519] Input: HTTP response received from the server.

[1520] Output: Search results displayed to the user.

[1521] Step 9:

[1522] The user selects a user they want to contact from the search results. For example, they click on a specific user from the list.

[1523] Input: User information selected by the user.

[1524] Output: Contact expected from the selected user.

[1525] Step 10:

[1526] The terminal generates an HTTP POST request based on the selected user's information and sends it to the server. It then packages and sends data including the selected user's ID.

[1527] Input: User information selected by the user.

[1528] Output: HTTP POST request sent to the server.

[1529] Step 11:

[1530] The server parses the received request and retrieves the contact information of the specified user. Then, it generates and sends a notification message. It uses an SQL SELECT statement to retrieve the contact information and uses it to send the notification message.

[1531] Input: HTTP POST request sent from the terminal.

[1532] Output: A notification message sent to the specified contact.

[1533] Step 12:

[1534] The server generates a response based on the notification transmission results and sends it to the terminal. The response includes the success or failure status in JSON format.

[1535] Input: Result of notification transmission.

[1536] Output: The HTTP response sent back to the terminal.

[1537] Step 13:

[1538] The device receives a response and displays a message to the user indicating that the notification was successful. For example, it might display "Notification successful."

[1539] Input: HTTP response received from the server.

[1540] Output: The notification result displayed to the user.

[1541] Step 14:

[1542] When a user enters information or performs a search, the emotion engine analyzes the user's input and voice to identify their emotions. For example, if the user enters "troubled," the engine recognizes that emotion as "confused."

[1543] Input: User input or voice information.

[1544] Output: Identified sentiment information.

[1545] Step 15:

[1546] The server saves the sentiment data to the database based on the analysis results. The sentiment data is saved using an SQL INSERT statement.

[1547] Input: Emotional data sent from the emotion engine.

[1548] Output: Emotional information stored in the database.

[1549] Step 16:

[1550] The server generates emotion-based responses and sends them to the device. For example, it generates support guidelines for the emotion "confused" and sends them to the device in JSON format.

[1551] Input: Identified sentiment information.

[1552] Output: The countermeasures sent to the terminal.

[1553] Step 17:

[1554] The device displays suggested solutions to the user. For example, it might display, "Here are the guidelines to resolve this issue."

[1555] Input: Countermeasures sent from the server.

[1556] Output: The countermeasures presented to the user.

[1557] (Application Example 2)

[1558] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1559] Currently, when introducing new machinery and tools in factories, the means of sharing information regarding operation methods, settings, and troubleshooting are sometimes inefficient. This results in operators taking a long time to become proficient in using new tools, potentially leading to operational errors and malfunctions, and ultimately reducing work efficiency. Furthermore, a challenge remains in providing appropriate support when operators experience stress or confusion.

[1560] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information on tools and services that a user has started using, means for storing the inputted tool and service information in a database, means for the user to search for information on specific tools and services, means for obtaining information on tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for contacting other users based on the information selected by the user, emotion engine means for recognizing the user's emotions, and means for generating and displaying appropriate responses based on the emotions recognized by the emotion engine means. As a result, operators can not only quickly become proficient in new tools and services, but also reduce operational errors and improve work efficiency by providing appropriate support according to their emotional state.

[1561] "User information" refers to information about the users who use the system.

[1562] "Tool and service information" refers to information such as the name, version, start date of use, and department that uses the tools and services that the user utilizes.

[1563] A "database" is a structured collection of records that stores information about the aforementioned tools and services, and allows it to be searched and retrieved when needed.

[1564] A "search method" refers to the interface and process that allows a user to find information about a specific tool or service.

[1565] "Communication methods" refer to features that allow users to exchange information and communicate with other users.

[1566] An "emotion engine" is a technology that recognizes a user's emotions and provides appropriate responses based on those emotions.

[1567] "Means for generating and displaying appropriate responses" refers to a process for providing responses and support in accordance with the user's emotions recognized by the emotion engine.

[1568] A "generative AI model" is an artificial intelligence algorithm used to generate the optimal result based on input data.

[1569] A "prompt sentence" is an input sentence that a generative AI model uses to generate an appropriate response.

[1570] This invention is a system that integrates an emotion engine to facilitate the smooth introduction and daily use of new machinery and tools within a factory. This system can recognize the user's emotions in real time and provide appropriate support.

[1571] System Configuration

[1572] hardware

[1573] Smart glasses (e.g., Microsoft HoloLens)

[1574] Server (cloud-based, e.g., AWS EC2)

[1575] Database (e.g., MySQL)

[1576] software

[1577] Emotion engine (e.g., Affectiva SDK)

[1578] Real-time information sharing system (e.g., WebSocket)

[1579] User interface (UI) frameworks (e.g., Unity)

[1580] System operation

[1581] 1. User information registration

[1582] Users enter information about new machines and tools using an app installed on their smart glasses. This includes the tool's name, version, start date, and department of use.

[1583] The terminal sends the entered information to the server as an HTTP request.

[1584] The server stores the received information in a database.

[1585] 2. Searching for and obtaining information

[1586] Users use smart glasses to search for information about specific tools or services using voice input.

[1587] The terminal sends the search query to the server via WebSocket.

[1588] The server searches the database for information, retrieves matching items, and sends the results back to the terminal.

[1589] The device displays search results to the user.

[1590] 3. Recognition of emotions and presentation of responses

[1591] The emotion engine analyzes the user's facial expressions through the smart glasses' camera and recognizes their emotional state.

[1592] The server generates appropriate countermeasures based on the analysis results received from the emotion engine.

[1593] The server displays the generated solutions (e.g., video tutorials, guides) on the smart glasses' display.

[1594] Specific example

[1595] Imagine an operator wearing smart glasses while using a newly introduced automated welding machine. When the operator asks a voice question like, "How do I set up the welding?", the application displays the appropriate setup procedure on the screen. Meanwhile, an emotion engine analyzes the operator's facial expressions, and if stress or confusion is detected, it suggests additional support (for example, detailed troubleshooting instructions or options to contact the help desk).

[1596] Example of a prompt

[1597] "I want to learn how to set up the newly installed automatic welding machine. Please provide a video tutorial on operation, monitor the operator's stress level with an emotion engine, and suggest appropriate support."

[1598] This system not only allows operators to quickly become proficient in using new equipment, but also provides appropriate support tailored to their emotional state, thereby reducing operational errors and improving work efficiency.

[1599] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1600] Step 1:

[1601] Enter and submit user information.

[1602] Users input information about new machines and tools through smart glasses.

[1603] The input includes the tool's name, version, start date, and department using it.

[1604] The terminal generates this input information as an HTTP request and sends it to the server.

[1605] (Input) Information about tools and services provided by the user.

[1606] (Output) Information formed as an HTTP request.

[1607] Step 2:

[1608] Storing information in a database

[1609] The server parses the received HTTP request, breaks down the input information, and stores it in the database.

[1610] When saving, the files are sorted into save fields based on the tool name, version, start date, and department using the tool.

[1611] (Input) Received HTTP request.

[1612] (Output) Information about tools and services stored in the database.

[1613] Step 3:

[1614] Searching for and retrieving information

[1615] Users can use smart glasses to search for information about specific tools or services by voice. For example, "I'm looking for information about a new automatic welding machine."

[1616] The terminal converts the voice data into text and generates a search query. This is then sent to the server via WebSocket.

[1617] The server searches the database, retrieves information on matching tools and services, and sends the results back to the terminal.

[1618] (Input) Voice command from the user (search query).

[1619] (Output) Information retrieved from the database and displayed to the user.

[1620] Step 4:

[1621] Emotion recognition and data transmission

[1622] The emotion engine analyzes the user's facial expressions and voice through the smart glasses' camera to recognize their emotional state.

[1623] The server receives the analysis results sent from the emotion engine and performs data calculations to generate appropriate countermeasures.

[1624] (Input) User's facial expressions and voice data.

[1625] (Output) Analyzed emotional status.

[1626] Step 5:

[1627] Generating appropriate countermeasures

[1628] Based on the received emotional state, the server uses a generative AI model to generate prompt sentences, and then generates appropriate countermeasures (such as video tutorials or guides) based on those prompts.

[1629] The generated countermeasures are prepared as data to be displayed to the user.

[1630] (Input) Analyzed emotion status.

[1631] (Output) Generated countermeasures (responses and guides based on prompt statements).

[1632] Step 6:

[1633] Display of optimal countermeasures

[1634] The device receives the appropriate countermeasure sent from the server and displays it on the smart glasses' display.

[1635] The user reviews the displayed information and continues with the task or operation.

[1636] (Input) Countermeasure data generated from the server.

[1637] (Output) Appropriate countermeasures displayed on the smart glasses' screen.

[1638] Through the above processing steps, users can quickly and efficiently learn how to operate new machines and tools, and with appropriate support tailored to their needs, it is expected that work errors will be reduced and work efficiency will be improved.

[1639] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1640] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1641] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1642] [Fourth Embodiment]

[1643] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1644] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1645] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1646] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1647] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1648] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1649] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1650] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1651] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1652] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1653] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1654] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1655] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1656] This invention provides a system for users to connect with other users or departments already using the same tools or services when using new tools or services, allowing for the sharing of knowledge and experience. This system is expected to reduce research time and enable more efficient work execution.

[1657] 1. System Overview

[1658] This system allows users to input information about tools and services they start using and save it in a database. Other users can then search for information about the same tools and services, and based on the search results, connect with and contact users who are already using them.

[1659] 2. User Information Registration

[1660] Information input and saving

[1661] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, its version, the date it was started, and the department using it.

[1662] The terminal generates and sends a request to the server to send the entered information.

[1663] The server analyzes the received information and stores it in the database.

[1664] For example, if member A of the design team starts using "design tool X," member A will input information about "design tool X" and save it to the database.

[1665] 3. Searching for and obtaining information

[1666] Execute search

[1667] Users enter the name of a specific tool or service into the search form to find information about it.

[1668] The terminal generates a search query and sends it to the server.

[1669] The server searches the database based on the received query and retrieves matching information.

[1670] Displaying search results

[1671] The server sends the search results to the terminal.

[1672] The device displays search results to the user.

[1673] For example, if member B searches for information about "design tool X," member A's information will be found in the database and displayed on member B's terminal.

[1674] 4. Notifications and Communications

[1675] Selection of communication method

[1676] The user selects a user they want to contact from the search results.

[1677] The terminal sends a request to the server containing information about the selected user.

[1678] Execute notification

[1679] The server sends a notification to the selected user and a message to the specified contact (email or chat).

[1680] Presentation of notification results

[1681] The server returns the notification transmission result to the terminal, informing the user that the notification was successful.

[1682] The device displays a message to the user indicating that a notification has been sent.

[1683] For example, if member B wants to contact member A, member B can send a notification to member A through the system and make contact.

[1684] 5. System Advantages

[1685] This system allows users to quickly understand the tools and services being used by other users and departments within their organization, and to communicate efficiently. As a result, research time is reduced, knowledge and experience are shared throughout the organization, and work efficiency is improved.

[1686] This invention significantly simplifies the process of introducing new tools and services, reducing the time and effort required for research and communication.

[1687] The following describes the processing flow.

[1688] Information Registration

[1689] Step 1:

[1690] The user logs into the system.

[1691] Step 2:

[1692] The user opens the "Register for a new tool or service" form.

[1693] Step 3:

[1694] The user enters information about the tool or service (name, version, start date, department using it) into the form.

[1695] Step 4:

[1696] The user presses the "Register" button.

[1697] Step 5:

[1698] The terminal generates an HTTP request based on the information entered and sends it to the server.

[1699] Step 6:

[1700] The server parses the received request and saves the information to the database.

[1701] Step 7:

[1702] The server generates a response indicating successful registration and sends it to the terminal.

[1703] Step 8:

[1704] The device receives a response and displays a message to the user indicating that registration was successful.

[1705] Searching for and retrieving information

[1706] Step 1:

[1707] The user logs into the system.

[1708] Step 2:

[1709] The user opens the "Information Search" form.

[1710] Step 3:

[1711] Enter the name of the tool or service you want to search for.

[1712] Step 4:

[1713] The user presses the "search" button.

[1714] Step 5:

[1715] The terminal generates an HTTP request based on the entered keyword and sends it to the server.

[1716] Step 6:

[1717] The server searches the database based on the received request and retrieves matching information.

[1718] Step 7:

[1719] The server generates a response based on the search results and sends it to the terminal.

[1720] Step 8:

[1721] The device receives the response and displays the search results to the user.

[1722] Notifications and Contacts

[1723] Step 1:

[1724] The user selects the user they want to contact from the search results.

[1725] Step 2:

[1726] The device generates an HTTP request based on the selected user's information and sends it to the server.

[1727] Step 3:

[1728] The server parses the received request and retrieves the contact information of the selected user.

[1729] Step 4:

[1730] The server generates a notification message and sends it to the specified contact.

[1731] Step 5:

[1732] The server generates a response based on the notification transmission result and sends it to the terminal.

[1733] Step 6:

[1734] The device receives a response and displays to the user that the notification was successful.

[1735] This will enable users to efficiently connect with other users who are using existing tools and services, and to share knowledge and experience.

[1736] (Example 1)

[1737] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1738] When users begin using new tools or services, they often face difficulties sharing information with other users or departments already using the same tools or services, leading to lengthy research times and decreased work efficiency. This invention aims to solve these problems and enable rapid information sharing and efficient work execution within organizations.

[1739] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1740] In this invention, the server includes means for inputting information about tools and services that a user has started using, means for storing the inputted information about tools and services in a database, means for the user to search for information about specific tools and services, means for obtaining information about tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for the user to contact other users based on the information selected by the user, a terminal for transmitting the information input by the user to the server, means for the server to analyze the information received, and means for the server to send a message to a specified contact. This enables users to quickly share information with other users within the organization and communicate efficiently.

[1741] A "user" is an individual or entity that uses the system to perform actions such as entering, searching for, viewing, and communicating information about the tools and services.

[1742] "Tools and services" refers to the software, applications, platforms, or entire services that users utilize for their work or activities.

[1743] "Information" refers to data that includes data items such as the name, version, start date of use, and department that uses the tool or service.

[1744] "Means of input" refers to the interface or form that users use to input information about tools or services into a system.

[1745] "Means of saving to a database" refers to the functions and processes for storing information about entered tools and services in a database.

[1746] "Means of searching" refers to the functions or interfaces that allow users to search for information about specific tools or services.

[1747] "Means of acquisition" refers to the functions and processes used to search and retrieve information about tools and services that match specified criteria from a database.

[1748] "Means of display" refers to functions or interfaces that visually present acquired information to the user.

[1749] "Means of communication" refers to the means or interfaces that users use to communicate with other users.

[1750] A "terminal" refers to a device used by a user to access a system and perform operations such as entering information, searching, and making communications.

[1751] A "server" refers to a central system that manages the entire system and handles data storage, retrieval, analysis, and transmission.

[1752] "Means of analysis" refers to the functions and processes that allow a server to understand the user information it receives and take appropriate action.

[1753] "Means of sending messages to specified contacts" refers to the functions and methods that allow users to send messages to people they wish to contact.

[1754] This invention provides a system for users to connect with other users or departments already using the same tools or services when starting to use new tools or services, allowing for the sharing of knowledge and experience. This system is expected to reduce research time and enable more efficient work execution.

[1755] System Overview

[1756] The system inputs information about tools and services that users start using and stores it in a database. Users can search for information about specific tools and services, retrieve matching information from the database, and use that information to contact other users.

[1757] Hardware and software to be used

[1758] Hardware: Server, client terminals (PC, tablet, smartphone)

[1759] Software: Database management systems (e.g., MySQL, PostgreSQL), communication protocols (e.g., HTTP / HTTPS), notification systems (e.g., mail servers, chat APIs)

[1760] User Information Registration

[1761] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, version, start date, and department using it. The terminal generates and sends a request to the server to send the entered information. The server parses the received information and stores it in a database.

[1762] Searching for and retrieving information

[1763] The user enters the name of a specific tool or service into a search form to find information about it. The device generates a search query and sends it to the server. The server searches its database based on the received query and retrieves matching information. The retrieved information is sent from the server to the device and displayed to the user.

[1764] Notifications and Contacts

[1765] The user selects a user they want to contact from the search results. The device sends a request to the server containing the selected user's information. The server sends a notification to the selected user and a message to the specified contact (email or chat). It then returns the notification sending result to the device, informing the user that the notification was successful.

[1766] Specific example

[1767] For example, if member A of the design team starts using "Design Tool X," member A enters information about "Design Tool X" and saves it in the database. Later, when member B searches for information about "Design Tool X," member A's information is found in the database and displayed on member B's terminal. Member B can then contact member A through the system to learn more about "Design Tool X."

[1768] Example of a prompt

[1769] The following are specific examples of prompt statements to be input to a generative AI model:

[1770] Please explain the procedures and benefits of a system that allows users to register their information when they start using new tools or services, and enables other users to search for and contact that information.

[1771] This clarifies the specific operating procedures and benefits of the system, allowing users to utilize it smoothly.

[1772] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1773] Processing steps

[1774] Step 1: Enter user information

[1775] The user enters information about the new tool or service. For example, they might fill in details such as "Tool Name: Design Tool X", "Version: 1.0", "Date Started: 2023-01-01", and "Department Using: Design Team" in the input form.

[1776] Input: User-provided details about tools and services

[1777] Output: Information input request sent to the terminal

[1778] Step 2: Generate and submit information input request

[1779] The terminal generates a request to send the information entered by the user to the server. This request includes information such as the tool name, version, start date of use, and department using the tool.

[1780] The terminal sends the generated request to the server.

[1781] Input: Detailed information about the tools or services entered by the user.

[1782] Output: Information input request sent to the server

[1783] Step 3: Analyze the information and save it to the database.

[1784] The server parses the received request and extracts detailed information about the tools and services.

[1785] The server saves the extracted information to a database. For example, it uses an SQL INSERT statement to record information about "Design Tool X" into the database.

[1786] Input: Information input request sent from the terminal

[1787] Output: Detailed information about tools and services stored in the database

[1788] Step 4: Enter your search query

[1789] To search for information about a specific tool or service, the user enters its name into the search form. For example, they might enter "Design Tool X".

[1790] Input: User's search query (name of tool or service)

[1791] Output: Search query sent to the terminal

[1792] Step 5: Generate and submit search queries

[1793] The terminal generates a search query based on the name entered in the search form. Specifically, it sends "Tool Name: Design Tool X" to the server as an HTTP request.

[1794] The terminal sends the generated search query to the server.

[1795] Input: Search query entered by the user

[1796] Output: Search queries sent to the server

[1797] Step 6: Search the database

[1798] The server searches the database based on the received search query. For example, it might use an SQL SELECT statement to retrieve records related to "Design Tool X".

[1799] Input: Search query sent from the device

[1800] Output: Matching information retrieved from the database

[1801] Step 7: Submit search results

[1802] The server sends the search results to the terminal. For example, it might return a list of other users using "Design Tool X".

[1803] Input: Matching information retrieved from the database

[1804] Output: Search results sent to the device

[1805] Step 8: Displaying search results

[1806] The terminal displays search results received from the server to the user. For example, information about users using "Design Tool X" may be displayed in a table or card format.

[1807] Input: Search results sent from the server

[1808] Output: Search results displayed to the user

[1809] Step 9: Select contacts and generate requests

[1810] The user selects other users they want to contact from the search results. For example, they might click on a user's name.

[1811] The device generates a request to contact the selected user. This request includes contact information and message content.

[1812] Input: User selects contact information

[1813] Output: Contact request to send to server

[1814] Step 10: Send contact request and perform notification

[1815] The terminal sends the generated contact request to the server.

[1816] The server parses the received contact request and sends a message through the appropriate notification method. For example, it might use a mail server to send a notification message.

[1817] Input: Contact request sent from the device

[1818] Output: Notification message sent to other users

[1819] Step 11: Sending and displaying notification results

[1820] The server receives the notification transmission result and sends it to the requesting terminal.

[1821] The device displays the transmission result to the user. For example, it might display a message such as, "A notification has been sent to contact A."

[1822] Input: Notification sent from the server

[1823] Output: Notification sent to the user

[1824] The above outlines the specific processing steps of this system.

[1825] (Application Example 1)

[1826] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1827] In recent years, manufacturing sites such as factories have been improving work efficiency by introducing various equipment and work procedures. However, when introducing new equipment or work procedures, problems arise such as a lack of information and the inability to effectively share existing knowledge. On the other hand, if there are users or departments that are already using the same equipment or work procedures, coordination and information sharing with them can greatly improve the efficiency of the introduction. However, current systems do not have a mechanism for sharing such information quickly and accurately, resulting in increased research time, duplicated work, and decreased work efficiency.

[1828] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1829] In this invention, the server includes means for inputting information on equipment and work procedures that a user has started using; means for storing the inputted information on equipment and work procedures in a database; means for the user to search for information on specific equipment and work procedures; means for obtaining information on equipment and work procedures that match specified conditions from the database; means for displaying the obtained information to the user; means for generating a notification message from the obtained information for the user to contact a specific other user and sending it to a specified contact; and means for generating and displaying a prompt using a generative AI model to promote additional knowledge sharing based on the obtained information. As a result, when introducing new equipment or work procedures, users can quickly obtain knowledge and experience from users who have already introduced them, thereby reducing investigation time and improving work efficiency.

[1830] "Equipment and operational procedures" is a general term referring to the devices, robots, tools, and methods and procedures for using them that are used in factories and manufacturing sites.

[1831] A "database" is a system that systematically stores and manages information, making it searchable and retrievable as needed.

[1832] A "notification message" is a message sent by one user to another user to contact them, and it is sent to their contacts.

[1833] A "generative AI model" refers to an algorithm or system that uses artificial intelligence technology to generate prompts based on specific conditions.

[1834] A "prompt" is text generated by a generative AI model and used as instructions or questions for users to share additional knowledge.

[1835] A "server" is a computer system used for storing, managing, and processing information, and its role is to provide data in response to user requests.

[1836] This invention is a system for quickly and efficiently sharing new equipment and work procedures used in factories and manufacturing sites with other users and departments. This system can reduce the time required for implementation surveys and improve operational efficiency.

[1837] 1. System Overview

[1838] This system allows users to input information about equipment and work procedures they have started using, and saves this information in a database. Other users can then search for information about the same equipment and procedures, and based on the search results, connect with and communicate with other users who are already using them. Furthermore, it uses a generative AI model to generate prompts, facilitating additional knowledge sharing.

[1839] 2. User Information Registration

[1840] Information input and saving

[1841] When a user begins using new equipment or a new work procedure, they input that information into the system via a terminal. This input includes the name, manufacturer, model, and start date of use of the equipment or procedure. The terminal generates and sends a request to the server to receive the input information. The server analyzes the received information and stores it in a database. For example, user A inputs information about the newly introduced robot "XYZ-123" into the system, and this information is stored in the database.

[1842] 3. Searching for and obtaining information

[1843] Execute search

[1844] The user enters the name of a specific piece of equipment or work procedure into a search form on their terminal to find information about it. The terminal generates a search query and sends it to the server. The server searches its database based on the received query and retrieves matching information.

[1845] Displaying search results

[1846] The server sends the search results to the terminal. The terminal displays the search results to the user. For example, if user B searches for information about the same robot "XYZ-123", user A's information will be found in the database and displayed on user B's terminal.

[1847] 4. Notifications and Communications

[1848] Selection of communication method

[1849] The user selects a user they wish to contact from the search results. The device then sends a request to the server containing the selected user's information.

[1850] Execute notification

[1851] The server sends a notification to the selected user and a message to the specified contact (email or chat). As proof of the notification's success, the server returns the notification's delivery status to the device, informing the user that the notification was successful. For example, if user B wants to contact user A, user B can send a notification to user A through the system and initiate contact.

[1852] 5. Prompt generation using generative AI models

[1853] The server uses a generative AI model to generate prompts based on the acquired information to facilitate additional knowledge sharing. The generated prompts are displayed to the user and used for specific advice and gathering additional information. An example of a prompt is: "Please register information about the newly introduced robot XYZ-123 and receive advice from users who are already using it regarding its specific usage and problem-solving methods."

[1854] This system allows users to quickly access information about equipment and work procedures used by other users and departments within the organization, and to communicate efficiently. As a result, research time is reduced, knowledge and experience are shared across the organization, and work efficiency is improved. This significantly simplifies the process of introducing new equipment and work procedures, and reduces the time and effort required for research and communication.

[1855] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1856] Step 1:

[1857] The user inputs information about the equipment and work procedures they have started using. Specifically, the user uses a terminal to input information such as the name, manufacturer, model, and start date of use of the equipment or work procedure. The input data is formatted by the terminal, and a request is generated to send to the server. The input data is sent to the server in JSON format.

[1858] Step 2:

[1859] The server analyzes the information received from the terminal and stores it in the database. Upon receiving the information, the server validates the input data to check for any invalid data. Data that passes validation is converted to an appropriate format so that it can be correctly stored in the database. This may include operations such as trimming strings and standardizing date formats.

[1860] Step 3:

[1861] A user searches for information on specific equipment or work procedures. The user enters the name of the equipment or work procedure and other criteria into the search form on the terminal. The terminal generates a search query based on this information and sends it to the server. The search criteria are sent in JSON format.

[1862] Step 4:

[1863] The server searches the database based on the received search query. The server retrieves data that matches the specified criteria. In this process, indexes are often used to improve search efficiency. The retrieved data is then formatted into an appropriate format.

[1864] Step 5:

[1865] The server sends the retrieved search results to the device. The server converts the search results into JSON format and sends it back to the device. The device receives this data.

[1866] Step 6:

[1867] The device displays the acquired information to the user. The device analyzes the received search results and displays them in a format that is easy for the user to understand. This includes displaying the information in table or list format.

[1868] Step 7:

[1869] The system connects users with other users based on the information selected by the user. The user selects the user they wish to contact from the displayed information and specifies their contact details (email or chat). The device then generates a notification message based on this information and sends it to the server.

[1870] Step 8:

[1871] The server sends a notification message to the specified contact. The server generates a notification message and sends it to the specified contact using the API of an email or chat service. The sending result is returned to the device and notified to the user.

[1872] Step 9:

[1873] The server generates and displays prompts using a generative AI model to facilitate additional knowledge sharing based on the acquired information. The server uses the generative AI model to generate useful prompt sentences based on the aforementioned information. The generated prompt sentences are sent to the terminal and displayed to the user. For example, a sentence such as "I would like to register information about the newly introduced robot XYZ-123 and receive advice from users who are already using it regarding specific usage and problem-solving methods" might be generated.

[1874] Through this series of processing steps, the system of the present invention facilitates rapid knowledge sharing among other users when introducing new equipment or work procedures in factories and manufacturing sites, enabling efficient work execution.

[1875] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1876] This invention combines a system that connects users with other users or departments already using the same tools or services to share knowledge and experience when users encounter new tools or services, with an emotion engine that recognizes the user's emotions. This system enables appropriate responses based on emotions, and is expected to reduce investigation time and improve work efficiency.

[1877] 1. System Overview

[1878] This system allows users to input information about tools and services they start using and saves it in a database. Furthermore, other users can search for information about the same tools and services, and connect with and communicate with users who are already using them based on the search results. In addition, an emotion engine analyzes the user's emotions and provides the most appropriate response based on those emotions.

[1879] 2. User Information Registration

[1880] Information input and saving

[1881] When a user starts using a new tool or service, they enter information about it into the system. This information includes the name of the tool or service, its version, the date it was started, and the department using it.

[1882] The terminal generates an HTTP request based on the entered information and sends it to the server.

[1883] The server analyzes the received information and stores it in the database.

[1884] For example, if member A of the design team starts using "design tool X," member A will input information about "design tool X" and save it to the database.

[1885] 3. Searching for and obtaining information

[1886] Execute search

[1887] Users enter the name of a specific tool or service into the search form to find information about it.

[1888] The terminal generates a search query and sends it to the server.

[1889] The server searches the database based on the received query and retrieves matching information.

[1890] Displaying search results

[1891] The server sends the search results to the terminal.

[1892] The device displays search results to the user.

[1893] For example, if member B searches for information about "design tool X," member A's information will be found in the database and displayed on member B's terminal.

[1894] 4. Notifications and Communications

[1895] Selection of communication method

[1896] The user selects a user they want to contact from the search results.

[1897] The terminal generates an HTTP request based on the selected user's information and sends it to the server.

[1898] Execute notification

[1899] The server parses the received request and retrieves the contact information of the selected user.

[1900] The server generates a notification message and sends it to the specified contact.

[1901] Presentation of notification results

[1902] The server generates a response based on the notification transmission results and sends it to the terminal.

[1903] The device receives the response and displays to the user that the notification was successful.

[1904] For example, if member B wants to contact member A, member B can send a notification to member A through the system and make contact.

[1905] 5. Function of the Emotion Engine

[1906] Recognition of emotions

[1907] When a user enters information into the system or performs a search, the emotion engine analyzes the user's input and voice to identify their emotions.

[1908] The server saves the user's emotions to a database based on the analysis results.

[1909] Providing the optimal solution

[1910] The server generates responses based on the identified emotions and presents them to the user through the emotion engine.

[1911] The device displays the suggested solutions to the user.

[1912] For example, if member B is experiencing difficulties with "design tool X," the emotion engine can identify that emotion and suggest appropriate support and guidance.

[1913] 6. System Advantages

[1914] This system allows users to quickly understand the tools and services being used by other users and departments within their organization, and to communicate efficiently. Furthermore, the emotion engine provides appropriate responses based on the user's emotional state, improving the user experience. As a result, it is expected to reduce research time and improve work efficiency.

[1915] The following describes the processing flow.

[1916] Information Registration

[1917] Step 1:

[1918] The user logs into the system.

[1919] Step 2:

[1920] The user opens the "Register for a new tool or service" form.

[1921] Step 3:

[1922] The user enters information about the tool or service (name, version, start date, department using it) into the form.

[1923] Step 4:

[1924] While the user is typing, the emotion engine analyzes the input, the user's facial expressions, and voice to identify their emotions.

[1925] Step 5:

[1926] The emotion engine identifies an emotion and sends it to the server.

[1927] Step 6:

[1928] The server analyzes the received emotion data and stores it in a database.

[1929] Step 7:

[1930] The user presses the "Register" button.

[1931] Step 8:

[1932] The terminal generates an HTTP request based on the information entered and sends it to the server.

[1933] Step 9:

[1934] The server parses the received request and saves the information to the database.

[1935] Step 10:

[1936] The server generates a response indicating successful registration and sends it to the terminal.

[1937] Step 11:

[1938] The device receives a response and displays a message to the user indicating that registration was successful.

[1939] Searching for and retrieving information

[1940] Step 1:

[1941] The user logs into the system.

[1942] Step 2:

[1943] The user opens the "Information Search" form.

[1944] Step 3:

[1945] Enter the name of the tool or service you want to search for.

[1946] Step 4:

[1947] The emotion engine analyzes the user's input and voice to identify their emotions.

[1948] Step 5:

[1949] The emotion engine identifies an emotion and sends it to the server.

[1950] Step 6:

[1951] The server analyzes the received emotion data and stores it in a database.

[1952] Step 7:

[1953] The user presses the "search" button.

[1954] Step 8:

[1955] The terminal generates an HTTP request based on the entered keyword and sends it to the server.

[1956] Step 9:

[1957] The server searches the database based on the received request and retrieves matching information.

[1958] Step 10:

[1959] The server generates a response based on the search results and sends it to the terminal.

[1960] Step 11:

[1961] The device receives the response and displays the search results to the user.

[1962] Notifications and Contacts

[1963] Step 1:

[1964] The user selects the user they want to contact from the search results.

[1965] Step 2:

[1966] The device generates an HTTP request based on the selected user's information and sends it to the server.

[1967] Step 3:

[1968] The server parses the received request and retrieves the contact information of the selected user.

[1969] Step 4:

[1970] The server generates a notification message and sends it to the specified contact.

[1971] Step 5:

[1972] The server generates a response based on the notification transmission result and sends it to the terminal.

[1973] Step 6:

[1974] The device receives a response and displays to the user that the notification was successful.

[1975] Step 7:

[1976] The emotion engine provides feedback and suggests the next action based on the user's emotional state.

[1977] In this way, users can efficiently connect with other users and receive appropriate responses based on their emotions. For example, if member B is experiencing difficulties with "design tool X," the emotion engine can identify that emotion and provide support by suggesting solutions.

[1978] (Example 2)

[1979] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1980] There has been a problem in understanding the usage status of existing corporate tools and services and in efficiently communicating with users. Furthermore, there is a problem in that the user experience deteriorates because there is no appropriate response to the anxiety and difficulties that users feel when using new tools and services. This invention aims to solve these problems.

[1981] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting information on tools and services that a user has started using, means for storing the inputted information on tools and services in a database, means for the user to search for information on specific tools and services, means for obtaining information on tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for contacting other users based on the information selected by the user, means for analyzing the user's input content and voice to identify emotions, and means for generating and presenting countermeasures based on the emotions. As a result, the user can quickly and efficiently share information and contact other users and departments, and can also receive appropriate support according to their emotions.

[1982] A "user" is an individual who uses the system to input information, search for information, or communicate.

[1983] "Tool and service information" refers to specific data regarding the tools and services that a user has started using, such as their name, version, start date, and department in which they are used.

[1984] A "database" is a collection of information and the system that manages it, used to store and manage information and analysis results from tools and services entered by users.

[1985] A "search method" refers to the function or interface that a user uses to search for information about a particular tool or service.

[1986] "Means for obtaining information that matches the conditions" refers to a system component that has the function of extracting information about tools and services that match the conditions specified by the user from a database.

[1987] "Means of displaying information" refers to screen display devices or interfaces that visually present acquired information to the user.

[1988] "Communication methods" refer to message generation and sending functions used to contact other users based on information selected by the user.

[1989] "Means for identifying emotions" refers to an analysis engine and functions that analyze user input and voice to recognize the user's emotions.

[1990] "Means for generating and presenting countermeasures" refers to a function that presents appropriate countermeasures and support to the user based on the results of identifying their emotions.

[1991] This invention is a system that allows users to input information about new tools and services and save it in a database. It also allows other users to search for information about the same tools and services and communicate with each other. Furthermore, this invention is a system that uses an emotion engine to recognize the user's emotions and suggests appropriate responses based on those emotions.

[1992] System Configuration

[1993] This system mainly consists of the following components:

[1994] A terminal for users to input information.

[1995] A function that sends information entered by the terminal to the server as an HTTP request.

[1996] A function that allows a server to receive information and save it to a database.

[1997] A feature that allows the device to send the user's search queries to the server.

[1998] A function that allows the server to retrieve search results from the database and send them to the terminal.

[1999] The emotion engine analyzes user input and voice to recognize emotions.

[2000] Interfaces and APIs for connecting each component.

[2001] Hardware and software to be used

[2002] The main hardware and software used in this system include the following:

[2003] Server: Web server software such as Apache or NGINX.

[2004] Database: A database management system such as MySQL or PostgreSQL.

[2005] Device: A user interface device such as a smartphone or PC.

[2006] Emotion engine: Sentiment analysis engines such as Google Cloud Natural Language API and IBM Watson.

[2007] Specific examples of operating procedures

[2008] Enter and save new tool information.

[2009] When a user starts using a new tool or service, they enter the information into their terminal. For example, if they start using "Design Tool X," they would enter its name, version, start date, and department using it.

[2010] The terminal generates an HTTP POST request based on the entered information and sends it to the server.

[2011] The server analyzes the received information and inserts records into the appropriate database tables. This stores information about new tools and services in the database.

[2012] Searching for and retrieving information

[2013] To search for information about a specific tool or service, the user enters the name into the search form. For example, they might enter "Design Tool X".

[2014] The terminal generates a GET request based on the search query entered by the user and sends it to the server.

[2015] The server searches the database based on the received query, retrieves matching information, and sends it to the terminal in JSON format.

[2016] The terminal displays the retrieved search results to the user. This allows the user to see information about "Design Tool X" entered by other users.

[2017] Notifications and Contacts

[2018] The user selects the user they want to contact from the search results. For example, if they want to contact a user who is knowledgeable about design tool X.

[2019] The device generates an HTTP POST request containing the user's ID and sends it to the server.

[2020] The server parses the received request, retrieves the contact information of the specified user, and generates and sends a notification message.

[2021] The device will display a notification to the user indicating that the notification was successful. For example, it might display "Notification successful."

[2022] Using an Emotion Engine

[2023] When a user enters information or searches for something, the emotion engine analyzes the user's input and voice to identify their emotion. For example, if a user enters "troubled," the emotion engine identifies it as "confused."

[2024] The server stores the identified emotion information in a database and generates countermeasures based on that emotion.

[2025] The device then presents the generated solutions to the user. For example, it might display, "Here are the guidelines to resolve this issue."

[2026] Example of a prompt

[2027] "I've started using the new design tool X, but I'm having trouble understanding many things. I'd like to get in touch with members of other departments who are using the same tool."

[2028] This allows users to connect with other users using the same tools and services, efficiently solve problems, and receive appropriate support tailored to their needs.

[2029] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2030] Step 1:

[2031] The user enters information about the new tool or service. For example, they might enter information such as "Tool Name: Design Tool X", "Version: 1.0", "Date Started: 2023-10-01", and "Department: Design" into a form. The system also checks the input data and displays error messages to the user as needed.

[2032] Input: Information about tools and services entered by the user.

[2033] Output: HTTP POST request generated by the terminal.

[2034] Step 2:

[2035] The device generates an HTTP POST request based on the information entered by the user and sends it to the server. Specifically, it packages the data in JSON format and sends it to the specified API endpoint.

[2036] Input: Information entered by the user.

[2037] Output: HTTP POST request sent to the server.

[2038] Step 3:

[2039] The server parses the HTTP POST request it receives and saves it to the database. First, it extracts data from the request body and saves it to the database table using an SQL INSERT statement.

[2040] Input: HTTP POST request sent from the terminal.

[2041] Output: Information about tools and services stored in the database.

[2042] Step 4:

[2043] To search for information about a specific tool or service, the user enters the name into the search form and clicks the "Search" button. For example, they might enter "Design Tool X".

[2044] Input: The search query entered by the user in the search form.

[2045] Output: Expectations regarding the search results displayed on the device.

[2046] Step 5:

[2047] The device generates a GET request based on the user's search query and sends it to the server. Query parameters are added to the URL, and the request is sent to the specified API endpoint.

[2048] Input: The search query entered by the user.

[2049] Output: HTTP GET request sent to the server.

[2050] Step 6:

[2051] The server parses the received GET request and searches the database. It then uses an SQL SELECT statement to retrieve matching information from the database.

[2052] Input: HTTP GET request sent from the terminal.

[2053] Output: Search results retrieved by the server.

[2054] Step 7:

[2055] The server sends the retrieved search results to the terminal in JSON format. The result data is converted to an appropriate format and returned as an HTTP response.

[2056] Input: Search results retrieved from the database.

[2057] Output: The HTTP response sent to the terminal.

[2058] Step 8:

[2059] The device displays the search results it has received to the user. A list of search results is displayed on the screen, allowing the user to select from them.

[2060] Input: HTTP response received from the server.

[2061] Output: Search results displayed to the user.

[2062] Step 9:

[2063] The user selects a user they want to contact from the search results. For example, they click on a specific user from the list.

[2064] Input: User information selected by the user.

[2065] Output: Contact expected from the selected user.

[2066] Step 10:

[2067] The terminal generates an HTTP POST request based on the selected user's information and sends it to the server. It then packages and sends data including the selected user's ID.

[2068] Input: User information selected by the user.

[2069] Output: HTTP POST request sent to the server.

[2070] Step 11:

[2071] The server parses the received request and retrieves the contact information of the specified user. Then, it generates and sends a notification message. It uses an SQL SELECT statement to retrieve the contact information and uses it to send the notification message.

[2072] Input: HTTP POST request sent from the terminal.

[2073] Output: A notification message sent to the specified contact.

[2074] Step 12:

[2075] The server generates a response based on the notification transmission results and sends it to the terminal. The response includes the success or failure status in JSON format.

[2076] Input: Result of notification transmission.

[2077] Output: The HTTP response sent back to the terminal.

[2078] Step 13:

[2079] The device receives a response and displays a message to the user indicating that the notification was successful. For example, it might display "Notification successful."

[2080] Input: HTTP response received from the server.

[2081] Output: The notification result displayed to the user.

[2082] Step 14:

[2083] When a user enters information or performs a search, the emotion engine analyzes the user's input and voice to identify their emotions. For example, if the user enters "troubled," the engine recognizes that emotion as "confused."

[2084] Input: User input or voice information.

[2085] Output: Identified sentiment information.

[2086] Step 15:

[2087] The server saves the sentiment data to the database based on the analysis results. The sentiment data is saved using an SQL INSERT statement.

[2088] Input: Emotional data sent from the emotion engine.

[2089] Output: Emotional information stored in the database.

[2090] Step 16:

[2091] The server generates emotion-based responses and sends them to the device. For example, it generates support guidelines for the emotion "confused" and sends them to the device in JSON format.

[2092] Input: Identified sentiment information.

[2093] Output: The countermeasures sent to the terminal.

[2094] Step 17:

[2095] The device displays suggested solutions to the user. For example, it might display, "Here are the guidelines to resolve this issue."

[2096] Input: Countermeasures sent from the server.

[2097] Output: The countermeasures presented to the user.

[2098] (Application Example 2)

[2099] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2100] Currently, when introducing new machinery and tools in factories, the means of sharing information regarding operation methods, settings, and troubleshooting are sometimes inefficient. This results in operators taking a long time to become proficient in using new tools, potentially leading to operational errors and malfunctions, and ultimately reducing work efficiency. Furthermore, a challenge remains in providing appropriate support when operators experience stress or confusion.

[2101] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information on tools and services that a user has started using, means for storing the inputted tool and service information in a database, means for the user to search for information on specific tools and services, means for obtaining information on tools and services that match specified conditions from the database, means for displaying the obtained information to the user, means for contacting other users based on the information selected by the user, emotion engine means for recognizing the user's emotions, and means for generating and displaying appropriate responses based on the emotions recognized by the emotion engine means. As a result, operators can not only quickly become proficient in new tools and services, but also reduce operational errors and improve work efficiency by providing appropriate support according to their emotional state.

[2102] "User information" refers to information about the users who use the system.

[2103] "Tool and service information" refers to information such as the name, version, start date of use, and department that uses the tools and services that the user utilizes.

[2104] A "database" is a structured collection of records that stores information about the aforementioned tools and services, and allows it to be searched and retrieved when needed.

[2105] A "search method" refers to the interface and process that allows a user to find information about a specific tool or service.

[2106] "Communication methods" refer to features that allow users to exchange information and communicate with other users.

[2107] An "emotion engine" is a technology that recognizes a user's emotions and provides appropriate responses based on those emotions.

[2108] "Means for generating and displaying appropriate responses" refers to a process for providing responses and support in accordance with the user's emotions recognized by the emotion engine.

[2109] A "generative AI model" is an artificial intelligence algorithm used to generate the optimal result based on input data.

[2110] A "prompt sentence" is an input sentence that a generative AI model uses to generate an appropriate response.

[2111] This invention is a system that integrates an emotion engine to facilitate the smooth introduction and daily use of new machinery and tools within a factory. This system can recognize the user's emotions in real time and provide appropriate support.

[2112] System Configuration

[2113] hardware

[2114] Smart glasses (e.g., Microsoft HoloLens)

[2115] Server (cloud-based, e.g., AWS EC2)

[2116] Database (e.g., MySQL)

[2117] software

[2118] Emotion engine (e.g., Affectiva SDK)

[2119] Real-time information sharing system (e.g., WebSocket)

[2120] User interface (UI) frameworks (e.g., Unity)

[2121] System operation

[2122] 1. User information registration

[2123] Users enter information about new machines and tools using an app installed on their smart glasses. This includes the tool's name, version, start date, and department of use.

[2124] The terminal sends the entered information to the server as an HTTP request.

[2125] The server stores the received information in a database.

[2126] 2. Searching for and obtaining information

[2127] Users use smart glasses to search for information about specific tools or services using voice input.

[2128] The terminal sends the search query to the server via WebSocket.

[2129] The server searches the database for information, retrieves matching items, and sends the results back to the terminal.

[2130] The device displays search results to the user.

[2131] 3. Recognition of emotions and presentation of responses

[2132] The emotion engine analyzes the user's facial expressions through the smart glasses' camera and recognizes their emotional state.

[2133] The server generates appropriate countermeasures based on the analysis results received from the emotion engine.

[2134] The server displays the generated solutions (e.g., video tutorials, guides) on the smart glasses' display.

[2135] Specific example

[2136] Imagine an operator wearing smart glasses while using a newly introduced automated welding machine. When the operator asks a voice question like, "How do I set up the welding?", the application displays the appropriate setup procedure on the screen. Meanwhile, an emotion engine analyzes the operator's facial expressions, and if stress or confusion is detected, it suggests additional support (for example, detailed troubleshooting instructions or options to contact the help desk).

[2137] Example of a prompt

[2138] "I want to learn how to set up the newly installed automatic welding machine. Please provide a video tutorial on operation, monitor the operator's stress level with an emotion engine, and suggest appropriate support."

[2139] This system not only allows operators to quickly become proficient in using new equipment, but also provides appropriate support tailored to their emotional state, thereby reducing operational errors and improving work efficiency.

[2140] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[2141] Step 1:

[2142] Enter and submit user information.

[2143] Users input information about new machines and tools through smart glasses.

[2144] The input includes the tool's name, version, start date, and department using it.

[2145] The terminal generates this input information as an HTTP request and sends it to the server.

[2146] (Input) Information about tools and services provided by the user.

[2147] (Output) Information formed as an HTTP request.

[2148] Step 2:

[2149] Storing information in a database

[2150] The server parses the received HTTP request, breaks down the input information, and stores it in the database.

[2151] When saving, the files are sorted into save fields based on the tool name, version, start date, and department using the tool.

[2152] (Input) Received HTTP request.

[2153] (Output) Information about tools and services stored in the database.

[2154] Step 3:

[2155] Searching for and retrieving information

[2156] Users can use smart glasses to search for information about specific tools or services by voice. For example, "I'm looking for information about a new automatic welding machine."

[2157] The terminal converts the voice data into text and generates a search query. This is then sent to the server via WebSocket.

[2158] The server searches the database, retrieves information on matching tools and services, and sends the results back to the terminal.

[2159] (Input) Voice command from the user (search query).

[2160] (Output) Information retrieved from the database and displayed to the user.

[2161] Step 4:

[2162] Emotion recognition and data transmission

[2163] The emotion engine analyzes the user's facial expressions and voice through the smart glasses' camera to recognize their emotional state.

[2164] The server receives the analysis results sent from the emotion engine and performs data calculations to generate appropriate countermeasures.

[2165] (Input) User's facial expressions and voice data.

[2166] (Output) Analyzed emotional status.

[2167] Step 5:

[2168] Generating appropriate countermeasures

[2169] Based on the received emotional state, the server uses a generative AI model to generate prompt sentences, and then generates appropriate countermeasures (such as video tutorials or guides) based on those prompts.

[2170] The generated countermeasures are prepared as data to be displayed to the user.

[2171] (Input) Analyzed emotion status.

[2172] (Output) Generated countermeasures (responses and guides based on prompt statements).

[2173] Step 6:

[2174] Display of optimal countermeasures

[2175] The device receives the appropriate countermeasure sent from the server and displays it on the smart glasses' display.

[2176] The user reviews the displayed information and continues with the task or operation.

[2177] (Input) Countermeasure data generated from the server.

[2178] (Output) Appropriate countermeasures displayed on the smart glasses' screen.

[2179] Through the above processing steps, users can quickly and efficiently learn how to operate new machines and tools, and with appropriate support tailored to their needs, it is expected that work errors will be reduced and work efficiency will be improved.

[2180] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[2181] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2182] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[2183] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2184] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[2185] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[2186] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[2187] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[2188] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[2189] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[2190] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[2191] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[2192] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[2193] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2194] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[2195] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[2196] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[2197] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[2198] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[2199] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[2200] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[2201] The following is further disclosed regarding the embodiments described above.

[2202] (Claim 1)

[2203] A means for users to input information about the tools and services they have started using,

[2204] Means for storing the information of the input tools and services in a database,

[2205] A means for users to search for information about specific tools or services,

[2206] A means for obtaining information on tools and services that match specified conditions from the aforementioned database,

[2207] Means for displaying the acquired information to the user,

[2208] A means for users to contact other users based on the information they have selected,

[2209] A system that includes this.

[2210] (Claim 2)

[2211] The system according to claim 1, characterized in that the means for searching for information on the aforementioned specific tools or services performs the search based on the name, version, and start date of use of the tool or service.

[2212] (Claim 3)

[2213] The system according to claim 1, characterized in that the means for a user to contact other users based on the information selected by the user is to establish communication by generating a notification message and sending it to a designated contact.

[2214] "Example 1"

[2215] (Claim 1)

[2216] A means for users to input information about the tools and services they have started using,

[2217] Means for storing the information of the input tools and services in a database,

[2218] A means for users to search for information about specific tools or services,

[2219] A means for obtaining information on tools and services that match specified conditions from the aforementioned database,

[2220] Means for displaying the acquired information to the user,

[2221] A means for users to contact other users based on the information they have selected,

[2222] A terminal for sending the information entered by the user to the server,

[2223] Means for analyzing the information received by the server,

[2224] The server provides means for sending a message to a designated contact,

[2225] A system that includes this.

[2226] (Claim 2)

[2227] The system according to claim 1, characterized in that the means for searching for information on the aforementioned specific tools or services performs the search based on the name, version, and start date of use of the tool or service.

[2228] (Claim 3)

[2229] The system according to claim 1, characterized in that the means for a user to contact other users based on the information selected by the user is to establish communication by generating a notification message and sending it to a designated contact.

[2230] "Application Example 1"

[2231] (Claim 1)

[2232] A means for users to input information about the equipment they have started using and the work procedures they have followed,

[2233] A means for storing the input information on the equipment and work procedures in a database,

[2234] A means for users to search for information on specific equipment or work procedures,

[2235] A means for obtaining information on equipment and work procedures that match specified conditions from the aforementioned database,

[2236] Means for displaying the acquired information to the user,

[2237] Of the information obtained, a means for generating a notification message for the user to contact a specific other user and sending it to a designated contact,

[2238] A means for generating and displaying prompts using a generative AI model to promote additional knowledge sharing based on the acquired information,

[2239] A system that includes this.

[2240] (Claim 2)

[2241] The system according to claim 1, characterized in that the means for searching for information on specific equipment or work procedures performs the search based on the name, version, and start date of use of the equipment or work procedure.

[2242] (Claim 3)

[2243] The system according to claim 1, characterized in that the means for a user to contact other users based on the information selected by the user is to establish communication by generating a notification message and sending it to a designated contact.

[2244] "Example 2 of combining an emotion engine"

[2245] (Claim 1)

[2246] A means for users to input information about the tools and services they have started using,

[2247] Means for storing the information of the input tools and services in a database,

[2248] A means for users to search for information about specific tools or services,

[2249] A means for obtaining information on tools and services that match specified conditions from the aforementioned database,

[2250] Means for displaying the acquired information to the user,

[2251] A means for users to contact other users based on the information they have selected,

[2252] A means of analyzing user input and voice to identify emotions,

[2253] A means for generating and presenting countermeasures based on the aforementioned emotions,

[2254] A system that includes this.

[2255] (Claim 2)

[2256] The system according to claim 1, characterized in that the means for searching for information on the aforementioned specific tools or services performs the search based on the name, version, and start date of use of the tool or service.

[2257] (Claim 3)

[2258] The system according to claim 1, characterized in that the means for a user to contact other users based on the information selected by the user is to establish communication by generating a notification message and sending it to a designated contact.

[2259] "Application example 2 when combining with an emotional engine"

[2260] (Claim 1)

[2261] A means for users to input information about the tools and services they have started using,

[2262] Means for storing the information of the input tools and services in a database,

[2263] A means for users to search for information about specific tools or services,

[2264] A means for obtaining information on tools and services that match specified conditions from the aforementioned database,

[2265] Means for displaying the acquired information to the user,

[2266] A means for users to contact other users based on the information they have selected,

[2267] An emotion engine that recognizes the user's emotions,

[2268] A means for generating and displaying an appropriate response based on the emotion recognized by the emotion engine means,

[2269] A system that includes this.

[2270] (Claim 2)

[2271] The system according to claim 1, characterized in that the means for searching for information on the aforementioned specific tools or services performs the search based on the name, version, and start date of use of the tool or service.

[2272] (Claim 3)

[2273] The system according to claim 1, characterized in that the means for a user to contact other users based on the information selected by the user is to establish communication by generating a notification message and sending it to a designated contact.

[2274] (Claim 4)

[2275] The system according to claim 1, characterized in that the emotion engine means for recognizing the user's emotions analyzes the user's facial expressions, voice, and input content.

[2276] (Claim 5)

[2277] The system according to claim 1, characterized in that the means for generating and displaying the appropriate response generates a prompt sentence based on the user's emotional state using a generation AI model and displays a response based thereon. [Explanation of symbols]

[2278] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for users to input information about the tools and services they have started using, Means for storing the information of the input tools and services in a database, A means for users to search for information about specific tools or services, A means for obtaining information on tools and services that match specified conditions from the aforementioned database, Means for displaying the acquired information to the user, A means for users to contact other users based on the information they have selected, A system that includes this.

2. The system according to claim 1, characterized in that the means for searching for information on the aforementioned specific tools or services performs the search based on the name, version, and start date of use of the tool or service.

3. The system according to claim 1, characterized in that the means for contacting other users based on the information selected by the user is to establish communication by generating a notification message and sending it to a designated contact.

Images